OpenHub — The Ultimate Curated Software & Tool Directory

flink-api-examples

Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.

Data-Engineering 64

proto-schema-parser

A pure Python protobuf parser

Data-Engineering 64

nodestream

A Declarative framework for Building, Maintaining, and Analyzing Graph Data

Data-Engineering 64

soda-spark

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

Data-Engineering 64

xontrib-pipeliner

Let your pipe lines flow thru the Python code in Xonsh shell.

Data-Engineering 63

streaming-examples

Example projects and demos around data streaming , stream processing, change data capture, and more.

Data-Engineering 63

kenobi

Easiest way to monitor asynchronous data pipelines

Data-Engineering 62

feature-store

Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.

Data-Engineering 62

opne-aureka

Upload spreadsheets, ask questions via chat, and auto-generate chart reports. No coding required, gain instant insights and unlock data value effortlessly. ｜上传表格，像聊天一样提问，系统自动分析生成图表报告。无需编程，即时洞察，数据价值触手可

Data-Engineering 62

unit-gen

UnitGen 是一个用于生成微调代码的数据框架 —— 直接从你的代码库中生成微调数据：代码补全、测试生成、文档生成等。UnitGen is a code fine-tuning data framework that generates data from your existing codebase.

Data-Engineering 61

parqv

Interactive Python TUI for visualizing and analyzing files with multiple formats

Data-Engineering 61

SoloLakehouse

A local-first lakehouse reference architecture for production-minded data platform engineering.

Data-Engineering 61

pandas-gpt

Power up your data science workflow with ChatGPT.

Data-Engineering 61

bytehub

ByteHub: making feature stores simple

Data-Engineering 61

xxh-shell-xonsh

Use @xonsh wherever you go through the SSH without installation on the host.

Data-Engineering 60

VisiLens

A fast, local-first web GUI for exploring large CSV/Parquet/JSONL files. Powered by VisiData’s engine. Opens millions of rows instantly. Works with local files, SSH servers, and Jupyter. Your new data

Data-Engineering 60

mz-hack-day-2022

Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!

Data-Engineering 60

data-engineering-zoomcamp-notes

Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club

Data-Engineering 60

agentic-engineering-for-apache-kafka

AI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ

Data-Engineering 59

online_store

End to end data engineering project

Data-Engineering 59

klaus-kode-agentic-integrator

Agentic Data Integrator that helps you build production-ready data pipelines so you can connect to more systems, faster. You run it in your terminal as a workflow wizard.

Data-Engineering 59

data-engineering-patterns

600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.

Data-Engineering 59

sql-workbench

Public issue-tracking and feature suggestion for sql-workbench.com

Data-Engineering 59

Data-Engineering-Nanodegree

Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift, Data Lake with Spark and Data Pipeline with Airflow.

Data-Engineering 58