OpenHub DIRECTORY
Data-Engineering logo

Data-Engineering

Data-Engineering Open Source

πŸ” Data EngineeringπŸ«‘ covering πŸ… everything 🍏 from data 🍊 ingestion to 🦁 processing 🐯 storage and 🐲 orchestration 🐳 Ideal aspiring 🌼 data engineers 🐝backend developers πŸ¦† and data πŸ»β€β„οΈ enthusiasts 🐧 look

β˜… 38 Stars β‘‚ 1 Forks License: MIT License
Download Latest Release Official Website β†— GitHub Repository β†—

About Data-Engineering

πŸ” Data EngineeringπŸ«‘ covering πŸ… everything 🍏 from data 🍊 ingestion to 🦁 processing 🐯 storage and 🐲 orchestration 🐳 Ideal aspiring 🌼 data engineers 🐝backend developers πŸ¦† and data πŸ»β€β„οΈ enthusiasts 🐧 looking to build 🐒 production πŸ¦‹ ready data 🏡 systems Data πŸš‹ validation 🚞 quality checks 🚁 and automated ✈ testing 🚟 pipelines πŸš‚

Supported Platforms

Open Source Web Cross-Platform

Related in Data-Engineering

data-engineering-zoomcamp

data-engineering-zoomcamp

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here πŸ‘‡πŸΌ

 prefect

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

 airbyte

airbyte

Open-source data movement for ELT pipelines and AI agents β€” from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

 taipy

taipy

Turns Data and AI algorithms into production-ready web applications in no time.

 dagster

dagster

An orchestration platform for the development, production, and observation of data assets.

 Cookbook

Cookbook

The Data Engineering Cookbook