prefect
Data-Engineering Open SourcePrefect is a workflow orchestration framework for building resilient data pipelines in Python.
★ 23,936 Stars
⑂ 2,540 Forks
License: Apache License 2.0
About prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Supported Platforms
Open Source Web Cross-Platform
Related in Data-Engineering
data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
taipy
Turns Data and AI algorithms into production-ready web applications in no time.
dagster
An orchestration platform for the development, production, and observation of data assets.
Cookbook
The Data Engineering Cookbook
data-engineer-roadmap
Roadmap to becoming a data engineer in 2021