Data-Engineering
Tìm thấy 653 ứng dụng & công cụ phù hợp
streamify
A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
yobulkdev
🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative
dataengineering-roadmap
Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨
bacalhau
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
data-engineering-book
Accumulated knowledge and experience in the field of Data Engineering
active_workflow
Polyglot workflows without leaving the comfort of your technology stack.
hamilton
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
complete-dbt-bootcamp-zero-to-hero
Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course
practical-data-engineering
Practical Data Engineering: A Hands-On Real-Estate Project Guide
koheesio
Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.
altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
datavines
Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.
Failed-ML
Compilation of high-profile real-world examples of failed machine learning projects
vectorflow
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
DataFlow-Engine
数据流引擎是一款面向数据集成、数据同步、数据交换、数据共享、任务配置、任务调度的底层数据驱动引擎。数据流引擎采用管执分离、多流层、插件库等体系应对大规模数据任务、数据高频上报、数据高频采集、异构数据兼容的实际数据问题。
huey
Browser-based data analytics & BI with DuckDB-WASM. Privacy-first: your data stays local; no server required.
conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
software-architect-mindmap
🧠Mindmap of 🗺️Software Architecture, Software engineering: An Overview of Software Terminologies and Concepts.