Tìm thấy 653 ứng dụng & công cụ phù hợp
End-to-end ELT data engineering project
Dummy variable generation with fit/transform capabilities
A versatile, high-performance Change Data Capture (CDC) engine built in Rust. Streams database changes into downstream systems like Kafka, Redis, NATS and etc, giving you full control over routing, tr
Stop creating bad DAGs! Use this tool to measure and compare the parse time of your DAGs, identify bottlenecks, and optimize your Airflow environment for better performance.
Synthetic data generation for evaluating LLM symbolic and logic reasoning
A client-lib for Parler.com featuring commenting, posting, following, unfollowing and data scraping
A Python/Pandas ETL pipeline that turns a deliberately messy automotive dataset into production-ready data, with 15 pytest tests and GitHub Actions CI.
Udacity Data Engineer Nano Degree - Project-3 (Data Warehouse)
Delta Lake Optimization Project: Hands‑on lab to explore partitioning, Z‑Ordering, compaction (manual & auto), Liquid Clustering, and VACUUM using a synthetic sales dataset in Databricks. Includes a s
Helm charts
Prefect integrations with NASA Earthdata.
A detailed educational article exploring how Streamlit revolutionizes AI app development. Learn how this Python framework bridges the gap between data science and usability, empowering anyone to deplo
Semantic-layer transpiler: one neutral IR, many dialects (dbt, Snowflake Cortex, semantic views, supersimple, nao). Written in Go.
Designing Data-Intensive Applications - Comprehensive guide with interactive documentation
Drift Adaptation as Supervision Routing Under Heterogeneous Costs
Template to spin up delta lake locally using docker
Udacity data engineering nanodegree project
PawMark is a platform for developers to build, schedule and monitor data pipelines.
Verified Open Source software & tools ready for production.
Big Data CONFERENCE Europe 2025 🇱🇹 AI, Cloud and Data Conference - Build Your First End-to-End Lakehouse Solution (aka.ms/fabconlake)
The web dashboard for the Didact Platform.
dataPipe is a data processing and data analytics library for JavaScript. Inspired by LINQ (C#) and Pandas (Python)
High-performance, declarative stream processor for delimited text data.
Here I will be exploring various tools and methods that are used in data engineering process with Python.