Data-Engineering
Tìm thấy 653 ứng dụng & công cụ phù hợp
elusion
DataFrame / Data Engineering Library with familiar syntax like ones we love: PySpark and SQL, focused on user experience, spead and accuracy.
full-stack-data-engineering
End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.
data-observability-installer
Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility acr
datahelix
The DataHelix generator allows you to quickly create data, based on a JSON profile that defines fields and the relationships between them, for the purpose of testing and validation
Skytrax-Data-Warehouse
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data vi
from-data-to-intelligence
从数据到智能：企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记：从 0 到 1 构建企业级医药数据平台，再到 Data + AI 转型下的 Agentic BI。
goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats
Introduction-to-Docker
(WIP) Getting started with Docker - An introduction to Docker with data science and engineering applications
Data-Engineering-Project-with-HDFS-and-Kafka
Data Engineering Project with Hadoop HDFS and Kafka
special-topic-data-engineering
This course presents to the students recent research and industrial issues pertaining to data engineering, database systems and technologies. Various topics of interests that are directly or indirectl
viewflow
Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
sidemantic
The universal metrics layer. Compatible with 15+ formats: Cube, MetricFlow, LookML, Omni, BSL, LDM, Cortex, Malloy, OSI, SML, TML, Hex, Rill, Superset
adventure-works
Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, e
data-engineering-skills
Skills related to Data Engineering Work for Claude Code
scriptella-etl
Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java.
uber-expenses-tracking
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.