Tìm thấy 653 ứng dụng & công cụ phù hợp
git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit
Enables Python developers to leverage Debezium's CDC capabilities with custom event handlers and seamless integration.
100 essential Databricks concepts for data engineers, organized by category with difficulty levels and self-assessment scoring
Automated stock screener scanning 3,800+ stocks daily for confirmed Stage 2 uptrends passing 8 strict criteria. Features: smart caching (74% fewer API calls), market regime filtering, automated stop-l
Market data acquisition, storage, and update workflows for machine learning for trading.
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
Dépôt pour le cours d'IA par la communauté @DefendIntelligence.
Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped
Journeys between the two worlds of Python 🐍 and Rust 🦀
A Spring Boot Camel boilerplate that aims to consume events from Apache Kafka, process it and send to a PostgreSQL database.
Open Source data engineering demo project using dbt, DuckDB, dlt, Dagster and Metabase. Two storage modes for the delta tables are supported: local and Microsoft Fabric Onelake.
An Elasticsearch client tailored to data science workflows.
A comprehensive collection of 180 curated project ideas across 6 technology domains (Backend, Frontend, Data Science, Data Engineering, DevOps, System Design) at 3 difficulty levels. Detailed learning
CoDA-Bench is a benchmark for code agents on data-intensive tasks. 🎈代码智能体能搞定数据密集型任务吗?
Pipeline de detecção de fraude em tempo real na AWS, com ingestão de eventos, ETL em Python e analytics serverless (S3, Glue, Athena) provisionados via Terraform, simulando cenário de banco/fintech.
Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes synthetic data, step-by-step guide, and certification prep.
Oracle AI Data Platform Workbench Samples
Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Sample project showing reliable data ingestion application using FastAPI and dramatiq
A re-implementation of Hadoop DistCP in Apache Spark
Unified Data Foundation with Microsoft Fabric with Options to Integrate with Azure Databricks and Microsoft Purview
Blockchain ETL Architecture
Real-Time M-Pesa Transaction Streaming Pipeline built using modern data engineering technologies to ingest, process, stream, and analyze transaction data in real time. Demonstrates event-driven archit
Databricks Data Engineer Associate Certification Lab: End-to-end hands-on project covering Auto Loader, Medallion Architecture, SCD Type 2, Unity Catalog governance, and Databricks Jobs orchestration.