Data-Engineering
Tìm thấy 653 ứng dụng & công cụ phù hợp
titan
Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for
data-lakes-on-aws
Enterprise-grade, production-hardened, serverless data lake on AWS
dagster-open-platform
Dagster Labs' open-source data platform, built with Dagster.
bitcoin-etl
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
ethereum-etl-airflow
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contrac
Learn-Something-Every-Day
📝 A compilation of everything that I learn; Computer Science, Software Development, Engineering, Math, and Coding in General. Read the rendered results here ->
Everything-Tech
A collection of online resources to help you on your Tech journey.
yuniql
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
databricks_bootcamp_2026
End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL
gspread-pandas
Read and write Google Sheets as pandas DataFrames — column-matched appends, real dtypes, and layout detection for sheets that don't start at A1.
efficient_data_processing_spark
Code for "Efficient Data Processing in Spark" Course
snowflake-demo-notebooks
Collection of Snowflake Notebook demos, tutorials, and examples
jaffle-shop
🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.
e2e-data-engineering
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All compone
orbital
Orbital automates integration between data sources (APIs, Databases, Queues and Functions). BFF's, API Composition and ETL pipelines that adapt as your specs change.
dataplane
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a
Comprehensive-Data-Science-AI-Project-Portfolio
A curated collection of AI, data engineering, and DevOps projects featuring real-world applications, advanced techniques, and tutorials—ideal for learners and practitioners exploring data science and
recap
Work with your web service, database, and streaming schemas in a single format.
feathub
FeatHub - A stream-batch unified feature store for real-time machine learning