Data-Engineering
Tìm thấy 653 ứng dụng & công cụ phù hợp
sayn
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
Awesome-Data-Science-Resources
Resources about data science, machine learning, deep learning, data engineering, and SQL.
data-engineering-project
End to end data engineering project with kafka, airflow, spark, postgres and docker.
dexscraper
Real-time DexScreener scraper python SDK for multi-chain token discovery, filtering, and OHLC/OHLCVT export for metatrader and bots.
IBM-Data-Engineer-Specialization-Coursera-Personal-Note-Public
All of my individual learning materials, documents, and notes from the process of getting the Coursera IBM Data Engineer Professional Certificate specialization are stored in this repository.
data-engineering
🚀 Advanced Data & AI Engineering Portfolio: Real-world projects and production-ready patterns to level up your AI skills—from building clean data pipelines to deploying RAG systems, AI agents, and int
thedataengineeringbook
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
fabric-unified-data-blueprint
Microsoft Fabric Unified Data Foundation with Databricks & Purview 2026
dataflow-ops
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
finmlkit
An open-source, lightweight, and blazing-fast financial machine learning library built with Numba. Process raw trades, generate advanced bars, features, and labels for quantitative research.
prefect-dataplatform
Example repository showing how to build a data platform with Prefect, dbt and Snowflake
python_essentials_for_data_engineers
Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video walkthroughs.
prefect-deployment-patterns
Code examples showing flow deployment to various types of infrastructure
LilHomie
A Machine Learning Project implemented from scratch which involves web scraping, data engineering, exploratory data analysis and machine learning to predict housing prices in New York Tri-State Area.
incan
Incan: a modern, Pythonic language that compiles to Rust! Type-safe, async-friendly, with fixtures, testing, and web/inter-op built in.
sqlpipe
SQLpipe makes it easy to move the result of one query from one database to another.
flowtide
High-performance streaming SQL query engine designed for real-time data processing. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications.
polygon-etl
ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub