Data-Engineering
Tìm thấy 653 ứng dụng & công cụ phù hợp
coursera_ml_da_specialization
Coursera Specialization: Machine Learning and Data Analysis (Yandex & MIPT)
machine-learning
Learn AI together, for free. AI learning and teaching resources for everyone.
sqrl
Agentic Data Engineering Harness for building data pipelines, data products, data APIs, and data lakes autonomously
pipelinex
PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more
data_engineering_best_practices
Sample project to demonstrate data engineering best practices
bulker
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
dud
A lightweight CLI tool for versioning data alongside source code and building data pipelines.
airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
starflow
Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
awesome-bigquery-views
Useful SQL queries for Blockchain ETL datasets in BigQuery.
Interview-Process-Coding-Questions
Interview coding questions and experiences for several companies merged into one repository
airflow-autoscaling-ecs
Airflow Deployment on AWS ECS Fargate Using Cloudformation
awesome-data-contracts
A curated list of awesome blogs, videos, tools and resources about Data Contracts
datajoint-python
Relational Workflows: where database schemas define executable data pipelines.
data-engineering-project-template
This is a template you can use for your next data engineering portfolio project.
spark-alchemy
Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive