OpenHub — The Ultimate Curated Software & Tool Directory

Spark-StudyClub

Grupo de Estudios de Apache Spark organizado por la comunidad Data Engineering Latam

Data-Engineering 40

automating-your-data-pipeline-with-apache-airflow

Automating Your Data Pipeline with Apache Airflow

Data-Engineering 40

cloud-data-ai-security-zero-to-hero

Cloud + Data + AI + Security from zero to hero. 148 certs across 27 providers, 53 plain-English concepts, 15 hands-on builds, cross-cloud + AI service comparisons.

Data-Engineering 40

examples

Best practices for data workflows, integrations with the Modern Data Stack (MDS), Infrastructure as Code (IaC), Cloud Provider Services

Data-Engineering 40

leoflow

Apache Airflow-compatible workflow orchestrator, re-engineered in Go — the drop-in Airflow UI + REST API, but on a single-binary control plane (no Python GIL), with pod-per-task isolation and GitOps-n

Data-Engineering 40

slipstream-async

Slipstream provides a data-flow model to simplify development of stateful streaming applications.

Data-Engineering 39

Apache-Spark-Guide

Apache Spark Guide

Data-Engineering 39

ethers.js-bigquery

ethers.js library, compiled for use in Google BigQuery

Data-Engineering 39

Awesome-Data-Engineering

📒(GitBook) A curated list of awesome Data Engineering resources

Data-Engineering 39

codecut-blog

45+ production-ready tutorials on data science, MLOps, and AI tools. All code is executable and adaptable for real projects.

Data-Engineering 39

scala-ql

Data manipulation and reporting for Scala.

Data-Engineering 39

AirflowDataPipeline

Example of an ETL Pipeline using Airflow

Data-Engineering 39

proof-of-deliberation

Verifying Human Annotation Reliability from Interaction Traces

Data-Engineering 38

data-engineering-salaries

A Streamlit app to explore data engineering salary data.

Data-Engineering 38

R-Programming

🏀 R Programming ⚽ the go-to 🎳 language 🥎 data science 🪀statistical analysis 🏉 and data 🎮 visualization 🏈 Perfect data 🦁 analysts 🏬 researchers and 🐯 aspiring data 🦊 scientists statistical 🐲 modeling h

Data-Engineering 38

sqltesting

Library for Running SQL Unit Test Cases

Data-Engineering 38

google-cloud-data-engineer-resources

Some of useful materials I'm using to pass the Google Cloud Professional Data Engineer Certification Exam

Data-Engineering 38

awesome-data-pipeline

Awesome list for datapipeline

Data-Engineering 38

Atlas-Social-de-Hortolandia

Repositório de desenvolvimento (MVP) para estruturação analítica do CadÚnico municipal. Sem dados pessoais — apenas código, dicionários, esquemas e amostras sintéticas. Alinhado à LGPD e boas práticas

Data-Engineering 38

dbt-dummy

A dbt (data build tool) project you can use for testing purposes or experimentation

Data-Engineering 38

IBM-Data-Engineering-Professional-Specialization-Coursera

Solution for IBM Data Engineering Professional Certificate

Data-Engineering 38

dagster-odp

A configuration-driven framework for building Dagster pipelines that enables teams to create and manage data workflows using YAML/JSON instead of code

Data-Engineering 38

Data-Engineering

🍔 Data Engineering🫑 covering 🍅 everything 🍏 from data 🍊 ingestion to 🦁 processing 🐯 storage and 🐲 orchestration 🐳 Ideal aspiring 🌼 data engineers 🐝backend developers 🦆 and data 🐻‍❄️ enthusiasts 🐧 look

Data-Engineering 38

grant-rs

Manage Redshift/Postgres privileges in GitOps style written in Rust

Data-Engineering 37