Tìm thấy 653 ứng dụng & công cụ phù hợp
lakeFS airflow operator
Example Fondant pipeline preparing data to train a Controlnet model
GovHub - Transformando Dados em Valor para Gestão Pública
Efficient streaming data ingestion, transformation & activation
This is the code accompanying the blog article on makeitnew.io. It defines a Prefect flow which can be visualized, run locally or registers in Prefect cloud.
Code & docs for Pipekit's talks
End-to-end data engineering pipeline with various technologies to ingest real time data.
A lightweight dataframe & math toolkit for Rust
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such
Data Engineering Essentials
proof of concept to generate Airbyte low-code YAML connectors from API documentation
Framework for data processing
Automação em Python que consome a API secreta da Gupy, filtra vagas no estado do Rio de Janeiro e dispara alertas formatados em tempo real no Telegram.
AI-powered geopolitical news intelligence platform. Ingests 100K+ daily events from GDELT, stores in MotherDuck (DuckDB), orchestrates with Dagster, and features an AI chat interface with Text-to-SQL.
Tutorials & articles on Python, leetcode problems, pandas, and more.
Python COTTAS library for compressing and querying RDF
ELT Code for your Data Warehouse
Stop staring at cron expressions: discover the missing visual calendar that finally lets you manage DAGs like a human.
If you use android + linux you need this.
PySpark data-pipeline testing and CICD
ETH PhD Program course
Schedule for talks, workshops, etc. w/ links to past talk slides and videos.
The World's First AI-Enabled Multi-Modality Native Search Engine
Verified Open Source software & tools ready for production.