Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra

Data-Engineering Open Source

A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

★ 29 Stars ⑂ 8 Forks License: Open Source

Download Latest Release Official Website ↗ GitHub Repository ↗

About Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra

A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

Supported Platforms

Open Source Web Cross-Platform

Related in Data-Engineering

data-engineering-zoomcamp

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

taipy

Turns Data and AI algorithms into production-ready web applications in no time.

dagster

An orchestration platform for the development, production, and observation of data assets.

Cookbook

The Data Engineering Cookbook