Python
airscholar/e2e-data-engineering
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
★ 370
Stars
159 forks · 5 open issues
+1.0/wk
Growth · measured
Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.
8.6
Momentum / 100
see the breakdown below
3y ago
Created
last push 21mo ago
Star history
How this score was built
| Component | Weight | Earned | Why |
|---|---|---|---|
| Velocity | 55 | 1.1 | +1.0/wk, log-scaled against a 750/day ceiling |
| Acceleration | 15 | 0.0 | last week ran 0.46× the monthly pace |
| Freshness | 15 | 0.0 | last push 21mo ago; decays to zero at 180 days |
| Scale | 15 | 7.5 | 370 stars, log-scaled against 150k — stops a 3-star repo topping the board |
| Momentum | 100 | 8.6 | sum of the above |
Detail
| Topics | apache-airflowapache-kafkaapache-sparkapache-zookeeperbig-datacassandracontainerizationdata-engineeringdata-pipelinedata-processingdata-storagedockeretl-pipelinepostgresqlreal-time-analytics |
| Matched on | Data (data-pipeline) |
| Short window | +1 stars over 7 days = 0.1/day |
| Long window | +8 stars over 26 days = 0.3/day |
| Lifetime average | 0.32 stars/day over 1,156 days |
| First seen here | 2026-10-11 |
| Last read | 2d ago |