9.3k repos tracked
updated 2d ago
Most starred

Data

Pipelines, warehouses, orchestration and analytics engineering.

Trending New Most starred 580 repositories · topics: data-engineering, etl, data-pipeline, database, duckdb
  1. 551
    Autonomous backend platform. Your coding agent builds it over MCP, Backenly keeps it running: Postgres, REST APIs, auth, storage, realtime, and functions, with every change governed, verified, and reversible.
    TypeScript created 3mo ago pushed 5d ago agent-toolsai-agentsauthentication
    +1.0/day
    lifetime avg
    ★ 107
    26
  2. 552
    High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
    Rust created 51d ago pushed 3d ago arrowclidata-cleaning
    +2.2/day
    lifetime avg
    ★ 107
    31
  3. 553
    An AI-native multi-model database unifying SQL, vector, full-text, graph, and sandboxed Python — for transactional, analytical, and agent workloads.
    Rust created 6mo ago pushed 18d ago ai-nativeanalytical-databasecolumnar-database
    flat
    measured
    ★ 105
    20
  4. 554
    100% open-source, AI-native web analytics with cookieless tracking, open exports, custom domains, and SSO—self-hosted as one Go binary or managed in EU/US cloud.
    Go created 12mo ago pushed 4d ago ai-analyticsai-nativeai-visibility
    +3.0/wk
    measured
    ★ 105
    24
  5. 555
    Source-available semantic and context layer, rule engine, and semantic sidecar for agentic AI and governed analytics. Compiles declarative YAML models into optimized SQL, KPIs, and semantic context across 8 SQL dialects.
    Python created 9mo ago pushed 3d ago agentic-aianalytics-as-codebigquery
    +2.0/wk
    measured
    ★ 103
    38
  6. 556
    A DynamoDB emulator in Rust, backed by SQLite. Starts in milliseconds as a single static binary, and is verified against real AWS by a public conformance suite. Runs as an HTTP server, an MCP server for coding agents, an embeddable library, or in the browser via WebAssembly.
    Rust created 7mo ago pushed 13d ago awsciconformance
    —
    stale
    ★ 102
    20
  7. 557
    Open-source, self-hosted workspace for pages, databases and AI. One Node.js process with SQLite.
    TypeScript created 16d ago pushed 13d ago aiblock-editordatabase
    +2.3/day
    measured
    ★ 102
    30
  8. 558
    End-to-end Banking Analytics with Dataiku | Data Preparation, Machine Learning, Customer Scoring & Automated Pipelines
    created 52d ago pushed 13d ago banking-analyticsdatadata-analysis
    —
    stale
    ★ 97
    20
  9. 559
    MiniBank - Simulation bancaire en C++
    C++ created 23d ago pushed 6d ago bankingbnpbourse
    +3.6/day
    measured
    ★ 93
    33
  10. 560
    Self-hosted database performance diagnostics for SQL Server, MySQL & PostgreSQL: trends, AAS insight, Top SQL, plan-change tracking, blocking & deadlock analysis. Single-process deploy, built-in MCP server for AI agents.
    C# created 2mo ago pushed 45d ago databasedbamcp-server
    —
    stale
    ★ 91
    17
  11. 561
    Stream PostgreSQL changes into standard Apache Iceberg tables, built in Rust.
    Rust created 2mo ago pushed 17d ago apache-icebergcdcchange-data-capture
    —
    stale
    ★ 85
    19
  12. 562
    Event-driven OneLake pipeline desktop tool with auto-merge Upsert, Python reporting, and Teams alert
    C++ created 9d ago pushed 7d ago activatordata-engineeringdata-factory
    —
    stale
    ★ 82
    20
  13. 563
    Play + Postgres starter template with a clean UI
    JavaScript created 9d ago pushed 7d ago activatorcssdatabase
    —
    stale
    ★ 82
    20
  14. 564
    Roblox DirectX 11 Graphics Boost 2026: Fix Lag and Rendering Issues on Windows
    HTML created 46d ago pushed 2d ago adonis-loadercompilercomposable
    flat
    measured
    ★ 70
    20
  15. 565
    Production Data Engineering Cloud Architecture Workflow Automation Portfolio 2026
    HTML created 46d ago pushed 3d ago awsdata-engineeringluau
    flat
    measured
    ★ 68
    20
  16. 566
    Self-hosted tabular ML that doesn't lie. Leakage Guard, conformal intervals, profit-optimized thresholds, counterfactuals & instant REST/MCP API.
    Python created 6d ago pushed 3d ago automlcatboostconformal-prediction
    +18/day
    lifetime avg
    ★ 67
    45
  17. 567
    Infrastructure for agent-built apps and workflows
    TypeScript created 29d ago pushed 9d ago citizen-developerdatabasedeployment
    +4.0/wk
    measured
    ★ 65
    24
  18. 568
    A beautiful and convenient TUI database client with MCP support.
    Rust created 2mo ago pushed 28d ago coding-agentdatabasedb
    —
    stale
    ★ 59
    18
  19. 569
    Open Source FiveM vMenu Translation Hub 2026: Community Language Packs for Cfx.re Servers
    HTML created 47d ago pushed 3d ago databasefivemmenu
    flat
    measured
    ★ 56
    20
  20. 570
    AI Virtual Personal Trainer Python App 2026: Motion Rep Counting and Voice Workout Coach
    HTML created 47d ago pushed 4d ago databaseexercisesmediapipe
    flat
    measured
    ★ 53
    20
  21. 571
    Automated User-Agent database for 100+ browsers on 100+ operating systems. Updated every 5 minutes via GitHub Actions. Weighted by real-world popularity, grouped by OS and browser, with a cumulative ALL/ folder of unique agents.
    Python created 51d ago pushed 7d ago 100gbitactionactions
    —
    stale
    ★ 50
    20
  22. 572
    Crash-safe embedded key-value store in C
    C created 24d ago pushed 24d ago cdatabasekey-value-store
    —
    stale
    ★ 50
    18
  23. 573
    A Python/Pandas ETL pipeline that turns a deliberately messy automotive dataset into production-ready data, with 15 pytest tests and GitHub Actions CI.
    Python created 2mo ago pushed 56d ago data-cleaningdata-engineeringdata-pipeline
    —
    stale
    ★ 49
    15
  24. 574
    A fast, native database client for PostgreSQL, MySQL and SQLite. Written in Rust with egui; runs on Linux, macOS and Windows.
    Rust created 39d ago pushed 3d ago cross-platformdatabasedatabase-client
    +2.8/wk
    measured
    ★ 49
    23
  25. 575
    Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.
    Python created 39d ago pushed 30d ago categorical-encodingdata-cleaningdata-pipeline
    —
    stale
    ★ 48
    18
  26. 576
    Versioned DuckDB databases, locally or replicated through S3, for people and agents
    C++ created 29d ago pushed 5d ago agentsbranchingduckdb
    +1.2/day
    measured
    ★ 48
    26
  27. 577
    ⚡ A Simple, Self-Hosted Link Shortener with Analytics.
    TypeScript created 57d ago pushed 42d ago analyticsbitly-alternativeduckdb
    —
    stale
    ★ 47
    17
  28. 578
    A PostgreSQL proxy that keeps each user's data in their own region. Shards by a key you name, splits reads from writes, pools connections, and moves a key between regions while the application keeps reading and writing. No driver to install.
    Rust created 41d ago pushed 23d ago asyncbackenddatabase
    flat
    measured
    ★ 47
    18
  29. 579
    An async ORM for Python and TypeScript with one Rust core: one Prisma schema, typed models, migrations, PostgreSQL and SQLite.
    Rust created 37d ago pushed 7d ago asyncdatabasemigrations
    +1.3/day
    lifetime avg
    ★ 45
    26
  30. 580
    A light TablePlus alternative for PostgreSQL that your AI agents can use too, over MCP. macOS and Windows.
    Rust created 10d ago pushed 7d ago ai-agentsclaude-codedatabase
    +5.9/day
    lifetime avg
    ★ 44
    35
← previous page 12 of 12