9.3k repos tracked
updated 2d ago
New

Data

Pipelines, warehouses, orchestration and analytics engineering.

Trending New Most starred 23 repositories · topics: data-engineering, etl, data-pipeline, database, duckdb
  1. 1
    Servidor MCP e CLI para localizar empresas brasileiras por CNAE e região, utilizando dados abertos de CNPJ da Receita Federal.
    TypeScript created 6d ago pushed 5d ago cnaecnpjduckdb
    +36/day
    lifetime avg
    ★ 127
    51
  2. 2
    PGX — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime🐘
    Rust created 30d ago pushed 4d ago agentsai-infrastructureai-infrastructure-development
    +20/day
    measured
    ★ 677
    48
  3. 3
    A fast, multi-threaded Redis® and Valkey alternative written in Rust: drop-in compatible, with full-text and vector search built in
    Rust created 23d ago pushed 2d ago cachedatabasedragonfly-alternative
    +13/day
    measured
    ★ 934
    46
  4. 4
    Self-hosted tabular ML that doesn't lie. Leakage Guard, conformal intervals, profit-optimized thresholds, counterfactuals & instant REST/MCP API.
    Python created 6d ago pushed 3d ago automlcatboostconformal-prediction
    +18/day
    lifetime avg
    ★ 67
    45
  5. 5
    High-assurance AI data visualization IDE & analytics workbench. Natural language to charts with local ground-truth table verification.
    Python created 40d ago pushed 5d ago ai-analyticsanalyticsbi
    +6.6/day
    lifetime avg
    ★ 249
    39
  6. 6
    The data transformation tool the open-source community deserves.
    Python created 14d ago pushed 2d ago data-engineeringduckdb
    +5.3/day
    measured
    ★ 305
    37
  7. 7
    Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.
    Python created 42d ago pushed 10d ago ai-engineeringcoursedata-engineering
    +5.0/day
    measured
    ★ 172
    36
  8. 8
    A light TablePlus alternative for PostgreSQL that your AI agents can use too, over MCP. macOS and Windows.
    Rust created 10d ago pushed 7d ago ai-agentsclaude-codedatabase
    +5.9/day
    lifetime avg
    ★ 44
    35
  9. 9
    MiniBank - Simulation bancaire en C++
    C++ created 23d ago pushed 6d ago bankingbnpbourse
    +3.6/day
    measured
    ★ 93
    33
  10. 10
    In-memory key-value server in Rust that speaks RESP, so redis-cli and Redis clients connect. Locks, rate limits, job queues and a change feed are single commands; Raft-based failover. Clients for Rust, .NET, Go, Java, Python and Node.js.
    Rust created 23d ago pushed 3d ago cachedatabasedistributed-lock
    +2.6/day
    measured
    ★ 215
    32
  11. 11
    Open-source, self-hosted workspace for pages, databases and AI. One Node.js process with SQLite.
    TypeScript created 16d ago pushed 13d ago aiblock-editordatabase
    +2.3/day
    measured
    ★ 102
    30
  12. 12
    An async ORM for Python and TypeScript with one Rust core: one Prisma schema, typed models, migrations, PostgreSQL and SQLite.
    Rust created 37d ago pushed 7d ago asyncdatabasemigrations
    +1.3/day
    lifetime avg
    ★ 45
    26
  13. 13
    A fast, native, keyboard-driven database client for macOS. 20 databases, an AI assistant that shows its work, free and open source.
    Rust created 40d ago pushed 13d ago ai-assistantclickhousedatabase
    +5.0/wk
    measured
    ★ 419
    26
  14. 14
    Versioned DuckDB databases, locally or replicated through S3, for people and agents
    C++ created 29d ago pushed 5d ago agentsbranchingduckdb
    +1.2/day
    measured
    ★ 48
    26
  15. 15
    Infrastructure for agent-built apps and workflows
    TypeScript created 29d ago pushed 8d ago citizen-developerdatabasedeployment
    +4.0/wk
    measured
    ★ 65
    24
  16. 16
    A fast, native database client for PostgreSQL, MySQL and SQLite. Written in Rust with egui; runs on Linux, macOS and Windows.
    Rust created 39d ago pushed 3d ago cross-platformdatabasedatabase-client
    +2.8/wk
    measured
    ★ 49
    23
  17. 17
    Genomic sequence storage, indexing and alignment inside PostgreSQL: https://bioseqdb.com/
    VHDL created 41d ago pushed 2d ago alignmentbioinformaticsbiology
    −1.0/wk
    measured
    ★ 207
    22
  18. 18
    Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
    Python created 27d ago pushed 19d ago apache-icebergapache-sparkdata-engineering
    −1.0/wk
    measured
    ★ 274
    21
  19. 19
    Play + Postgres starter template with a clean UI
    JavaScript created 9d ago pushed 6d ago activatorcssdatabase
    —
    stale
    ★ 82
    20
  20. 20
    Event-driven OneLake pipeline desktop tool with auto-merge Upsert, Python reporting, and Teams alert
    C++ created 9d ago pushed 7d ago activatordata-engineeringdata-factory
    —
    stale
    ★ 82
    20
  21. 21
    Crash-safe embedded key-value store in C
    C created 24d ago pushed 24d ago cdatabasekey-value-store
    —
    stale
    ★ 50
    18
  22. 22
    A PostgreSQL proxy that keeps each user's data in their own region. Shards by a key you name, splits reads from writes, pools connections, and moves a key between regions while the application keeps reading and writing. No driver to install.
    Rust created 41d ago pushed 23d ago asyncbackenddatabase
    flat
    measured
    ★ 47
    18
  23. 23
    Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.
    Python created 39d ago pushed 30d ago categorical-encodingdata-cleaningdata-pipeline
    —
    stale
    ★ 48
    18