9.3k repos tracked
updated 2d ago
Most starred

Data

Pipelines, warehouses, orchestration and analytics engineering.

Trending New Most starred 580 repositories · topics: data-engineering, etl, data-pipeline, database, duckdb
  1. 51
    The local-first database that runs on every JS runtime and replicates with your existing backend - no vendor, no lock-in - https://rxdb.info/
    TypeScript created 9y ago pushed 2d ago angularbrowser-databasecouchdb
    +1.0/wk
    measured
    ★ 23.4k
    29
  2. 52
    Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.
    Rust created 5y ago pushed 2mo ago databasepostgrespostgresql
    +3.4/day
    measured
    ★ 23.3k
    35
  3. 53
    Database diagrams editor that allows you to visualize and design your DB with a single query.
    TypeScript created 2y ago pushed 6d ago databasedbdb-migration
    +7.3/day
    measured
    ★ 23.1k
    60
  4. 54
    A high-performance observability data pipeline.
    Rust created 8y ago pushed 2d ago agentcloud-nativedata-transformation
    +3.7/day
    measured
    ★ 22.8k
    41
  5. 55
    Simple and fast JSON database
    JavaScript created 12y ago pushed 7mo ago databaseelectronembeddable
    −1.0/wk
    measured
    ★ 22.6k
    13
  6. 56
    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
    Python created 6y ago pushed 2d ago bigquerychange-data-capturedata
    +5.0/day
    measured
    ★ 22.3k
    44
  7. 57
    ✨ AI Spreadsheet for Business
    TypeScript created 4y ago pushed 2d ago ai-agentairtableairtable-alternative
    +2.9/day
    measured
    ★ 22k
    39
  8. 58
    high-performance graph database for real-time use cases
    Go created 11y ago pushed 4d ago databasedistributedgo
    +1.0/day
    measured
    ★ 21.8k
    40
  9. 59
    🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
    Rust created 7y ago pushed 3d ago backenddatabasegraph
    +1.0/day
    measured
    ★ 21.4k
    38
  10. 60
    Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
    Java created 10y ago pushed 2d ago bigdatadata-encryptiondata-pipeline
    flat
    measured
    ★ 20.8k
    28
  11. 61
    open-source agentic AI data assistant for the next generation of AI + Data products.
    Python created 3y ago pushed 3d ago agentsbgidatabase
    +6.7/day
    measured
    ★ 20.3k
    47
  12. 62
    High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
    Python created 8mo ago pushed 2d ago aicppdata-pipeline
    +180/day
    measured
    ★ 19.9k
    86
  13. 63
    Turns Data and AI algorithms into production-ready web applications in no time.
    Python created 4y ago pushed 3mo ago automationdata-engineeringdata-integration
    +6.0/wk
    measured
    ★ 19.5k
    25
  14. 64
    An open source cybersecurity protocol for syncing decentralized graph data.
    JavaScript created 12y ago pushed 24d ago artificial-intelligencebig-datablockchain
    +2.0/wk
    measured
    ★ 19.2k
    28
  15. 65
    AI search engine and MCP server for bots and agents. One Rust binary indexes code, docs, logs, JSONL/CSV and PDFs for BM25 full-text, vector and hybrid search, code search without grep, agent memory and RAG. Elasticsearch-compatible API; Corpus Hub serves hundreds of reference memory corpora.
    Rust created 4mo ago pushed 2d ago agent-memoryai-agentsbm25
    +242/day
    measured
    ★ 19.2k
    73
  16. 66
    Database migrations. CLI and Golang library.
    Go created 8y ago pushed 2mo ago aws-s3cassandradatabase
    +1.3/day
    measured
    ★ 19k
    29
  17. 67
    GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
    Python created 2y ago pushed 3d ago ai-agentsbigquerybusiness-intelligence
    +11/day
    measured
    ★ 18.1k
    51
  18. 68
    VictoriaMetrics: fast, cost-effective monitoring solution and time series database
    Go created 8y ago pushed 2d ago databasegrafanagraphite
    +11/day
    measured
    ★ 18k
    57
  19. 69
    The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
    Go created 12y ago pushed 5d ago consensusdatabasedistributed-database
    +5.3/day
    measured
    ★ 17.9k
    43
  20. 70
    👶🏻 신입 개발자 전공 지식 & 기술 면접 백과사전 📖
    Java created 7y ago pushed 17mo ago algorithmcomputer-sciencecs
    +1.7/day
    measured
    ★ 17.7k
    21
  21. 71
    :kangaroo: - PouchDB is a pocket-sized database.
    JavaScript created 16y ago pushed 3d ago couchdbdatabasehacktoberfest
    −1.0/wk
    measured
    ★ 17.6k
    27
  22. 72
    QuestDB is a high performance, open-source, time-series database
    Java created 12y ago pushed 2d ago apache-arrowcapital-marketsdatabase
    +3.1/day
    measured
    ★ 17.5k
    42
  23. 73
    Graphs for Everyone
    Java created 13y ago pushed 16d ago cypherdatabasegraph
    +2.9/day
    measured
    ★ 17.4k
    37
  24. 74
    libSQL is a fork of SQLite that is both Open Source, and Open Contributions.
    C created 4y ago pushed 22d ago databaseembedded-databaserust
    +1.3/day
    measured
    ★ 17.3k
    33
  25. 75
    Workflow Engine for Kubernetes
    Go created 9y ago pushed 2d ago airflowargoargo-workflows
    +2.1/day
    measured
    ★ 17.1k
    38
  26. 76
    MCP Toolbox for Databases is an open source MCP server for databases.
    Go created 2y ago pushed 3d ago agentagentsai
    +8.1/day
    measured
    ★ 16.8k
    50
  27. 77
    Realm is a mobile database: a replacement for Core Data & SQLite
    Objective-C created 14y ago pushed 42d ago databaseiosmobile
    flat
    measured
    ★ 16.6k
    24
  28. 78
    An orchestration platform for the development, production, and observation of data assets.
    Python created 8y ago pushed 3d ago analyticsdagsterdata-engineering
    +3.7/day
    measured
    ★ 16.4k
    40
  29. 79
    Embeddable Postgres with real-time, reactive bindings.
    TypeScript created 2y ago pushed 3d ago databasepostgreswasm
    +4.3/day
    measured
    ★ 16.2k
    42
  30. 80
    Apache Doris is a real-time analytics and hybrid search database for AI agents.
    Java created 9y ago pushed 2d ago agentaibigquery
    +3.9/day
    measured
    ★ 16.2k
    40
  31. 81
    NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
    C++ created 11y ago pushed 2d ago c-plus-pluscassandracpp
    +1.9/day
    measured
    ★ 15.8k
    40
  32. 82
    Fast key-value DB in Go.
    Go created 9y ago pushed 18d ago databasedocument-databasego
    +1.0/day
    measured
    ★ 15.8k
    40
  33. 83
    The Data Engineering Cookbook
    Python created 7y ago pushed 22d ago best-practicesbig-datacookbook
    +1.4/day
    measured
    ★ 15.5k
    33
  34. 84
    Go MySQL Driver is a MySQL driver for Go's (golang) database/sql package
    Go created 13y ago pushed 8d ago databasegomariadb
    +1.1/day
    measured
    ★ 15.3k
    48
  35. 85
    EF Core is a modern object-database mapper for .NET. It supports LINQ queries, change tracking, updates, and schema migrations.
    C# created 12y ago pushed 2d ago aspnet-productc-sharpdatabase
    +4.0/wk
    measured
    ★ 14.8k
    31
  36. 86
    A curated list of awesome big data frameworks, ressources and other awesomeness.
    created 12y ago pushed 8d ago awesomeawesome-listbigdata
    +1.3/day
    measured
    ★ 14.7k
    33
  37. 87
    A Minimalistic Wrapper for IndexedDB
    TypeScript created 12y ago pushed 8d ago databaseindexeddbjavascript
    +1.0/day
    measured
    ★ 14.7k
    32
  38. 88
    Graph-Native Infrastructure for Context and Accountable AI Systems
    Python created 16mo ago pushed 2d ago agent-memoryaiai-governance
    +19/day
    measured
    ★ 14.4k
    52
  39. 89
    A type-safe TypeScript SQL query builder
    TypeScript created 5y ago pushed 2d ago browserbundatabase
    +3.0/day
    measured
    ★ 14.3k
    40
  40. 90
    🥑 ArangoDB is a native multi-model database with flexible data models for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript extensions.
    C++ created 15y ago pushed 2d ago arangodbdatabasedistributed-database
    +4.0/wk
    measured
    ★ 14.3k
    31
  41. 91
    Gel supercharges Postgres with a modern data model, graph queries, Auth & AI solutions, and much more.
    Python created 9y ago pushed 10mo ago databaseedgedbedgeql
    +0.9/wk
    measured
    ★ 14.2k
    13
  42. 92
    A javascript library to run SQLite on the web.
    JavaScript created 14y ago pushed 12d ago databaseemscriptenjavascript
    +1.0/wk
    measured
    ★ 13.7k
    27
  43. 93
    Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
    Java created 7y ago pushed 2d ago analyticsbig-datadata-science
    +11/day
    measured
    ★ 13.5k
    63
  44. 94
    Postgres CLI with autocompletion and syntax highlighting
    Python created 12y ago pushed 3d ago databasepostgrespostgresql
    +4.0/wk
    measured
    ★ 13.4k
    31
  45. 95
    Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
    Java created 10y ago pushed 2d ago apache-kafkacdcchange-data-capture
    +5.3/day
    measured
    ★ 13.3k
    46
  46. 96
    Distributed PostgreSQL as an extension
    C created 10y ago pushed 2d ago cituscitus-extensiondatabase
    +2.0/day
    measured
    ★ 12.8k
    41
  47. 97
    Apache ZooKeeper
    Java created 17y ago pushed 3d ago apacheconfiguration-managementconsensus
    +6.0/wk
    measured
    ★ 12.8k
    39
  48. 98
    The open-source reactive database for app developers
    TypeScript created 2y ago pushed 3d ago backendconvexdatabase
    +1.6/day
    measured
    ★ 12.8k
    35
  49. 99
    Roadmap to becoming a data engineer in 2021
    created 6y ago pushed 4y ago clouddata-engineer-roadmapdata-engineering
    +1.0/wk
    measured
    ★ 12.8k
    13
  50. 100
    Infrastructure orchestration from local to your cloud
    Go created 5y ago pushed 4d ago awsbackendcloud
    +5.0/day
    measured
    ★ 12.7k
    42
← previous page 2 of 12 next →