9.3k repos tracked
updated 2d ago
Most starred

Data

Pipelines, warehouses, orchestration and analytics engineering.

Trending New Most starred 580 repositories ยท topics: data-engineering, etl, data-pipeline, database, duckdb
  1. 101
    A distributed, fast open-source graph database featuring horizontal scalability and high availability
    C++ created 8y ago pushed 2mo ago big-datacppdatabase
    +1.3/day
    measured
    โ˜… 12.5k
    29
  2. 102
    ๐Ÿ”ฅ A well-tested feature-rich modular Firebase implementation for React Native. Supports both iOS & Android platforms for all Firebase services.
    TypeScript created 9y ago pushed 2d ago analyticsandroidauth
    +1.0/wk
    measured
    โ˜… 12.3k
    28
  3. 103
    The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
    Java created 5y ago pushed 2d ago analyticsbig-datacloudnative
    +3.7/day
    measured
    โ˜… 12.2k
    44
  4. 104
    A curated list of awesome PostgreSQL software, libraries, tools and resources, inspired by awesome-mysql
    created 11y ago pushed 2mo ago databasepostgrespostgresql
    +4.0/wk
    measured
    โ˜… 12.1k
    25
  5. 105
    Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
    C++ created 9y ago pushed 2d ago apibm25cpp
    +4.0/wk
    measured
    โ˜… 12.1k
    31
  6. 106
    Grist is the evolution of spreadsheets.
    TypeScript created 6y ago pushed 3d ago awesomedatabasespreadsheet
    +5.0/day
    measured
    โ˜… 12.1k
    43
  7. 107
    Rich MySQL Terminal Client with AutoCompletion, Syntax Highlighting, and Dataframes
    Python created 11y ago pushed 2d ago auto-completiondata-sciencedatabase
    +5.0/wk
    measured
    โ˜… 12k
    36
  8. 108
    Always know what to expect from your data.
    Python created 9y ago pushed 2d ago cleandatadata-engineeringdata-profilers
    +1.3/day
    measured
    โ˜… 11.9k
    34
  9. 109
    Incremental engine for long horizon agents ๐ŸŒŸ Star if you like it!
    Rust created 20mo ago pushed 3d ago agentic-data-frameworkaiai-agents
    +6.4/day
    measured
    โ˜… 11.8k
    44
  10. 110
    ๐Ÿ‰ Reactive & asynchronous database for powerful React and React Native apps โšก๏ธ
    JavaScript created 8y ago pushed 52d ago databasehacktoberfestpersistence
    +1.0/wk
    measured
    โ˜… 11.8k
    24
  11. 111
    A database migration tool. Supports SQL migrations and Go functions.
    Go created 10y ago pushed 5d ago databasedatabase-migrationsgo
    +3.1/day
    measured
    โ˜… 11.7k
    38
  12. 112
    WCDB is a cross-platform database framework developed by WeChat.
    C created 9y ago pushed 30d ago androiddatabaseios
    +2.0/wk
    measured
    โ˜… 11.6k
    27
  13. 113
    Realm is a mobile database: a replacement for SQLite & ORMs
    Java created 14y ago pushed 13mo ago androiddatabasejava
    +1.0/wk
    measured
    โ˜… 11.5k
    13
  14. 114
    A data visualization and analytics component, especially well-suited for large and/or streaming datasets.
    Rust created 9y ago pushed 2d ago analyticsapache-arrowbi
    +4.7/day
    measured
    โ˜… 11.4k
    43
  15. 115
    A list of learning materials to understand databases internals
    created 6y ago pushed 2y ago awesomeawesome-listblogs
    +1.4/day
    measured
    โ˜… 11.2k
    19
  16. 116
    A truly Open Source MongoDB alternative
    Go created 5y ago pushed 5mo ago databasedocumentferretdb
    +3.0/wk
    measured
    โ˜… 11.1k
    17
  17. 117
    A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.
    Go created 5y ago pushed 10mo ago cadencecsharpdatabase
    +4.0/wk
    measured
    โ˜… 10.9k
    15
  18. 118
    Open-source, low-latency key/value engine built on Valkey with query subscriptions and hierarchical storage tiers.
    C created 4y ago pushed 6mo ago cachedatabasekey-value
    flat
    measured
    โ˜… 10.8k
    12
  19. 119
    YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
    C created 9y ago pushed 2d ago cloud-nativecppdatabase
    +2.3/day
    measured
    โ˜… 10.7k
    37
  20. 120
    Writing a sqlite clone from scratch in C
    C created 9y ago pushed 2y ago database
    +6.0/wk
    measured
    โ˜… 10.5k
    32
  21. 121
    Curso para aprender los fundamentos del lenguaje SQL y bases de datos relacionales desde cero y para principiantes.
    Python created 3y ago pushed 19mo ago basesdedatoscursodatabase
    +5.4/day
    measured
    โ˜… 10.5k
    28
  22. 122
    A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledge Graph for LLM (GraphRAG).
    Rust created 3y ago pushed 2d ago cloud-databasedatabasedatabase-as-a-service
    +1.3/day
    measured
    โ˜… 10.5k
    34
  23. 123
    OceanBase is the unified distributed database for the AI era โ€” open-source, multi-model, one engine for your most demanding workloads.
    C++ created 5y ago pushed 3d ago analyticscloud-nativedatabase
    +6.0/wk
    measured
    โ˜… 10.4k
    32
  24. 124
    q - Run SQL directly on delimited files and multi-file sqlite databases
    Python created 14y ago pushed 9mo ago clicommand-linecommand-line-tool
    โ€”
    stale
    โ˜… 10.4k
    12
  25. 125
    ่ฎก็ฎ—ๆœบๅŸบ็ก€๏ผˆ่ฎก็ฎ—ๆœบ็ฝ‘็ปœ/ๆ“ไฝœ็ณป็ปŸ/ๆ•ฐๆฎๅบ“/Git...๏ผ‰้ข่ฏ•้—ฎ้ข˜ๅ…จ้ขๆ€ป็ป“๏ผŒๅŒ…ๅซ่ฏฆ็ป†็š„follow-up questionไปฅๅŠ็ญ”ๆกˆ๏ผ›ๅ…จ้ƒจ้‡‡็”จใ€้—ฎ้ข˜+่ฟฝ้—ฎ+็ญ”ๆกˆใ€‘็š„ๅฝขๅผ๏ผŒๅณๆ‹ฟๅณ็”จ๏ผŒ็›ดๅ‡ปไบ’่”็ฝ‘ๅคงๅŽ‚้ข่ฏ•๏ผ›ๅฏ็”จไบŽๆจกๆ‹Ÿ้ข่ฏ•ใ€้ข่ฏ•ๅ‰ๅคไน ใ€็ŸญๆœŸๅ†…ๅฟซ้€Ÿๅค‡ๆˆ˜้ข่ฏ•...
    created 6y ago pushed 2y ago computer-networkcomputer-sciencedatabase
    +4.0/wk
    measured
    โ˜… 10.3k
    21
  26. 126
    Go (Golang) Clean Architecture based on Reading Uncle Bob's Clean Architecture
    Go created 9y ago pushed 2y ago architecturearticleclean-architecture
    โ€”
    stale
    โ˜… 10.2k
    12
  27. 127
    Python SQL Parser and Transpiler
    Python created 5y ago pushed 3d ago bigqueryclickhousedatabricks
    +4.0/day
    measured
    โ˜… 9.8k
    42
  28. 128
    ๐Ÿš Python-powered shell. Full-featured, cross-platform and AI-friendly.
    Python created 11y ago pushed 4d ago anthropicclaudeclaude-code
    โˆ’2.0/wk
    measured
    โ˜… 9.7k
    26
  29. 129
    Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
    Rust created 4y ago pushed 2d ago apache-icebergdata-engineeringdatabase
    +6.0/wk
    measured
    โ˜… 9.4k
    32
  30. 130
    ๐Ÿง™ Build, run, and manage data pipelines for integrating and transforming data.
    Python created 4y ago pushed 15d ago artificial-intelligencedatadata-engineering
    +3.0/wk
    measured
    โ˜… 8.8k
    28
  31. 131
    Fancy stream processing made operationally mundane
    Go created 10y ago pushed 2d ago amqpcqrsdata-engineering
    +2.0/wk
    measured
    โ˜… 8.8k
    29
  32. 132
    Open Source Feature Flags, Experimentation, and Product Analytics
    TypeScript created 5y ago pushed 2d ago ab-testingabtestabtesting
    +2.9/day
    measured
    โ˜… 8.6k
    38
  33. 133
    A lightweight, cloud-native GIS platform for visualizing, exploring, and analyzing geospatial data. It runs in the web browser, on the desktop, on mobile, and inside Jupyter notebooks.
    TypeScript created 5mo ago pushed 3d ago cesiumdata-scienceduckdb
    +20/day
    measured
    โ˜… 8.4k
    52
  34. 134
    Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
    Go created 5y ago pushed 4d ago awsazurecis
    +4.0/wk
    measured
    โ˜… 8k
    30
  35. 135
    LLM-Driven Extraction of Unstructured Data โ€” Built for API Deployments & ETL Pipeline Workflows
    Python created 2y ago pushed 2d ago ai-agentsdata-engineeringdocument-ai
    +9.7/day
    measured
    โ˜… 7.4k
    58
  36. 136
    Database manager for MySQL, PostgreSQL, SQL Server, MongoDB, SQLite and others. Runs under Windows, Linux, Mac or as web application
    JavaScript created 6y ago pushed 3d ago cassandraclickhousecockroachdb
    +2.7/day
    measured
    โ˜… 7.4k
    47
  37. 137
    The Open Source Feature Store for AI/ML
    Python created 7y ago pushed 3d ago big-datadata-engineeringdata-quality
    +5.0/wk
    measured
    โ˜… 7.4k
    31
  38. 138
    Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
    Rust created 4y ago pushed 2d ago apache-arrowcomputer-visiondata-analysis
    +4.4/day
    measured
    โ˜… 7.3k
    40
  39. 139
    Data processing for and with foundation models! ๐ŸŽ ๐Ÿ‹ ๐ŸŒฝ โžก๏ธ โžก๏ธ๐Ÿธ ๐Ÿน ๐Ÿท
    Python created 3y ago pushed 4d ago datadata-analysisdata-pipeline
    +3.9/day
    measured
    โ˜… 7.2k
    41
  40. 140
    Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
    TypeScript created 5y ago pushed 3d ago analyticsbusiness-intelligencedashboard
    +1.6/day
    measured
    โ˜… 7.1k
    34
  41. 141
    TSP่‡ชๆ‰˜็ฎกใ€้›ถ่ฟ็ปด็š„ A ่‚กใ€Œ่‡ชๅปบ็ญ–็•ฅ + ็›‘ๆŽง + ๅ›žๆต‹ใ€้‡ๅŒ–ๅทฅไฝœๅฐ | LLM่ƒฝๅŠ›้ฉฑไฝฟ็ญ–็•ฅๅฎšๅˆถ+ไธช่‚กๅˆ†ๆž+ๅค็›˜ | ่‡ช็”ฑๆŽฅๅ…ฅ็ฌฌไธ‰ๆ–นๆ•ฐๆฎๆบไธŽไธชๆ€งๅŒ–ๆ‰ฉๅฑ•ๆ•ฐๆฎ | ไธชไบบๅผ€ๆบ
    Python created 4mo ago pushed 3d ago a-stockai-agentaigc
    +99/day
    measured
    โ˜… 7.1k
    79
  42. 142
    The leader in Customer Data Infrastructure
    Scala created 14y ago pushed 19d ago analyticsdatadata-collection
    โˆ’1.0/wk
    measured
    โ˜… 7k
    25
  43. 143
    the portable Python dataframe library
    Python created 11y ago pushed 3d ago bigqueryclickhousedatabase
    +1.6/day
    measured
    โ˜… 6.7k
    47
  44. 144
    Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
    Go created 5y ago pushed 3d ago airbyteattack-surface-managementaws
    +5.0/wk
    measured
    โ˜… 6.6k
    45
  45. 145
    The SQL IDE for Your Terminal. Now with hsql, your agent's favorite sql client.
    Python created 3y ago pushed 3d ago agentcliclient
    +2.3/day
    measured
    โ˜… 6.5k
    37
  46. 146
    Flink CDC is a streaming data integration tool
    Java created 6y ago pushed 3d ago batchcdcchange-data-capture
    +4.0/wk
    measured
    โ˜… 6.5k
    35
  47. 147
    Free and open source database client built natively for developers
    Swift created 10mo ago pushed 2d ago appkitdatabasedatabase-client
    +4.4/day
    measured
    โ˜… 6.4k
    40
  48. 148
    data load tool (dlt) is an open source Python library that makes data loading easy ๐Ÿ› ๏ธ
    Python created 4y ago pushed 2d ago datadata-engineeringdata-lake
    +4.4/day
    measured
    โ˜… 6.1k
    42
  49. 149
    AliSQL is a MySQL branch originated from Alibaba Group. Fetch document from Release Notes at bottom.
    C++ created 10y ago pushed 23d ago alisqldatabaseduckdb
    +3.0/wk
    measured
    โ˜… 6k
    40
  50. 150
    High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
    Rust created 4y ago pushed 3d ago ai-engineeringai-pipelinearrow
    +1.0/day
    measured
    โ˜… 5.8k
    32
โ† previous page 3 of 12 next โ†’