Trending
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
551 repositories ·
topics: data-engineering, etl, data-pipeline, database, duckdb
-
101Powerpipe: Dashboards for DevOps. Visualize cloud configurations. Assess security posture against a massive library of benchmarks. Build custom dashboards with code.+2.0/wkmeasured★ 52640
-
102high-performance graph database for real-time use cases+1.0/daymeasured★ 21.8k40
-
103Harness for building data engineering agents designed around human control, correctness, and safety.+3.0/wkmeasured★ 23540
-
104TypeScript ETL toolkit for indexing Ethereum, Solana, and Substrate data, sourced from SQD Network.+3.0/wkmeasured★ 1.3k40
-
105🔥🔥超过1000本的计算机经典书籍、个人笔记资料以及本人在各平台发表文章中所涉及的资源等。书籍资源包括C/C++、Java、Python、Go语言、数据结构与算法、操作系统、后端架构、计算机系统知识、数据库、计算机网络、设计模式、前端、汇编以及校招社招各种面经~+21/daymeasured★ 27.9k40
-
106Fast key-value DB in Go.+1.0/daymeasured★ 15.8k40
-
107Apache ZooKeeper+6.0/wkmeasured★ 12.8k39
-
108Database Reporting Tool and Tasks (.Net)+2.0/wkmeasured★ 1.6k39
-
109✨ AI Spreadsheet for Business+2.9/daymeasured★ 22k39
-
110🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊+2.0/wkmeasured★ 98739
-
111High-assurance AI data visualization IDE & analytics workbench. Natural language to charts with local ground-truth table verification.+6.6/daylifetime avg★ 24939
-
112Distributed reliable key-value store for the most critical data of a distributed system+2.3/daymeasured★ 52.4k39
-
113Workflow Engine for Kubernetes+2.1/daymeasured★ 17.1k38
-
114A database migration tool. Supports SQL migrations and Go functions.+3.1/daymeasured★ 11.7k38
-
115Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.+2.4/daymeasured★ 1.6k38
-
116Skills related to Data Engineering Work for Claude Code+3.0/wkmeasured★ 13338
-
117Privacy and Security focused Segment-alternative, in Golang and React+1.0/daymeasured★ 4.5k38
-
118Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through deeply versioned, context-rich data packages.+1.0/wkmeasured★ 1.4k38
-
119Cognitive memory database for AI agents — consolidates duplicates, detects contradictions, fades stale memories via temporal decay. Rust, Apache-2.0, ships as library / MCP server / HTTP cluster.+2.0/wkmeasured★ 17938
-
120Prefect is a workflow orchestration framework for building resilient data pipelines in Python.+2.4/daymeasured★ 24.1k38
-
121Source-available semantic and context layer, rule engine, and semantic sidecar for agentic AI and governed analytics. Compiles declarative YAML models into optimized SQL, KPIs, and semantic context across 8 SQL dialects.+2.0/wkmeasured★ 10338
-
122Self-hosted database backup manager with a web UI. Schedule, backup, and restore MySQL, PostgreSQL, MariaDB, Microsoft SQL Server, MongoDB, SQLite & Redis to S3, SFTP, Samba or local storage. SSH Tunnel support.+2.7/daymeasured★ 2.6k38
-
123🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.+1.0/daymeasured★ 21.4k38
-
124One database for user-user (follows), user-item (likes), and item-item (related items) interactions — precomputed at write time, served as simple lookups+2.0/wkmeasured★ 23038
-
125Open Source Feature Flags, Experimentation, and Product Analytics+2.9/daymeasured★ 8.6k38
-
126A modern replacement for Redis and Memcached+2.1/daymeasured★ 31.8k38
-
127A library that provides an embeddable, persistent key-value store for fast storage.+2.1/daymeasured★ 32.2k38
-
128The data transformation tool the open-source community deserves.+5.3/daymeasured★ 30537
-
129Graphs for Everyone+2.9/daymeasured★ 17.4k37
-
130Every database. One studio. A free, open-source database GUI for SQL, document, and key-value databases.+3.3/daymeasured★ 31037
-
131DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!+3.1/daymeasured★ 4.8k37
-
132The SQL IDE for Your Terminal. Now with hsql, your agent's favorite sql client.+2.3/daymeasured★ 6.5k37
-
133Secure memory management for AI Agents • Ensures data integrity • Reduces hallucinations • Maintains consistent long-term context+6.0/wkmeasured★ 62437
-
134Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.+4.0/wkmeasured★ 81837
-
135View SQLite databases+2.0/wkmeasured★ 10737
-
136CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.+1.9/daymeasured★ 32.6k37
-
137Unified local observability for AI coding assistants+4.0/wkmeasured★ 28337
-
138YugabyteDB - the cloud native distributed SQL database for mission-critical applications.+2.3/daymeasured★ 10.7k37
-
139Open-source inference server and production cluster for all the models your agent needs.+2.9/daymeasured★ 3.5k36
-
140👾 nao is the #1 open source agentic BI. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone+3.1/daymeasured★ 2k36
-
141Open Source Business Intelligence Tool+5.0/wkmeasured★ 1k36
-
142Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.+1.3/daymeasured★ 3.2k36
-
143Rich MySQL Terminal Client with AutoCompletion, Syntax Highlighting, and Dataframes+5.0/wkmeasured★ 12k36
-
144Modern documentation site generator for dbt Core — lineage explorer, health scoring, full-text search. Live demo: https://demo.docglow.com+2.0/wkmeasured★ 15336
-
145Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.+5.0/daymeasured★ 17236
-
146The MongoDB Database+1.6/daymeasured★ 28.7k36
-
147Where data access meets operational intelligence+6.0/wkmeasured★ 5.1k36
-
148A light TablePlus alternative for PostgreSQL that your AI agents can use too, over MCP. macOS and Windows.+5.9/daylifetime avg★ 4435
-
149Scalable datastore for metrics, events, and real-time analytics+1.4/daymeasured★ 31.8k35
-
150Flink CDC is a streaming data integration tool+4.0/wkmeasured★ 6.5k35