Trending
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
551 repositories ·
topics: data-engineering, etl, data-pipeline, database, duckdb
-
151The most comprehensive SQL guide from a real-world expert! Learn everything from basics to advanced queries, optimizations, and real-world SQL+3.4/daymeasured★ 1.7k35
-
152Official home of the DB Browser for SQLite (DB4S) project. Previously known as "SQLite Database Browser" and "Database Browser for SQLite". Website at:+1.4/daymeasured★ 24.8k35
-
153Token Efficiency For AI Agents+1.0/wkmeasured★ 12535
-
154Home of the Open Data Contract Standard (ODCS).+1.7/daymeasured★ 1.2k35
-
155The open-source reactive database for app developers+1.6/daymeasured★ 12.8k35
-
156Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends+2.3/daymeasured★ 2.6k35
-
157A fast, keyboard-first database client built with Rust and GPUI.+2.6/daymeasured★ 51435
-
158One browser tab for PostgreSQL, MySQL, Oracle, SQL Server, MongoDB, Redis, SQLite, Couchbase, ClickHouse, Druid, DuckDB, Turso and more. An open-source SQL IDE with SSO, audit trail and AI-assisted queries MIT licensed, with nothing held back behind an enterprise wall.+2.6/daymeasured★ 1.3k35
-
159Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.+3.4/daymeasured★ 23.3k35
-
160The memory & storage database engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible. Supports graph, vector, array, timeseries.+1.0/daymeasured★ 24334
-
161The fastest business intelligence tool for humans and agents.+1.9/daymeasured★ 3k34
-
162High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios+1.1/daymeasured★ 25.2k34
-
163Business intelligence as code: build fast, interactive data visualizations in SQL and markdown+1.6/daymeasured★ 7.1k34
-
164Python Stream Processing+6.0/wkmeasured★ 2.1k34
-
165A list of useful resources to learn Data Engineering from scratch+3.0/wkmeasured★ 4k34
-
166Modern SQL and NoSQL database client for Neovim+6.0/wkmeasured★ 16634
-
167Always know what to expect from your data.+1.3/daymeasured★ 11.9k34
-
168REST API for any Postgres database+1.0/daymeasured★ 27.7k34
-
169The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.+5.0/wkmeasured★ 2.3k34
-
170Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.+1.7/daymeasured★ 3.5k34
-
171Pure-Go SQLite, no cgo. Official mirror of gitlab.com/cznic/sqlite — issues and PRs welcome here.+5.0/wkmeasured★ 12334
-
172A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledge Graph for LLM (GraphRAG).+1.3/daymeasured★ 10.5k34
-
173A curated list of awesome big data frameworks, ressources and other awesomeness.+1.3/daymeasured★ 14.7k33
-
174Data streaming runtime focused on performance, consistency, and extensibility. Write plugins in Rust or WASM and process data with data guarantees.+3.0/wkmeasured★ 10733
-
175Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.+1.0/daymeasured★ 28.4k33
-
176MiniBank - Simulation bancaire en C+++3.6/daymeasured★ 9333
-
177The Data Engineering Cookbook+1.4/daymeasured★ 15.5k33
-
178Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.+2.0/wkmeasured★ 1.2k33
-
179libSQL is a fork of SQLite that is both Open Source, and Open Contributions.+1.3/daymeasured★ 17.3k33
-
180ClickBench: a Benchmark For Analytical Databases+1.1/daymeasured★ 1.2k32
-
181A Minimalistic Wrapper for IndexedDB+1.0/daymeasured★ 14.7k32
-
182In-memory key-value server in Rust that speaks RESP, so redis-cli and Redis clients connect. Locks, rate limits, job queues and a change feed are single commands; Raft-based failover. Clients for Rust, .NET, Go, Java, Python and Node.js.+2.6/daymeasured★ 21532
-
183Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage+5.0/wkmeasured★ 3.3k32
-
184The fully open-source DuckDB workbench that runs in your browser. SQL editor, notebooks, charts, AI assistant. No install, no signup, no backend — your data never leaves the tab.+6.0/wkmeasured★ 65232
-
185Fast, distributed per-aggregate event log with strict ordering and optimistic concurrency control.+1.0/wkmeasured★ 11632
-
186Postgres intelligence for ai agents+1.6/daymeasured★ 1.5k32
-
187Writing a sqlite clone from scratch in C+6.0/wkmeasured★ 10.5k32
-
188OceanBase is the unified distributed database for the AI era — open-source, multi-model, one engine for your most demanding workloads.+6.0/wkmeasured★ 10.4k32
-
189Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.+6.0/wkmeasured★ 9.4k32
-
190High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale+1.0/daymeasured★ 5.8k32
-
191DuckDB extension to read and write to SQLite databases+2.0/wkmeasured★ 29731
-
192Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.+1.0/daymeasured★ 2.7k31
-
193ingestr is a CLI tool to copy data between any databases with a single command seamlessly.+1.0/daymeasured★ 4k31
-
194Supercharge BigQuery with BigFunctions+1.0/wkmeasured★ 76131
-
195📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.+7.9/daymeasured★ 30.8k31
-
196A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!+1.4/daymeasured★ 93131
-
197EF Core is a modern object-database mapper for .NET. It supports LINQ queries, change tracking, updates, and schema migrations.+4.0/wkmeasured★ 14.8k31
-
198🥑 ArangoDB is a native multi-model database with flexible data models for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript extensions.+4.0/wkmeasured★ 14.3k31
-
199Dadbod Grip turns database tables into editable Vim buffers, with schema browsing, staged mutations, generated SQL, relationship navigation, and cross-database federation inside Neovim.+2.0/wkmeasured★ 18231
-
200Postgres CLI with autocompletion and syntax highlighting+4.0/wkmeasured★ 13.4k31