Most starred
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
580 repositories ยท
topics: data-engineering, etl, data-pipeline, database, duckdb
-
451A lightweight local first SQL analytics tool. Get your data ๐ฆ in a rowflatmeasuredโ 25622
-
452A Postgres Compatible Database for Heavy, Multi-Tenant Workloads+9.4/daymeasuredโ 25541
-
453Bindings for H3 to DuckDBflatmeasuredโ 25420
-
454Independent ground-up Rust reimplementation of SQLite with page-level MVCC concurrent writers (serializable snapshot isolation). Runs today in compatibility mode over standard SQLite files; RaptorQ erasure-coded self-healing durability is in-progress research, not yet a live guarantee.+1.0/wkmeasuredโ 25223
-
455High-assurance AI data visualization IDE & analytics workbench. Natural language to charts with local ground-truth table verification.+6.6/daylifetime avgโ 24939
-
456High performance embedded vector databaseflatmeasuredโ 2457
-
457The memory & storage database engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible. Supports graph, vector, array, timeseries.+1.0/daymeasuredโ 24334
-
458NL2SQL - Ask questions in plain English, get SQL queries and results. Powered by LangGraph.flatmeasuredโ 2387
-
459end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuckflatmeasuredโ 23818
-
460Harness for building data engineering agents designed around human control, correctness, and safety.+3.0/wkmeasuredโ 23540
-
461Next-generation SQL static analyzer written in Rust. 282+ rules. Zero false positives. Security, performance, reliability, cost, compliance, quality. 14 SQL dialects. Offline. CI/CD ready.flatmeasuredโ 23111
-
462The duckdb R package+1.0/wkmeasuredโ 23122
-
463This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. The pipeline leverages a combination of tools and services including Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.+1.0/wkmeasuredโ 2308
-
464One database for user-user (follows), user-item (likes), and item-item (related items) interactions โ precomputed at write time, served as simple lookups+2.0/wkmeasuredโ 23038
-
465A collection of tools for extracting FHIR resources and analytics services on top of that data.flatmeasuredโ 22822
-
466A playground for running duckdb as a stateless query engine over a data lake+1.0/wkmeasuredโ 2258
-
467A curated list of awesome public DBT projectsflatmeasuredโ 2227
-
468A local-first relational database for the browser, React Native and your backend.+2.0/wkmeasuredโ 22224
-
469A collection of AI skills for working with Dagster+2.0/wkmeasuredโ 21825
-
470Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.+1.0/wkmeasuredโ 21726
-
471In-memory key-value server in Rust that speaks RESP, so redis-cli and Redis clients connect. Locks, rate limits, job queues and a change feed are single commands; Raft-based failover. Clients for Rust, .NET, Go, Java, Python and Node.js.+2.6/daymeasuredโ 21532
-
472Pushdown compute from Snowflake to DuckDB running on your infrastructureโstaleโ 2087
-
473ERD Builder Pro is a database design and documentation tool for developers. Build ERDs, flowcharts, notes, and drawings โ all in one workspaceflatmeasuredโ 20722
-
474Genomic sequence storage, indexing and alignment inside PostgreSQL: https://bioseqdb.com/โ1.0/wkmeasuredโ 20722
-
475Your coding agent starts every session blank. Rekal is the memory your team is missing+1.0/wkmeasuredโ 20618
-
476AgentSeek is an application development lifecycle toolkit for AI ecosystem apps, built by OceanBase OSS Team.+2.0/wkmeasuredโ 20422
-
477Open-source in-browser DuckDB SQL editorโstaleโ 20411
-
478ใEasy Data x AIใๆฏไธ้จ้ขๅๆๆ AI ็ฑๅฅฝ่ ็ๆฐๆฎไธ AI ๅบ็กๅ ฅ้จ่ฏพ็จใ้่ฟๅ่ฝจๅญฆไน ่ทฏๅพ๏ผไปๆฐๆฎ้ฉฑๅจ่ง่งๅญฆไน ๆๅปบ AI Agentใ+4.0/wkmeasuredโ 20025
-
479A ่กใๆ่ดงใๆๆๆฐๆฎๆฌๅฐๅ็ฎก้๏ผTushare Pro ๆๅ โ Parquet ๅๅบๅญๅจ โ DuckDB ๆฌๅฐๆฅ่ฏข๏ผๆฏๆๅข้ๅๆญฅไธๅฎๆถ่ฐๅบฆ+1.0/wkmeasuredโ 19721
-
480sqlite3 viewerflatmeasuredโ 19619
-
481the DATABASE Editor. https://discord.gg/cEe8v2Y7PJflatmeasuredโ 19420
-
482A lightweight embedded database engine that natively fuses vector search, graph, and document-oriented metadata within a single storage kernel โ ready to use the moment data is written.+1.0/daymeasuredโ 18842
-
483Focusing on building industry-leading ETL engines.flatmeasuredโ 18721
-
484A fast, minimal, cross-platform database client built with C++ and ImGui+3.0/wkmeasuredโ 18624
-
485Job board aggregator indexing 1,000,000+ active positions from 20,000+ companies across Greenhouse, Lever, Ashby, Workday, and other major ATS platforms. Multithreaded Python ETL pipeline, daily automated refreshes via GitHub Actions, filterable client-side search.+5.0/wkmeasuredโ 18526
-
486The smallest backend framework and among the top three in the world.flatmeasuredโ 18217
-
487Dadbod Grip turns database tables into editable Vim buffers, with schema browsing, staged mutations, generated SQL, relationship navigation, and cross-database federation inside Neovim.+2.0/wkmeasuredโ 18231
-
488An extensible, multi-database GUI client for macOS โ add any database by implementing a single Swift protocol. Built for contributors.flatmeasuredโ 1817
-
489RaccoonX(DBCheck): Database Inspection Toolflatmeasuredโ 18122
-
490Cognitive memory database for AI agents โ consolidates duplicates, detects contradictions, fades stale memories via temporal decay. Rust, Apache-2.0, ships as library / MCP server / HTTP cluster.+2.0/wkmeasuredโ 17938
-
491An open-source inference engine for AI functions in SQL+5.0/wkmeasuredโ 17926
-
492Text-to-SQL access control: schema selection that gives the LLM only the tables the caller is allowed to read. Row-level-security-aware table pruning for LangChain, MCP and any SQL agent. Postgres, Oracle, MySQL, SQL Server. 75% fewer prompt tokens.โ5.0/wkmeasuredโ 17421
-
493Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.+5.0/daymeasuredโ 17236
-
494Faucet is an open-source, single-binary server that turns any SQL database into a secure, governed REST API with role-based access control and native MCP support for applications and AI agents.+3.0/wkmeasuredโ 17023
-
495Modern SQL and NoSQL database client for Neovim+6.0/wkmeasuredโ 16634
-
496Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenariosflatmeasuredโ 16421
-
497Git For database Systemsflatmeasuredโ 16321
-
498DuckLake took Flight. Welcome to SwanLake.flatmeasuredโ 16217
-
499Code examples for the book titled Spatial Data Management with DuckDBโstaleโ 16119
-
500On-device property graph database. Schema-as-code. One CLI โ One Folder. No Server. Think: DuckDB for graphs.flatmeasuredโ 1597