Most starred
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
580 repositories ·
topics: data-engineering, etl, data-pipeline, database, duckdb
-
501End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.+1.0/wkmeasured★ 15516
-
502Turn any folder into a Notion-style database — 7 views, 17 column types, formulas, relations, rollups, and subtasks. All stored in plain Markdown frontmatter.+2.0/wkmeasured★ 15522
-
503Modern documentation site generator for dbt Core — lineage explorer, health scoring, full-text search. Live demo: https://demo.docglow.com+2.0/wkmeasured★ 15336
-
504📖 Data Engineering from Raw Corporaflatmeasured★ 1509
-
505Discover, mask, and verify sensitive data in SQL databases — an auditable scan → mask → validate workflow for safe database copies.+1.0/wkmeasured★ 15022
-
506relational database stored in discord guildsflatmeasured★ 1496
-
507MAC address manufacturer lookup database combining IEEE, Nmap, Wireshark and HDM Mac-Tracker, with downloadable formats and a browser lookup. https://ringmast4r.github.io/OUI-Master-Database/+4.0/wkmeasured★ 14925
-
508Native lakehouse experience in Postgres powered by DuckDB & DuckLake+2.0/wkmeasured★ 14930
-
509A modern, open-source database client for desktop and web.+3.0/wkmeasured★ 14722
-
510Extract a slice of your production database to reproduce bugs locally. Point dbslice at a record, it follows foreign keys and gives you a complete, importable subsetflatmeasured★ 14410
-
511Production-grade SQL gateway in front of DuckDB Quack + DuckLake + Iceberg. Multi-tenant pools, pluggable auth (DB/JWT/OIDC), table-level ACLs, role-aware routing, and a live admin console+2.0/wkmeasured★ 14423
-
512从数据到智能:企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记:从 0 到 1 构建企业级医药数据平台,再到 Data + AI 转型下的 Agentic BI。+2.0/wkmeasured★ 14027
-
513Interactive Emacs database client for MySQL, PostgreSQL, SQLite, MongoDB, Redis, and JDBC.+1.8/wkmeasured★ 13923
-
514Datos públicos de Chile curados, normalizados y validados: geografía, demografía, economía, salud, educación y distritos electorales. Listos para consumir en una línea de código con Polars, DuckDB, SQLite y Excel.+1.0/wkmeasured★ 13722
-
515Observability platform for Digital Employee, providing real-time tracing, session insights, and cost analysis for multi-agent workflowsflatmeasured★ 1367
-
516DuckDB extension for Microsoft SQL Server (TDS + TLS), with catalog integration and pushdown.+1.0/wkmeasured★ 13622
-
517The Boring query platform - Connect and query anything+1.0/wkmeasured★ 13514
-
518Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.+1.0/wkmeasured★ 13526
-
519Skills related to Data Engineering Work for Claude Code+3.0/wkmeasured★ 13338
-
520A modern, lightweight database management tool. Create, manage, and run multiple database instances locally with an intuitive interface.—stale★ 13014
-
521Pivot is a high-performance real time analytics database on open data formats.+3.8/wklifetime avg★ 12825
-
522AI-native cross-platform database workbench for developers and data teams.−2.0/wkmeasured★ 12721
-
523Type-safe SQL query builder. Zero dependencies, AST-first, hookable, tree-shakeable. Pure TypeScript.flatmeasured★ 12715
-
524Servidor MCP e CLI para localizar empresas brasileiras por CNAE e região, utilizando dados abertos de CNPJ da Receita Federal.+36/daylifetime avg★ 12751
-
525Token Efficiency For AI Agents+1.0/wkmeasured★ 12535
-
526A cognition aware database engine for AI agent memory. Purpose built in Rust with WAL, HNSW, knowledge graphs, and speculative context pre assembly. Not a wrapper, a ground up storage engine that thinks.+2.0/wkmeasured★ 12427
-
527A simple Python CLI to download Garmin Connect data as local files and load them into a SQLite database for analysis—stale★ 12417
-
528Pure-Go SQLite, no cgo. Official mirror of gitlab.com/cznic/sqlite — issues and PRs welcome here.+5.0/wkmeasured★ 12334
-
529Linter for dangerous Postgres migration patterns in Diesel and SQLx. Prevents downtime caused by unsafe schema changes.+1.0/wkmeasured★ 12222
-
530The open-source pulse on software across Greece+2.0/wkmeasured★ 12123
-
531Apache Phoenix Adaptersflatmeasured★ 12114
-
532🐬 Beginner-to-advanced MySQL course — filtering, joins, subqueries, window functions, CTEs & more. Hands-on guides with copy-paste SQL on one sample database. 🎥 Full video walkthrough on YouTube.+4.0/wkmeasured★ 12126
-
533A robust, configuration-driven ETL and data import framework for Laravel. Handles CSV/Excel streaming, queues, validation, and relationships.—stale★ 12010
-
534Complete structured archive of every CIA World Factbook edition from 1990-2025. 281 countries, 36 years, 1M+ parsed data fields in SQL Server. Python ETL scripts included. Website created to allow users to explore the data without downloading. www.worldfactbookarchive.org+3.0/wkmeasured★ 11929
-
535A Scala 3 web framework. Direct-style. The case class is the source of truth. Deploy with one command.+1.2/daylifetime avg★ 11927
-
536Lightweight GPL-3.0 desktop database client (PostgreSQL / MySQL / SQLite / Redis). Built with Tauri + Rust, under 15MB.—stale★ 11720
-
537Fast, distributed per-aggregate event log with strict ordering and optimistic concurrency control.+1.0/wkmeasured★ 11632
-
538Microsoft Fabric Unified Data Foundation with Databricks & Purview 2026flatmeasured★ 11421
-
539MCP server for 200M+ patents, scientific literature, chemistry and pharma records. Search prior art and R&D intelligence powered by PatSnap's proprietary databases via Claude, Cursor and MCP-compatible clients.—stale★ 11215
-
540Backend Engineering, Low-Level Design, System Design, Networking, Security, SQL, and Distributed Systems explained through visual diagrams.flatmeasured★ 11220
-
541Open-source text-to-SQL engine you tune and measure on your own database+1.0/wkmeasured★ 11222
-
542Free Open-source AI SQL client that helps developers and data teams explore databases using natural language.+4.0/wkmeasured★ 11130
-
543OpenFGA-to-PostgreSQL authorization compiler. Generates specialized SQL functions from .fga schemas that query your existing tables. Zero sync, always consistent.+4.0/wkmeasured★ 11130
-
544Dex lets your agent build your analytics.+1.1/daymeasured★ 11127
-
545Scan-to-Practice: a field-tested AI skill and methodology for turning scanned learning materials into structured practice products.flatmeasured★ 11014
-
546Application-level quota management for Laravel with calendar periods, Eloquent integration, middleware, and multiple storage backends.flatmeasured★ 11012
-
547A graph database provides Cypher query, fluent builder and management UI implemented in Golang.flatmeasured★ 11010
-
548Terminal database client with AI chat and an MCP server+1.0/wkmeasured★ 10821
-
549View SQLite databases+2.0/wkmeasured★ 10737
-
550Data streaming runtime focused on performance, consistency, and extensibility. Write plugins in Rust or WASM and process data with data guarantees.+3.0/wkmeasured★ 10733