Trending
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
551 repositories ·
topics: data-engineering, etl, data-pipeline, database, duckdb
-
1High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.+180/daymeasured★ 19.9k86
-
2TSP自托管、零运维的 A 股「自建策略 + 监控 + 回测」量化工作台 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源+99/daymeasured★ 7.1k79
-
3AI search engine and MCP server for bots and agents. One Rust binary indexes code, docs, logs, JSONL/CSV and PDFs for BM25 full-text, vector and hybrid search, code search without grep, agent memory and RAG. Elasticsearch-compatible API; Corpus Hub serves hundreds of reference memory corpora.+242/daymeasured★ 19.2k73
-
425 MB lightweight cross-platform database client for 100+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Server, and Dameng. Built-in AI, MCP Server, CLI, desktop and Docker. | 轻量级跨平台数据库管理工具,支持 MySQL、PostgreSQL、SQLite、Redis、MongoDB、达梦等 100+ 数据库,提供桌面端、Docker、CLI、内置 AI 助手和 MCP。+148/daymeasured★ 29.2k71
-
5The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:+33/daymeasured★ 50.2k66
-
6The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw+89/daymeasured★ 78.2k64
-
7Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)+11/daymeasured★ 13.5k63
-
8Development at the speed of light+16/daymeasured★ 25.5k61
-
9The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.+39/daymeasured★ 114.6k60
-
10Database diagrams editor that allows you to visualize and design your DB with a single query.+7.3/daymeasured★ 23.1k60
-
11LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows+9.7/daymeasured★ 7.4k58
-
12A system for agentic LLM-powered data processing and ETL+7.7/daymeasured★ 4.2k58
-
13VictoriaMetrics: fast, cost-effective monitoring solution and time series database+11/daymeasured★ 18k57
-
14Take your agent-built product live: hosting, database, domain, email, payments — on your own accounts. Open-source Agent Skill + zero-dependency Node CLI: detect → plan → approve → apply → verify. No GoLive account, backend or telemetry.+10/daymeasured★ 1.4k57
-
15A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.+12/daymeasured★ 59.8k54
-
16DuckDB is a high-performance analytical database system+22/daymeasured★ 42.8k54
-
17Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼+22/daymeasured★ 46.7k53
-
18qData is an open-source data governance and data development platform that integrates ETL, data development, metadata management, data quality, data assets, API services, and AI-powered data Q&A.+11/daymeasured★ 81153
-
19Graph-Native Infrastructure for Context and Accountable AI Systems+19/daymeasured★ 14.4k52
-
20A lightweight, cloud-native GIS platform for visualizing, exploring, and analyzing geospatial data. It runs in the web browser, on the desktop, on mobile, and inside Jupyter notebooks.+20/daymeasured★ 8.4k52
-
21The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, auth & more.+15/daymeasured★ 38.8k51
-
22GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.+11/daymeasured★ 18.1k51
-
23Servidor MCP e CLI para localizar empresas brasileiras por CNAE e região, utilizando dados abertos de CNPJ da Receita Federal.+36/daylifetime avg★ 12751
-
24📚 C/C++ 技术面试基础知识总结,包括语言、程序库、数据结构、算法、系统、网络、链接装载库等知识及面试经验、招聘、内推等信息。This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, including language, program library, data structure, algorithm, system, network, link loading library, interview experience, recruitment, recommendation, etc.+3.3/daymeasured★ 38.3k50
-
25ClickHouse® is a real-time analytics database management system+13/daymeasured★ 50.8k50
-
26TypeScript & JavaScript ORM for Node.js — supports PostgreSQL, MySQL, MariaDB, SQLite, SQL Server, Oracle, and more.+1.3/daymeasured★ 36.7k50
-
27Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.+13/daymeasured★ 30.1k50
-
28MCP Toolbox for Databases is an open source MCP server for databases.+8.1/daymeasured★ 16.8k50
-
29The fastest path to AI-powered full stack observability, even for lean teams.+11/daymeasured★ 81.3k50
-
30A native, all-in-one workspace for databases, SSH, SFTP, terminals, remote desktop, monitoring, and AI.+12/daymeasured★ 2.1k50
-
31A SQL database in Rust: SQLite-compatible, now also speaking Postgres (experimental). The LLVM of databases.+12/daymeasured★ 25.2k49
-
32Free, simple, and intuitive online database diagram editor and SQL generator.+11/daymeasured★ 40.2k49
-
33Open-source database & workspace for AI agents — structured data, durable knowledge, reusable skills, runnable apps, and human review on the writes that matter. Local-first and self-hostable.+13/daymeasured★ 70849
-
34Free universal database tool and SQL client+9.9/daymeasured★ 52.3k48
-
35A flexible distributed key-value database that is optimized for caching and other realtime workloads.+9.3/daymeasured★ 27.6k48
-
36Apache Superset is a Data Visualization and Data Exploration Platform+9.1/daymeasured★ 75.4k48
-
37PGX — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime🐘+20/daymeasured★ 67748
-
38Postgres rewritten in Rust, now faster than Postgres and Clickhouse+15/daymeasured★ 5.8k48
-
39Go MySQL Driver is a MySQL driver for Go's (golang) database/sql package+1.1/daymeasured★ 15.3k48
-
40Drone Log analyzer: A high-performance universal dashboard application for organizing and analyzing DJI/Litchi flight logs privately in one place. Supports plugin for custom flight log formats. Built with Tauri v2, DuckDB, and React.+2.0/daymeasured★ 1.6k48
-
41Apache Airflow - A platform to programmatically author, schedule, and monitor workflows+8.7/daymeasured★ 47.4k47
-
42open-source agentic AI data assistant for the next generation of AI + Data products.+6.7/daymeasured★ 20.3k47
-
43Durable Streams API+3.7/daymeasured★ 81147
-
44the portable Python dataframe library+1.6/daymeasured★ 6.7k47
-
45Database manager for MySQL, PostgreSQL, SQL Server, MongoDB, SQLite and others. Runs under Windows, Linux, Mac or as web application+2.7/daymeasured★ 7.4k47
-
46Dolt – Git for Data+8.3/daymeasured★ 24.8k47
-
47Browser-based data analytics & BI with DuckDB-WASM. Privacy-first: your data stays local; no server required.+2.0/daymeasured★ 63346
-
48A fast, multi-threaded Redis® and Valkey alternative written in Rust: drop-in compatible, with full-text and vector search built in+13/daymeasured★ 93446
-
49Automatic SQL injection and database takeover tool+7.3/daymeasured★ 38.9k46
-
50Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.+5.3/daymeasured★ 13.3k46
page 1 of 12
next →