Trending
Data
Pipelines, warehouses, orchestration and analytics engineering.
Trending
New
Most starred
551 repositories ·
topics: data-engineering, etl, data-pipeline, database, duckdb
-
251A javascript library to run SQLite on the web.+1.0/wkmeasured★ 13.7k27
-
252:kangaroo: - PouchDB is a pocket-sized database.−1.0/wkmeasured★ 17.6k27
-
253Query robotics, drone, and IoT data in plain English through an MCP server, with an intelligent edge data reduction pipeline that keeps only the data that matters.+1.0/wkmeasured★ 40127
-
254QuackOSM: an open-source Python and CLI tool for reading OpenStreetMap PBF files using DuckDB+1.0/wkmeasured★ 38027
-
255Actively curated list of awesome BI tools. PRs welcome!+5.0/wkmeasured★ 2.3k27
-
256Illuminate your data. Agent framework turning natural language into SQL, charts, dashboards and reports.+3.0/wkmeasured★ 32627
-
257从数据到智能:企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记:从 0 到 1 构建企业级医药数据平台,再到 Data + AI 转型下的 Agentic BI。+2.0/wkmeasured★ 14027
-
258A cognition aware database engine for AI agent memory. Purpose built in Rust with WAL, HNSW, knowledge graphs, and speculative context pre assembly. Not a wrapper, a ground up storage engine that thinks.+2.0/wkmeasured★ 12427
-
259A data platform for investment research. Ingests financial data sources and computes point-in-time financial metrics for valuation and screening. Delivered as an MCP server.+5.0/wkmeasured★ 32927
-
260WCDB is a cross-platform database framework developed by WeChat.+2.0/wkmeasured★ 11.6k27
-
261Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course+2.0/wkmeasured★ 84127
-
262Autonomous backend platform. Your coding agent builds it over MCP, Backenly keeps it running: Postgres, REST APIs, auth, storage, realtime, and functions, with every change governed, verified, and reversible.+1.0/daylifetime avg★ 10726
-
263Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.+1.0/wkmeasured★ 21726
-
264An async ORM for Python and TypeScript with one Rust core: one Prisma schema, typed models, migrations, PostgreSQL and SQLite.+1.3/daylifetime avg★ 4526
-
265🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.−2.0/wkmeasured★ 9.7k26
-
266Blazing-fast, Neuro-symbolic Data-Wrangling toolkit+1.0/wkmeasured★ 3.8k26
-
267A fast, native, keyboard-driven database client for macOS. 20 databases, an AI assistant that shows its work, free and open source.+5.0/wkmeasured★ 41926
-
268Versioned DuckDB databases, locally or replicated through S3, for people and agents+1.2/daymeasured★ 4826
-
269YARD is an editor plugin for Godot to manage resources and query them at runtime, with a table view in the editor as the cherry on top.+4.0/wkmeasured★ 37126
-
270Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI+2.0/wkmeasured★ 1.4k26
-
271🐬 Beginner-to-advanced MySQL course — filtering, joins, subqueries, window functions, CTEs & more. Hands-on guides with copy-paste SQL on one sample database. 🎥 Full video walkthrough on YouTube.+4.0/wkmeasured★ 12126
-
272A desktop application for viewing and analyzing tabular data+3.0/wkmeasured★ 3.5k26
-
273Visualize and share your data. All in SQL. Powered by DuckDB.+2.0/wkmeasured★ 1.3k26
-
274An open-source inference engine for AI functions in SQL+5.0/wkmeasured★ 17926
-
275Job board aggregator indexing 1,000,000+ active positions from 20,000+ companies across Greenhouse, Lever, Ashby, Workday, and other major ATS platforms. Multithreaded Python ETL pipeline, daily automated refreshes via GitHub Actions, filterable client-side search.+5.0/wkmeasured★ 18526
-
276Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.+1.0/wkmeasured★ 13526
-
277🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications+1.0/wkmeasured★ 2.3k26
-
278Local MCP server for DuckDB and MotherDuck+3.0/wkmeasured★ 53926
-
279A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.+2.4/daymeasured★ 1.7k26
-
280AxData 是一个开源量化数据库框架,覆盖通达信、巨潮、腾讯财经、新浪财经、东方财富、财联社、开盘红等公开源接口。+1.4/daymeasured★ 32525
-
281🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.+1.0/wkmeasured★ 1.7k25
-
282Turns Data and AI algorithms into production-ready web applications in no time.+6.0/wkmeasured★ 19.5k25
-
283Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.+3.0/wkmeasured★ 1.8k25
-
284Python Streaming DataFrames for Kafka+1.0/wkmeasured★ 1.6k25
-
285《Easy Data x AI》是一门面向所有 AI 爱好者的数据与 AI 基础入门课程。通过双轨学习路径,从数据驱动视角学习构建 AI Agent。+4.0/wkmeasured★ 20025
-
286Bindings and ADO.NET Provider for DuckDB+2.0/wkmeasured★ 72225
-
287pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).−2.0/wkmeasured★ 4.1k25
-
288A curated list of awesome PostgreSQL software, libraries, tools and resources, inspired by awesome-mysql+4.0/wkmeasured★ 12.1k25
-
289An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.+3.0/wkmeasured★ 1.6k25
-
290MAC address manufacturer lookup database combining IEEE, Nmap, Wireshark and HDM Mac-Tracker, with downloadable formats and a browser lookup. https://ringmast4r.github.io/OUI-Master-Database/+4.0/wkmeasured★ 14925
-
291AI-native SQL client for humans and agents. Query, explore, visualize, and open agent database work as editable SQL workspaces.+3.0/wkmeasured★ 30925
-
292Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). MIT.+1.0/wkmeasured★ 1.1k25
-
293Ergonomic bindings to duckdb for Rust+1.0/wkmeasured★ 98325
-
294The leader in Customer Data Infrastructure−1.0/wkmeasured★ 7k25
-
295Pivot is a high-performance real time analytics database on open data formats.+3.8/wklifetime avg★ 12825
-
296🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL+1.0/wkmeasured★ 1.2k25
-
297A collection of AI skills for working with Dagster+2.0/wkmeasured★ 21825
-
298The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.flatmeasured★ 2.4k25
-
299Örnek SQL sorguları, T-SQL pratikleri ve Northwind veritabanı çalışmaları.+1.6/daymeasured★ 28424
-
300A fast, minimal, cross-platform database client built with C++ and ImGui+3.0/wkmeasured★ 18624