Data

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

A serverless cluster computing system for the Go programming language

A hub for various industry-specific schemas to be used with VLMs.

Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.

Universal MCP-Server for your Databases optimized for LLMs and AI-Agents.

Local MCP server for DuckDB and MotherDuck

大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批流,私域营销等模块

Free, open-source SQL Server and Postgres performance monitoring. Collectors, real-time alerts, graphical plan viewer, MCP server for AI analysis. Supports SQL 2016-2025, Azure SQL, AWS RDS, Postgres, Aurora Postgres.

Powerpipe: Dashboards for DevOps. Visualize cloud configurations. Assess security posture against a massive library of benchmarks. Build custom dashboards with code.

A Spark plugin for reading and writing Excel files

Open-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.

A fast, keyboard-first database client built with Rust and GPUI.

ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases

Drop-in replacement for Apache Spark UI

SQLAlchemy driver for DuckDB

Code review for data in dbt

Server application to serve U.S. federal spending data via a RESTful API

Power of appbase.io via CLI, with nifty imports from your favorite data sources

Streaming reactive and dataflow graphs in Python

Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.

Command line SQL interface for relational databases and common data file formats

AI agent tooling for data engineering workflows.

A database client for PostgreSQL, SQLite, Redis, and ClickHouse, built with Tauri, React, and TypeScript.

All-in-one intelligent assistant powered by LlamaIndex — RAG, GraphRAG, NL2SQL, Skills & Memory with multimodal support.

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

Monopoly is a Python library & CLI that converts bank statement PDFs to CSV.

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

🪄 Inline SQL in any Python program

A fast, native, keyboard-driven database client for macOS. 20 databases, an AI assistant that shows its work, free and open source.

DuckDB Foreign Data Wrapper for PostgreSQL

Read and write Google Sheets as pandas DataFrames — column-matched appends, real dtypes, and layout detection for sheets that don't start at A1.

An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.

Flowfile is a visual ETL tool and Python library combining drag-and-drop workflows with Polars dataframes. Build data pipelines visually, define flows programmatically with a Polars-like API, and export to standalone Python code. Perfect for fast, intuitive data processing from development to production.

Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.

🕵️Track prices of the Hetzner dedicated server auction

Builder skills for Convex apps. Convex patterns plus a PRD, task.md, changelog, and files.md workflow for Claude Code, Codex, Cursor, and OpenCode.

Query robotics, drone, and IoT data in plain English through an MCP server, with an intelligent edge data reduction pipeline that keeps only the data that matters.

A drop-in replacement for dplyr, powered by DuckDB for speed.

Code for "Efficient Data Processing in Spark" Course

A dbt adapter for Databricks.

GigAPI is a Timeseries lakehouse for real-time data and sub-second queries, powered by DuckDB OLAP + Parquet Query Engine, Compactor w/ Cloud-Native Storage. Drop-in FDAP alternative ⭐

ORM, but better

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch

loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms

RX encoder, decoder, and CLI data tool

An open source, standard data file format for graph data storage and retrieval.

QuackOSM: an open-source Python and CLI tool for reading OpenStreetMap PBF files using DuckDB

Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!