Data

Learn how to develop, deploy and iterate on production-grade ML applications.

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Open-source research workspace for connecting sources, evidence, notes and ideas. Built for academic research with Zotero integration. Available on MacOS, Windows and Linux.

六十七门真实网课的模块合辑全书 + 思维导图复习笔记 + 逐字稿，全部由 Video2Book 从课程音频重构：683 册模块全书、921 篇复习笔记、3,522 份逐字稿，从逐讲精读到考前速查，笔记支持 Markmap / XMind 脑图导入，可按课点播定制。

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

Self-hosted tabular ML that doesn't lie. Leakage Guard, conformal intervals, profit-optimized thresholds, counterfactuals & instant REST/MCP API.

Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.

Incremental engine for long horizon agents 🌟 Star if you like it!

《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

Search infrastructure for AI

.NET aot orm, VB.NET/C# orm, Mysql/PostgreSQL/SqlServer/Oracle orm, Sqlite/Firebird/Clickhouse/DuckDB orm, 达梦/金仓/虚谷/翰高/高斯 orm, 神通 orm, 南大通用 orm, 国产 orm, TDengine orm, QuestDB orm, MsAccess orm.

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

A scalable, distributed, collaborative, document-graph database, for the realtime web

Pluggable data replication with checkpointing, batching, and integrity events

Grist is the evolution of spreadsheets.

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.

An open-source engine that turns continuous content streams into search and monitoring. Durable ingestion, hybrid search, alerts, and plugins for formats, models and business rules.

Monopoly is a Python library & CLI that converts bank statement PDFs to CSV.

A user friendly TUI for SQL databases. Written in python. Supports SQL server, Mysql, PostreSQL, SQLite, Turso and more.

Python SQL Parser and Transpiler

QuestDB is a high performance, open-source, time-series database

开源中国股市（A股）本地数据湖：沪深股票行情、A股股票数据与金融数据，面向量化研究、量化交易与回测，含财务数据、期货数据、资金流向、公告、指数行业与宏观。55 个日更数据集，复权与历史成分内置，行级溯源、PIT，MCP 原生。免注册、免 Token，自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.

A lightweight embedded database engine that natively fuses vector search, graph, and document-oriented metadata within a single storage kernel — ready to use the moment data is written.

dbt adapter for DuckDB

Embeddable Postgres with real-time, reactive bindings.

A time-series database for high-performance real-time analytics packaged as a Postgres extension

Compile Time Async Dynamic SQL ORM

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Infrastructure orchestration from local to your cloud

Fast and lightweight DB Client made in Rust and GPUI.

A Postgres Compatible Database for Heavy, Multi-Tenant Workloads

An extensible framework for linking databases and interactive views.

👩‍💻👨‍💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

qStudio - Free SQL Analysis Tool

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

看海量化回测平台 khQuant 开源版 V2.2：免费开源的 A 股量化回测桌面软件。不用开户、不用装 QMT，BaoStock / Tushare 下载数据到本地 DuckDB，Python 写策略，一键出回测报告。

Distributed PostgreSQL as an extension

A high-performance observability data pipeline.

NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB

Apache Doris is a real-time analytics and hybrid search database for AI agents.

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Declarative YAML around SQL for dbt-native dashboards: easy for agents to write, easy for humans to audit.

AliSQL is a MySQL branch originated from Alibaba Group. Fetch document from Release Notes at bottom.

Free and open source database client built natively for developers

An orchestration platform for the development, production, and observation of data assets.

A type-safe TypeScript SQL query builder