Data

Production Data Engineering Cloud Architecture Workflow Automation Portfolio 2026

Bindings for H3 to DuckDB

A curated list with resources about node-based UIs

Local-first Apple Health MCP server. Lets AI assistants answer questions about your sleep, workouts, activity and heart data from a local export.

数据流引擎是一款面向数据集成、数据同步、数据交换、数据共享、任务配置、任务调度的底层数据驱动引擎。数据流引擎采用管执分离、多流层、插件库等体系应对大规模数据任务、数据高频上报、数据高频采集、异构数据兼容的实际数据问题。

visual data prep powered by python

Backend Engineering, Low-Level Design, System Design, Networking, Security, SQL, and Distributed Systems explained through visual diagrams.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

the DATABASE Editor. https://discord.gg/cEe8v2Y7PJ

Open Source FiveM vMenu Translation Hub 2026: Community Language Packs for Cfx.re Servers

Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!

AI Virtual Personal Trainer Python App 2026: Motion Rep Counting and Voice Workout Coach

A Redis-compatable key-value store. Up to 10x faster. Native vector support.

Command line SQL interface for relational databases and common data file formats

RX encoder, decoder, and CLI data tool

An AI-native multi-model database unifying SQL, vector, full-text, graph, and sandboxed Python — for transactional, analytical, and agent workloads.

Builder skills for Convex apps. Convex patterns plus a PRD, task.md, changelog, and files.md workflow for Claude Code, Codex, Cursor, and OpenCode.

A curated list of awesome ETL frameworks, libraries, and software.

Unified MySQL, Postgres & FlightSQL Server, Powered by DuckDB.

A list of learning materials to understand databases internals

sqlite3 viewer

📙 Awesome Data Catalogs and Observability Platforms.

A PostgreSQL proxy that keeps each user's data in their own region. Shards by a key you name, splits reads from writes, pools connections, and moves a key between regions while the application keeps reading and writing. No driver to install.

Your coding agent starts every session blank. Rekal is the memory your team is missing

ANTLR-based PostgreSQL query parser for Go. Extracts tables, columns, joins, CTEs, parameters, DDL actions, and full column-usage metadata from SQL into a structured IR.

end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck

A simplified, lightweight ETL Framework based on Apache Spark

WhatTheDuck is an open-source web application built on DuckDB. It allows users to upload CSV and Parquet files, store them in tables, and perform SQL queries on the data.

The smallest backend framework and among the top three in the world.

DataKit is a browser-based data analysis platform that processes multi-gigabyte files locally. All processing happens in your browser - no data is sent to external servers.

DuckLake took Flight. Welcome to SwanLake.

Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.

A truly Open Source MongoDB alternative

A fast, simple, and embedded key-value store for Rust.

End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.

Read and write Google Sheets as pandas DataFrames — column-matched appends, real dtypes, and layout detection for sheets that don't start at A1.

A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.

A lightweight schema-on-read analytics in a single binary

🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.

Yet another redundant workflow engine

Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.

Type-safe SQL query builder. Zero dependencies, AST-first, hookable, tree-shakeable. Pure TypeScript.

The premier open source Data Quality solution

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

The Boring query platform - Connect and query anything

Feathr – A scalable, unified data and AI engineering platform for enterprise

Apache Phoenix Adapters

ER diagram generator. Paste CREATE TABLE statements and get a clean, interactive ERD — runs 100% in your browser, nothing uploaded

:bar_chart: :clipboard: Dashboards using YAML or JSON files

Scan-to-Practice: a field-tested AI skill and methodology for turning scanned learning materials into structured practice products.