LLM & Inference

LlamaIndex is the document processing platform for AI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

【AI 时代的业务系统基座】企业级 AI 低代码平台：权限、多租户、工作流、报表、大屏、AI 知识库等通用能力开箱即用，AI 只需生成业务差异部分。AI Skills 一句话生成完整系统——建表、前后端代码、菜单权限、BPM 流程、表单、报表、大屏全自动。内置 AI 应用平台（聊天、知识库、流程编排、MCP），兼容主流大模型。Java + Vue3，支持单体/微服务与信创国产化。

Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.

A community-supported supercharged document management system: scan, index and archive all your documents

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Build resilient agents.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.

AirLLM 2.8T LLM inference with single 4GB GPU

An AI prompt optimizer for writing better prompts and getting better AI results.

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

A generative speech model for daily dialogue.

An open-source engine that turns continuous content streams into search and monitoring. Durable ingestion, hybrid search, alerts, and plugins for formats, models and business rules.

Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Hundreds of models & providers. One command to find what runs on your hardware.

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

SGLang is a high-performance serving framework for large language models and multimodal models.

Vane is an AI-powered answering engine.

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

⌥ Coding agent with the IDE wired in. Built by Stencil Labs.

"Vibe-Trading: Your Personal Trading Agent"

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.

Draw and edit draw.io diagrams by chatting with an AI. Web app, desktop app, and an MCP server for Claude Code, Cursor, Codex and VS Code.

A modular graph-based Retrieval-Augmented Generation (RAG) system

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

A reliable coding agent for complex software engineering tasks.

817 structured cybersecurity skills for AI agents · Mapped to 6 frameworks: MITRE ATT&CK, NIST CSF 2.0, MITRE ATLAS, D3FEND, NIST AI RMF & MITRE F3 (Fight Fraud) · agentskills.io standard · Works with Claude Code, GitHub Copilot, Codex CLI, Cursor, Gemini CLI & 20+ platforms · 29 security domains · Apache 2.0

Build and run agents you can see, understand and trust.

LLM Frontend for Power Users.

📚 从零开始构建大模型

Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up｜Star if you like it!

Community plugin to control Blender 3D with any LLM of your choice. Not affiliated with the official Blender Foundation.

Open Source AI Platform - AI Chat with advanced features that works with every LLM

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.

Python scraper based on AI

Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

Find secrets with Gitleaks 🔑

A lightweight, powerful framework for multi-agent workflows

TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets (Chat Memory, Skill, LLM-Wiki, Code-Graph) that are governed, shared, and equipped across agents and frameworks.