Trending
LLM & Inference
Models, serving stacks, quantisation and fine-tuning.
Trending
New
Most starred
800 repositories ·
topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
-
101Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.+51/daymeasured★ 2.5k58
-
102A persistent workspace for development work that self-improves and continues beyond one session.+23/daymeasured★ 4.8k58
-
103A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention+44/daymeasured★ 15.5k58
-
104Your AI workspace for models, agents, and productivity.+29/daymeasured★ 53.3k57
-
105A one stop repository for generative AI research updates, interview resources, notebooks and much more!+19/daymeasured★ 30.1k57
-
106Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)+57/daymeasured★ 2.7k57
-
107🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具,覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体(小红书/抖音/微信/飞书/钉钉/Qt 上位机/机械设计)。搭配编排器 agency-orchestrator,一句话即可让多位专家按 DAG 自动协作。+29/daymeasured★ 21.9k57
-
108The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol+25/daymeasured★ 38.5k57
-
109AI Agent 开发指南 | Agent Harness | 上下文工程 | 高级 RAG | MCP | Agentic RL 强化学习 | LangGraph 实战 | 1.2 万+ 大模型面试题 | 算法岗 / 开发岗求职 | 转行大模型+35/daymeasured★ 11.7k56
-
110Coordinate Claude, Codex and Cursor windows with shared tasks, acknowledgements, prechecks, parallel tests, source-bound proofs and independent review. Built-in skills recall lessons, simplify code and forecast work. Track progress, decisions and evidence in a bilingual local dashboard, with MCP plugins. Browse skills and verified security audits.+48/daymeasured★ 1.3k56
-
111零基础入门 AI Agent 的基础教程。不只是教程,也是一个能在本地跑起来的 Agent:读写文件、执行命令、MCP、长期记忆,自带网页端看清每一步。从 100 行最小循环开始,一课加一个能力,最后拆解 Claude Code、Codex 等主流 Agent+61/daymeasured★ 36656
-
112:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.+59/daylifetime avg★ 30656
-
113Hundreds of models & providers. One command to find what runs on your hardware.+28/daymeasured★ 38.7k56
-
114⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅,支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机,也支持接入 MCP 架构,赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。+26/daymeasured★ 63.5k56
-
115High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows+30/daymeasured★ 21.5k56
-
116Find secrets with Gitleaks 🔑+31/daymeasured★ 30.7k56
-
117🛠️ Awesome tools & guides for harness engineering.+18/daymeasured★ 4.6k56
-
118Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code+29/daymeasured★ 18.2k56
-
119Self-hosted metasearch and grounding engine for AI agents, based on SearXNG. Rust, JSON API, optional page text.+45/daylifetime avg★ 83455
-
120Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.+20/daymeasured★ 47.8k55
-
121One shared memory for every coding agent on your team. Claude Code, Cursor and Codex get a map of your code and your team's past decisions, so they pick up where you left off.+30/daymeasured★ 11.1k55
-
122LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.+23/daymeasured★ 50.2k55
-
123Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai+25/daymeasured★ 32.5k55
-
124Sample code and notebooks for Generative AI on Google Cloud, with Gemini platform+3.6/daymeasured★ 17.8k55
-
125An autonomous, context-aware AI desktop companion. Built with Python, featuring real-time screen vision, custom ONNX voice synthesis, active window tracking, and a dynamic floating UI with reactive facial expressions.+110/daymeasured★ 5.2k55
-
126Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk+14/daymeasured★ 6.1k55
-
127Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up|Star if you like it!+24/daymeasured★ 34k55
-
128Mastra is the modern TypeScript framework for AI-powered applications and agents.+24/daymeasured★ 29.3k55
-
129Open Source AI Platform - AI Chat with advanced features that works with every LLM+23/daymeasured★ 33.2k54
-
130The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.+22/daymeasured★ 42.6k54
-
131SGLang is a high-performance serving framework for large language models and multimodal models.+22/daymeasured★ 38.5k54
-
132A straightforward method for training your LLM, from downloading data to generating text.+36/daymeasured★ 13.1k54
-
133Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.+19/daymeasured★ 30.9k54
-
134LLM Frontend for Power Users.+31/daymeasured★ 35.3k54
-
135Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.+33/daymeasured★ 85254
-
136Python scraper based on AI+28/daymeasured★ 32.5k54
-
137Survey companion for Computational Character Modeling: role-playing methods, data foundations, and evaluation, organized by the manuscript.+48/daylifetime avg★ 16554
-
138A lightweight, powerful framework for multi-agent workflows+21/daymeasured★ 30.5k54
-
139Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)+18/daymeasured★ 75.9k53
-
140[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation+19/daymeasured★ 40.5k53
-
141🎭 AI 写小说:从零生成 10-50 章完整中文小说,三层问答 · 创作记忆 · 悬念钩子 · 自动校验,长篇网文连载皆宜|开源免费,适配主流 coding agent|🤝 Infistar.cc 赞助 · 注册送 $5|AI novel writing skill+26/daymeasured★ 4.7k53
-
142A curated list of 120+ LLM libraries category wise.+3.1/daymeasured★ 10.9k53
-
143AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.+14/daymeasured★ 187.9k52
-
144Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.+19/daymeasured★ 32.6k52
-
145📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG+17/daymeasured★ 40k52
-
14650x your usage with cheap-ag. Opus/Astra plans, a dirt-cheap model writes every line, and tests decide what ships. Your $20 plan stops hitting limits. One MCP server for Claude Code & Codex.+37/daylifetime avg★ 27852
-
147🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.+33/daymeasured★ 66752
-
148Threat modeling for AI coding agents: point Claude Code, Codex or any agent at your repo and get an evidence-traced threat model. 36 architectures, 29 methods, MIT.+37/daymeasured★ 36252
-
149AI生成の日本語を自然な日本語へ推敲するAgent Skill / Agent Skill for Refining AI-Generated Japanese into Natural Japanese+24/daymeasured★ 2.9k52
-
150One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.+17/daymeasured★ 13.8k52