9.3k repos tracked
updated 2d ago
Trending

LLM & Inference

Models, serving stacks, quantisation and fine-tuning.

Trending New Most starred 800 repositories · topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
  1. 101
    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
    Cuda created 32d ago pushed 2d ago cudadeepseekdeepseek-v4
    +51/day
    measured
    ★ 2.5k
    58
  2. 102
    A persistent workspace for development work that self-improves and continues beyond one session.
    Python created 3mo ago pushed 2d ago agentagentic-aiagents
    +23/day
    measured
    ★ 4.8k
    58
  3. 103
    A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention
    created 8mo ago pushed 16d ago claude-aiclaude-skillsllm
    +44/day
    measured
    ★ 15.5k
    58
  4. 104
    Your AI workspace for models, agents, and productivity.
    TypeScript created 2y ago pushed 2d ago agent-skillsagent-workspaceagentic-workspace
    +29/day
    measured
    ★ 53.3k
    57
  5. 105
    A one stop repository for generative AI research updates, interview resources, notebooks and much more!
    HTML created 2y ago pushed 5d ago awesomeawesome-listgenerative-ai
    +19/day
    measured
    ★ 30.1k
    57
  6. 106
    Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)
    Go created 35d ago pushed 25d ago ai-agentautonomous-agentsblue-team
    +57/day
    measured
    ★ 2.7k
    57
  7. 107
    🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具,覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体(小红书/抖音/微信/飞书/钉钉/Qt 上位机/机械设计)。搭配编排器 agency-orchestrator,一句话即可让多位专家按 DAG 自动协作。
    Shell created 8mo ago pushed 4d ago agency-orchestratoragent-definitionsai-agents
    +29/day
    measured
    ★ 21.9k
    57
  8. 108
    The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol
    TypeScript created 3y ago pushed 2d ago agentagent-nativeagentic-ai
    +25/day
    measured
    ★ 38.5k
    57
  9. 109
    AI Agent 开发指南 | Agent Harness | 上下文工程 | 高级 RAG | MCP | Agentic RL 强化学习 | LangGraph 实战 | 1.2 万+ 大模型面试题 | 算法岗 / 开发岗求职 | 转行大模型
    MDX created 12mo ago pushed 2d ago agentic-rlagenticragai-agent
    +35/day
    measured
    ★ 11.7k
    56
  10. 110
    Coordinate Claude, Codex and Cursor windows with shared tasks, acknowledgements, prechecks, parallel tests, source-bound proofs and independent review. Built-in skills recall lessons, simplify code and forecast work. Track progress, decisions and evidence in a bilingual local dashboard, with MCP plugins. Browse skills and verified security audits.
    Python created 41d ago pushed 2d ago agent-orchestrationagent-skillsagentic-coding
    +48/day
    measured
    ★ 1.3k
    56
  11. 111
    零基础入门 AI Agent 的基础教程。不只是教程,也是一个能在本地跑起来的 Agent:读写文件、执行命令、MCP、长期记忆,自带网页端看清每一步。从 100 行最小循环开始,一课加一个能力,最后拆解 Claude Code、Codex 等主流 Agent
    Python created 8d ago pushed 8d ago agentai-agentchinese
    +61/day
    measured
    ★ 366
    56
  12. 112
    :sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.
    Python created 8d ago pushed 3d ago auto-researchbenchmarkdeep-learning
    +59/day
    lifetime avg
    ★ 306
    56
  13. 113
    Hundreds of models & providers. One command to find what runs on your hardware.
    Rust created 8mo ago pushed 4d ago ggufllmlocalai
    +28/day
    measured
    ★ 38.7k
    56
  14. 114
    ⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅,支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机,也支持接入 MCP 架构,赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。
    Python created 18mo ago pushed 3d ago aibarkdata-analysis
    +26/day
    measured
    ★ 63.5k
    56
  15. 115
    High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
    Rust created 10mo ago pushed 2d ago aiai-agentai-coding-agent
    +30/day
    measured
    ★ 21.5k
    56
  16. 116
    Find secrets with Gitleaks 🔑
    Go created 8y ago pushed 11d ago ai-poweredci-cdcicd
    +31/day
    measured
    ★ 30.7k
    56
  17. 117
    🛠️ Awesome tools & guides for harness engineering.
    created 7mo ago pushed 2mo ago agemtagenticagentic-ai
    +18/day
    measured
    ★ 4.6k
    56
  18. 118
    Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
    TypeScript created 4mo ago pushed 3d ago ai-gatewayai-toolsanthropic
    +29/day
    measured
    ★ 18.2k
    56
  19. 119
    Self-hosted metasearch and grounding engine for AI agents, based on SearXNG. Rust, JSON API, optional page text.
    Rust created 21d ago pushed 2d ago agplai-agentsgrounding
    +45/day
    lifetime avg
    ★ 834
    55
  20. 120
    Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.
    Python created 4y ago pushed 2d ago aiai-agentai-agents
    +20/day
    measured
    ★ 47.8k
    55
  21. 121
    One shared memory for every coding agent on your team. Claude Code, Cursor and Codex get a map of your code and your team's past decisions, so they pick up where you left off.
    TypeScript created 4mo ago pushed 2d ago ai-agentsanthropicclaude-code
    +30/day
    measured
    ★ 11.1k
    55
  22. 122
    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
    Go created 3y ago pushed 2d ago agentsaiapi
    +23/day
    measured
    ★ 50.2k
    55
  23. 123
    Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
    Rust created 22mo ago pushed 2d ago aiai-meeting-assistantllm
    +25/day
    measured
    ★ 32.5k
    55
  24. 124
    Sample code and notebooks for Generative AI on Google Cloud, with Gemini platform
    Jupyter Notebook created 3y ago pushed 4d ago agentsgcpgemini
    +3.6/day
    measured
    ★ 17.8k
    55
  25. 125
    An autonomous, context-aware AI desktop companion. Built with Python, featuring real-time screen vision, custom ONNX voice synthesis, active window tracking, and a dynamic floating UI with reactive facial expressions.
    Python created 6mo ago pushed 4mo ago aiai-agentai-companion
    +110/day
    measured
    ★ 5.2k
    55
  26. 126
    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
    C++ created 18mo ago pushed 2d ago aiamdgenai
    +14/day
    measured
    ★ 6.1k
    55
  27. 127
    Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up|Star if you like it!
    TypeScript created 15mo ago pushed 3d ago acpagent-teamai
    +24/day
    measured
    ★ 34k
    55
  28. 128
    Mastra is the modern TypeScript framework for AI-powered applications and agents.
    TypeScript created 2y ago pushed 2d ago agentsaichatbots
    +24/day
    measured
    ★ 29.3k
    55
  29. 129
    Open Source AI Platform - AI Chat with advanced features that works with every LLM
    Python created 3y ago pushed 2d ago aiai-chatchatgpt
    +23/day
    measured
    ★ 33.2k
    54
  30. 130
    The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.
    Rust created 8mo ago pushed 2d ago agent-orchestrationai-agentsai-assistant
    +22/day
    measured
    ★ 42.6k
    54
  31. 131
    SGLang is a high-performance serving framework for large language models and multimodal models.
    Python created 2y ago pushed 2d ago attentionblackwellcuda
    +22/day
    measured
    ★ 38.5k
    54
  32. 132
    A straightforward method for training your LLM, from downloading data to generating text.
    Python created 22mo ago pushed 36d ago geminilarge-language-modelsllm
    +36/day
    measured
    ★ 13.1k
    54
  33. 133
    Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
    TypeScript created 2y ago pushed 2d ago agentic-aiagentsai
    +19/day
    measured
    ★ 30.9k
    54
  34. 134
    LLM Frontend for Power Users.
    JavaScript created 3y ago pushed 36d ago aichatllm
    +31/day
    measured
    ★ 35.3k
    54
  35. 135
    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
    C++ created 32d ago pushed 3d ago anthropic-apicudagemma
    +33/day
    measured
    ★ 852
    54
  36. 136
    Python scraper based on AI
    Python created 2y ago pushed 33d ago ai-crawlerai-scrapingai-search
    +28/day
    measured
    ★ 32.5k
    54
  37. 137
    Survey companion for Computational Character Modeling: role-playing methods, data foundations, and evaluation, organized by the manuscript.
    TeX created 6d ago pushed 6d ago awesome-listcomputational-character-modelinglarge-language-models
    +48/day
    lifetime avg
    ★ 165
    54
  38. 138
    A lightweight, powerful framework for multi-agent workflows
    Python created 20mo ago pushed 2d ago agentsaiframework
    +21/day
    measured
    ★ 30.5k
    54
  39. 139
    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
    Python created 3y ago pushed 3d ago agentaideepseek
    +18/day
    measured
    ★ 75.9k
    53
  40. 140
    [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation
    Python created 2y ago pushed 4d ago doclinggenaigpt
    +19/day
    measured
    ★ 40.5k
    53
  41. 141
    🎭 AI 写小说:从零生成 10-50 章完整中文小说,三层问答 · 创作记忆 · 悬念钩子 · 自动校验,长篇网文连载皆宜|开源免费,适配主流 coding agent|🤝 Infistar.cc 赞助 · 注册送 $5|AI novel writing skill
    JavaScript created 9mo ago pushed 6d ago agentai-fictionai-novel
    +26/day
    measured
    ★ 4.7k
    53
  42. 142
    A curated list of 120+ LLM libraries category wise.
    created 20mo ago pushed 14d ago ai-engineergenerative-ailarge-language-models
    +3.1/day
    measured
    ★ 10.9k
    53
  43. 143
    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
    Python created 3y ago pushed 2d ago agentic-aiagentsai
    +14/day
    measured
    ★ 187.9k
    52
  44. 144
    Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
    Python created 8mo ago pushed 9d ago ai-codingclaudeclaude-code
    +19/day
    measured
    ★ 32.6k
    52
  45. 145
    📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
    Python created 19mo ago pushed 2d ago agentic-aiagentsai
    +17/day
    measured
    ★ 40k
    52
  46. 146
    50x your usage with cheap-ag. Opus/Astra plans, a dirt-cheap model writes every line, and tests decide what ships. Your $20 plan stops hitting limits. One MCP server for Claude Code & Codex.
    TypeScript created 10d ago pushed 4d ago agentic-codingai-agentsanthropic
    +37/day
    lifetime avg
    ★ 278
    52
  47. 147
    🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
    Rust created 21d ago pushed 7d ago a2aai-gatewayanthropic
    +33/day
    measured
    ★ 667
    52
  48. 148
    Threat modeling for AI coding agents: point Claude Code, Codex or any agent at your repo and get an evidence-traced threat model. 36 architectures, 29 methods, MIT.
    created 10d ago pushed 9d ago ai-agentsappsecclaude-code
    +37/day
    measured
    ★ 362
    52
  49. 149
    AI生成の日本語を自然な日本語へ推敲するAgent Skill / Agent Skill for Refining AI-Generated Japanese into Natural Japanese
    Python created 38d ago pushed 3d ago agent-skillsai-writingantigravity
    +24/day
    measured
    ★ 2.9k
    52
  50. 150
    One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.
    Python created 12mo ago pushed 2d ago agent-memoryagentic-aiai
    +17/day
    measured
    ★ 13.8k
    52
← previous page 3 of 16 next →