9.3k repos tracked
updated 2d ago
Most starred

LLM & Inference

Models, serving stacks, quantisation and fine-tuning.

Trending New Most starred 883 repositories · topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
  1. 1
    Reverse engineer anything with agents, from app behavior down to native binaries.
    TypeScript created 6mo ago pushed 2d ago agent-skillsaiandroid
    +3,943/day
    measured
    ★ 432.8k
    85
  2. 2
    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
    JavaScript created 9mo ago pushed 6d ago ai-agentsanthropicclaude
    +768/day
    measured
    ★ 297.5k
    85
  3. 3
    The agent that grows with you
    Python created 15mo ago pushed 2d ago aiai-agentai-agents
    +342/day
    measured
    ★ 260.7k
    80
  4. 4
    Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
    TypeScript created 2y ago pushed 2d ago aiai-agentsai-crawler
    +320/day
    measured
    ★ 198.8k
    78
  5. 5
    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
    Python created 3y ago pushed 2d ago agentic-aiagentsai
    +14/day
    measured
    ★ 187.9k
    52
  6. 6
    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
    Go created 3y ago pushed 3d ago deepseekgemmaglm
    +113/day
    measured
    ★ 186k
    69
  7. 7
    Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
    JavaScript created 4mo ago pushed 9d ago agent-skillsai-agentsclaude
    +749/day
    measured
    ★ 184.9k
    84
  8. 8
    f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
    MDX created 3y ago pushed 3d ago aiartificial-intelligenceawesome-list
    +121/day
    measured
    ★ 175.9k
    70
  9. 9
    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
    Python created 8y ago pushed 2d ago audiodeep-learningdeepseek
    +34/day
    measured
    ★ 168.6k
    59
  10. 10
    Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
    Python created 3y ago pushed 2d ago agentagentic-aiagentic-framework
    +81/day
    measured
    ★ 160.5k
    67
  11. 11
    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
    Svelte created 3y ago pushed 2d ago aillmllm-ui
    +101/day
    measured
    ★ 157.8k
    68
  12. 12
    Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
    Python created 3y ago pushed 3d ago agentschatgptgenerative-ai
    +31/day
    measured
    ★ 156.4k
    59
  13. 13
    The agent engineering platform.
    Python created 4y ago pushed 2d ago agentsaiai-agents
    +57/day
    measured
    ★ 149.1k
    64
  14. 14
    Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.
    Python created 7mo ago pushed 4d ago ai-agentsantigravityast
    +642/day
    measured
    ★ 142.7k
    84
  15. 15
    利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
    Python created 2y ago pushed 2d ago ai-video-generatorcontent-creationffmpeg
    +474/day
    measured
    ★ 139.5k
    85
  16. 16
    TradingAgents: Multi-Agents LLM Financial Trading Framework
    Python created 22mo ago pushed 3d ago agentfinancellm
    +376/day
    measured
    ★ 120.7k
    79
  17. 17
    Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
    Python created 2y ago pushed 2d ago ai-agentsai-toolsbrowser-agent
    +92/day
    measured
    ★ 120.1k
    67
  18. 18
    🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.
    Go created 7mo ago pushed 3d ago aianthropiccaveman
    +245/day
    measured
    ★ 117.6k
    75
  19. 19
    The open-source app everyone uses to manage agents at work
    TypeScript created 8mo ago pushed 2d ago acpxagent-orchestrationagent-skills
    +404/day
    measured
    ★ 111.3k
    79
  20. 20
    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
    Jupyter Notebook created 3y ago pushed 3d ago aiartificial-intelligenceattention-mechanism
    +53/day
    measured
    ★ 107.9k
    63
  21. 21
    A high-throughput and memory-efficient inference and serving engine for LLMs
    Python created 3y ago pushed 2d ago amdblackwellcuda
    +78/day
    measured
    ★ 96.4k
    66
  22. 22
    Turn any idea, plan, or codebase into a beautiful interactive diagram. An agent skill for Claude Code, Codex, and more.
    JavaScript created 6mo ago pushed 3d ago agent-skillsai-agentsarchitecture-diagram
    +352/day
    measured
    ★ 93.7k
    78
  23. 23
    🙌 OpenHands: AI-Driven Development
    TypeScript created 2y ago pushed 2d ago agentartificial-intelligencechatgpt
    +76/day
    measured
    ★ 92.7k
    65
  24. 24
    Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
    Python created 2y ago pushed 3d ago aiai-agentscrawl4ai-cloud
    +62/day
    measured
    ★ 86.9k
    64
  25. 25
    📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程
    Python created 14mo ago pushed 25d ago agentllmrag
    +126/day
    measured
    ★ 86.1k
    68
  26. 26
    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
    Rust created 9mo ago pushed 2d ago agentic-codingai-codinganthropic
    +96/day
    measured
    ★ 85.6k
    67
  27. 27
    An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
    Python created 18mo ago pushed 3d ago agentagenticagentic-framework
    +55/day
    measured
    ★ 85k
    64
  28. 28
    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
    created 3y ago pushed 9mo ago courselarge-language-modelsllm
    +24/day
    measured
    ★ 84.9k
    41
  29. 29
    Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1
    Python created 16mo ago pushed 12d ago agentagent-developmentai-agent
    +62/day
    measured
    ★ 79.9k
    63
  30. 30
    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
    Python created 2y ago pushed 2d ago agentaichatgpt
    +47/day
    measured
    ★ 79.1k
    61
  31. 31
    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
    Python created 10mo ago pushed 2d ago agentaianthropic
    +98/day
    measured
    ★ 78.9k
    67
  32. 32
    GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
    C++ created 3y ago pushed 17mo ago ai-chatllm-inference
    −1.6/day
    measured
    ★ 77.3k
    14
  33. 33
    Learn AI Engineering! Learn it. Build it. Ship it for others.
    Python created 7mo ago pushed 4d ago agentsaiai-agents
    +212/day
    measured
    ★ 76.9k
    74
  34. 34
    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
    Python created 3y ago pushed 3d ago agentaideepseek
    +18/day
    measured
    ★ 75.9k
    53
  35. 35
    为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。
    Python created 3y ago pushed 9mo ago academicchatglm-6bchatgpt
    +5.3/day
    measured
    ★ 71.6k
    29
  36. 36
    🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
    Python created 3y ago pushed 9mo ago agentgptllm
    +15/day
    measured
    ★ 71.2k
    38
  37. 37
    Documented system prompts from Anthropic - Claude Fable 5.1, Opus 5.5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Google - Gemini 3.8 Flash, 3.1 Pro, Antigravity. xAI - Grok, Grok Bot, Cursor, Kimi and more! Updated regularly.
    Python created 18mo ago pushed 3d ago aiai-agentsai-prompts
    +61/day
    measured
    ★ 70.8k
    65
  38. 38
    The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.
    Python created 3y ago pushed 3d ago agentic-memoryagentic-memory-systemagents
    +59/day
    measured
    ★ 68.5k
    63
  39. 39
    Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
    JavaScript created 3y ago pushed 3d ago agent-computeragent-harnessagent-orchestration
    +39/day
    measured
    ★ 68k
    60
  40. 40
    LLM 驱动的多市场股票智能分析系统:多源行情、实时新闻、决策看板与自动推送,支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs.
    Python created 10mo ago pushed 4d ago a-stockai-agentaigc
    +49/day
    measured
    ★ 67.6k
    61
  41. 41
    Agent skill that removes signs of AI-generated writing from text
    Python created 9mo ago pushed 11d ago agent-skillsai-humanizerai-writing
    +418/day
    measured
    ★ 65.1k
    80
  42. 42
    Context7 Platform -- Up-to-date docs for AI agents
    TypeScript created 19mo ago pushed 2d ago llmmcpmcp-server
    +49/day
    measured
    ★ 64.2k
    61
  43. 43
    ⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅,支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机,也支持接入 MCP 架构,赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。
    Python created 18mo ago pushed 3d ago aibarkdata-analysis
    +26/day
    measured
    ★ 63.5k
    56
  44. 44
    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
    Python created 3y ago pushed 2d ago ai-gatewayanthropicazure-openai
    +66/day
    measured
    ★ 62.8k
    64
  45. 45
    在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and Kimi K3 among them. Completely free, with no usage cap.
    JavaScript created 44d ago pushed 3d ago ai-agentsdeepseekdeepseek-harness
    +1,667/day
    measured
    ★ 61.8k
    84
  46. 46
    The best-benchmarked open-source AI memory system. And it's free.
    Python created 7mo ago pushed 3d ago aichromadbllm
    +87/day
    measured
    ★ 60.4k
    81
  47. 47
    A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.
    Python created 3y ago pushed 5d ago chromadbdocument-qadocument-search
    −4.3/day
    measured
    ★ 58.7k
    29
  48. 48
    A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team at Anthropic PBC (no affiliation). A delectable showcase of top tier skills, ambidextrous agents, scintillating status lines, top notch developer tooling, and also we have plugins
    Python created 18mo ago pushed 2d ago agent-skillsagentic-codeagentic-coding
    +70/day
    measured
    ★ 57.3k
    64
  49. 49
    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
    Python created 14mo ago pushed 30d ago agentagent-memoryai-agent
    +106/day
    measured
    ★ 57.2k
    65
  50. 50
    Your AI workspace for models, agents, and productivity.
    TypeScript created 2y ago pushed 2d ago agent-skillsagent-workspaceagentic-workspace
    +29/day
    measured
    ★ 53.3k
    57
page 1 of 18 next →