9.3k repos tracked
updated 2d ago
New

LLM & Inference

Models, serving stacks, quantisation and fine-tuning.

Trending New Most starred 131 repositories · topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
  1. 1
    在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and Kimi K3 among them. Completely free, with no usage cap.
    JavaScript created 44d ago pushed 3d ago ai-agentsdeepseekdeepseek-harness
    +1,667/day
    measured
    ★ 61.8k
    84
  2. 2
    dsh-go — DeepSeek Harness 装进口袋:手机本机运行,也能遥控你的电脑。
    Dart created 14d ago pushed 2d ago ai-agentandroidandroid-app
    +1,544/day
    measured
    ★ 10.8k
    82
  3. 3
    An on-device AI agent for Android that operates apps and the web to get things done for you.
    Kotlin created 9d ago pushed 3d ago accessibilityai-agentandroid
    +1,102/day
    measured
    ★ 6.9k
    81
  4. 4
    🤖 Open-source, local-first alternative to Grok Bot, OpenAI dots and Claude Duet. Your own AI bots on any model: GPT, Claude, Gemini, Grok, DeepSeek, Kimi, GLM and 70+ more through one Modelflare key. Reach them in the app, WeChat or Feishu; they remember you, work in the background, run commands and use your computer. Pay per use.
    Python created 12d ago pushed 2d ago ai-agentai-assistantchatbot
    +296/day
    lifetime avg
    ★ 2.7k
    72
  5. 5
    Experience-Driven Black-Box Cost Control for Coding Agents
    Python created 26d ago pushed 3d ago agentic-aiagentic-codingai-coding
    +206/day
    lifetime avg
    ★ 4.8k
    70
  6. 6
    A self-hosted job search app that writes tailored resumes and cover letters from your profile.
    TypeScript created 35d ago pushed 3d ago caprovercover-letterdocker
    +204/day
    measured
    ★ 4.4k
    70
  7. 7
    一个自己找热点、自己写日报的网站框架。把信源和精选标准换成你的,它就是你的行业热点站。
    TypeScript created 40d ago pushed 2d ago aichinesecontent-curation
    +107/day
    measured
    ★ 9.6k
    67
  8. 8
    Autonomous pentest legion — AI commander + worker swarm + layered fact-intent graph. 3rd Tencent Intelligent Attack-Defense online champion (634 teams · 8h unattended · 1B tokens beat 4.5B). The Nüwa Test: give AIs Create/Language/History, let a civilization grow.
    Python created 8d ago pushed 4d ago ai-agentsautonomous-agentsclaude-code
    +178/day
    measured
    ★ 1.2k
    67
  9. 9
    The lossless, headless coding agent harness. One 7 MB static binary, four tools, plain stdin/stdout, no silent cuts.
    Go created 6d ago pushed 5d ago agent-harnessclicoding-agent
    +159/day
    lifetime avg
    ★ 602
    65
  10. 10
    Answer me with HTML — an agent skill that answers hard questions with a one-page HTML you can actually read. 让 AI Agent 用一页 HTML 回答复杂问题。
    JavaScript created 36d ago pushed 3d ago agent-skillai-agentclaude-code
    +101/day
    measured
    ★ 5.3k
    65
  11. 11
    Autonomous development for real products. Governed agents build from specs you approve, follow the rules you set, and nothing merges until another agent proves it. Your decisions, judgement and taste are the bar that work must clear. Declare your vision and let agents build it.
    JavaScript created 32d ago pushed 10d ago agentic-codingai-agentsai-governance
    +36/day
    measured
    ★ 685
    61
  12. 12
    让 AI 实时看见你的屏幕:按变化量筛选帧、多帧拼进一张图,静止画面几乎不花 token
    JavaScript created 6d ago pushed 2d ago ai-agentdshdsh-plugin
    +93/day
    lifetime avg
    ★ 367
    60
  13. 13
    AI API 中转站评测排行与切换工具:实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
    Rust created 36d ago pushed 6d ago aiapi-relayapi-relay-pricing
    +61/day
    measured
    ★ 4.3k
    60
  14. 14
    免 ROOT 免 Termux,一个 APK 在安卓手机上跑 DeepSeek Harness。引擎内嵌 App 进程 · 读屏操作 App · 改系统设置 · 定时/条件自动化 · 可选 Shizuku
    Kotlin created 11d ago pushed 3d ago ai-agentandroiddeepseek
    +70/day
    measured
    ★ 828
    59
  15. 15
    斯坦福 Stanford CS329Z Engineering AI Agents 中文教程:面向 Python 开发者的 AI 智能体课程,19 讲与 4 项实践,涵盖 LLM、RAG、工具调用、记忆、多智能体、评测与安全。完整 Markdown、在线与离线 HTML。Chinese course notes.
    HTML created 10d ago pushed 7d ago agent-memoryagentic-aiai-agents
    +76/day
    measured
    ★ 497
    58
  16. 16
    Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.
    Swift created 27d ago pushed 2d ago ai-agentairplayautomation
    +49/day
    measured
    ★ 4.4k
    58
  17. 17
    A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.
    Python created 19d ago pushed 7d ago compiled-weightsgated-deltanetinterpretability
    +68/day
    measured
    ★ 666
    58
  18. 18
    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
    Cuda created 32d ago pushed 2d ago cudadeepseekdeepseek-v4
    +51/day
    measured
    ★ 2.5k
    58
  19. 19
    Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)
    Go created 35d ago pushed 25d ago ai-agentautonomous-agentsblue-team
    +57/day
    measured
    ★ 2.7k
    57
  20. 20
    Coordinate Claude, Codex and Cursor windows with shared tasks, acknowledgements, prechecks, parallel tests, source-bound proofs and independent review. Built-in skills recall lessons, simplify code and forecast work. Track progress, decisions and evidence in a bilingual local dashboard, with MCP plugins. Browse skills and verified security audits.
    Python created 41d ago pushed 2d ago agent-orchestrationagent-skillsagentic-coding
    +48/day
    measured
    ★ 1.3k
    56
  21. 21
    零基础入门 AI Agent 的基础教程。不只是教程,也是一个能在本地跑起来的 Agent:读写文件、执行命令、MCP、长期记忆,自带网页端看清每一步。从 100 行最小循环开始,一课加一个能力,最后拆解 Claude Code、Codex 等主流 Agent
    Python created 8d ago pushed 8d ago agentai-agentchinese
    +61/day
    measured
    ★ 366
    56
  22. 22
    :sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.
    Python created 8d ago pushed 3d ago auto-researchbenchmarkdeep-learning
    +59/day
    lifetime avg
    ★ 306
    56
  23. 23
    Self-hosted metasearch and grounding engine for AI agents, based on SearXNG. Rust, JSON API, optional page text.
    Rust created 21d ago pushed 2d ago agplai-agentsgrounding
    +45/day
    lifetime avg
    ★ 834
    55
  24. 24
    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
    C++ created 32d ago pushed 3d ago anthropic-apicudagemma
    +33/day
    measured
    ★ 852
    54
  25. 25
    Survey companion for Computational Character Modeling: role-playing methods, data foundations, and evaluation, organized by the manuscript.
    TeX created 6d ago pushed 6d ago awesome-listcomputational-character-modelinglarge-language-models
    +48/day
    lifetime avg
    ★ 165
    54
  26. 26
    🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
    Rust created 21d ago pushed 7d ago a2aai-gatewayanthropic
    +33/day
    measured
    ★ 667
    52
  27. 27
    50x your usage with cheap-ag. Opus/Astra plans, a dirt-cheap model writes every line, and tests decide what ships. Your $20 plan stops hitting limits. One MCP server for Claude Code & Codex.
    TypeScript created 10d ago pushed 4d ago agentic-codingai-agentsanthropic
    +37/day
    lifetime avg
    ★ 278
    52
  28. 28
    Threat modeling for AI coding agents: point Claude Code, Codex or any agent at your repo and get an evidence-traced threat model. 36 architectures, 29 methods, MIT.
    created 10d ago pushed 9d ago ai-agentsappsecclaude-code
    +37/day
    measured
    ★ 362
    52
  29. 29
    AI生成の日本語を自然な日本語へ推敲するAgent Skill / Agent Skill for Refining AI-Generated Japanese into Natural Japanese
    Python created 38d ago pushed 3d ago agent-skillsai-writingantigravity
    +24/day
    measured
    ★ 2.9k
    52
  30. 30
    Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
    Rust created 44d ago pushed 3d ago ai-agentsai-gatewayai-proxy
    +26/day
    measured
    ★ 566
    50
  31. 31
    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
    C++ created 16d ago pushed 2d ago apple-siliconcudagguf
    +23/day
    lifetime avg
    ★ 319
    49
  32. 32
    AI 跨境电商运营智能体工具箱 · 把运营 SOP 拆成 7 个可复用的 AI Agent 工作流,含 Prompt、模板与真实案例
    Python created 25d ago pushed 21d ago ai-agentscross-border-ecommerceecommerce
    +23/day
    measured
    ★ 972
    48
  33. 33
    Find the cheapest API for any model and connect it from your AI agent: Grandet Skill and an anonymous MCP server, backed by listed prices from 1,800+ official, inference and relay providers on grandet.ai.
    JavaScript created 34d ago pushed 11d ago agent-skillsaiai-agents
    +20/day
    measured
    ★ 1.1k
    48
  34. 34
    Fold papers, web pages, files, and AI replies into five levels of detail. Zoom from an overview to the original text.
    Python created 34d ago pushed 3d ago arxivllmlocal-first
    +18/day
    measured
    ★ 922
    48
  35. 35
    Official Inference Code of EAGLE-4
    Python created 18d ago pushed 7d ago eaglegpullm-inference
    +18/day
    measured
    ★ 1.2k
    48
  36. 36
    A 2007 Nokia can't search Google anymore, so I gave it Claude, ChatGPT, Gemini and Grok. J2ME app for Nokia S40/S60 + tiny Go server.
    Java created 43d ago pushed 34d ago ai-chatchatbotclaude
    +3.4/day
    measured
    ★ 387
    47
  37. 37
    An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.
    TypeScript created 24d ago pushed 8d ago ai-agentai-assistantchatgpt-alternative
    +18/day
    measured
    ★ 478
    47
  38. 38
    Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
    Python created 25d ago pushed 12d ago calibrationcudacuda-graphs
    +20/day
    measured
    ★ 292
    47
  39. 39
    Official Code for OpenVLHarness: Real-World Visual Agentic Tool‑Use with Multimodal Memory
    Python created 24d ago pushed 9d ago agent-harnessagent-skillsagentic-ai
    +18/day
    lifetime avg
    ★ 385
    46
  40. 40
    new-api / sub2api 中转站账号管理中心:余额、API Key、用量、倍率、模型比价 | https://nvcenter.cc
    TypeScript created 15d ago pushed 14d ago api-key-managementapi-relayclaude
    +20/day
    lifetime avg
    ★ 253
    46
  41. 41
    Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
    Python created 42d ago pushed 2d ago agent-securityai-agentsai-safety
    +15/day
    measured
    ★ 458
    46
  42. 42
    A self-evolving agentic OS. A new architecture for agent execution, built on operating-system principles, with the harness as a path toward superintelligence.
    Rust created 30d ago pushed 3d ago agent-frameworkagentic-osai-agents
    +14/day
    measured
    ★ 706
    46
  43. 43
    UI for AI agents. React components for what agents do – agent trees, tool calls, traces, handoffs and approvals – and for the rest of your app. One file each, install with shadcn or via MCP. Free and open source.
    TypeScript created 35d ago pushed 3d ago agent-uiaiai-agents
    +13/day
    measured
    ★ 469
    45
  44. 44
    AI 编程福利导航:汇总 Claude Code、Codex、Cursor 中转站与公益站,整理免费额度、注册福利、签到活动和评测记录,提供可视化看板与 Python 数据采集工具。
    HTML created 23d ago pushed 3d ago ai-codingapi-relayclaude-code
    +12/day
    measured
    ★ 608
    45
  45. 45
    Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
    Rust created 18d ago pushed 3d ago ai-agentsbrowser-automationcrawl4ai-alternative
    +14/day
    measured
    ★ 227
    44
  46. 46
    和《偶像大师 闪耀色彩》偶像实时语音/文字对话的 AI 分身:日语原声 + 中文字幕、回忆原作剧情、跨角色共享记忆;支持 Google/GitHub 登录与自带密钥,Docker Compose 一键部署(参考 LAPLACE Eidolon)
    Python created 43d ago pushed 3d ago ai-companioncharacter-aidocker-compose
    +12/day
    measured
    ★ 394
    44
  47. 47
    AI coding agent that makes a small model beat a frontier one
    Go created 33d ago pushed 2d ago agentic-workflowsai-agentcoding-agent
    +12/day
    lifetime avg
    ★ 367
    44
  48. 48
    在 Android 手机上本地部署和管理 AstrBot 与 NapCat,内置 PRoot Ubuntu 运行环境,支持原生管理界面、WebUI、日志、备份恢复和独立更新,无需 Root。
    Kotlin created 13d ago pushed 5d ago aiandroidastrbot
    +12/day
    measured
    ★ 331
    43
  49. 49
    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
    C++ created 37d ago pushed 5d ago homebrewllama-cppllm
    +10/day
    measured
    ★ 810
    43
  50. 50
    ☤ The official plugins for Hermes Agent, built and maintained by Nous Research: Home Assistant, Spotify, Claude Subscription DirectSDK and more, one install away from the Hermes plugin catalog.
    Python created 28d ago pushed 4d ago agent-pluginsai-agentsclaude
    +11/day
    measured
    ★ 601
    43
page 1 of 3 next →