9.3k repos tracked
updated 2d ago
Trending

LLM & Inference

Models, serving stacks, quantisation and fine-tuning.

Trending New Most starred 800 repositories · topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
  1. 1
    Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
    Python created 13mo ago pushed 2d ago abliterationanti-censorshipanticensorship
    +346/day
    measured
    ★ 39.5k
    89
  2. 2
    📡 Your own AI-powered news radar. Generates daily briefings in English & Chinese. | 用 AI 构建你专属的新闻雷达
    Python created 8mo ago pushed 4d ago aggregatorfeishu-botllm
    +252/day
    measured
    ★ 12.8k
    88
  3. 3
    Reverse engineer anything with agents, from app behavior down to native binaries.
    TypeScript created 6mo ago pushed 2d ago agent-skillsaiandroid
    +3,943/day
    measured
    ★ 432.8k
    85
  4. 4
    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
    JavaScript created 9mo ago pushed 6d ago ai-agentsanthropicclaude
    +768/day
    measured
    ★ 297.5k
    85
  5. 5
    利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
    Python created 2y ago pushed 2d ago ai-video-generatorcontent-creationffmpeg
    +474/day
    measured
    ★ 139.5k
    85
  6. 6
    Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
    JavaScript created 4mo ago pushed 9d ago agent-skillsai-agentsclaude
    +749/day
    measured
    ★ 184.9k
    84
  7. 7
    在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and Kimi K3 among them. Completely free, with no usage cap.
    JavaScript created 44d ago pushed 3d ago ai-agentsdeepseekdeepseek-harness
    +1,667/day
    measured
    ★ 61.8k
    84
  8. 8
    Open-source skills for designing and reviewing software with AI agents
    Python created 55d ago pushed 3d ago agent-skillsai-agentsantigravity
    +972/day
    measured
    ★ 12.1k
    84
  9. 9
    Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.
    Python created 7mo ago pushed 4d ago ai-agentsantigravityast
    +642/day
    measured
    ★ 142.7k
    84
  10. 10
    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
    C created 3mo ago pushed 37d ago avx2c99cpu-inference
    +203/day
    measured
    ★ 10.6k
    83
  11. 11
    Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.
    Go created 45d ago pushed 2d ago claude-codecodexdeepseek
    +730/day
    measured
    ★ 30.2k
    83
  12. 12
    dsh-go — DeepSeek Harness 装进口袋:手机本机运行,也能遥控你的电脑。
    Dart created 14d ago pushed 2d ago ai-agentandroidandroid-app
    +1,544/day
    measured
    ★ 10.8k
    82
  13. 13
    An on-device AI agent for Android that operates apps and the web to get things done for you.
    Kotlin created 9d ago pushed 3d ago accessibilityai-agentandroid
    +1,102/day
    measured
    ★ 6.9k
    81
  14. 14
    The best-benchmarked open-source AI memory system. And it's free.
    Python created 7mo ago pushed 3d ago aichromadbllm
    +87/day
    measured
    ★ 60.4k
    81
  15. 15
    Agent skill that removes signs of AI-generated writing from text
    Python created 9mo ago pushed 11d ago agent-skillsai-humanizerai-writing
    +418/day
    measured
    ★ 65.1k
    80
  16. 16
    The agent that grows with you
    Python created 15mo ago pushed 2d ago aiai-agentai-agents
    +342/day
    measured
    ★ 260.7k
    80
  17. 17
    The open-source app everyone uses to manage agents at work
    TypeScript created 8mo ago pushed 2d ago acpxagent-orchestrationagent-skills
    +404/day
    measured
    ★ 111.3k
    79
  18. 18
    TradingAgents: Multi-Agents LLM Financial Trading Framework
    Python created 22mo ago pushed 3d ago agentfinancellm
    +376/day
    measured
    ★ 120.7k
    79
  19. 19
    TSP自托管、零运维的 A 股「自建策略 + 监控 + 回测」量化工作台 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源
    Python created 4mo ago pushed 3d ago a-stockai-agentaigc
    +99/day
    measured
    ★ 7.1k
    79
  20. 20
    Turn any idea, plan, or codebase into a beautiful interactive diagram. An agent skill for Claude Code, Codex, and more.
    JavaScript created 6mo ago pushed 3d ago agent-skillsai-agentsarchitecture-diagram
    +352/day
    measured
    ★ 93.7k
    78
  21. 21
    Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
    TypeScript created 2y ago pushed 2d ago aiai-agentsai-crawler
    +320/day
    measured
    ★ 198.8k
    78
  22. 22
    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
    Rust created 3y ago pushed 2d ago chatgptgptllamacpp
    +50/day
    measured
    ★ 45.5k
    76
  23. 23
    AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
    Python created 3y ago pushed 2d ago agentaiastrbot
    +206/day
    measured
    ★ 46.1k
    76
  24. 24
    🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.
    Go created 7mo ago pushed 3d ago aianthropiccaveman
    +245/day
    measured
    ★ 117.6k
    75
  25. 25
    Clone any viral video with AI agents. Not just a script, the whole workflow: swap the face, the words, the B-roll, ship 100 variants in one command, and get your 100M views.
    TypeScript created 3mo ago pushed 3d ago agentic-aiaiai-agents
    +246/day
    measured
    ★ 28.1k
    74
  26. 26
    Learn AI Engineering! Learn it. Build it. Ship it for others.
    Python created 7mo ago pushed 4d ago agentsaiai-agents
    +212/day
    measured
    ★ 76.9k
    74
  27. 27
    Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
    TypeScript created 7mo ago pushed 2d ago agent-failureagent-harnessagent-observability
    +145/day
    measured
    ★ 8k
    73
  28. 28
    🤖 Open-source, local-first alternative to Grok Bot, OpenAI dots and Claude Duet. Your own AI bots on any model: GPT, Claude, Gemini, Grok, DeepSeek, Kimi, GLM and 70+ more through one Modelflare key. Reach them in the app, WeChat or Feishu; they remember you, work in the background, run commands and use your computer. Pay per use.
    Python created 11d ago pushed 2d ago ai-agentai-assistantchatbot
    +296/day
    lifetime avg
    ★ 2.7k
    72
  29. 29
    A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
    Python created 6mo ago pushed 5d ago agentic-aiagentic-workflowsai-agent
    +66/day
    measured
    ★ 8.5k
    70
  30. 30
    An AI prompt optimizer for writing better prompts and getting better AI results.
    TypeScript created 21mo ago pushed 4d ago ai-promptsai-toolsllm
    +134/day
    measured
    ★ 40.7k
    70
  31. 31
    Experience-Driven Black-Box Cost Control for Coding Agents
    Python created 26d ago pushed 3d ago agentic-aiagentic-codingai-coding
    +206/day
    lifetime avg
    ★ 4.8k
    70
  32. 32
    f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
    MDX created 3y ago pushed 3d ago aiartificial-intelligenceawesome-list
    +121/day
    measured
    ★ 175.9k
    70
  33. 33
    A self-hosted job search app that writes tailored resumes and cover letters from your profile.
    TypeScript created 35d ago pushed 3d ago caprovercover-letterdocker
    +204/day
    measured
    ★ 4.4k
    70
  34. 34
    ⌥ Coding agent with the IDE wired in. Built by Stencil Labs.
    TypeScript created 10mo ago pushed 2d ago ai-agentai-coding-agentanthropic
    +123/day
    measured
    ★ 37.9k
    70
  35. 35
    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
    Go created 3y ago pushed 3d ago deepseekgemmaglm
    +113/day
    measured
    ★ 186k
    69
  36. 36
    A community-supported supercharged document management system: scan, index and archive all your documents
    Python created 4y ago pushed 3d ago aiangulararchiving
    +64/day
    measured
    ★ 47.7k
    69
  37. 37
    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
    Svelte created 3y ago pushed 2d ago aillmllm-ui
    +101/day
    measured
    ★ 157.8k
    68
  38. 38
    📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程
    Python created 14mo ago pushed 25d ago agentllmrag
    +126/day
    measured
    ★ 86.1k
    68
  39. 39
    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
    Python created 10mo ago pushed 2d ago agentaianthropic
    +98/day
    measured
    ★ 78.9k
    67
  40. 40
    Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
    Python created 2y ago pushed 2d ago ai-agentsai-toolsbrowser-agent
    +92/day
    measured
    ★ 120.1k
    67
  41. 41
    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
    Rust created 9mo ago pushed 2d ago agentic-codingai-codinganthropic
    +96/day
    measured
    ★ 85.6k
    67
  42. 42
    Build and run agents you can see, understand and trust.
    Python created 2y ago pushed 3d ago agentchatbotlarge-language-models
    +97/day
    measured
    ★ 35.4k
    67
  43. 43
    一个自己找热点、自己写日报的网站框架。把信源和精选标准换成你的,它就是你的行业热点站。
    TypeScript created 40d ago pushed 2d ago aichinesecontent-curation
    +107/day
    measured
    ★ 9.6k
    67
  44. 44
    Harness engineering beginner tutorial, from 0 to 1
    TypeScript created 7mo ago pushed 16d ago agentagenticagentic-ai
    +129/day
    measured
    ★ 23.2k
    67
  45. 45
    Autonomous pentest legion — AI commander + worker swarm + layered fact-intent graph. 3rd Tencent Intelligent Attack-Defense online champion (634 teams · 8h unattended · 1B tokens beat 4.5B). The Nüwa Test: give AIs Create/Language/History, let a civilization grow.
    Python created 8d ago pushed 4d ago ai-agentsautonomous-agentsclaude-code
    +178/day
    measured
    ★ 1.2k
    67
  46. 46
    Open-source Grok Bot alternative. Choose your own model and sandbox.
    TypeScript created 2mo ago pushed 2d ago ai-agentschatgptdocker
    +130/day
    measured
    ★ 7.1k
    67
  47. 47
    Consider it done. The open-source AI agent that works out of the box · 想到,就能做到。开源、开箱即用的 AI Agent。
    TypeScript created 3mo ago pushed 2d ago agentai-agentai-assistant
    +124/day
    measured
    ★ 9.3k
    67
  48. 48
    Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
    Python created 3y ago pushed 2d ago agentagentic-aiagentic-framework
    +81/day
    measured
    ★ 160.5k
    67
  49. 49
    List of Permanent Free LLM API (API Keys)
    JavaScript created 7mo ago pushed 3d ago aiaionapi
    +102/day
    measured
    ★ 12.3k
    66
  50. 50
    Community plugin to control Blender 3D with any LLM of your choice. Not affiliated with the official Blender Foundation.
    Python created 20mo ago pushed 3d ago 3d-modelingaiblender
    +100/day
    measured
    ★ 33.4k
    66
page 1 of 16 next →