9.3k repos tracked
updated 2d ago
Trending

LLM & Inference

Models, serving stacks, quantisation and fine-tuning.

Trending New Most starred 800 repositories · topics: llm, large-language-models, llm-inference, llm-serving, fine-tuning
  1. 701
    [ICML 2026] When Drafts Evolve: Speculative Decoding Meets Online Learning
    Python created 8mo ago pushed 3mo ago efficient-inferencelarge-language-modelsllm
    flat
    measured
    ★ 127
    13
  2. 702
    A curated list of reinforcement learning with human feedback resources (continually updated)
    created 3y ago pushed 5mo ago deep-learningdeep-reinforcement-learninghuman-feedback
    +1.0/wk
    measured
    ★ 4.4k
    13
  3. 703
    Easy fine-tuning for Qwen3-TTS: Fast voice cloning and high-quality multilingual speech synthesis.
    Python created 8mo ago pushed 5mo ago aiaudio-generationdeep-learning
    +1.0/wk
    measured
    ★ 130
    13
  4. 704
    A collection of libraries to optimise AI model performances
    Python created 4y ago pushed 2y ago aianalyticsartificial-intelligence
    +1.0/wk
    measured
    ★ 8.3k
    12
  5. 705
    CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
    Cuda created 11mo ago pushed 7mo ago cublascuda-kernelslarge-language-models
    +1.0/wk
    measured
    ★ 487
    12
  6. 706
    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
    Python created 3y ago pushed 6mo ago alpacaalpaca-2large-language-models
    −3.0/wk
    measured
    ★ 18.9k
    12
  7. 707
    LoRA fine-tune Gemma 4 31B to speak caveman-mode natively. Style: github.com/JuliusBrussee/caveman
    Python created 5mo ago pushed 4mo ago cavemanfine-tuninggemma
    +1.0/wk
    measured
    ★ 122
    12
  8. 708
    LLM Finetuning with peft
    Jupyter Notebook created 3y ago pushed 15mo ago falconfine-tuninghuggingface
    +2.0/wk
    measured
    ★ 3k
    12
  9. 709
    ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
    Python created 3y ago pushed 2y ago chatglmchatglm-6blarge-language-models
    −4.0/wk
    measured
    ★ 15.5k
    12
  10. 710
    State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
    Jupyter Notebook created 8y ago pushed 2y ago computer-visiondeep-learningdrug-discovery
    −2.0/wk
    measured
    ★ 14.9k
    12
  11. 711
    📋 A list of open LLMs available for commercial use.
    created 3y ago pushed 21mo ago commerciallarge-language-modelsllm
    −3.0/wk
    measured
    ★ 12.9k
    12
  12. 712
    M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + React + mlx-lm.
    TypeScript created 8mo ago pushed 4mo ago ai-assistantapple-silicondesktop-app
    flat
    measured
    ★ 180
    12
  13. 713
    A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
    Python created 2y ago pushed 4mo ago datasetllmllm-serving
    flat
    measured
    ★ 293
    11
  14. 714
    🔥🔥High-Performance Face Recognition Library on PaddlePaddle & PyTorch🔥🔥
    Python created 7y ago pushed 19mo ago artificial-intelligencecomputer-visionconvolutional-neural-network
    +1.0/wk
    measured
    ★ 3.6k
    11
  15. 715
    OML 1.0 via Fingerprinting: Open, Monetizable, and Loyal AI
    Python created 24mo ago pushed 21mo ago fine-tuningfingerprintloyalty
    +1.0/wk
    measured
    ★ 3.5k
    11
  16. 716
    The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention
    Python created 22mo ago pushed 16mo ago large-language-modelsllmllms
    +1.0/wk
    measured
    ★ 3.5k
    11
  17. 717
    The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
    created 3y ago pushed 14mo ago agentlarge-language-modelsllm
    flat
    measured
    ★ 8.3k
    11
  18. 718
    Zero-friction LLM fine-tuning skill for Claude Code, Gemini CLI & any ACP agent. Unsloth on NVIDIA · TRL+MPS/MLX on Apple Silicon. Automates env setup, LoRA training (SFT, DPO, GRPO, vision), post-hoc GRPO log diagnostics, evaluation, and export end-to-end. Part of the Gaslamp AI platform.
    Python created 7mo ago pushed 4mo ago apple-siliconclaude-codedpo
    flat
    measured
    ★ 283
    11
  19. 719
    A series of large language models trained from scratch by developers @01-ai
    Jupyter Notebook created 3y ago pushed 23mo ago large-language-models
    −2.0/wk
    measured
    ★ 7.8k
    11
  20. 720
    中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
    Python created 3y ago pushed 6mo ago 64kalpacaalpaca-2
    −1.0/wk
    measured
    ★ 7.1k
    11
  21. 721
    The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
    Python created 3y ago pushed 2y ago large-language-modelsvision-language-model
    flat
    measured
    ★ 6.7k
    11
  22. 722
    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
    created 5mo ago pushed 4mo ago benchmarkbenchmarkingdeep-learning
    +1.0/wk
    measured
    ★ 150
    11
  23. 723
    A large-scale 7B pretraining language model developed by BaiChuan-Inc.
    Python created 3y ago pushed 2y ago artificial-intelligencecevalchatgpt
    −2.0/wk
    measured
    ★ 5.6k
    11
  24. 724
    OpenChat: Advancing Open-source Language Models with Imperfect Data
    Python created 3y ago pushed 2y ago large-language-modelsopen-sourcetransformers
    −4.0/wk
    measured
    ★ 5.5k
    11
  25. 725
    MoBA: Mixture of Block Attention for Long-Context LLMs
    Python created 20mo ago pushed 19mo ago flash-attentionllmllm-serving
    +1.0/wk
    measured
    ★ 2.2k
    11
  26. 726
    Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
    TypeScript created 23mo ago pushed 8mo ago agentagentic-aiagentic-ai-development
    −2.0/wk
    measured
    ★ 5k
    11
  27. 727
    Align Anything: Training All-modality Model with Feedback
    Python created 2y ago pushed 11mo ago chameleondpolarge-language-models
    flat
    measured
    ★ 4.7k
    11
  28. 728
    A series of large language models developed by Baichuan Intelligent Technology
    Python created 3y ago pushed 2y ago artificial-intelligencebenchmarkceval
    −3.0/wk
    measured
    ★ 4.1k
    10
  29. 729
    Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
    Python created 3y ago pushed 18mo ago chatgptfoundation-modelsgpt-4
    flat
    measured
    ★ 3.6k
    10
  30. 730
    Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
    Python created 2y ago pushed 2y ago generationlarge-language-modelsvision-language-model
    flat
    measured
    ★ 3.3k
    10
  31. 731
    🚀🚀🚀 [ICML 2026] Official Implementation of Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?
    Python created 5mo ago pushed 4mo ago generationimage-restorationlarge-language-models
    flat
    measured
    ★ 355
    10
  32. 732
    MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.
    Python created 17mo ago pushed 16mo ago large-language-modelsllmminimax-m1
    −1.0/wk
    measured
    ★ 3.2k
    10
  33. 733
    [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
    Python created 3y ago pushed 2y ago blip2cross-modal-pretraininglarge-language-models
    flat
    measured
    ★ 3.1k
    10
  34. 734
    Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
    Python created 7y ago pushed 2y ago albertbartbert
    flat
    measured
    ★ 3.1k
    10
  35. 735
    Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
    Python created 3y ago pushed 9mo ago deep-learningdeveloper-toolsembeddings
    flat
    measured
    ★ 3.1k
    10
  36. 736
    Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.
    Python created 9mo ago pushed 5mo ago deepseekdeepseek-aiengram
    −6.0/wk
    measured
    ★ 1.3k
    10
  37. 737
    Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.
    Python created 2y ago pushed 8mo ago llmllm-inferenceprompt
    +1.0/wk
    measured
    ★ 1.2k
    10
  38. 738
    Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
    Jupyter Notebook created 3y ago pushed 2y ago llmllm-inference
    flat
    measured
    ★ 2.8k
    10
  39. 739
    [TPAMI 2023] LibFewShot: A Comprehensive Library for Few-shot Learning.
    Python created 5y ago pushed 12mo ago few-shot-learningfine-tuningimage-classification
    +1.0/wk
    measured
    ★ 1.1k
    10
  40. 740
    A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!
    created 3y ago pushed 9mo ago aifine-tuninggpt
    +1.0/wk
    measured
    ★ 989
    10
  41. 741
    Mastering Applied AI, One Concept at a Time
    Jupyter Notebook created 3y ago pushed 8mo ago fine-tuningfinetuningfinetuning-llms
    flat
    measured
    ★ 2.4k
    10
  42. 742
    GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Attention + MTP speculative decode
    Shell created 4mo ago pushed 4mo ago blackwellglmllm-inference
    flat
    measured
    ★ 155
    10
  43. 743
    Your Automatic Prompt Engineering Assistant for GenAI Applications
    Python created 3y ago pushed 2y ago aiai-experimentsai-toolkit
    flat
    measured
    ★ 2.1k
    10
  44. 744
    Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"
    Jupyter Notebook created 2y ago pushed 8mo ago bitsandbytesfine-tuningfinetuning
    +1.0/wk
    measured
    ★ 877
    10
  45. 745
    AICI: Prompts as (Wasm) Programs
    Rust created 3y ago pushed 21mo ago aiinferencelanguage-model
    flat
    measured
    ★ 2.1k
    10
  46. 746
    A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL
    Python created 3y ago pushed 16mo ago databasedatasetsfine-tuning
    flat
    measured
    ★ 2k
    10
  47. 747
    Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.
    Jupyter Notebook created 3y ago pushed 2y ago llama-2llama2llm
    −1.0/wk
    measured
    ★ 1.9k
    10
  48. 748
    Molecode presents molecules as code and enables LLMs to operate and reason on chemistry directly.
    Python created 5mo ago pushed 5mo ago ai-agentai-for-sciencechemistry
    −1.0/wk
    measured
    ★ 308
    9
  49. 749
    [ICLR 2026] GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)
    Python created 11mo ago pushed 4mo ago deep-learningfoundation-modelslarge-language-models
    flat
    measured
    ★ 122
    9
  50. 750
    🚀WebUI integrated platform for latest LLMs | 各大语言模型的全流程工具 WebUI 整合包。支持主流大模型API接口和开源模型。支持知识库,数据库,角色扮演,mj文生图,LoRA和全参数微调,数据集制作,live2d等全流程应用工具
    Python created 3y ago pushed 11mo ago chatbotembeddingsfine-tuning
    +1.0/wk
    measured
    ★ 555
    9
← previous page 15 of 16 next →