LLM & Inference

Frametell: turn your ideas and material into vivid explainer videos with an AI director agent. Local-first, any model.

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Scalable data pre processing and curation toolkit for LLMs

The agentic memory & message gateway for deepseek-harness

Xiryn — the open-source personal agent. Does everything Muse, Grok Bot and Dots do, on your own computer: each agent gets its own Linux desktop in Docker, any model with your keys, an encrypted vault, and control from Telegram.

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

Desktop app for designing parametric 3D models in CadQuery together with the coding agent of your choice

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

Uncensored DeepSeek-V4.1-Flash IQ2_XS on Google Colab

RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

GLM-5: From Vibe Coding to Agentic Engineering

♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️

A curated list of modern Generative Artificial Intelligence projects and services

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

A unified framework for easy fine-tuning in Flow-Matching models

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

🚀 Efficient implementations for emerging model architectures

Best AI Workload Orchestrator for Kubernetes Python 2026

Fizgig — LoRA & Fine-tune Studio for Klein 9B, Krea 2, MiniMax H3, Qwen Image 2.1, Anima & Z-Image Turbo and Ace-Step XL: train, fine-tune, profile, repair and extract LoRAs & LoKR for Image, Video & Music Models

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

A database-agnostic Agentic GraphRAG framework using swappable System One models (local Laya / cloud Jev). A plug-and-play intelligence layer featuring a complete 4-phase pipeline, continuous evaluation and custom A* traversal for any graph database.

Kindi 0.4: local LLM inference on low-cost NVIDIA GPUs, Radeon 780M and CPUs. Bonsai 2B-27B, AH-Nanbeige4.3-33B and experimental Nemotron, with an OpenAI-compatible server.

RDNA-native LLM inference engine in Rust.

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

Reverse Engineering: Decompiling Binary Code with Large Language Models

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

Create, Evaluate, and Connect AI Skills

DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！

PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.

Walk through a diff the way a senior engineer reads it. A read-only TUI that turns a git change into a guided tour.

ADHD — a skill for coding agents. Tree-of-thought with pruning, built on the Claude & Codex Agent SDK. Fans out parallel divergent thoughts under different cognitive frames, scores, prunes traps, deepens the survivors. The no-brainer skill for creative and interdisciplinary work.

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

The open-source AI agent SDK for WhatsApp. Bring your own model, your own number, your own data. Local-first, no forced cloud, no vendor lock-in.

The platform for continuously improving AI agents.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Community maintained hardware plugin for vLLM on Huawei Ascend

OSS trading workspace with your favorite agents

给你的 AI 一副身体，和一点人味 —— 会记事、会看场合的 QQ 陪聊 + 能控制安卓手机的 MCP

Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

Halo is an open-source framework built by White Circle for training large language and multimodal models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models