Go · Apache-2.0
defilantech/LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
★ 252
Stars
43 forks · 124 open issues
+6.0/wk
Growth · measured
Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.
28.0
Momentum / 100
see the breakdown below
12mo ago
Created
last push 3d ago
Star history
How this score was built
| Component | Weight | Earned | Why |
|---|---|---|---|
| Velocity | 55 | 5.1 | +6.0/wk, log-scaled against a 750/day ceiling |
| Acceleration | 15 | 0.9 | last week ran 1.06× the monthly pace |
| Freshness | 15 | 15.0 | last push 3d ago; decays to zero at 180 days |
| Scale | 15 | 7.0 | 252 stars, log-scaled against 150k — stops a 3-star repo topping the board |
| Momentum | 100 | 28.0 | sum of the above |
Detail
| Topics | aiapple-siliconautoscalingedge-computingggufgpuhomelabinferencekuberneteskubernetes-operatorllama-cppllmlocal-llmmetalmlxmulti-gpunvidiaself-hostedtgivllm |
| Matched on | Dev Tools (kubernetes) |
| Short window | +6 stars over 7 days = 0.9/day |
| Long window | +21 stars over 26 days = 0.8/day |
| Lifetime average | 0.70 stars/day over 358 days |
| First seen here | 2026-10-11 |
| Last read | 2d ago |