9.3k repos tracked
updated 2d ago
Markdown · Apache-2.0

amitshekhariitbhu/llm-inference-engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

★ 398
Stars
50 forks · 0 open issues
+1.4/day
Growth · measured
Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.
29.6
Momentum / 100
see the breakdown below
2mo ago
Created
last push 7d ago

Star history

2026-10-10 311 → 398 stars +87 over 26 days 2026-11-05

How this score was built

ComponentWeightEarnedWhy
Velocity557.4 +1.4/day, log-scaled against a 750/day ceiling
Acceleration150.0 last week ran 0.43× the monthly pace
Freshness1514.7 last push 7d ago; decays to zero at 180 days
Scale157.5 398 stars, log-scaled against 150k — stops a 3-star repo topping the board
Momentum10029.6 sum of the above

Detail

Topicsinference-engineeringinference-optimizationlarge-language-modelsllmllm-engineeringllm-inferencellms
Matched onLLM & Inference (large-language-models, llm-inference)
Short window+10 stars over 7 days = 1.4/day
Long window+87 stars over 26 days = 3.3/day
Lifetime average5.01 stars/day over 79 days
First seen here2026-10-11
Last read2d ago