Python · Apache-2.0
microsoft/sarathi-serve
A low-latency & high-throughput serving engine for LLMs
★ 535
Stars
68 forks · 17 open issues
flat
Growth · measured
Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.
7.9
Momentum / 100
see the breakdown below
3y ago
Created
last push 10mo ago
Star history
How this score was built
| Component | Weight | Earned | Why |
|---|---|---|---|
| Velocity | 55 | 0.0 | flat, log-scaled against a 750/day ceiling |
| Acceleration | 15 | 0.0 | needs 7-day and 30-day rates side by side |
| Freshness | 15 | 0.0 | last push 10mo ago; decays to zero at 180 days |
| Scale | 15 | 7.9 | 535 stars, log-scaled against 150k — stops a 3-star repo topping the board |
| Momentum | 100 | 7.9 | sum of the above |
Detail
| Topics | llamallm-inferencepytorchtransformer |
| Matched on | LLM & Inference (llm-inference) |
| Short window | +0 stars over 7 days = 0.0/day |
| Long window | +1 stars over 26 days = 0.0/day |
| Lifetime average | 0.49 stars/day over 1,099 days |
| First seen here | 2026-10-11 |
| Last read | 2d ago |