Repository · Apache-2.0
amitshekhariitbhu/transformers-explained
Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer inside a Transformer.
★ 230
Stars
25 forks · 0 open issues
+1.0/wk
Growth · measured
Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.
13.0
Momentum / 100
see the breakdown below
4mo ago
Created
last push 4mo ago
Star history
How this score was built
| Component | Weight | Earned | Why |
|---|---|---|---|
| Velocity | 55 | 1.1 | +1.0/wk, log-scaled against a 750/day ceiling |
| Acceleration | 15 | 0.0 | last week ran 0.93× the monthly pace |
| Freshness | 15 | 5.0 | last push 4mo ago; decays to zero at 180 days |
| Scale | 15 | 6.9 | 230 stars, log-scaled against 150k — stops a 3-star repo topping the board |
| Momentum | 100 | 13.0 | sum of the above |
Detail
| Topics | architectureattention-is-all-you-needattention-mechanismlarge-language-modelsllmllmstransformers |
| Matched on | LLM & Inference (large-language-models) |
| Short window | +1 stars over 7 days = 0.1/day |
| Long window | +4 stars over 26 days = 0.2/day |
| Lifetime average | 1.91 stars/day over 120 days |
| First seen here | 2026-10-11 |
| Last read | 2d ago |