Jupyter Notebook

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

★ 107.9k

Stars

16.7k forks · 1 open issues

+53/day

Growth · measured

Stars counted between two of our own snapshots roughly a week apart. The repository page gives the exact span.

62.7

Momentum / 100

see the breakdown below

3y ago

Created

last push 3d ago

Star history

2026-10-10 106.3k → 107.9k stars +1.5k over 26 days 2026-11-05

Component	Weight	Earned	Why
Velocity	55	33.2	+53/day, log-scaled against a 750/day ceiling
Acceleration	15	0.0	last week ran 0.91× the monthly pace
Freshness	15	15.0	last push 3d ago; decays to zero at 180 days
Scale	15	14.6	107.9k stars, log-scaled against 150k — stops a 3-star repo topping the board
Momentum	100	62.7	sum of the above

Topics	aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers
Matched on	LLM & Inference (large-language-models, llm)
Short window	+372 stars over 7 days = 53.1/day
Long window	+1.5k stars over 26 days = 58.2/day
Lifetime average	89.82 stars/day over 1,201 days
First seen here	2026-10-11
Last read	2d ago