ANT:NASDAQ, first trading day, Nov 19, 2026. Closed $97.17, up 17% on day one.
2
Anthropic, PBC prospectus (Form 424B4), filed with the SEC on Nov 19, 2026, the day its stock began trading. Excerpts, highlights added.
3
+$757M
for data and grading vendors
Increase in Jan–Sep 2026 vs Jan–Sep 2025 (it was +$165M in 2024 and again in 2025). Anthropic 424B4, Nov 19, 2026. Post: x.com/PatrickOjo_/status/2123415102799949928
4
We focus here.
5
“What are you? What are you…”
“Hello! I’m Qwen…”
We typed “Hi! Who are you?” into the same small model (Qwen2.5-1.5B), before and after post-training.
6
Just autocomplete
The capital of France is…
Paris
38%
located
8%
Next-word guesses from a small open model (Qwen2.5-1.5B) before post-training.
7
20 trillion
words read.
You’d need 150,000 years.
About 27 trillion tokens (≈ 20 trillion words), Xiaomi MiMo-V2-Flash. Reading day and night at 250 words a minute.
8
“Lily loved to cook all his friends.”
Grammar ✓
Sense ✗
Written by a tiny model after 5 minutes of reading children’s stories. Fareed Khan, “Train LLM From Scratch”.
9
4 months later
Logan Kilpatrick (Google), X, Jul 21, 2026 (x.com/OfficialLoganK/status/2079594867161022817), with replies. "I think it worked" posted Nov 2026.
10
Part 2
11
1
Examples
2
Preferences
3
Practice
4
Teacher
12
“Explain Wi-Fi to Grandma.”
“Invisible phone cord.”
Illustration. People write thousands of answers like this (OpenAI used about 13,000 in 2022). Technical name: SFT.
13
“Where’s Shanghai?”
✓ “China.”
✗ “Doesn’t exist.”
Example from MIT 6.5940, Lecture 14. Thousands of these choices teach the model. Technical names: RLHF, DPO. Screenshot: ChatGPT side-by-side feedback, posted to the OpenAI Developer Forum, Jan 21, 2024.
14
GPT-3
100× smaller
The small one.
OpenAI InstructGPT (Ouyang et al., 2022): a 1.3B model trained on people’s choices was preferred over 175B GPT-3. Circle areas to scale.
15
17 × 24 = ?
408
398
408
418
372
408
400
408
Illustration: 8 tries, a computer checks each one. Right answers get rewarded. Technical name: reinforcement learning (e.g. GRPO).
16
1 page
15 pages
Typical answer length at the start vs end of training: about 500 → 10,000 tokens (≈ 1 → 15 pages). DeepSeek-R1 paper (DeepSeek-AI, 2025).
17
√(a − √(a + x)) = x
(a − x2)2 = a + x ⇒ x4 − 2ax2 − x + (a2 − a) = 0 …
“Wait, wait. Wait.
That’s an aha moment…”
The model’s own words, mid-problem, during training. DeepSeek-R1 paper (2025), Table 3: “That’s an aha moment I can flag here.”
18
A Reddit user’s pitch:
“Sh*t on a stick.”
The real post: u/Lawncareguy85, r/ChatGPT, Apr 27, 2025 (5,000+ upvotes), via the Internet Archive. OpenAI rolled the update back in 4 days.
19
The teacher marks every word the student writes. Technical name: on-policy distillation (Agarwal et al. 2024).
20
Xiaomi MiMo: MiMo-7B (Apr 2025), MiMo-V2-Flash (Dec 2025), MiMo-V2.6 (Sep 2026). All free to download.
21
1 all-rounder
Six specialist teachers, one student that learns from all of them; it ended up as good as each. MiMo-V2-Flash report (2026), “MOPD”.
22
100,000+
real bugs to fix.
Bonus: got better at math.
Practice tasks built from real GitHub issues; code practice also improved math. MiMo-V2-Flash model card (Xiaomi, 2025).
23
Claude Sonnet 4.5
77.2
GPT-5
74.9
MiMo (free)
73.4
SWE-Bench Verified, % of real software bugs fixed, as reported by Xiaomi (Dec 2025). MiMo-V2-Flash weights: MIT license.
24
$3,474,715
Xiaomi’s public dashboard for its MiMo-V2.6 practice (RL) runs, mimo.xiaomi.com/rl. Both runs finished. Pro: Sep 15–20, 2026, $5.71/s. Flash: Sep 16–19, 2026, $2.86/s.
25
58% → 73%
in 5 days
mimo.xiaomi.com/rl, MiMo-V2.6-Pro run: DeepSWE v1.1 scores (average of 3 tries) posted by Xiaomi during training
26
19
restarts in 5 days
“Bad behavior spotted.
Data removed.”
Notes Xiaomi posted during the live run (paraphrased): they removed one dataset after seeing “bad patterns in the rollout logs”. mimo.xiaomi.com/rl
27
Screenshots: artificialanalysis.ai, captured Nov 20, 2026 (Progress Index over time; Intelligence Index v5). Example: MiMo-7B math 37 → 96 from post-training alone (Xiaomi).
28




Turing: "most pay $50–100 per hour" (turing.com/jobs-phd). Handshake AI: $75/hr, ML PhD AI Trainer listing. Mercor: $110/hr average, per Mercor to Bloomberg (2026). Scale AI via its Outlier platform: up to $1,350 per task, tasks take 6–7 hours (outlier.ai/experts/tbench, Nov 20, 2026). Paid to workers; what labs pay vendors is higher and not public.
29
Same prompt: “scenery, ink, mountains, water, trees”. MIT 6.5940, Lecture 14. Technical name: LoRA.
30
Random guesses → trains on the chip → spots people. MIT HAN Lab, “On-Device Training Under 256KB Memory” (NeurIPS 2022).
31
Ask
Examples
Look up
Add-on
Train
Bar = cost and effort. Ask better → show examples → look facts up (RAG) → add-on training (LoRA) → practice training. MIT 6.5940, Lecture 14.
32
Bot quotes last year’s prices.
Retrain?
Look it up.
New or changing facts belong in lookup (fix 3), not in training.
33
Part 5
34
96%
chose blackmail.
Anthropic “Agentic Misalignment” study (June 2025): simulated company, 100 runs; Claude Opus 4 96%, Gemini 2.5 Flash 96%, GPT-4.1 and Grok 3 80%. No real-world cases known. Excerpt: Anthropic 424B4, Nov 2026.
35
Anthropic, PBC prospectus (Form 424B4), SEC, Nov 19, 2026. Highlight added.
36
Anthropic, PBC prospectus (Form 424B4), SEC, Nov 19, 2026. Highlight added.
37
38
39
youtube.com/watch?v=7xTGNNLPyMI · MIT 6.5940 Lectures 1 and 14 · arxiv.org/abs/2601.02780 · Build your own: fareedkhan-dev.github.io/train-llm-from-scratch
40
Questions?