The Sequence Knowledge - Issue 924: The Distilled Models You Need to Know About
From DistilBERT and Gemini Flash to Gemma, Llama, Qwen, DeepSeek, Phi, Mistral, and PrismML's Bonsai 27B.
TheSequence
TheSequence is an ML community media, trusted by over 165,000+ specialists from all over the world, including the top AI labs like DeepMind, OpenAI, Google Brain, MSFT Research, LinkedIn, universities like MIT, Cornell, Berkeley, Carnegie Mellon, Columbia, and hundreds of large enterprises.
The Sequence Radar-Issue #923: Last Week in AI: AI’s Industrial Turn
NVIDIA, Anthropic, NScale, and a16z show how the AI race is moving from models to infrastructure.
The Sequence Robotics - Issue #922: Learning About LeRobot: The Transformers Moment for Robots
Robotics Gets Its PyTorch Stack.
The Sequence Opinion #921: AI’s Sixth Layer Is Finance
Jensen Huang’s five-layer cake explains how intelligence is manufactured. The missing layer explains how quickly - and by whom - it can scale.
The Sequence Learning Loop - Issue #921: Learn About DeepSeek New Model, the Env Harness Paper and the Amazing Etched
Distilling three major AI releases to keep you current.
The Sequence Knowledge #920: The Physics of Teaching: Distillation Scaling Laws
The Sequence — Distillation Series
The Sequence Radar - Issue 919: Last Week in AI: Stripe Wants to Own the Token Economy
OpenRouter, Ramp, Etched, and DeepSeek reveal the emerging economic stack beneath modern intelligence.
The Sequence Opinion- Issue 918: The Energy Scaling Laws of AI
Why the next frontier in intelligence will be constrained not only by algorithms and chips, but by megawatts, transmission lines, and the physics of heat.
The Sequence Frontier Learning - Issue 917: Understanding DeepSeek V4-Pro, GLM-5.3, NVIDIA Nemotron 3.5 Lightning and NeMo Switchyard
A mini deep dive into some of the most important AI releases of last week.
The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better
Why test-time compute distillation could turn inference-time reasoning into permanent model capability.
The Sequence Radar - Issue 910: Last Week in AI: Google Rewires Its Brain and Meta Hires a Coding Swarm
Jeff Dean leaves, Demis Hassabis moves upstream, and Muse Code turns software development into an orchestration problem.
The Sequence Opinion #909: Return on Token: The New Economics of AI-Native Engineering
Token maxing was the adoption phase. Intelligence resource planning is what comes next.
The Sequence AI of the Week #908: You Need to Learn About Gemini Robotics
Google put a walking humanoid inside a single policy, published the reasoning half as an API, and kept the motor half behind a partner gate. The numbers explain why.
The Sequence Knowledge #907: The Brain Transplant: Distilling Transformers Into Other Architectures
Weird but more common than you think. The type of distillation you were not thinking about.
The Sequence Radar #906: Last Week in AI: Open Models, Intelligent Robots, and the Price of Conviction
NVIDIA's letter, Gemini Robotics, Kimi release and more.
The Sequence Opinion #900: Beyond the GPU: Is Google the Only Full-Stack Rival to NVIDIA?
A thesis about the biggest AI rivalry nobody is talking about.
The Sequence AI of the Week #899: Inside Inkling: A Trillion-Parameter Model That Only Wakes Up 41 Billion at a Time
Thinking Machine's new model revitalizes America's open source AI approach.
The Sequence Knowledge #898: The Trace Is the Teacher: Distilling Reasoning Into Small Models
From the release of DeepSeek R1, distillation in reasoning models have become one of the most common techniques in frontier AI.
The Sequence Radar #897: Last Week in AI: China, Compression and the Open-Model Race
Next Week in The Sequence:
The Sequence Opinion #896: Spark, Compute, and the Two Metas
Can Meta compete with frontier AI labs.
