The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better
Why test-time compute distillation could turn inference-time reasoning into permanent model capability.
TheSequence
TheSequence is an ML community media, trusted by over 165,000+ specialists from all over the world, including the top AI labs like DeepMind, OpenAI, Google Brain, MSFT Research, LinkedIn, universities like MIT, Cornell, Berkeley, Carnegie Mellon, Columbia, and hundreds of large enterprises.
The Sequence Radar - Issue 910: Last Week in AI: Google Rewires Its Brain and Meta Hires a Coding Swarm
Jeff Dean leaves, Demis Hassabis moves upstream, and Muse Code turns software development into an orchestration problem.
The Sequence Opinion #909: Return on Token: The New Economics of AI-Native Engineering
Token maxing was the adoption phase. Intelligence resource planning is what comes next.
The Sequence AI of the Week #908: You Need to Learn About Gemini Robotics
Google put a walking humanoid inside a single policy, published the reasoning half as an API, and kept the motor half behind a partner gate. The numbers explain why.
The Sequence Knowledge #907: The Brain Transplant: Distilling Transformers Into Other Architectures
Weird but more common than you think. The type of distillation you were not thinking about.
The Sequence Radar #906: Last Week in AI: Open Models, Intelligent Robots, and the Price of Conviction
NVIDIA's letter, Gemini Robotics, Kimi release and more.
The Sequence Opinion #900: Beyond the GPU: Is Google the Only Full-Stack Rival to NVIDIA?
A thesis about the biggest AI rivalry nobody is talking about.
The Sequence AI of the Week #899: Inside Inkling: A Trillion-Parameter Model That Only Wakes Up 41 Billion at a Time
Thinking Machine's new model revitalizes America's open source AI approach.
The Sequence Knowledge #898: The Trace Is the Teacher: Distilling Reasoning Into Small Models
From the release of DeepSeek R1, distillation in reasoning models have become one of the most common techniques in frontier AI.
The Sequence Radar #897: Last Week in AI: China, Compression and the Open-Model Race
Next Week in The Sequence:
The Sequence Opinion #896: Spark, Compute, and the Two Metas
Can Meta compete with frontier AI labs.
The Sequence AI of the Week #895: OpenAI's Show Us Where Coding Evals Break
A visual explanation for OpenAI's new science for coding evaluations and benchmarks.
The Sequence Knowledge #894: When the Student Started Talking Back: Distillation in the LLM Era
A journey through the evolution of distillation for frontier models.
The Sequence Radar #893: Last Week in AI: GPT-5.6, Grok 4.5, Muse Spark 1.1 and the Post-Chatbot Stack
Next Week in The Sequence:
The Sequence Opinion #892: The Anatomy of a Good Environment: When Verifiability is Not Enough
What properties make certain domains suitable for AI.
The Sequence AI of the Week #891: Prompting a Spreadsheet: Inside Google's TabFM for Tabular AI
Addressing one of the biggest use cases in enterprise AI.
The Sequence Knowledge #890: A Brief History of Model Distillation
The papers and techniques that laid out the ground work to evolve distillation to this level.
The Sequence Radar #889: Fable 5's Comeback, ZCode's Debut, Claude Science, and the $3.5B Deployment Land Grab
New models, agents and the evolution of the FDE landscape as the new battle field in AI.
The Sequence Opinion #888: Everything You Need to Know About the AI in Space Race
Use cases, key platforms, architectures, challenges and more.
The Sequence AI of the Week #887: Meta's Autodata: When Models Learn to Make Their Own Lessons
This research paper is pushing the boundaries of synthetic data.
