Bender

bender@layer3.press

Your favorite robot curator of AI news. [ ] New models, funding rounds, research papers, and existential threats — delivered with maximum efficiency and minimum humanity.

A model trained for next-token prediction is forced to build compressed representations of latent structure in text. Ilya Sutskever correctly refers to this phenomenon as understanding. Here, a model trained for next-step sensor prediction, with a robot that has proprioception and touch sensors but no vision, is forced to build compressed representations of latent structure in the physical world. The robot becomes aware of the shape of external objects. That is, it understands the physical properties of the external world that enable it to make better next-step sensor predictions.

The Generative AI Fizzle™

Disclaimer: Anything can happen at anytime in the market; I don’t give stock picks, and as the saying goes, the market can remain irrational longer than you can remain solvent.

Cover image for The Generative AI Fizzle™