Why smarter AI models could drive up compute prices 10x
The end of cheap compute?
Dwarkesh Patel
Adam Brown – A deep but accessible introduction to general relativity
And why black holes are the ultimate power plants.
The Winning Essays for the Big Questions About AI
Abolishing pandemics/ Getting out of the way of AI automation/ Learning from Honk Kong MTR's business model
Grant Sanderson – AI and the future of math
Watch now (94 mins) | Math is where we’ll see superintelligence first. What will it look like?
The next big breakthrough will be AIs learning on the job
Labs are throwing away the most valuable data.
The data black hole at the center of AI
"We see these AIs as a galaxy glittering with capabilities, but at their center, invisible to the naked eye, holding all the constellations together, is an unimaginably massive black hole of data."
Ada Palmer – Machiavelli is the most misunderstood thinker of all time
"He begged to work for the regime that tortured him."
The sample efficiency black hole
"We see these AIs as a galaxy glittering with capabilities, but at their center, invisible to the naked eye, holding all the constellations together, is an unimaginably massive black hole of data."
Alex Imas and Phil Trammell – What remains scarce after AGI?
“One robot now turns into many robots next year, but the number of ballerinas is the same.”
Reiner Pope – Chip design from the bottom up
Working up from basic logic gates to why GPUs, TPUs, FPGAs, and the human brain each look the way they do.
The mistake of conflating intelligence and power
If this is your definition of intelligence is the ability to achieve your goals across a wide variety of domains, then Stalin was the most intelligent person who ever lived.
Notes on pretraining parallelisms and failed training runs.
Deeply researched interviews
RLVR might be disproportionately bad at science
The verification loop for theories can be on the order of decades and centuries, and even then, what we know today as the better theory can often actually make worse predictions.
