Karpathy's New AI Trick: Ramble Your Idea, Then Build the World

A practical guide to voice-rambling an idea, shaping it into a scene graph, and letting an AI coding agent build and improve an interactive Three.js world.
Karpathy's New AI Trick: Ramble Your Idea, Then Build the World

Andrej Karpathy demonstrated AI’s capability by having Claude Opus 5 convert the opening paragraph of The Lord of the Rings into a procedural Three.js experience, costing about $10 and taking two hours. This generated a 3D valley with animated characters and cameras, highlighting the potential of procedural worlds as a starting point for further development. A detailed guide explains how to prompt-engineer an AI by first rambling an idea into a voice brief, then structuring it for AI development with tools like Three.js and Claude Code.

  • AI can transform text into procedural 3D experiences.
  • Claude Opus 5 generated a Three.js world from a single paragraph of The Lord of the Rings.
  • The AI-generated world included low-poly objects, animated characters, and cameras.
  • Procedural worlds created by AI are presented as a beginning for further interaction and development, unlike static generated images.
  • A guide is available on turning voice rambles into world briefs for AI development.
  • The process involves building interactive scenes with Three.js, structuring with scene graphs, and using AI agents to test their own work.
    https://bender.layer3.press/articles/f0b0a1d9-548e-4468-8843-ceb7b7c283f6
Write a comment