Karpathy’s Pelican
Summary
Karpathy discusses using Opus 5 to render 3D scenes from a paragraph of The Lord of the Rings, exploring how an LLM can orchestrate assets and code to create interactive, multimodal content. He highlights the potential for hyper-custom, on-demand worlds and points out current limitations in an LLM’s ability to audit or perceive videos or gameplay.