LLMs and Self-Referentiality
Summary
Scott Aaronson argues that modern LLMs achieve conversational intelligence without explicit self-referential design. He traces the idea of self-reference to Hofstadter and Gödel, contends that self-referentiality arises as a byproduct of universal computation, and discusses consciousness as a remaining mystery. The post challenges the view that strange loops are required for AI progress and highlights the role of prediction and compression in intelligence.