My Throw Decides My Aim
Summary
The article explores the philosophy of how language models generate text, using the metaphor of the throw to illustrate how the model's output is shaped by context, prompts, and training. It discusses sampling, supervised fine-tuning, RLHF, and the idea that the model's voice can feel intimate yet artificial, raising questions about conscious intent and alignment while acknowledging the role of prompt design.