Weight-Space Programming builds neural networks like a 1990s researcher
Summary
An exploration of weight-space programming where LLMs write and edit neural network weights. The piece contrasts hand-crafted, pre-deep-learning techniques with data-driven results on MNIST, Go networks, and a dogs-vs-cats test, highlighting both the promise and limits of this approach.