Can a Linear Program Do Weight-Space Programming?
Summary
The article analyzes weight-space programming and demonstrates how a linear program can identify a steering direction to reduce looping behavior in neural networks by editing weights. It shows LP-based search can replace laborious trial-and-error edits, achieving similar or better performance with far fewer modified weights, and discusses steering vectors and per-token residual-stream dynamics.