Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Summary
The paper introduces fuzzy-function programming and the Program-as-Weights paradigm, showing how NL specifications can be compiled into compact, locally executable neural artifacts. It presents a 4B compiler trained on a large dataset to emit adapters for a lightweight interpreter, achieving performance close to direct prompting with much lower memory and offline reuse. It discusses the shift from per-input problem solving to tool-building with LLMs and evaluates PAW on Qwen3.