Dream-RSI: Recursive Self-Improvement through Evolving Worlds
Summary
Dream-RSI introduces a framework for scalable recursive self-improvement by treating accumulation of discovery as a replay simulator. By dreaming in this simulator and using off-policy feedback, the system refines exploration policies and then redeploys improved policies online to continue expanding the simulated discovery space. The approach promises reduced discovery cost while maintaining or improving quality across domains like algorithm engineering, optimization, and GPU kernel work.