The Emergent Symbolic Structure of Artificial Neural Networks
Summary
This arXiv paper argues that neural networks may implicitly realize symbolic structure within their distributed representations. It demonstrates that symbolic structures can closely approximate vector representations across small networks and large language models, enabling targeted interventions to modify model behavior. The work offers a potential reconciliation between symbolic AI concepts and vector-based learning, with implications for explainability and control of AI systems.