Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or con...
Research Paper
Summary
Research paper demonstrating that neural network vector representations can be closely approximated by closed-form symbolic structure equations, reconciling symbolic and connectionist views of intelligence.
Highlights
- Neural network internal representations can be replaced with closed-form symbolic equations while preserving behavior
- Findings validated on small list-manipulation networks and LLMs across arithmetic, logic, code, and language
- Symbolic approximation enables targeted interventions on LLM internal representations to modify outputs
- Provides a potential reconciliation between symbolic conceptions of intelligence and vector-based modern AI
- 30-page paper with 29 pages of references and appendices, submitted to arXiv in August 2026
auto-generated
Context
Audience
Researchers in AI interpretability, cognitive science, and symbolic AI; ML practitioners interested in understanding and controlling LLM behavior
DomainNeural Network Interpretability
FormatResearch paper (arXiv preprint)
AccessFree online (arXiv)
Source Overview
The paper shows that neural network vector representations can be replaced with closed-form symbolic structure equations while preserving network behavior.
This result holds for small list-manipulation networks and LLMs across arithmetic, logic, code, and language. The symbolic approximation enables targeted interventions on internal representations to modify LLM outputs.
Topics
Related
Symbolic AIMechanistic interpretabilityTransformer internal representationsLogic and language in neural networksCognitive science of intelligence
