titleSpatialBrain: Spatial Intelligence Growing from Experience
authorsYifan Zhou, Ziyang Gong, Xiaojun Ye, Yifei Liu, Donggang Li, Xiaolong Zhou, Zhihang Zhong, Xue Yang
date2026-10-21
venuearXiv (preprint, not peer reviewed)
idarXiv:2610.29317
affiliationShanghai Jiao Tong University
upvotes13 (Hugging Face Daily Papers, 2026-11-01)
linksabs pdf hf
abstractSpatial reasoning requires more than access to geometric tools: a reasoner must decide when direct observation is sufficient and when to reconstruct, measure, or change reference frames. We present SpatialBrain, a framework that retains experience about these decisions while keeping its vision-language backbone fixed. The key distinction is between evidence about a scene and experience about how to reason with that evidence. 3DFusionMemory fuses current-scene observations into queryable spatial relations. A Spatial Skill Library provides reusable tool procedures, and Spatial Cognition associates task conditions with experience about when and how to use memory and skills. Completed trajectories are abstracted into process records and consolidated between task blocks, allowing later decisions to draw on earlier execution without transferring scene coordinates or reference answers. Across five spatial-reasoning benchmarks, SpatialBrain improves on direct answers from the same backbone on four and ties on the fifth. Component comparisons, experience-coverage curves, and traced resource decisions characterize how the framework accumulates and uses these resources.

cite

@misc{zhou2026spatialbrain,
  title={SpatialBrain: Spatial Intelligence Growing from Experience},
  author={Yifan Zhou and Ziyang Gong and Xiaojun Ye and Yifei Liu and Donggang Li and Xiaolong Zhou and Zhihang Zhong and Xue Yang},
  year={2026},
  eprint={2610.29317},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2610.29317}
}