| title | Scaling Mathematical Proof Supervision from Structured Textbooks |
|---|---|
| authors | Youqing Fang, Zhouqi Hua, Yinhao Tang, Yuzhe Gu, Lingkai Kong, Bin Liu, Weiming Zhang, Kai Chen, Yanan Sun, Wenwei Zhang |
| date | 2026-10-29 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2610.40394 |
| affiliation | Intern Large Models |
| upvotes | 44 (Hugging Face Daily Papers, 2026-11-14) |
| links | abs pdf hf |
| cite | |
| related | Atria Dawn: The Dawn of Agentic Superintelligence Sage S2.1 Flash Technical Report Intern-S2-Preview: Scientific Agentic Foundation Model Scalable Visual Pretraining for Language Intelligence Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games |
| abstract | Mathematical supervision for language models is typically flattened into isolated problem-solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics subjects into approximately 380K structured proof-supervision records while preserving chapter order, proposition-proof links, dependency references, and source provenance. Leveraging these structural signals, we explore curriculum learning across multiple mathematical subjects and characterize scaling patterns with supervision volume and source breadth. At full scale, fine-tuning on TOME-Math raises the unweighted mean score across our held-out evaluations and established public benchmarks by 16.7 percentage points over the base model, while exceeding all three public instruction-data baselines evaluated in aggregate. Our findings highlight structured textbooks as both a scalable source of mathematical supervision and an empirical framework for studying the impact of data organization on mathematical reasoning. We will release the corpus to facilitate further research on structured mathematical supervision. |
bibtex
@misc{fang2026scaling,
title={Scaling Mathematical Proof Supervision from Structured Textbooks},
author={Youqing Fang and Zhouqi Hua and Yinhao Tang and Yuzhe Gu and Lingkai Kong and Bin Liu and Weiming Zhang and Kai Chen and Yanan Sun and Wenwei Zhang},
year={2026},
eprint={2610.40394},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2610.40394}
}