| title | Socratic Skill Learning: Interleaving Teaching and Practice for Transferable Agent Skills |
|---|---|
| authors | Letian Zhu, Han Li, Yifan Yao, Xinping Lei, Xinyu Che, Jiahao Wang, Dianyi Wang, Yucheng Fu, Jiakai Wang, Zhiqi Bai, Wenbo Su, Jiaheng Liu |
| date | 2026-10-13 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2610.17860 |
| affiliation | NJU-LINK Lab |
| upvotes | 45 (Hugging Face Daily Papers, 2026-11-01) |
| links | abs pdf hf code |
| abstract | Agent Skills improve LLM agents by making task knowledge reusable across sessions. Learning transferable Skills requires evidence about a procedure and its conditions of use, which a successful task attempt can leave untested. We introduce Socratic Skill Learning (SSL), which interleaves expert teaching with Student practice. An Educator guides investigation while the Student remains the sole environment operator and Skill author, able to question, test, and adapt advice. To test reuse beyond the learning task, we construct SkillTransferBench, with 35 task families and 408 executable cases, pairing public variation specifications with held-out evaluation in fresh solver sessions. On the main 22-family, 155-case cohort, Fixed-Window SSL reaches 0.801 utility, versus 0.723 without a Skill, 0.761 for adapted Trace2Skill (trajectory distillation), and 0.751 for adapted SKILL-KD (contrastive distillation). Across three model pairs on shared families, interleaved guidance outperforms expert authoring and post-hoc teaching. Process analysis links guidance to Student writing and package revision; a case study shows the Student testing and refining a proposed procedure for later reuse. As demand for new lessons falls, the cost of fixed-window review grows. Issue-Guided SSL tracks unresolved questions across Skill revisions to select and focus review, reaching 0.805 utility with 61.7% fewer Educator tokens and 16.9% fewer total acquisition tokens than Fixed-Window SSL on the main cohort. |
cite
@misc{zhu2026socratic,
title={Socratic Skill Learning: Interleaving Teaching and Practice for Transferable Agent Skills},
author={Letian Zhu and Han Li and Yifan Yao and Xinping Lei and Xinyu Che and Jiahao Wang and Dianyi Wang and Yucheng Fu and Jiakai Wang and Zhiqi Bai and Wenbo Su and Jiaheng Liu},
year={2026},
eprint={2610.17860},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2610.17860}
}