| title | IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems |
|---|---|
| authors | A. Jian Yang, An Huang, Bo Dan, Chen Mu, Chengran Yang, Chuan Shi, Feng Chang, Hongxin Li, Hongyuan Tao, Jinxing Zhang, Jujie He, Kun Wang, Lin Jing, Ming Yang, Qicheng Hu, Renyuan Li, Shark Liu, Shawn Guo, Shi Qing, Shi Zhong, Tianyu Zheng, Wei Liu, Wei Zhang, Wenrui Cai, Wenxiao Chen, Xuxing Chen, Yan Xing, Yi Xing, Yifan Luo, Yiran Xing, Yizhi Li, Yongsheng Kang, Yucheng Ding, Yue Song, Yun Qing, Yunqi Liu, Zelong Huang, Zhengmao Ye, Zhentao Fan, Zhiteng Li, Ziling Huang, Bihong Tang, Bingli Wang, Ce Jun, Changhao Chen, Chen Hu, Chen Xiao, Chi Liu, Chunjiang Ge, Danyang Li, Deyang Kong, Dian Qi, Ding Tan, Evan Yang, Fanglin Xu, Fei Bai, Gang Liu, Guochang Li, Hao Tang, Haoran Feng, Haowen Wang, Huahao Hu, Huanjin Yao, Huatong Song, Jia Deng, Jiajun Wu, Jialiang Cheng, Jiayi Liang, Jiayi Wu, Jie Deng, Jiejun Tan, Jing Yang, Jingda Xu, Junhang Cheng, Junxiao Liu, Kai Lv, Kaixiang Pan, Kecheng Lu, Kun Zeng, Kun Zheng, Kunbo Ding, Liang Qiu, Lingyi Sun, Luan Zhang, Mengxiao Lv, Ning Dong, Pei Wang, Peng Zhang, Qingsong Cai, Qixiang Yin, Qiyao Wang, Renbiao Liu, Renfei Dang, Ruihang Li, Ruirui Huang, Shanhui Yin, Shen Jian, Shengjie Fang, Shikai Li, Shinan Zhang, Shiqi Chen, Shuai Liu, Shuangqi Li, Shuo Tang, Shuqing Deng, Sijin Hao, Siwei Wu, Siyue Wang, Tao Hai, Tao Ren, TingYang Chen, Wei Shao, Weicheng Gu, Weihan Peng, Wenlong Miao, Xavier Yu, Xiangyuan Ji, Xiaocheng Li, Xiaodong Huang, Xiaohan Ge, Xiaoxiang Shi, Xiaoyang Zhang, Xiaoyu Yang, Xidong Wang, Xin Li, Xinyu Tang, Xiyuan Yang, Xudong Ma, Ya Tong, Yachao Wang, Yang Tian, Yaxin Du, Yeli Ruan, Yi Wang, Yi Yu, Yibin Feng, Yibo Tan, Yihang Wang, Yiming Ju, Yinda Chen, Yinda Chen, Yingjie Du, Yiwei Liu, Yizhi Zhou, Yuan Wei, Yuli Chen, Yuqi Zhu, Yuwen Li, Yuxi Dong, Yuxuan Zhang, Yuyang Song, Zhange Zhang, Zhaohan Zhang, Zhaoyi Li, Zhen Zhang, Zhengbo Zhang, Zhihang Hu, Zhiwei Yu, Zhixin Xie, Zhiyu Chen, Zhizhao Luo, Zhongyuan Wu, Zhou Fang, Zhu Lin, Zhuocheng Gong, Zixi Zhao, Ziyang Zeng, Ziyi Wang, Ziyu Zhao, Ran Tao, Mingjie Tang, Chuan Hao, Peihao Wu, Jianzhou Wang, Nan Jiang, Yuan Zhi, Bryan Dai |
| date | 2026-10-22 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2610.30949 |
| affiliation | IQuest |
| upvotes | 99 (Hugging Face Daily Papers, 2026-11-01) |
| links | abs pdf hf |
| abstract | We present IQuest-Q1, a sparse Mixture-of-Experts (MoE) agentic foundation model with 320B total parameters (15B activated). IQuest-Q1 is developed through a three-stage process: (1) stable and efficient pre-training, combining Stable SplitNorm, Muon, and muP with a two-stage curriculum whose second stage increases the coding-data mixture, preserving a wide stability margin between safe and optimal learning rates; (2) fine-grained mid-training, expanding the data mixture across domains and formats and progressively extending the context; and (3) multi-scaffold with multi-version post-training, combining SFT, domain-specialized RL, and MOPD across various scaffolds to integrate complementary training signals and strengthen agentic coding capabilities. Furthermore, model merging combines different experts and checkpoints from different stages while mitigating conflicts among their parameter updates. The resulting IQuest-Q1 demonstrates capabilities in both coding and general tasks. We release IQuest-Q1 as an open-source model to support community research and development. |
cite
@misc{yang2026iquest,
title={IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems},
author={A. Jian Yang and An Huang and Bo Dan and Chen Mu and Chengran Yang and Chuan Shi and Feng Chang and Hongxin Li and Hongyuan Tao and Jinxing Zhang and Jujie He and Kun Wang and Lin Jing and Ming Yang and Qicheng Hu and Renyuan Li and Shark Liu and Shawn Guo and Shi Qing and Shi Zhong and Tianyu Zheng and Wei Liu and Wei Zhang and Wenrui Cai and Wenxiao Chen and Xuxing Chen and Yan Xing and Yi Xing and Yifan Luo and Yiran Xing and Yizhi Li and Yongsheng Kang and Yucheng Ding and Yue Song and Yun Qing and Yunqi Liu and Zelong Huang and Zhengmao Ye and Zhentao Fan and Zhiteng Li and Ziling Huang and Bihong Tang and Bingli Wang and Ce Jun and Changhao Chen and Chen Hu and Chen Xiao and Chi Liu and Chunjiang Ge and Danyang Li and Deyang Kong and Dian Qi and Ding Tan and Evan Yang and Fanglin Xu and Fei Bai and Gang Liu and Guochang Li and Hao Tang and Haoran Feng and Haowen Wang and Huahao Hu and Huanjin Yao and Huatong Song and Jia Deng and Jiajun Wu and Jialiang Cheng and Jiayi Liang and Jiayi Wu and Jie Deng and Jiejun Tan and Jing Yang and Jingda Xu and Junhang Cheng and Junxiao Liu and Kai Lv and Kaixiang Pan and Kecheng Lu and Kun Zeng and Kun Zheng and Kunbo Ding and Liang Qiu and Lingyi Sun and Luan Zhang and Mengxiao Lv and Ning Dong and Pei Wang and Peng Zhang and Qingsong Cai and Qixiang Yin and Qiyao Wang and Renbiao Liu and Renfei Dang and Ruihang Li and Ruirui Huang and Shanhui Yin and Shen Jian and Shengjie Fang and Shikai Li and Shinan Zhang and Shiqi Chen and Shuai Liu and Shuangqi Li and Shuo Tang and Shuqing Deng and Sijin Hao and Siwei Wu and Siyue Wang and Tao Hai and Tao Ren and TingYang Chen and Wei Shao and Weicheng Gu and Weihan Peng and Wenlong Miao and Xavier Yu and Xiangyuan Ji and Xiaocheng Li and Xiaodong Huang and Xiaohan Ge and Xiaoxiang Shi and Xiaoyang Zhang and Xiaoyu Yang and Xidong Wang and Xin Li and Xinyu Tang and Xiyuan Yang and Xudong Ma and Ya Tong and Yachao Wang and Yang Tian and Yaxin Du and Yeli Ruan and Yi Wang and Yi Yu and Yibin Feng and Yibo Tan and Yihang Wang and Yiming Ju and Yinda Chen and Yinda Chen and Yingjie Du and Yiwei Liu and Yizhi Zhou and Yuan Wei and Yuli Chen and Yuqi Zhu and Yuwen Li and Yuxi Dong and Yuxuan Zhang and Yuyang Song and Zhange Zhang and Zhaohan Zhang and Zhaoyi Li and Zhen Zhang and Zhengbo Zhang and Zhihang Hu and Zhiwei Yu and Zhixin Xie and Zhiyu Chen and Zhizhao Luo and Zhongyuan Wu and Zhou Fang and Zhu Lin and Zhuocheng Gong and Zixi Zhao and Ziyang Zeng and Ziyi Wang and Ziyu Zhao and Ran Tao and Mingjie Tang and Chuan Hao and Peihao Wu and Jianzhou Wang and Nan Jiang and Yuan Zhi and Bryan Dai},
year={2026},
eprint={2610.30949},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2610.30949}
}