titleAPT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation
authorsSirui Zhang, Fangyun Wei, Dong Chen, Jinjing Zhao, Yitong Wang, Yunuo Chen, Baining Guo, Zheng-Jun Zha
date2026-10-13
venuearXiv (preprint, not peer reviewed)
idarXiv:2610.18097
affiliationMicrosoft Research
upvotes23 (Hugging Face Daily Papers, 2026-11-01)
linksabs pdf hf code
abstractPost-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed training distributions. We introduce APT (Agentic Post-Training), a fully automated framework that adaptively post-trains a base model according to its evolving capability profile. APT coordinates three agents to construct evaluation sets from user requirements, diagnose model-specific strengths and failure modes, and generate reinforcement learning data with an adaptive prompt distribution that emphasizes underperforming capabilities. By repeatedly evaluating, diagnosing, and updating the generator, APT lets the current model's behavior shape its next training tasks, forming a feedback loop inspired by recursive self-improvement. For general-purpose settings without user-specified evaluation scenarios, we further develop an evaluation harness that enables broad and diverse evaluation set generation. Experiments across multiple base models, benchmarks, and generation architectures demonstrate that APT is model-agnostic, benchmark-agnostic, architecture-agnostic, and fully automated.

cite

@misc{zhang2026apt,
  title={APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation},
  author={Sirui Zhang and Fangyun Wei and Dong Chen and Jinjing Zhao and Yitong Wang and Yunuo Chen and Baining Guo and Zheng-Jun Zha},
  year={2026},
  eprint={2610.18097},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2610.18097}
}