| title | Code World Model 2.0: Towards Infinite Controllable Video Generation |
|---|---|
| authors | Ruoyu Wang, Hao Zhong, Yanming Yang, Jiahao Tian, Lin Liu, Biao Gong, Guoshan Lu, Yiding Tian, Chunhua Shen, Zhenzhong Lan, Chi Zhang |
| date | 2026-11-17 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2611.22925 |
| affiliation | inclusionAI |
| upvotes | 19 (Hugging Face Daily Papers, 2026-11-21) |
| links | abs pdf hf code |
| cite | |
| primer | World models |
| related | Realtime-Venus: A full-duplex interaction system with asynchronous delegation RULER: Instance-aware Rubric Rewards for SVG Generation Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes |
| abstract | Visual proxies decouple explicit world-state simulation from photorealistic video synthesis, offering a controllable interface for both offline clip creation and real-time interactive streaming. Yet a practical renderer must address two challenges. Upstream proxies vary from coarse layouts to fine articulated geometry depending on the interaction, and streaming inference must operate in a few causal steps without accumulating drift across self-generated history. We present Invoker-Render, pairing a bidirectional creation model with a causal four-step streaming model under a shared conditioning interface over structural proxies, an appearance reference, and language. Trained on an aligned approximately 200-hour multi-granularity corpus, Invoker-Render honors fine geometric constraints when supplied while synthesizing plausible local motion under coarse proxies, enabling runtime selection of input detail. To bridge bidirectional creation and real-time streaming without compounding step compression and rollout drift, we introduce Progressive Forcing (ProForcing). ProForcing first trains a causal predictor and distills it into a four-step renderer using histories derived from training videos. Training then shifts to continuous self-generated rollouts. A pipelined serving stack supports efficient streaming inference. Experiments show versatile control across proxy families, granularities, and camera paths, consistent gains over recent streaming baselines, and stable 30-minute racing rollouts that preserve scene and subject appearance. |
bibtex
@misc{wang2026code,
title={Code World Model 2.0: Towards Infinite Controllable Video Generation},
author={Ruoyu Wang and Hao Zhong and Yanming Yang and Jiahao Tian and Lin Liu and Biao Gong and Guoshan Lu and Yiding Tian and Chunhua Shen and Zhenzhong Lan and Chi Zhang},
year={2026},
eprint={2611.22925},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2611.22925}
}