| title | VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender |
|---|---|
| authors | Yuzhe Chen, Muxi Diao, Lele Yang, Wenbin Xu, Xuyang Liu, Qile Su, Changyi Liu, Jiankang Chen, Kaiyu Jiang, Haoyu Zhang, Hongyi Fu, Jianxiong Wang, Tianke Zhang, Haonan Fan, Yingxin Li, Bingyi Li, Xu Wang, Xuanyu Zheng, Bin Wen, Tingting Gao, Wentao Zhang, Jiale Cao |
| date | 2026-11-11 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2611.15789 |
| affiliation | Kling-Keye |
| upvotes | 89 (Hugging Face Daily Papers, 2026-11-18) |
| links | abs pdf hf code |
| cite | |
| abstract | Controllable real-world video generation models can condition on a rendered graybox proxy video, which fixes layout, motion and camera. Coding agents can build such videos by reconstructing a 4D scene in Blender, yet no benchmark checks both these videos and the long, multi-shot scenes behind them. We introduce VibePrevisBench, a benchmark for 4D scene reconstruction: an agent turns a brief into an executable 4D scene and renders its proxy video. Its 242 tasks span four input kinds, including scripts, photos, continuations, and reference videos. Each delivery is scored along two evaluation dimensions. Rule-based Scene Check re-runs the code and compares the exported 4D scene with hidden ground truth facts in nine dimensions. VLM-based Screen Check asks a VLM judge whether the facts that pass can be recognized in the proxy video. We analyze the evaluation results and trajectories of 11 frontier coding agents and identify three key observations. First, multimodal understanding separates the agents, especially in understanding space and camera motion. Second, all agents seem to already master basic camera work and staging, and fail at challenging requests. Third, agents inspect their own renders but fail to correct their errors. Agents thus need better visual understanding of space and camera, explicit checks for challenging requests, and item-by-item verification of renders against the brief. |
bibtex
@misc{chen2026vibeprevisbench,
title={VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender},
author={Yuzhe Chen and Muxi Diao and Lele Yang and Wenbin Xu and Xuyang Liu and Qile Su and Changyi Liu and Jiankang Chen and Kaiyu Jiang and Haoyu Zhang and Hongyi Fu and Jianxiong Wang and Tianke Zhang and Haonan Fan and Yingxin Li and Bingyi Li and Xu Wang and Xuanyu Zheng and Bin Wen and Tingting Gao and Wentao Zhang and Jiale Cao},
year={2026},
eprint={2611.15789},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2611.15789}
}