| title | Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning |
|---|---|
| authors | Yizhe Zhang, Xujia Wang, Songqi Tang, Xujie Tang, Leo Jiahao Jiang, Jiacheng Wang, Bowen Qu, JinBo Li, Qin Wang, Ji Qi, Lei Hou, Bin Xu, Juanzi Li |
| date | 2026-10-15 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2610.22444 |
| affiliation | Tsinghua University |
| upvotes | 17 (Hugging Face Daily Papers, 2026-11-01) |
| links | abs pdf hf code |
| abstract | Spatio-Temporal Video Grounding (STVG) aims to jointly localize a target in space and time given a natural-language query. Despite continued advances, existing STVG benchmarks remain largely centered on localizing targets through instance-specific descriptions, leaving them largely decoupled from long-form reasoning increasingly emphasized in multimodal large language models (MLLMs). In this paper, we introduce Event-STVG, a task that shifts STVG from locating what is described toward event-level reasoning by unifying long-form context, repeated-event reasoning, event localization, role inference, and multi-target grounding. To facilitate research on Event-STVG, we construct a large-scale benchmark comprising 4,016 annotated event occurrences across soccer and seven additional domains. Experiments with state-of-the-art MLLMs reveal substantial difficulty, with the strongest model achieving only 5.4% m-vIoU at the 10-minute horizon. Across domains, we consistently observe confusion among repeated same-type events, spatial grounding bottlenecks, and rare success in jointly grounding all required roles. Event-STVG establishes a new challenge for visual understanding in MLLMs, calling for future models that can jointly reason about complex events across space and time. Code and annotations are available at https://github.com/THU-KEG/EventSTVG |
cite
@misc{zhang2026event,
title={Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning},
author={Yizhe Zhang and Xujia Wang and Songqi Tang and Xujie Tang and Leo Jiahao Jiang and Jiacheng Wang and Bowen Qu and JinBo Li and Qin Wang and Ji Qi and Lei Hou and Bin Xu and Juanzi Li},
year={2026},
eprint={2610.22444},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2610.22444}
}