| title | MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering |
|---|---|
| authors | Changjiang Jiang, Jiang Zhou, Xinbin Yuan, Fan Zhang, Tao Feng, Zhuohan Xie |
| date | 2026-10-14 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2611.21644 |
| affiliation | Mohamed Bin Zayed University of Artificial Intelligence |
| upvotes | 1 (Hugging Face Daily Papers, 2026-11-19) |
| links | abs pdf hf code |
| cite | |
| related | Each Reward to Its Relevant Tokens: Reward-Specific Token-Level Credit Assignment for Multi-Reward RL Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision |
| abstract | Multimodal large language models (MLLMs) excel in vision-language tasks; yet, whether they maintain consistent understanding of information-rich visuals (InfoVis) when the surface language changes remains unclear. To quantify this capability, we introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations derived from 128 seed instances across 24 languages. We construct seed-matched, language-parallel visuals and QA pairs by disentangling numerical-structural data from text and programmatically synchronizing translated labels. We evaluate 25 MLLMs under two settings: Language-Aligned QA (LQA, matching visual-text languages) and Cross-Language QA (XQA, fixed QA language with varying visual languages). The results show that aggregate accuracy masks substantial robustness gaps: two models with comparable mean LQA accuracy (80.4\%) exhibit performance spreads of 7.8 and 20.3 percentage points across languages. Moreover, all 25 models score lower with non-English visuals under fixed English QA, underscoring the need for cross-language sensitivity metrics. |
bibtex
@misc{jiang2026minfovisqa,
title={MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering},
author={Changjiang Jiang and Jiang Zhou and Xinbin Yuan and Fan Zhang and Tao Feng and Zhuohan Xie},
year={2026},
eprint={2611.21644},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2611.21644}
}