| title | "PRISM" Is Not All You Need: Cross-Topic Name Collisions and Scientific Paper Retrieval |
|---|---|
| authors | Jingjie Ning, Xueqi Li, Yibo Kong |
| date | 2026-11-01 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2611.01362 |
| affiliation | Carnegie Mellon University |
| upvotes | 6 (Hugging Face Daily Papers, 2026-11-11) |
| links | abs pdf hf |
| cite | |
| related | Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation Training Object Permanence in World Models Into the Unknown: Benchmarking AI agents on open scientific research problems K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand |
| abstract | Scientific names increasingly connect papers from different research topics, leaving readers to recover a paper's identity from context. We study this convergence in 564,861 AI-related arXiv records. Cross-topic name collision grows 4.33-fold from a pooled 2020-2022 reference to 2026, compared with 1.12-fold within topics. A second sentence encoder reproduces the pattern, and name-group resampling quantifies its uncertainty. Fixed word-frequency bands locate the main increase in an intermediate-frequency vocabulary shared by many research areas. We then measure the ambiguity that remains after supplying research clues. With the same three-term query construction, shared-name targets retain matched identification deficits of 25.7 percentage points under title-based BM25 and 6.9 points under title-plus-abstract E5. Within fixed same-name candidates, listwise language-model ranking reaches 89.2% using the query and candidate titles. Topic-specific comparisons show that context resolves more cross-topic ambiguity. The evaluation separates candidate competition, document fields, and contextual ranking through lexical, dense, and language-model baselines. Source-linked cases and a portable evaluation collection make the phenomenon inspectable and reusable for scientific retrieval and research assistants. |
bibtex
@misc{ning2026prism,
title={"PRISM" Is Not All You Need: Cross-Topic Name Collisions and Scientific Paper Retrieval},
author={Jingjie Ning and Xueqi Li and Yibo Kong},
year={2026},
eprint={2611.01362},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2611.01362}
}