titleBlind Variation, Selective Retention: Improving Creative Idea Generation in AI Scientists
authorsGuowei Xu, Jiaru Zou, Mete Erdogan, Haotian Ye, Pan Lu, James Zou
date2026-11-09
venuearXiv (preprint, not peer reviewed)
idarXiv:2611.12184
affiliationStanford University
upvotes4 (Hugging Face Daily Papers, 2026-11-13)
linksabs pdf hf code
cite
relatedThinking Inertia: LLMs Keep Thinking When Told Not To
Hybrid Reasoning Agents
AISPA: User-Centric System Prompt Auditing for Large Language Model Applications
The Last Human-Written Paper: Agent-Native Research Artifacts
Stateless Language Agents: Scaling Long-Horizon Automated Research
abstractScientific discovery requires ideas that are original, useful, and non-obvious. Yet AI scientists are typically given as much task information as possible during idea generation, which can anchor generation toward familiar approaches. Inspired by the cognitive framework of Blind Variation and Selective Retention (BVSR), we propose a discovery framework that separates these two roles of information: it generates proposals under deliberately limited task information to broaden exploration, then learns from proposals previously verified on the same task and their outcomes to retain promising candidates for costly empirical evaluation. We evaluate BVSR across five proposer models and 12 scientific tasks. Limiting task information substantially increases proposal originality and non-obviousness, and produces a larger share of highly creative and high-utility proposals than existing state-of-the-art prompting-based baselines. Learning from prior proposal outcomes on the task further improves candidate selection, discarding half of the candidates while retaining most top-performing proposals. When incorporated into existing AI-scientist workflows, BVSR achieves stronger discoveries across gene expression analysis, drug response prediction, anomaly detection, scaling law discovery, and brain activity prediction. These results suggest that effective AI scientists should use information differently across stages of discovery: constrain task-specific information during exploration while exploiting accumulated empirical experience on the task.

bibtex

@misc{xu2026blind,
  title={Blind Variation, Selective Retention: Improving Creative Idea Generation in AI Scientists},
  author={Guowei Xu and Jiaru Zou and Mete Erdogan and Haotian Ye and Pan Lu and James Zou},
  year={2026},
  eprint={2611.12184},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2611.12184}
}