titleReplacing Training with Memory: Listwise Selection for Text-to-SQL
authorsYeonseok Jeong, Soyoung Yoon, Seongjun Lee, Seung-won Hwang
date2026-09-01
venuearXiv (preprint, not peer reviewed)
idarXiv:2609.00834
affiliationSeoul National University
upvotes4 (Hugging Face Daily Papers, 2026-11-01)
linksabs pdf hf code
abstractModern Text-to-SQL systems often follow generate-execute-select pipelines, generating multiple candidate queries then selecting the best one. Listwise selection, by jointly comparing multiple candidates, has been widely adopted, but fine-tuning listwise selectors is costly. We thus propose a fine-tuning-free listwise selector. We replace two major fine-tuning objectives with inference-time strategies: (1) learning selection criteria as ordering and (2) mitigating positional bias. First, we build reusable structured memories instead of learning selection behavior as model parameters. Given a question, MaP-SQL retrieves memories distilled from training data that encode how natural language maps to schema elements, SQL operations, and expected outputs. These memories serve as explicit decision criteria for evaluating candidates in a listwise manner. Second, to mitigate ordering bias of listwise selectors, we aggregate rankings across multiple input permutations, with inference cost optimized by execution results and pointwise scoring. Our approach improves selection accuracy while maintaining efficiency and compatibility with existing large language models. Across Text-to-SQL benchmarks, it produces more stable selection without fine-tuning and fewer unnecessary comparisons than existing methods. On BIRD-dev, it outperforms the previous state-of-the-art selector-based method R^3-SQL by 2.02 execution accuracy points on average using the same candidate sets, with 2.92x fewer tokens.

cite

@misc{jeong2026replacing,
  title={Replacing Training with Memory: Listwise Selection for Text-to-SQL},
  author={Yeonseok Jeong and Soyoung Yoon and Seongjun Lee and Seung-won Hwang},
  year={2026},
  eprint={2609.00834},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2609.00834}
}