Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers
Apr 23, 2026ยท
,,,,
Xin Chen
Equal contribution
,Feng Jiang
Equal contribution
Yiqian Zhang
Hardy Chen
Shuo Yan
Wenya Xie
Min Yang
Corresponding author
,Shujian Huang
Corresponding author
ยท
0 min readAbstract
Reasoning-oriented Large Language Models (LLMs) have achieved remarkable progress with Chain-of-Thought (CoT) prompting, yet they remain fundamentally limited by a blind self-thinking paradigm: performing extensive internal reasoning even when critical information is missing or ambiguous. We propose Proactive Interactive Reasoning (PIR), a new reasoning paradigm that transforms LLMs from passive solvers into proactive inquirers that interleave reasoning with clarification. Unlike existing search- or tool-based frameworks that primarily address knowledge uncertainty by querying external environments, PIR targets premise- and intent-level uncertainty through direct interaction with the user. PIR is implemented via two core components: (1) an uncertainty-aware supervised fine-tuning procedure that equips models with interactive reasoning capability, and (2) a user-simulator-based policy optimization framework driven by a composite reward that aligns model behavior with user intent. Extensive experiments on mathematical reasoning, code generation, and document editing demonstrate that PIR consistently outperforms strong baselines, achieving up to 32.70% higher accuracy, 22.90% higher pass rate, and 41.36 BLEU improvement, while reducing nearly half of the reasoning computation and unnecessary interaction turns. Further reliability evaluations on factual knowledge, question answering, and missing-premise scenarios confirm the strong generalization and robustness of PIR.
Type
Publication
ACL Main 2026 Accepted

Authors
Yiqian Zhang
(he/him)
PhD Student in CS @ CWRU
I am an incoming PhD student in Computer Science at Case Western Reserve University, where I am fortunate to be advised by Prof. Erman Ayday. Prior to joining CWRU, I earned my M.S. in Electrical and Computer Engineering from Georgia Tech and my bachelor’s degree in Computer Science from Beijing Jiaotong University.
My research interests lie in the area of Trustworthy AI, with a focus on enhancing the reasoning capabilities of Large Language Models (LLMs) and ensuring their safety alignment.
Please feel free to reach out!