Abstract
Chain-of-Thought(CoT) prompting and its variants explore equipping largelanguage models (LLMs) with high-level reasoning abilities by emulatinghuman-like linear cognition and logic. However, the human mind is complicatedand mixed with both linear and nonlinear thinking. In this work, we propose\textbf{I}nferential \textbf{E}xclusion \textbf{P}rompting (IEP), a novelprompting that combines the principles of elimination and inference in order toguide LLMs to think non-linearly. IEP guides LLMs to plan and then utilizeNatural Language Inference (NLI) to deduce each possible solution's entailmentrelation with context, commonsense, or facts, therefore yielding a broaderperspective by thinking back for inferring. This forward planning and backwardeliminating process allows IEP to better simulate the complex human thinkingprocesses compared to other CoT-based methods, which only reflect linearcognitive processes. We conducted a series of empirical studies and havecorroborated that IEP consistently outperforms CoT across various tasks.Additionally, we observe that integrating IEP and CoT further improves theLLMs' performance on certain tasks, highlighting the necessity of equippingLLMs with mixed logic processes. Moreover, to better evaluate comprehensivefeatures inherent in human logic, we introduce \textbf{M}ental-\textbf{A}bility\textbf{R}easoning \textbf{B}enchmark (MARB). The benchmark comprises six novelsubtasks with a total of 9,115 questions, among which 1,685 are developed withhand-crafted rationale references. We believe both \textsc{IEP} and\textsc{MARB} can serve as a promising direction for unveiling LLMs' logic andverbal reasoning abilities and drive further advancements. \textsc{MARB} willbe available at ~\texttt{anonymity link} soon.