Abstract
System 2 reasoning is one of the defining characteristics of intelligence,which requires slow and logical thinking. Human conducts System 2 reasoning viathe language of thoughts that organizes the reasoning process as a causalsequence of mental language, or thoughts. Recently, it has been observed thatSystem 2 reasoning can be elicited from Large Language Models (LLMs)pre-trained on large-scale natural languages. However, in this work, we showthat there is a significant gap between the modeling of languages and thoughts.As language is primarily a tool for humans to share knowledge and thinking,modeling human language can easily absorb language biases into LLMs deviatedfrom the chain of thoughts in minds. Furthermore, we show that the biases willmislead the eliciting of "thoughts" in LLMs to focus only on a biased part ofthe premise. To this end, we propose a new prompt technique termedLanguage-of-Thoughts (LoT) to demonstrate and alleviate this gap. Instead ofdirectly eliciting the chain of thoughts from partial information, LoTinstructs LLMs to adjust the order and token used for the expressions of allthe relevant information. We show that the simple strategy significantlyreduces the language modeling biases in LLMs and improves the performance ofLLMs across a variety of reasoning tasks.