Abstract
Program-of-Thought (PoT), which aims to use programming language instead ofnatural language as an intermediate step in reasoning, is an important way forLLMs to solve mathematical problems. Since different programming languagesexcel in different areas, it is natural to use the most suitable language forsolving specific problems. However, current PoT research only focuses on singlelanguage PoT, ignoring the differences between different programming languages.Therefore, this paper proposes an multilingual program reasoning method,MultiLingPoT. This method allows the model to answer questions using multipleprogramming languages by fine-tuning on multilingual data. Additionally, priorand posterior hybrid methods are used to help the model select the mostsuitable language for each problem. Our experimental results show that thetraining of MultiLingPoT improves each program's mathematical reasoning byabout 2.5\%. Moreover, with proper mixing, the performance of MultiLingPoT canbe further improved, achieving a 6\% increase compared to the single-languagePoT with the data augmentation.Resources of this paper can be found athttps://github.com/Nianqi-Li/MultiLingPoT.