Abstract
Multilingual large language models (MLLMs) do not perform as well whenanswering questions in non-dominant languages as they do in their dominantlanguages. Although existing translate-then-answer methods alleviate thisissue, the mechanisms behind their effectiveness remain unclear. In this study,we analogize the dominant language of MLLMs to the native language of humansand use two human cognitive features: the Language Trigger (LT) and the DomainTrigger (DT), to interpret the mechanisms behind translate-then-answer methods.This reveals that while sufficient LTs are provided by these methods, thereremains a deficiency in DT retention. To mitigate this issue, we propose NativeLanguage Prompting (NatLan), employing a Multi-MLLM collaboration strategy andintroducing an additional role-enhanced domain-specific MLLM with strongermultilingual understanding capabilities as the translator. Across five languageQA benchmarks, NatLan achieves up to a 31.28% improvement in accuracy and,compared to existing state-of-the-art methods, provides comparable or greaterretention of DTs in up to 87% of cases. Our code is available athttps://github.com/AnonyNLP/NatLan.