Abstract
Using large language models, this paper presents techniques to improveextremely low-resourced indigenous language translations. Our approaches aregrounded in the use of (1) the presence of a datastore consisting of a limitednumber of parallel translation examples, (2) the inherent capabilities of LLMslike GPT-3.5, and (3) a word-level translation dictionary. We harness thepotential of LLMs and in-context learning techniques in such a setting forusing LLMs as universal translators for extremely low-resourced languages. Ourmethodology hinges on utilizing LLMs as language compilers for selectedlanguage pairs, hypothesizing that they could internalize syntactic structuresto facilitate accurate translation. We introduce three techniques: KNNPromptingwith Retrieved Prompting Context, Chain-of-Thought Prompting andLearningfrom-Mistakes Prompting, with the last method addressing past errors.The evaluation results suggest that, even with limited corpora, LLMs caneffectively translate extremely low-resource languages when paired with properprompting.