Abstract
Large Language Models (LLMs) are increasingly bringing advances to NaturalLanguage Processing. However, low-resource languages, those lacking extensiveprominence in datasets for various NLP tasks, or where existing datasets arenot as substantial, such as Portuguese, already obtain several benefits fromLLMs, but not to the same extent. LLMs trained on multilingual datasetsnormally struggle to respond to prompts in Portuguese satisfactorily,presenting, for example, code switching in their responses. This work proposesa fine-tuned LLaMA 2-based model for Portuguese prompts named Bode in twoversions: 7B and 13B. We evaluate the performance of this model inclassification tasks using the zero-shot approach with in-context learning, andcompare it with other LLMs. Our main contribution is to bring an LLM withsatisfactory results in the Portuguese language, as well as to provide a modelthat is free for research or commercial purposes.