Abstract

Large Language Models (LLMs) have gained significant attention due to theirhigh performance on a wide range of natural language tasks since the release ofChatGPT. The LLMs learn to understand and generate language by trainingbillions of model parameters on vast volumes of text data. Despite being arelatively new field, LLM research is rapidly advancing in various directions.In this paper, we present an overview of LLM families, including LLaMA, PaLM,GPT, and MoE, and the methods developed to create and enhance LLMs for officialEuropean Union (EU) languages. We provide a comprehensive summary of commonmonolingual and multilingual datasets used for pretraining LLMs.

 

Quick Read (beta)