Abstract
Over the past three years, the rapid advancement of Large Language Models(LLMs) has had a profound impact on multiple areas of Artificial Intelligence(AI), particularly in Natural Language Processing (NLP) across diverselanguages, including Arabic. Although Arabic is considered one of the mostwidely spoken languages across 27 countries in the Arabic world and used as asecond language in some other non-Arabic countries as well, there is still ascarcity of Arabic resources, datasets, and tools. Arabic NLP tasks facevarious challenges due to the complexities of the Arabic language, includingits rich morphology, intricate structure, and diverse writing standards, amongother factors. Researchers have been actively addressing these challenges,demonstrating that pre-trained Large Language Models (LLMs) trained onmultilingual corpora achieve significant success in various Arabic NLP tasks.This study provides an overview of using large language models (LLMs) for theArabic language, highlighting early pre-trained Arabic Language models acrossvarious NLP applications and their ability to handle diverse Arabic contenttasks and dialects. It also provides an overview of how techniques likefinetuning and prompt engineering can enhance the performance of these models.Additionally, the study summarizes common Arabic benchmarks and datasets whilepresenting our observations on the persistent upward trend in the adoption ofLLMs.