Comparative Analysis of Listwise Reranking with Large Language Models in Limited-Resource Language Contexts

  • 2025-01-15 06:15:13
  • Yanxin Shen, Lun Wang, Chuanqi Shi, Shaoshuai Du, Yiyi Tao, Yixian Shen, Hang Zhang
  • 0

Abstract

Large Language Models (LLMs) have demonstrated significant effectivenessacross various NLP tasks, including text ranking. This study assesses theperformance of large language models (LLMs) in listwise reranking forlimited-resource African languages. We compare proprietary models RankGPT3.5,Rank4o-mini, RankGPTo1-mini and RankClaude-sonnet in cross-lingual contexts.Results indicate that these LLMs significantly outperform traditional baselinemethods such as BM25-DT in most evaluation metrics, particularly in nDCG@10 andMRR@100. These findings highlight the potential of LLMs in enhancing rerankingtasks for low-resource languages and offer insights into cost-effectivesolutions.

 

Quick Read (beta)

loading the full paper ...