Tatarstan Toponyms: A Bilingual Dataset and Hybrid RAG System for Geospatial Question Answering

  • 2026-08-19 17:14:30
  • Mullosharaf K. Arabov, Svetlana S. Khaybullina, Dinara M. Naumetova
  • 0

Abstract

This paper addresses end-to-end geospatial question answering over multilingual toponymic data. We introduce a bilingual (Russian-Tatar) dataset of 9,688 toponyms with linguistic, etymological, and coordinate information (93.1 percent georeferenced). Based on this, we construct about 39,000 question-context-answer triples with guaranteed answer localization. Our architecture combines a hybrid retriever (dense semantic indexing with multilingual-e5-large plus geospatial filtering/ranking using KD-trees and haversine distance) and an extractive reader fine-tuned on transformer models. On 500 test queries, hybrid search achieves Recall@1 = 0.988, Recall@5 = 1.000, MRR = 0.994, significantly outperforming BM25 and spatial-only methods. Among readers (RuBERT, XLM-RoBERTa-large, T5-RUS), XLM-RoBERTa-large gives best results: EM = 0.992, F1 = 0.994. RuBERT models fail on coordinate questions due to tokenization artifacts, but simple post-processing recovers 100 percent accuracy. Resources (dataset, QA corpus, models, web demo) are openly released on Hugging Face. Results are directly applicable to geospatial QA services, geocoding, and digital humanities projects.

 

Quick Read (beta)

loading the full paper ...