Abstract

Meaningfully comparing language models is challenging with currentexplanation methods. Current explanations are overwhelming for humans due tolarge vocabularies or incomparable across models. We present TopEx, anexplanation method that enables a level playing field for comparing languagemodels via model-agnostic topics. We demonstrate how TopEx can identifysimilarities and differences between DistilRoBERTa and GPT-2 on a variety ofNLP tasks.

 

Quick Read (beta)