TopEx: Topic-based Explanations for Model Comparison

  • 2023-06-01 18:59:10
  • Shreya Havaldar, Adam Stein, Eric Wong, Lyle Ungar
  • 0

Abstract

Meaningfully comparing language models is challenging with currentexplanation methods. Current explanations are overwhelming for humans due tolarge vocabularies or incomparable across models. We present TopEx, anexplanation method that enables a level playing field for comparing languagemodels via model-agnostic topics. We demonstrate how TopEx can identifysimilarities and differences between DistilRoBERTa and GPT-2 on a variety ofNLP tasks.

 

Quick Read (beta)

loading the full paper ...