AdaPrompt: Adaptive Prompt-based Finetuning for Relation Extraction

  • 2021-04-15 17:57:43
  • Xiang Chen, Xin Xie, Ningyu Zhang, Jiahuan Yan, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen
  • 23

Abstract

In this paper, we reformulate the relation extraction task as mask languagemodeling and propose a novel adaptive prompt-based finetuning approach. Wepropose an adaptive label words selection mechanism that scatters the relationlabel into variable number of label tokens to handle the complex multiple labelspace. We further introduce an auxiliary entity discriminator object toencourage the model to focus on context representation learning. Extensiveexperiments on benchmark datasets demonstrate that our approach can achievebetter performance on both the few-shot and supervised setting.

 

Quick Read (beta)

loading the full paper ...