Abstract

We introduce two reference-free metrics for quality evaluation of taxonomies.The first metric evaluates robustness by calculating the correlation betweensemantic and taxonomic similarity, covering a type of error not handled byexisting metrics. The second uses Natural Language Inference to assess logicaladequacy. Both metrics are tested on five taxonomies and are shown to correlatewell with F1 against gold-standard taxonomies.

 

Quick Read (beta)