Abstract
We develop a system for the FEVER fact extraction and verification challengethat uses a high precision entailment classifier based on transformer networkspretrained with language modeling, to classify a broad set of potentialevidence. The precision of the entailment classifier allows us to enhancerecall by considering every statement from several articles to decide upon eachclaim. We include not only the articles best matching the claim text by TFIDFscore, but read additional articles whose titles match named entities andcapitalized expressions occurring in the claim text. The entailment moduleevaluates potential evidence one statement at a time, together with the titleof the page the evidence came from (providing a hint about possible pronounantecedents). In preliminary evaluation, the system achieves .5736 FEVER score,.6108 label accuracy, and .6485 evidence F1 on the FEVER shared task test set.