Abstract
Many NLP models gain performance by having access to a knowledge base. A lotof research has been devoted to devising and improving the way the knowledgebase is accessed and incorporated into the model, resulting in a number ofmechanisms and pipelines. Despite the diversity of proposed mechanisms, thereare patterns in the designs of such systems. In this paper, we systematicallydescribe the typology of artefacts (items retrieved from a knowledge base),retrieval mechanisms and the way these artefacts are fused into the model. Thisfurther allows us to uncover combinations of design decisions that had not yetbeen tried. Most of the focus is given to language models, though we also showhow question answering, fact-checking and knowledgable dialogue models fit intothis system as well. Having an abstract model which can describe thearchitecture of specific models also helps with transferring thesearchitectures between multiple NLP tasks.