Abstract
Over the past decade, knowledge graphs became popular for capturingstructured domain knowledge. Relational learning models enable the predictionof missing links inside knowledge graphs. More specifically, latent distanceapproaches model the relationships among entities via a distance between latentrepresentations. Translating embedding models (e.g., TransE) are among the mostpopular latent distance approaches which use one distance function to learnmultiple relation patterns. However, they are not capable of capturingsymmetric relations. They also force relations with reflexive patterns tobecome symmetric and transitive. In order to improve distance based embedding,we propose multi-distance embeddings (MDE). Our solution is based on the ideathat by learning independent embedding vectors for each entity and relation onecan aggregate contrasting distance functions. Benefiting from MDE, we alsodevelop supplementary distances resolving the above-mentioned limitations ofTransE. We further propose an extended loss function for distance basedembeddings and show that MDE and TransE are fully expressive using this lossfunction. Furthermore, we obtain a bound on the size of their embeddings forfull expressivity. Our empirical results show that MDE significantly improvesthe translating embeddings and outperforms several state-of-the-art embeddingmodels on benchmark datasets.