Abstract
We propose orthogonal inductive matrix completion (OMIC), an interpretablemodel composed of a sum of matrix completion terms, each with orthonormal sideinformation. We can inject prior knowledge about the eigenvectors of the groundtruth matrix, whilst maintaining the representation capability of the model. Wepresent a provably converging algorithm that optimizes all components of themodel simultaneously, using nuclear-norm regularisation. Our method is backedup by \textit{distribution-free} learning guarantees that improve with thequality of the injected knowledge. As a special case of our general framework,we study a model consisting of a sum of user and item biases (genericbehaviour), a non-inductive term (specific behaviour), and an inductive termusing side information. Our theoretical analysis shows that $\epsilon$-recovering the ground truthmatrix requires at most $O\left( \frac{n+m+(\sqrt{n}+\sqrt{m})mn\sqrt{r}C}{\epsilon^2}\right)$ entries, where $r$ is the rank of the groundtruth matrix. We analyse the performance of OMIC on several synthetic and realdatasets. On synthetic datasets with a sliding scale of user bias relevance, weshow that OMIC better adapts to different regimes than other methods and canrecover the ground truth. On real life datasets containing user/itemsrecommendations and relevant side information, we find that OMIC surpasses thestate of the art, with the added benefit of greater interpretability.