Abstract
Word evolution refers to the changing meanings and associations of wordsthroughout time, as a byproduct of human language evolution. By studying wordevolution, we can infer social trends and language constructs over differentperiods of human history. However, traditional techniques such as wordrepresentation learning do not adequately capture the evolving languagestructure and vocabulary. In this paper, we develop a dynamic statistical modelto learn time-aware word vector representation. We propose a model thatsimultaneously learns time-aware embeddings and solves the resulting "alignmentproblem". This model is trained on a crawled NYTimes dataset. Additionally, wedevelop multiple intuitive evaluation strategies of temporal word embeddings.Our qualitative and quantitative tests indicate that our method not onlyreliably captures this evolution over time, but also consistently outperformsstate-of-the-art temporal embedding approaches on both semantic accuracy andalignment quality.