Labelling as an unsupervised learning problem

  • 2018-05-10 10:04:27
  • Terry Lyons, Imanol Perez Arribas
  • 25

Abstract

Unravelling hidden patterns in datasets is a classical problem with manypotential applications. In this paper, we present a challenge whose objectiveis to discover nonlinear relationships in noisy cloud of points. If a set ofpoint satisfies a nonlinear relationship that is unlikely to be due torandomness, we will label the set with this relationship. Since points cansatisfy one, many or no such nonlinear relationships, cloud of points willtypically have one, multiple or no labels at all. This introduces the labellingproblem that will be studied in this paper. The objective of this paper is to develop a framework for the labellingproblem. We introduce a precise notion of a label, and we propose an algorithmto discover such labels in a given dataset, which is then tested in syntheticdatasets. We also analyse, using tools from random matrix theory, the problemof discovering false labels in the dataset.

 

Introduction (beta)

None

 

Conclusion (beta)

None