Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE

  • 2025-03-06 16:22:22
  • Aditya Ravuri, Neil D. Lawrence
  • 0

Abstract

This paper shows that dimensionality reduction methods such as UMAP andt-SNE, can be approximately recast as MAP inference methods corresponding to amodel introduced in ProbDR, that describes the graph Laplacian (an estimate ofthe data precision matrix) using a Wishart distribution, with a mean given by anon-linear covariance function evaluated on the latents. This interpretationoffers deeper theoretical and semantic insights into such algorithms, byshowing that variances corresponding to these covariances are low (potentiallymisspecified), and forging a connection to Gaussian process latent variablemodels by showing that well-known kernels can be used to describe covariancesimplied by graph Laplacians. We also introduce tools with which similardimensionality reduction methods can be studied.

 

Quick Read (beta)

loading the full paper ...