Abstract
Deep learning models often tackle the intra-sample structure, such as theorder of words in a sentence and pixels in an image, but have not pay muchattention to the inter-sample relationship. In this paper, we show thatexplicitly modeling the inter-sample structure to be more discretized canpotentially help model's expressivity. We propose a novel method, AtomModeling, that can discretize a continuous latent space by drawing an analogybetween a data point and an atom, which is naturally spaced away from otheratoms with distances depending on their intra structures. Specifically, wemodel each data point as an atom composed of electrons, protons, and neutronsand minimize the potential energy caused by the interatomic force among datapoints. Through experiments with qualitative analysis in our proposed AtomModeling on synthetic and real datasets, we find that Atom Modeling can improvethe performance by maintaining the inter-sample relation and can capture aninterpretable intra-sample relation by mapping each component in a data pointto electron/proton/neutron.