Abstract
This paper does not describe a working system. Instead, it presents a singleidea about representation which allows advances made by several differentgroups to be combined into an imaginary system called GLOM. The advancesinclude transformers, neural fields, contrastive representation learning,distillation and capsules. GLOM answers the question: How can a neural networkwith a fixed architecture parse an image into a part-whole hierarchy which hasa different structure for each image? The idea is simply to use islands ofidentical vectors to represent the nodes in the parse tree. If GLOM can be madeto work, it should significantly improve the interpretability of therepresentations produced by transformer-like systems when applied to vision orlanguage