Abstract
This paper establishes a formal information-theoretic framework for imagecaptioning, conceptualizing captions as compressed linguistic representationsthat selectively encode semantic units in images. Our framework posits thatgood image captions should balance three key aspects: informationallysufficient, minimally redundant, and readily comprehensible by humans. Byformulating these aspects as quantitative measures with adjustable weights, ourframework provides a flexible foundation for analyzing and optimizing imagecaptioning systems across diverse task requirements. To demonstrate itsapplicability, we introduce the Pyramid of Captions (PoCa) method, whichgenerates enriched captions by integrating local and global visual information.We present both theoretical proof that PoCa improves caption quality undercertain assumptions, and empirical validation of its effectiveness acrossvarious image captioning models and datasets.