Abstract
State-of-The-Art (SoTA) image captioning models are often trained on theMicroSoft Common Objects in Context (MS-COCO) dataset, which containshuman-annotated captions with an average length of approximately ten tokens.Although effective for general scene understanding, these short captions oftenfail to capture complex scenes and convey detailed information. Moreover,captioning models tend to exhibit bias towards the ``average'' caption, whichcaptures only the more general aspects, thus overlooking finer details. In thispaper, we present a novel approach to generate richer and more informativeimage captions by combining the captions generated from different SoTAcaptioning models. Our proposed method requires no additional model training:given an image, it leverages pre-trained models from the literature to generatethe initial captions, and then ranks them using a newly introducedimage-text-based metric, which we name BLIPScore. Subsequently, the top twocaptions are fused using a Large Language Model (LLM) to produce the final,more detailed description. Experimental results on the MS-COCO and Flickr30ktest sets demonstrate the effectiveness of our approach in terms ofcaption-image alignment and hallucination reduction according to the ALOHa,CAPTURE, and Polos metrics. A subjective study lends additional support tothese results, suggesting that the captions produced by our model are generallyperceived as more consistent with human judgment. By combining the strengths ofdiverse SoTA models, our method enhances the quality and appeal of imagecaptions, bridging the gap between automated systems and the rich andinformative nature of human-generated descriptions. This advance enables thegeneration of more suitable captions for the training of both vision-languageand captioning models.