Abstract
This study presents a comprehensive benchmark analysis of various YOLO (YouOnly Look Once) algorithms, from YOLOv3 to the newest addition. It representsthe first research to comprehensively evaluate the performance of YOLO11, thelatest addition to the YOLO family. It evaluates their performance on threediverse datasets: Traffic Signs (with varying object sizes), African Wildlife(with diverse aspect ratios and at least one instance of the object per image),and Ships and Vessels (with small-sized objects of a single class), ensuring acomprehensive assessment across datasets with distinct challenges. To ensure arobust evaluation, we employ a comprehensive set of metrics, includingPrecision, Recall, Mean Average Precision (mAP), Processing Time, GFLOPs count,and Model Size. Our analysis highlights the distinctive strengths andlimitations of each YOLO version. For example: YOLOv9 demonstrates substantialaccuracy but struggles with detecting small objects and efficiency whereasYOLOv10 exhibits relatively lower accuracy due to architectural choices thataffect its performance in overlapping object detection but excels in speed andefficiency. Additionally, the YOLO11 family consistently shows superiorperformance in terms of accuracy, speed, computational efficiency, and modelsize. YOLO11m achieved a remarkable balance of accuracy and efficiency, scoringmAP50-95 scores of 0.795, 0.81, and 0.325 on the Traffic Signs, AfricanWildlife, and Ships datasets, respectively, while maintaining an averageinference time of 2.4ms, a model size of 38.8Mb, and around 67.6 GFLOPs onaverage. These results provide critical insights for both industry andacademia, facilitating the selection of the most suitable YOLO algorithm fordiverse applications and guiding future enhancements.