Abstract
Since the entry of kernel theory in the field of quantum machine learning,quantum kernel methods (QKMs) have gained increasing attention with regard toboth probing promising applications and delivering intriguing researchinsights. Two common approaches for computing the underlying Gram matrix haveemerged: fidelity quantum kernels (FQKs) and projected quantum kernels (PQKs).Benchmarking these methods is crucial to gain robust insights and to understandtheir practical utility. In this work, we present a comprehensive large-scalestudy examining QKMs based on FQKs and PQKs across a manifold of designchoices. Our investigation encompasses both classification and regression tasksfor five dataset families and 64 datasets, systematically comparing the use ofFQKs and PQKs quantum support vector machines and kernel ridge regression. Thisresulted in over 20,000 models that were trained and optimized using astate-of-the-art hyperparameter search to ensure robust and comprehensiveinsights. We delve into the importance of hyperparameters on model performancescores and support our findings through rigorous correlation analyses. In this,we also closely inspect two data encoding strategies. Moreover, we provide anin-depth analysis addressing the design freedom of PQKs and explore theunderlying principles responsible for learning. Our goal is not to identify thebest-performing model for a specific task but to uncover the mechanisms thatlead to effective QKMs and reveal universal patterns.