Abstract
Training Quantum Neural Networks (QNNs) on large amount of classical data canbe both time consuming as well as expensive. Higher amount of training datawould require higher number of gradient descent steps to reach convergence.This, in turn would imply that the QNN will require higher number of quantumexecutions, thereby driving up its overall execution cost. In this work, wepropose performing the dataset distillation process for QNNs, where we use anovel quantum variant of classical LeNet model containing residual connectionand trainable Hermitian observable in the Parametric Quantum Circuit (PQC) ofthe QNN. This approach yields highly informative yet small number of trainingdata at similar performance as the original data. We perform distillation forMNIST and Cifar-10 datasets, and on comparison with classical models observethat both the datasets yield reasonably similar post-inferencing accuracy onquantum LeNet (91.9% MNIST, 50.3% Cifar-10) compared to classical LeNet (94%MNIST, 54% Cifar-10). We also introduce a non-trainable Hermitian for ensuringstability in the distillation process and note marginal reduction of up to 1.8%(1.3%) for MNIST (Cifar-10) dataset.