Abstract

Adjusting the quantization according to the data or to the model loss seemsmandatory to enable a high accuracy in the context of quantized neuralnetworks. This work presents Histogram-Equalized Quantization (HEQ), anadaptive framework for linear symmetric quantization. HEQ automatically adaptsthe quantization thresholds using a unique step size optimization. Weempirically show that HEQ achieves state-of-the-art performances on CIFAR-10.Experiments on the STL-10 dataset even show that HEQ enables a proper trainingof our proposed logic-gated (OR, MUX) residual networks with a higher accuracyat a lower hardware complexity than previous work.

 

Quick Read (beta)