Abstract
This paper analyzes the design and competitiveness of four neural network(NN) architectures recently proposed as decoders for forward error correction(FEC) codes. We first consider the so-called single-label neural network (SLNN)and the multi-label neural network (MLNN) decoders which have been reported toachieve near maximum likelihood (ML) performance. Here, we show analyticallythat SLNN and MLNN decoders can always achieve ML performance, regardless ofthe code dimensions -- although at the cost of computational complexity -- andno training is in fact required. We then turn our attention to twotransformer-based decoders: the error correction code transformer (ECCT) andthe cross-attention message passing transformer (CrossMPT). We compare theirperformance against traditional decoders, and show that ordered statisticsdecoding outperforms these transformer-based decoders. The results in thispaper cast serious doubts on the application of NN-based FEC decoders in theshort and medium block length regime.