Abstract
There exist several techniques for representing the chess board inside thecomputer. In the first part of this paper, the concepts of thebitboard-representation and the advantages of (rotated) bitboards in movegeneration are explained. In order to illustrate those ideas practice, theconcrete implementation of the move-generator in FUSc# is discussed and weexplain a technique how to verify the move-generator with the "perft"-command.We show that the move-generator of FUSc# works 100% correct. The second part of this paper deals with reinforcement learning in computerchess (and beyond). We exemplify the progress that has been made in this fieldin the last 15-20 years by comparing the "state of the art" from 2002-2008,when FUSc# was developed, with recent innovations connected to "AlphaZero". Wediscuss how a "FUSc#-Zero" could be implemented and what would be necessary toreduce the number of training games necessary to achieve a good performance.This can be seen as a test case to the general prblem of improving "sampleeffciency" in reinforcement learning. In the final part, we move beyond computer chess, as the importance of sampleeffciency extends far beyond board games into a wide range of applicationswhere data is costly, diffcult to obtain, or time consuming to generate. Wereview some application of the ideas developed in AlphaZero in other domains,i.e. the "other Alphas" like AlphaFold, AlphaTensor, AlphaGeometry andAlphaProof. We also discuss future research and the potential for such methodsfor ecological economic planning.