Reinforcement Learning and Life Cycle Assessment for a Circular Economy -- Towards Progressive Computer Science

  • 2025-05-05 18:53:39
  • Johannes Buchner
  • 0

Abstract

The aim of this paper is to discuss the potential of using methods fromReinforcement Learning for Life Cycle Assessment in a circular economy, and topresent some new ideas in this direction. To give some context, we explain howReinforcement Learning was successfully applied in computer chess (and beyond).As computer chess was historically called the "drosophila of AI", we start bydescribing a method for the board representation called 'rotated bitboards'that can potentially also be applied in the context of sustainability. In thefirst part of this paper, the concepts of the bitboard-representation and theadvantages of (rotated) bitboards in move generation are explained. In order toillustrate those ideas practice, the concrete implementation of themove-generator in FUSc# (a chess engine developed at FU Berlin in C# some yearsago) is described. In addition, rotated binary neural networks are discussedbriefly. The second part deals with reinforcement learning in computer chess (andbeyond). We exemplify the progress that has been made in this field in the last15-20 years by comparing the "state of the art" from 2002-2008, when FUSc# wasdeveloped, with the ground-breaking innovations connected to "AlphaZero". Wereview some application of the ideas developed in AlphaZero in other domains,e.g. the "other Alphas" like AlphaFold, AlphaTensor, AlphaGeometry andAlphaProof. In the final part of the paper, we discuss the computer-sciencerelated challenges that changing the economic paradigm towards (absolute)sustainability poses and in how far what we call 'progressive computer science'needs to contribute. Concrete challenges include the closing of material loopsin a circular economy with Life Cycle Assessment in order to optimize for(absolute) sustainability, and we present some new ideas in this direction.

 

Quick Read (beta)

loading the full paper ...