Abstract
Modern deep learning systems rely on (a) a hand-tuned neural networktopology, (b) massive amounts of labeled training data, and (c) extensivetraining over large-scale compute resources to build a system that can performefficient image classification or speech recognition. Unfortunately, we arestill far away from implementing adaptive general purpose intelligent systemswhich would need to learn autonomously in unknown environments and may not haveaccess to some or any of these three components. Reinforcement learning andevolutionary algorithm (EA) based methods circumvent this problem bycontinuously interacting with the environment and updating the models based onobtained rewards. However, deploying these algorithms on ubiquitous autonomousagents at the edge (robots/drones) demands extremely high energy-efficiency dueto (i) tight power and energy budgets, (ii) continuous/lifelong interactionwith the environment, (iii) intermittent or no connectivity to the cloud to runheavy-weight processing. To address this need, we present GENESYS, an HW-SWprototype of an EA-based learning system, that comprises a closed loop learningengine called EvE and an inference engine called ADAM. EvE can evolve thetopology and weights of neural networks completely in hardware for the task athand, without requiring hand-optimization or backpropagation training. ADAMcontinuously interacts with the environment and is optimized for efficientlyrunning the irregular neural networks generated by EvE. GENESYS identifies andleverages multiple unique avenues of parallelism unique to EAs that we term'gene'- level parallelism, and 'population'-level parallelism. We ran GENESYSwith a suite of environments from OpenAI gym and observed 2-5 orders ofmagnitude higher energy-efficiency over state-of-the-art embedded and desktopCPU and GPU systems.