Abstract
Recent advancements in Large Language Models (LLMs) and Visual LanguageModels (VLMs) have significantly impacted robotics, enabling high-levelsemantic motion planning applications. Reinforcement Learning (RL), acomplementary paradigm, enables agents to autonomously optimize complexbehaviors through interaction and reward signals. However, designing effectivereward functions for RL remains challenging, especially in real-world taskswhere sparse rewards are insufficient and dense rewards require elaboratedesign. In this work, we propose Autonomous Reinforcement learning for ComplexHuman-Informed Environments (ARCHIE), an unsupervised pipeline leveragingGPT-4, a pre-trained LLM, to generate reward functions directly from naturallanguage task descriptions. The rewards are used to train RL agents insimulated environments, where we formalize the reward generation process toenhance feasibility. Additionally, GPT-4 automates the coding of task successcriteria, creating a fully automated, one-shot procedure for translatinghuman-readable text into deployable robot skills. Our approach is validatedthrough extensive simulated experiments on single-arm and bi-manualmanipulation tasks using an ABB YuMi collaborative robot, highlighting itspracticality and effectiveness. Tasks are demonstrated on the real robot setup.