Abstract
Recent advancements in Large Language Models (LLMs) and Visual LanguageModels (VLMs) have significantly impacted robotics, enabling high-levelsemantic motion planning applications. Reinforcement Learning (RL), acomplementary paradigm, enables agents to autonomously optimize complexbehaviors through interaction and reward signals. However, designing effectivereward functions for RL remains challenging, especially in real-world taskswhere sparse rewards are insufficient and dense rewards require elaboratedesign. In this work, we propose Autonomous Reinforcement learning for ComplexHumanInformed Environments (ARCHIE), an unsupervised pipeline leveraging GPT-4,a pre-trained LLM, to generate reward functions directly from natural languagetask descriptions. The rewards are used to train RL agents in simulatedenvironments, where we formalize the reward generation process to enhancefeasibility. Additionally, GPT-4 automates the coding of task success criteria,creating a fully automated, one-shot procedure for translating human-readabletext into deployable robot skills. Our approach is validated through extensivesimulated experiments on single-arm and bi-manual manipulation tasks using anABB YuMi collaborative robot, highlighting its practicality and effectiveness.Tasks are demonstrated on the real robot setup.