Abstract
Learning from Demonstration is increasingly used for transferring operatormanipulation skills to robots. In practice, it is important to cater forlimited data and imperfect human demonstrations, as well as underlying safetyconstraints. This paper presents a constrained-space optimization andreinforcement learning scheme for managing complex tasks. Through interactionswithin the constrained space, the reinforcement learning agent is trained tooptimize the manipulation skills according to a defined reward function. Afterlearning, the optimal policy is derived from the well-trained reinforcementlearning agent, which is then implemented to guide the robot to conduct tasksthat are similar to the experts' demonstrations. The effectiveness of theproposed method is verified with a robotic suturing task, demonstrating thatthe learned policy outperformed the experts' demonstrations in terms of thesmoothness of the joint motion and end-effector trajectories, as well as theoverall task completion time.