Abstract
Robots are extending their presence in domestic environments every day, beingmore common to see them carrying out tasks in home scenarios. In the future,robots are expected to increasingly perform more complex tasks and, therefore,be able to acquire experience from different sources as quickly as possible. Aplausible approach to address this issue is interactive feedback, where atrainer advises a learner on which actions should be taken from specific statesto speed up the learning process. Moreover, deep reinforcement learning hasbeen recently widely utilized in robotics to learn the environment and acquirenew skills autonomously. However, an open issue when using deep reinforcementlearning is the excessive time needed to learn a task from raw input images. Inthis work, we propose a deep reinforcement learning approach with interactivefeedback to learn a domestic task in a human-robot scenario. We compare threedifferent learning methods using a simulated robotic arm for the task oforganizing different objects; the proposed methods are (i) deep reinforcementlearning (DeepRL); (ii) interactive deep reinforcement learning using apreviously trained artificial agent as an advisor (agent-IDeepRL); and (iii)interactive deep reinforcement learning using a human advisor (human-IDeepRL).We demonstrate that interactive approaches provide advantages for the learningprocess. The obtained results show that a learner agent, using eitheragent-IDeepRL or human-IDeepRL, completes the given task earlier and has fewermistakes compared to the autonomous DeepRL approach.