Robotic Grasp Manipulation Using Evolutionary Computing and Deep Reinforcement Learning

  • 2020-01-15 17:23:55
  • Priya Shukla, Hitesh Kumar, G. C. Nandi
  • 3

Abstract

Intelligent Object manipulation for grasping is a challenging problem forrobots. Unlike robots, humans almost immediately know how to manipulate objectsfor grasping due to learning over the years. A grown woman can grasp objectsmore skilfully than a child because of learning skills developed over years,the absence of which in the present day robotic grasping compels it to performwell below the human object grasping benchmarks. In this paper we have taken upthe challenge of developing learning based pose estimation by decomposing theproblem into both position and orientation learning. More specifically, forgrasp position estimation, we explore three different methods - a GeneticAlgorithm (GA) based optimization method to minimize error between calculatedimage points and predicted end-effector (EE) position, a regression basedmethod (RM) where collected data points of robot EE and image points have beenregressed with a linear model, a PseudoInverse (PI) model which has beenformulated in the form of a mapping matrix with robot EE position and imagepoints for several observations. Further for grasp orientation learning, wedevelop a deep reinforcement learning (DRL) model which we name as Grasp DeepQ-Network (GDQN) and benchmarked our results with Modified VGG16 (MVGG16).Rigorous experimentations show that due to inherent capability of producingvery high-quality solutions for optimization problems and search problems, GAbased predictor performs much better than the other two models for positionestimation. For orientation learning results indicate that off policy learningthrough GDQN outperforms MVGG16, since GDQN architecture is specially madesuitable for the reinforcement learning. Based on our proposed architecturesand algorithms, the robot is capable of grasping all rigid body objects havingregular shapes.

 

Quick Read (beta)

loading the full paper ...