Hybrid Genetic Programming and Deep Reinforcement Learning for Low-complexity Robot Arm Trajectory Planning - INSA Rennes - Institut National des Sciences Appliquées de Rennes
Article Dans Une Revue Across the Disciplines Année : 2024

Hybrid Genetic Programming and Deep Reinforcement Learning for Low-complexity Robot Arm Trajectory Planning

Résumé

Robot arm control is a technological challenge where an algorithm needs to learn a deep understanding of spatial navigation. In particular, spatial navigation requires learning the relationship between the motor joint angular positions and the Cartesian coordinates of the robot. Trajectory planning is an even more complex challenge, where the algorithm must create a trajectory between two coordinates that does not cause a collision. State-of-the-art algorithms capable of solving trajectory planning are based on deep Reinforcement Learning (RL). These algorithms achieve high accuracy but suffer from high computational complexity. This paper proposes to use a genetic RL algorithm, the Tangled Program Graphs (TPGs), to solve trajectory planning. Using a genetic process, the TPGs generate a graph of programs with low inference complexity. On a first trajectory planning problem, the algorithm used achieves performance close to the state-of-the-art, but with a 100 less execution time and a 20× smaller model size. On a second and more difficult problem, the TPGs are not able to learn with efficiency. We propose a hybrid solution that mixes the TPGs and a state-of-the-art deep RL algorithm, the Soft Actor-Critic (SAC). This solution achieves better performance than the state-of-the-art for both problems, with 6 to 20 times faster execution times.

INTRODUCTION

Robot control presents a formidable technological challenge in today's landscape. At its core, this challenge entails the development of algorithms that possess a deep understanding of spatial relationships. This understanding is crucial for orchestrating the coordinated movements of the various motors of the robot. As robots become increasingly ubiquitous across industries, there is a pressing need to optimize the computational costs associated with controlling them. This optimization ensures efficiency without compromising performance, a balancing act essential for widespread adoption and practical implementation.

Some recent techniques, such as Deep Learning, can efficiently control robot models. Deep

Fichier principal
Vignette du fichier
ECTA_2024_62_CR.pdf (514.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04817362 , version 1 (03-12-2024)
hal-04817362 , version 2 (06-12-2024)

Licence

Identifiants

Citer

Quentin Vacher, Nicolas Beuve, Paul Allaire, Thibaut Marty, Mickaël Dardaillon, et al.. Hybrid Genetic Programming and Deep Reinforcement Learning for Low-complexity Robot Arm Trajectory Planning. Across the Disciplines, 2024, pp.139-150. ⟨10.5220/0013012500003837⟩. ⟨hal-04817362v2⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More