Skip to content

Domain Randomization for Robust, Affordable and Effective Closed-loop Control of Soft Robots

Notifications You must be signed in to change notification settings

andreaprotopapa/dr-soro

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 

Repository files navigation

Domain Randomization for Robust, Affordable and Effective Closed-loop Control of Soft Robots

Paper / Preprint / Website / Video

Gabriele Tiboni, Andrea Protopapa, Tatiana Tommasi, Giuseppe Averta - IROS2023

This repository presents the paper "Domain Randomization for Robust, Affordable and Effective Closed-loop Control of Soft Robots".

Abstract: Soft robots are becoming extremely popular thanks to their intrinsic safety to contacts and adaptability. However, the potentially infinite number of Degrees of Freedom makes their modeling a daunting task, and in many cases only an approximated description is available. This challenge makes reinforcement learning (RL) based approaches inefficient when deployed on a realistic scenario, due to the large domain gap between models and the real platform. In this work, we demonstrate, for the first time, how Domain Randomization (DR) can solve this problem by enhancing RL policies with: i) a higher robustness w.r.t. environmental changes; ii) a higher affordability of learned policies when the target model differs significantly from the training model; iii) a higher effectiveness of the policy, which can even autonomously learn to exploit the environment to increase the robot capabilities (environmental constraints exploitation). Moreover, we introduce a novel algorithmic extension of previous adaptive domain randomization methods for the automatic inference of dynamics parameters for deformable objects. We provide results on four different tasks and two soft robot designs, opening interesting perspectives for future research on Reinforcement Learning for closed-loop soft robot control. Watch video

Our release is has been developed into the repo sofa-dr-rl, where you can find:

  • ✅ SOFA gym environments (TrunkReach, TrunkPush, TrunkLift)
  • Code
    • ✅ RL training
    • ✅ DR compatibility
    • ✅ Reset-free DROPO

Cite us

If you use this repository, please consider citing

@inproceedings{tiboni2023domain,
  title={Domain randomization for robust, affordable and effective closed-loop control of soft robots},
  author={Tiboni, Gabriele and Protopapa, Andrea and Tommasi, Tatiana and Averta, Giuseppe},
  booktitle={2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  pages={612--619},
  year={2023},
  organization={IEEE}
}