Design and Intelligent Planning Simulation Method of a Space Bionic Soft Robot
LIU Wuji1, JING Zhongliang1, CHEN Wujun2, PAN Han1
1. School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China; 2. School of Naval Architecture, Ocean & Civil Engineering}, Shanghai Jiao Tong University, Shanghai 200240, China
Abstract：Conventional space rigid-body robots are subject to defects such as limited degree of freedom and low environmental adaptability. For those problems, a soft robot based on the organism structure is designed inspired by inchworm and snake, which is applicable to space in-orbit service. Firstly, the prototype of the soft robot is built and the drive characteristics of the Ni-Ti shape memory alloy (SMA) as the actuators are studied. A visual control interface is designed and the manoeuvrability of the soft robot prototype is verified by physical experiments. Besides, the Q-learning algorithm and the corresponding reward function based on the designed soft robot structure are designed. A simulation model of the soft robot is built, and autonomous learning and planning experiment of the robot arm model based on Q-learning is completed in the simulation environment. The experiment results show that the robot arm can converge to a stable state in a short time and complete planning tasks independently. Therefore, the proposed algorithm is effective and feasible, and the reinforcement learning method has a good application prospect in the intelligent planning and control of soft robots.
[1] Kim S, Laschi C, Trimmer B. Soft robotics: A bioinspired evolution in robotics[J]. Trends in Biotechnology, 2013, 31(5): 287-294. [2] Boyraz P, Runge G, Raatz A. An overview of novel actuators for soft robotics[J]. Actuators, 2018, 7(3). DOI: 10.3390/act 7030048. [3] Pfeifer R, Lungarella M, Iida F. Self-organization, embodiment, and biologically inspired robotics[J]. Science, 2007, 318(5853): 1088-1093. [4] Jing Z L, Qiao L F, Pan H, et al. An overview of the configu- ration and manipulation of soft robotics for on-orbit servicing [J]. Science China: Information Sciences, 2017, 60. DOI: 10. 1007/s11432-016-9033-0. [5] Laschi C, Cianchetti M, Mazzolai B, et al. Soft robot arm inspired by the octopus advanced robotics[J]. Advanced Robotics, 2012, 26(7): 709-727. [6] Lin H T, Leisk G G, Trimmer B. GoQBot: A caterpillar-inspired soft-bodied rolling robot[J]. Bioinspiration & Biomimetics, 2011, 6(2). DOI: 10.1088/1748-3182/6/2/026007. [7] Shepherd R F, Ilievski F, Choi W, et al. Multigait soft robot[J]. Proceedings of the National Academy Sciences of the United States of America, 2011, 108(51): 20400-20403. [8] Fang H B, Zhang Y T, Wang K W. Origami-based earthworm-like locomotion robots[J]. Bioinspiration & Biomimetics, 2017, 12(6). DOI: 10.1088/1748-3190/aa8448. [9] Kim B, Park S, Jee C Y, et al. An earthworm-like locomotive mechanism for capsule endoscopes[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA: IEEE, 2005. DOI: 10.1109/IROS.2005.1545608. [10] Seok S, Onal C D, Wood R, et al. Peristaltic locomotion with antagonistic actuators in soft robotics[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA: IEEE, 2010. DOI: 10.1109/ROBOT.2010.5509542. [11] Ilievski F, Mazzeo A D, Shepherd R F, et al. Soft robotics for chemists[J]. Angewandte Chemie, 2011, 50(8): 1890-1895. [12] Bar-Cohen Y. Electroactive polymer (EAP) actuators as artificial muscles: Reality, potential, and challenges[M]. 2nd ed. Bellingham, USA: SPIE, 2004. [13] Liu L W, Li J R, Lü X F, et al. Progress in constitutive theory and stability research of electroactive dielectric elastomers[J]. Scientia Sinica: Technologica, 2015, 45(5): 450-463. [14] Lampani L, Gaudenzi P. Finite element modeling for dielectric elastomer actuators (DEA)[C]//19th International Conference on Adaptive Structures and Technologies. Piscataway, USA: IEEE, 2008: 65-83. [15] Daerden F, Lefeber D. Pneumatic artificial muscles: Actuators for robotics and automation[J]. European Journal of Mechanical and Environmental Engineering, 2002, 1: 11-21. [16] Boblan I, Bannasch R, Schwenk H, et al. A human-like robot hand and arm with fluidic muscles: Biologically inspired construction and functionality[M]. Lecture Notes in Computer Science, Vol.3139. Berlin, Germany: Springer, 2004: 160-179. [17] Mosadegh B, Polygerinos P, Keplinger C, et al. Pneumatic networks for soft robotics that actuate rapidly[J]. Advanced Functional Materials, 2014, 24(15): 2163-2170. [18] Li C Q, Rahn C D. Design of continuous backbone, cable-driven robots[J]. Journal of Mechanical Design, 2002, 124(2): 265-271. [19] Camarillo D B, Milne C F, Carlson C R, et al. Mechanics mode- ling of tendon-driven continuum manipulators[J]. IEEE Transactions on Robotics, 2008, 24(6): 1262-1273. [20] Follador M, Cianchetti M, Arienti A, et al. A general method for the design and fabrication of shape memory alloy active spring actuators[J]. Smart Materials and Structures, 2012, 21(11). DOI: 10.1088/0964-1726/21/11/115029. [21] Redmon J, Farhadi A. YOLOv3: An incremental improvement [DB/OL]. (2018-04-08) [2020-03-21]. https://arxiv.org/abs/1804.02767.
