Free Gait Planning for a Hexapod Robot Based on Markov Decision Process
LI Manhong1, ZHANG Jianhua1, ZHANG Xiaojun1,2, ZHANG Minglu1
1. School of Mechanical Engineering, Hebei University of Technology, Tianjin 300130, China;
2. State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150080, China
In order to imitate biological gait accurately and develop the movement potential of hexapod robots comprehensively, a discrete gait model is built based on the discretization of foot trajectories and the fusion of CPG (central pattern generator) model and reflect model.Firstly, the stable position state space is constructed based on stability analysis, and the complex gait planning is transformed into the sequencing problem of position states in the stable position state space.Then, a free gait generation algorithm is proposed, and the optimized free gait planning algorithm for specific terrain is investigated by taking the average stability margin as performance index based on Markov decision process, which is good at dealing with sequential decision problem.The gait experiment results of the prototype show that both the free gait generation algorithm and the optimized algorithm can generate stable gait which accords with motion characteristics of creatures to some extent, and the optimized free gait planning algorithm can plan the optimized gait for specific terrain based on average stability margin quickly.
[1] Chen X, Wang L Q, Ye X F, et al.Prototype developmentand gait planning of biologically inspired multi-legged crablike robot[J].Mechatronics, 2013, 23(4): 429-444. [2] Tomohito T, Tatsuo A, Kenji I.Integrated limb mechanism robot ASTERISK[J].Journal of Robotics and Mechatronics, 2006, 18(2): 203-214.[3] Loc V G, Koo I M, Tran D T, et al.Improving traversability of quadruped walking robots using body movement in 3D rough terrains[J].Robotics and Autonomous Systems, 2011, 59(12): 1036-1048. [4] Barfoot T D, Earon E P.Experiments in learning distributed control for a hexapod robot[J].Robotics and Autonomous Systems, 2006, 54(10): 864-872. [5] Servet S, Hasan A.Kinematic and dynamic analysis of a hexapod walkingrunningbounding gaits robot and control actions[J].Computers and Electrical Engineering, 2012, 38(2): 444-458. [6] 陈学冬,孙翊,贾文川.多足步行机器人运动规划与控制\lk [M].武汉:华中科技大学出版社,2006.Chen X D, Sun Y, Jia W C.Motion planning and control of multilegged walking robot[M].Wuhan: Huazhong University of Science & Technology Press, 2006.[7] Erden M S, Kemal L.Free gait generation with reinforcementlearning for a six-legged robot[J].Robotics and Autonomous Systems, 2008, 56(3): 199-212. [8] Pablo K, Teodor M.Phase oscillator neural network as artificial central pattern generator for robots[J].Neurocomputing, 2012, 97(6): 115-124.[9] 王刚,张立勋,王立权.仿蟹机器人交错等相位波形步态研究 [J].机器人,2011,33(1):237-243.Wang G, Zhang L X, Wang L Q.On alternating equal-phase wave gait of crab-like robot[J].Robot, 2011, 33(1): 237-243.[10] Twickel A V, Hild M, Siedel T, et al.Neural control of a modular multi-legged walking machine: Simulation and hardware[J].Robotics and Autonomous Systems, 2012, 60(2): 227-241. [11] Porta J M, Celaya E.Reactive free-gait generation to follow arbitrary trajectories with a hexapod robot[J].Robotics and Autonomous Systems, 2004, 47(4): 187-201. [12] 陈甫,臧希喆,赵杰,等.六足步行机器人仿生机制研究\lk [J].机械与电子,2009,27(9):53-56.Chen F, Zang X J, Zhao J, et al.Research on biomimetics mechanism of hexapod walking robot[J].Machinery & Electronics, 2009, 27(9): 53-56.[13] 董玮,王如彬,张志康.大脑皮层信号作用下人体步态节律运动的探讨 [J].中国生物医学工程学报,2010,29(2):247-252.Dong W, Wang R B, Zhang Z K.Human rhythmic gait movement in the role of cerebral cortex signal[J].Chinese Journal of Biomedical Engineering, 2010, 29(2): 247-252.[14] Rebula J R, Neuhaus P D, Bonnlander B V, et al.A controller for the LittleDog quadruped walking on rough terrain [C]//IEEE International Conference on Robotics and Automation.Piscataway, USA: IEEE, 2007: 1467-1473.[15] 郑浩俊,张秀丽,汪劲松,等.基于生物中枢模式发生器原理的四足机器人 [J].清华大学学报:自然科学版,2004,44(2):166-169.Zheng H J, Zhang X L, Wang J S, et al.Quadruped robot based on biological central pattern generator[J].Journal of Tsinghua University: Nature Science Edition, 2004, 44(2): 166-169.[16] 黄博,姚玉峰,孙立宁.基于中枢神经模式的四足机器人步态控制 [J].机械工程学报,2010,46(7):1-6.Huang B, Yao Y F, Sun L N.Quadruped robot gait control based on central pattern generator[J].Journal of Mechanical Engineering, 2010, 46(7): 1-6.[17] 黄麟,韩宝玲,罗庆生,等.仿生六足机器人步态规划策略实验研究 [J].华中科技大学学报:自然科学版,2007,35(12):72-75.Huang L, Han B L, Luo Q H, et al.Experimental study on hexapod biomimetic robot's gait planning[J].Journal of Huazhong University of Science & Technology: Nature Science Edition, 2007, 35(12): 72-75.[18] 陈甫.六足仿生机器人的研制及其运动规划研究 [D].哈尔滨:哈尔滨工业大学,2009.Chen F.Development of hexapod biomimetic robot and research on its motion planning issue[D].Harbin: Harbin Institute of Technology, 2009.[19] Estremera J, Cobano J A.Continuous free-crab gaits for hexapod robots on a natural terrain with forbidden zones: An application to humanitarian demining[J].Robotics and Autonomous Systems, 2010, 58(5): 700-711. [20] 丁希仑,王志英,Alberto R.六边形对称分布六腿机器人的典型步态及其运动性能分析 [J].机器人,2010,32(6):759-765.Ding X L, Wang Z Y, Alberto R.Typical gaits and motion analysis of a hexagonal symmetrical hexapod robot[J].Robot, 2010, 32(6): 759-765.
