李至, 潘越, 陈殿生, 秦雪娇, 王韫, 王俊杰. 基于模仿学习的眼底手术行为机器人复现[J]. 机器人, 2024, 46(3): 361-369. DOI: 10.13973/j.cnki.robot.230279
引用本文: 李至, 潘越, 陈殿生, 秦雪娇, 王韫, 王俊杰. 基于模仿学习的眼底手术行为机器人复现[J]. 机器人, 2024, 46(3): 361-369. DOI: 10.13973/j.cnki.robot.230279
LI Zhi, PAN Yue, CHEN Diansheng, QIN Xuejiao, WANG Yun, WANG Junjie. Fundus Surgical Behavior Reproduction of Robot Based on Imitation Learning[J]. ROBOT, 2024, 46(3): 361-369. DOI: 10.13973/j.cnki.robot.230279
Citation: LI Zhi, PAN Yue, CHEN Diansheng, QIN Xuejiao, WANG Yun, WANG Junjie. Fundus Surgical Behavior Reproduction of Robot Based on Imitation Learning[J]. ROBOT, 2024, 46(3): 361-369. DOI: 10.13973/j.cnki.robot.230279

基于模仿学习的眼底手术行为机器人复现

Fundus Surgical Behavior Reproduction of Robot Based on Imitation Learning

  • 摘要: 针对现有眼底手术专家紧缺的问题, 提出了一种获取与学习医生眼底手术操作技能的方法。首先, 基于深度相机构建了手术操作行为采集平台, 对手术操作轨迹进行采集; 其次, 依据医生在不同手术阶段的操作意图, 基于隐马尔可夫模型, 实现了对医生操作技能的分割与表征; 再次, 基于模仿学习算法设计了医生手术操作学习方法, 并进一步实现了对医生手术操作的复现; 最后借助睿尔曼RM65-B机器人对相关方法进行了实验验证。结果显示, 本文的眼底手术行为模仿学习方法可有效实现手术操作技能的表征与学习, 并指导机器人完成相关手术操作。

     

    Abstract: In view of the shortage of experts in fundus surgery, a method to acquire and learn the doctor's operation skills of fundus surgery is proposed. Firstly, a surgical operation acquisition platform is constructed based on the depth camera, and the surgical operation trajectory is collected. Secondly, according to the operation intention of doctors in different stages of operation, the segmentation and formulation of doctors' operation skills are realized based on hidden Markov model. Thirdly, the learning method of doctor's operation is designed based on the imitation learning algorithm, and the reproduction of doctor's operation is further realized. Finally, the relevant methods are tested and verified by using RealMan RM65-B robot. Results show that the proposed imitation learning method for fundus surgical behavior can effectively realize the representation and learning of surgical operation skills, and guide the robot to complete the relevant surgical operations.

     

/

返回文章
返回