Operation and Image Integrated Surgery Path Planning for Robotic Cochlear Precise Implantation
WANG Hongpeng1, SHEN Lin1, ZHAO Hui2, FAN Chongshan1, LI Zhengxin3, ZHENG Fanjun2, ZHANG Chen2, HAN Jianda1
1. College of Artificial Intelligence, Nankai University, Tianjin 300350, China; 2. College of Otolaryngology Head and Neck Surgery, Chinese PLA General Hospital, Beijing 100853, China; 3. College of Computer Science, Nankai University, Tianjin 300350, China
Abstract：In view of the high potential risk, limited vision and poor consistency of the traditional surgical approaches to cochlear implantation, a multi-constraint and multi-objective preoperative planning optimization algorithm is proposed, which aims at the shortest DCA (direct cochlear access) from incision to round window and the least damage during implantation. Firstly, the operation and image integrated surgery path planning for robotic cochlear precise implantation is studied. The reconstructed 3D surgical view with multi-modal information fusion is taken as the working space. The identification of cochlear and facial nerve is carried out based on U-Net segmentation and recognition algorithm, which can provide vectorized functional partition and boundary information. The multi-objective and multi-constraint planning algorithm based on 3D reconstruction of CT images in Cartesian coordinate system is adopted. According to the design rules of robotic cochlear implantation surgery approach, the formula of path planning algorithm is deduced, and the corresponding DCA path is planned for the manipulator. Through the simulation experiment on the virtual simulation platform, the effectiveness and accuracy of the proposed method are proved.
[1] 付宜利, 潘博．微创外科手术机器人技术研究进展[J]．哈尔滨工业大学学报, 2019, 51(1):7-21. Fu Y L, Pan B. Research progress of surgical robot for minimally invasive surgery[J]. Journal of Harbin Institute of Technology, 2019, 51(1): 7-21. [2] 倪自强, 王田苗, 刘达．医疗机器人技术发展综述[J]．机械工程学报, 2015, 51(13):45-52. Ni Z Q, Wang T M, Liu D. Overview of medical robot technology development[J]. Journal of Mechanical Engineering, 2015, 51(13): 45-52. [3] 杜祥民, 张永寿．达芬奇手术机器人系统介绍及应用进展[J]．中国医学装备, 2011, 8(5):60-63. Du X M, Zhang Y S. Introduction and application progress of da Vinci surgical robot system[J]. China Medical Equipment, 2011, 8(5): 60-63. [4] Liu W P, Azizian M, Sorger J, et al.Cadaveric feasibility study of da Vinci Si-assisted cochlear implant with augmented visual navigation for otologic surgery[J]. JAMA Otolaryngology-Head & Neck Surgery, 2014, 140(3): 208-214. [5] Bell B, Stieger C, Gerber N, et al.A self-developed and constructed robot for minimally invasive cochlear implantation[J]. Acta Oto-Laryngologica, 2012, 132(4): 355-360. [6] Gerber N, Bell B, Gavaghan K, et al.Surgical planning tool for robotically assisted hearing aid implantation[J]. International Journal of Computer Assisted Radiology and Surgery, 2014, 9: 11-20. [7] Bell B, Gerber N, Williamson T, et al.In vitro accuracy evaluation of image-guided robot system for direct cochlear access[J]. Otology & Neurotology, 2013, 34(7): 1284-1290. [8] Feldmann A, Anso J, Bell B, et al.Robotic cochlear implantation: Surgical procedure and first clinical experience[J]. Acta Oto-Laryngologica, 2017, 137(4): 447-454. [10] Miroir M, Szewczyk J, Nguyen Y, et al.Design of a robotic system for minimally invasive surgery of the middle ear[C]//2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics. Piscataway, USA: IEEE, 2008. DOI:10.1109/BIOROB.2008.4762795. [11] Ke J, Zhang S X, Hu L, et al.Minimally invasive cochlear implantation assisted by bi-planar device: An exploratory feasibility study in vitro[J]. Chinese Medical Journal, 2016, 129(20): 2476-2483. [12] 黎建军, 赵凯, 王斌锐, 等．微创人工耳蜗手术导航匹配算法研究[J]．江西师范大学学报（自然科学版）．2017, 41(4):344-347. Zhou C Z, Xie L. The study on navigation matching algorithm for minimally invasive cochlear surgery[J]. Journal of Jiangxi Normal University (Natural Science Edition), 2017, 41(4): 344-347. [14] Tran D, Bourdev L, Fergus R, et al.Deep end2end voxel2voxel prediction[C]//IEEE Conference on Computer Vision and Pattern Recognition Workshops. Piscataway, USA: IEEE, 2016. DOI: 10.1109/CVPRW.2016.57. [15] Szegedy C, Vanhoucke V, Ioffe S, et al.Rethinking the inception architecture for computer vision[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA: IEEE, 2016. DOI:10.1109/CVPR.2016.308. [16] Coy H, Hsieh K, Wu W, et al.Inception modules enhance brain tumor segmentation[J]. Frontiers in Computational Neuroscience, 2019, 13: 44. [18] 王巍．基于3D深度残差全卷积网络的头颈CT放疗危及器官自动勾画[J]．中国生物医学工程学报, 2019, 38(3):257-265. Tian J X, Liu G C, Gu S S, et al. Segmentation of organs at risk on head and neck CT for radiotherapy based on 3D deep residual fully convolutional neural network[J]. Chinese Journal of Biomedical Engineering, 2019, 38(3): 257-265.
