Robotic Bone-drilling Operation by Force and Acoustic Signals
LI Shaodong1, DU Zhijiang2, YU Hongjian2
1. Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, China; 2. Harbin Institute of Technology, Harbin 150001, China
Abstract：In clinic robot-assisted bone surgeries of recent years, robots are mainly used in the screw path positioning, and the subsequent drilling procedure is still performed by surgeon. Therefore, the autonomous drilling procedure based on robot is the main research content in this paper. Firstly, force control for the cortical bone drilling is realized by a two-layer adaptive fuzzy controller. The nonlinear time-varying problem in the drilling is solved, and the drilling feed velocity and the thermal damage to bone tissue can be balanced. Then, force and acoustic features are extracted by time domain analysis and time-frequency analysis respectively during robotic drilling. The state of the drilled bone is recognized by combining those force and acoustic features, and the switch from force control to velocity control is realized. In this way, the drilling safety is guaranteed, which means that the inner cortical bone won’t be punctured by the drilling tool and the nervous tissue won’t be damaged. Finally, experiments of the force control and the drilled bone state recognition are carried out on the swine bone. Results of the force control show that the drilling force error is limited to [-2 N;2 N] by the two-layer adaptive fuzzy controller, and its influence on robotic drilling can be ignored since the drilling force is usually more than 20 N. Results of the drilled bone state recognition show that the state of inner cortical bone can be detected by acoustic features earlier than by force features, and the recognition robustness is improved by force features. Thus, the effectiveness of the proposed drilling control and state recognition strategy is proved.
[1] Joseph J R, Smith B W, Liu X L, et al.Current applications of robotics in spine surgery:A systematic review of the literature[J].Neurosurgical Focus, 2017, 42(5).DOI:10.3171/2017.2.FOCUS16544. [2] Khan A, Meyers J E, Slasios I, et al.Next-generation robotic spine surgery:First report on feasibility, safety, and learning curve[J].Operative Neurosurgery, 2019, 17(1):61-69. [3] Lefranc M, Peltier J.Evaluation of the ROSATM spine robot for minimally invasive surgical procedures[J].Expert Review of Medical Devices, 2016, 13(10):899-906. [4] 靳海洋,邓震,王宇,等.RSSS-II脊柱手术机器人系统开发及其实验研究[J].集成技术, 2016, 5(1):75-84.Jin H Y, Deng Z, Wang Y, et al.The development and experiment study of a robotic spinal surgical system RSSS-II[J].Journal of Integration Technology, 2016, 5(1):75-84. [5] Ho D, Li T G, Meng Q H.Bone drilling breakthrough detection via energy-based signal[C]//40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.Piscataway, USA:IEEE, 2018:1809-1812. [6] Accini F, Diaz I, Gil J J.Bone recognition during the drilling process[C]//6th IEEE International Conference on Biomedical Robotics and Biomechatronics.Piscataway, USA:IEEE, 2016:305-310. [7] Wang W D, Shi Y K, Yang N, et al.Experimental analysis of drilling process in cortical bone[J].Medical Engineering&Physics, 2014, 36(2):261-266. [8] Jin H Y, Hu Y, Deng Z, et al.Model-based state recognition of bone drilling with robotic orthopedic surgery system[C]//IEEE International Conference on Robotics and Automation.Piscataway, USA:IEEE, 2014:3538-3543. [9] Hu Y, Jin H Y, Zhang L W, et al.State recognition of pedicle drilling with force sensing in a robotic spinal surgical system[J].IEEE/ASME Transactions on Mechatronics, 2014, 19(1):357-365. [10] Aziz M H, Ayub M A, Jaafar R.Real-time algorithm for detection of breakthrough bone drilling[J].Procedia Engineering, 2012, 41:352-359. [11] Jin H Y, Hu Y, Tian W, et al.Safety analysis and control of a robotic spinal surgical system[J].Mechatronics, 2014, 24(1):55-65. [12] Jiang Z L, Sun Y, Zhao S J, et al.A model of vertebral motion and key point recognition of drilling with force in robot-assisted spinal surgery[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems.Piscataway, USA:IEEE, 2017:6455-6462. [13] Qi L, Meng M Q H.Real-time break-through detection of bone drilling based on wavelet transform for robot assisted orthopaedic surgery[C]//IEEE International Conference on Robotics and Biomimetics.Piscataway, USA:IEEE, 2014:601-606. [14] Louredo M, Diaz I, Gil J J.A robotic bone drilling methodology based on position measurements[C]//IEEE RAS&EMBS International Conference on Biomedical Robotics and Biomechatronics.Piscataway, USA:IEEE, 2012:1155-1160. [15] Accini F, Diaz I, Gil J J.Using an admittance algorithm for bone drilling procedures[J].Computer Methods and Programs in Biomedicine, 2016, 123:150-158. [16] Guan F Q, Sun Y, Qi X Z, et al.State recognition of bone drilling based on acoustic emission in pedicle screw operation[J].Sensors, 2018, 18(5).DOI:10.3390/s18051484. [17] Sun Y, Jin H Y, Hu Y, et al.State recognition of bone drilling with audio signal in robotic orthopedics surgery system[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems.Piscataway, USA:IEEE, 2014:3503-3508. [18] Wang Z G, Guo D C, Li X, et al.Estimating hurst exponent with wavelet packet[C]//7th International Conference on Computeraided Industrial Design and Conceptual Design.Piscataway, USA:IEEE, 2006.DOI:10.1109/CAIDCD.2006.329420. [19] Blok H J.On the nature of the stock market:Simulations and experiments[D].Vancouver, Canada:The University of British Columbia, 2000. [20] Jin H Y, Hu Y, Luo H L, et al.Intraoperative state recognition of a bone-drilling system with image-force fusion[C]//IEEE International Conference on Multisensor Fusion and Integration for Intelligent System.Piscataway, USA:IEEE, 2012:275-280. [21] Wang Y, Deng Z, Sun Y, et al.State detection of bone milling with multi-sensor information fusion[C]//IEEE International Conference on Robotics and Biomimetics.Piscataway, USA:IEEE, 2015:1643-1648. [22] Osa T, Abawi C F, Sugita N, et al.Autonomous penetration detection for bone cutting tool using demonstration-based learning[C]//IEEE International Conference on Robotics and Automation.Piscataway, USA:IEEE, 2014:290-296. [23] Lee W Y, Shih C L, Lee S T.Force control and breakthrough detection of a bone drilling system[J].IEEE/ASME Transactions on Mechatronics, 2004, 9(1):20-29. [24] Li S D, Du Z j, Yu H J.A robot-assisted spine surgery system based on intraoperative 2D fluoroscopy navigation[J].IEEE Access, 2020, 8:51786-51802.
