Three-dimensional Space Target Search Based on Hybrid Computer Interfacefor Multi-rotor Aircraft
SHI Tianwei1, WANG Hong2, CUI Wenhua1
1. School of International Finance and Banking, University of Science and Technology Liaoning, Anshan 114051, China;
2. Department of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China
Abstract：A hybrid computer interface (HCI) system, composed of semi-autonomous navigation, decision and interface switching subsystems, is proposed to implement indoor 3-dimensional (3D) space target search for multi-rotor aircraft. The semi-autonomous navigation subsystem is utilized to provide 2-dimensional (2D) feasible directions for the decision subsystem and avoid obstacles semi-automatically in 3D space for multi-rotor aircraft. The decision subsystem applies the joint-regression (JR) model and spectral power methods to extracting the time and frequency domain features from motor imagery (MI) electroencephalogram (EEG) signals, which are collected by the 6 electrodes. Simultaneously, the support vector machine (SVM) is employed to complete the MI feature classification. The interface switching subsystem employs the continuous wavelet transform (CWT) method to identify electrooculography (EOG) features of eyeblink, and switch interfaces between horizontal and vertical MI tasks by analyzing the eyeblink EOG. The actual indoor 3D space target search experiment shows that the presented HCI system has good adaptability and control stability. Compared with similar methods, the semi-autonomous navigation subsystem reduces the control difficulties, and the control precision is increased by about ±10 cm.
[1] Barea R, Boquete L, Ortega S, et al. EOG-based eye movements codification for human computer interaction[J]. Expert Systems with Applications, 2012, 39(3):2677-2683.
[2] Wijesoma W S, Wee K S, Wee O C, et al. EOG based control of mobile assistive platforms for the severely disabled[C]//2005 IEEE International Conference on Robotics and Biomimetics. Piscataway, USA:IEEE, 2006:490-494.
[3] Yang S W, Lin C S, Lin S K, et al. Design of virtual keyboard using blink control method for the severely disabled[J]. Computer Methods and Programs in Biomedicine, 2013, 111(2):410-418.
[4] Li J, Yan J Q, Liu X Z, et al. Using permutation entropy to measure the changes in EEG signals during absence seizures[J]. Entropy, 2014, 16(6):3049-3061.
[5] 张毅,罗明伟,罗元,等.基于脑电α/β波的智能轮椅人机交互[J].华中科技大学学报:自然科学版,2013,41(7):109-114.Zhang Y, Luo M W, Luo Y, et al. Intelligent wheelchair human-machine interaction using α/β wave of EEG[J]. Journal of Huazhong University of Science and Technology:Natural Science Edition, 2013, 41(7):109-114.
[6] Velasco-Álvarez F, Ron-Angevin R, da Silva-Sauer L, et al. Audio-cued motor imagery-based brain-computer interface:Navigation through virtual and real environments[J]. Neurocomputing, 2013, 121(SI):89-98.
[7] 俞建成,张进,李伟.基于事件相关电位的水下机械手脑电波控制[J].机器人,2017,39(4):395-404.Yu J C, Zhang J, Li W. Controlling an underwater manipulator via event-related potentials of brainwaves[J]. Robot, 2017, 39(4):395-404.
[8] 徐光华,张锋,王晶,等.面向智能轮椅脑机导航的高频组合编码稳态视觉诱发电位技术研究[J].机械工程学报,2013,49(6):21-29.Xu G H, Zhang F, Wang J, et al. Research on key technology on time series combination coding-based high-frequency SSVEP in intelligent wheelchair BCI navigation[J]. Journal of Mechanical Engineering, 2013, 49(6):21-29.
[9] Shi T W, Wang H, Zhang C. Brain computer interface system based on indoor semi-autonomous navigation and motor imagery for unmanned aerial vehicle control[J]. Expert Systems with Applications, 2015, 42(9):4196-4206.
[10] Lafleur K, Cassady K, Doud A, et al. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface[J]. Journal of Neural Engineering, 2013, 10(4):No.046003.
[11] Hu S Q, Tian Q Q, Cao Y. Motor imagery classification based on joint regression model and spectral power[J]. Neural Computing and Applications, 2013, 23(7/8):1931-1936.
[12] Kayikcioglu T, Aydemir O. A polynomial fitting and k-NN based approach for improving classification of motor imagery BCI data[J]. Pattern Recognition Letters, 2010, 31(11):1207-1215.
[13] Youn E, Koenig L, Jeong M K, et al. Support vector-based feature selection using Fisher's linear discriminant and support vector machine[J]. Expert Systems with Applications, 2010, 37(9):6148-6156.
[14] Cristianini N, Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods[M]. 1st ed. Cambridge, UK:Cambridge University Press, 2000:1-28.
[15] Bulling A, Ward J A, Gellersen H, et al. Eye movement analysis for activity recognition using electrooculography[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(4):741-753.
