Abstract：To make full use of measurements and improve the prediction accuracy, a predictive display algorithm is proposed to deal with multi-time-delay multi-rate measurements and missing data. Firstly, some of the delays in downlinks are "moved" to the uplinks, and thus the predictive display problem is converted into a standard filtering problem and a prediction problem, which can be tackled by a serial observer-predictor structure. Then, the re-organized innovation analysis is utilized and extended in the observer to re-organizing the multi-time-delay measurements into the ones without time delay, and the multi-rate measurements as well as missing data are tackled with the help of indication functions. Finally, simulation results show the effectiveness of the proposed predictive display algorithm.
 Niemeyer G, Preusche C, Stramigioli S, et al. Telerobotics[M]//Springer Handbook of Robotics. Berlin, Germany:Springer, 2016:1085-1108.
 Imaida T, Yokokohji Y, Doi T, et al. Ground-space bilateral teleoperation of ETS-VⅡ robot arm by direct bilateral coupling under 7-s time delay condition[J]. IEEE Transactions on Robotics and Automation, 2004, 20(3):499-511.
 Hirabayashi T, Akizono J, Yamamoto T, et al. Teleoperation of construction machines with haptic information for underwater applications[J]. Automation in Construction, 2006, 15(5):563-570.
 Desbats P, Geffard F, Piolain G, et al. Force-feedback teleoperation of an industrial robot in a nuclear spent fuel reprocessing plant[J]. Industrial Robot, 2006, 33(3):178-186.
 Okamura A M. Methods for haptic feedback in teleoperated robot-assisted surgery[J]. Industrial Robot, 2004, 31(6):499-508.
 Yoon W K, Goshozono T, Kawabe H, et al. Model-based space robot teleoperation of ETS-VⅡ manipulator[J]. IEEE Transactions on Robotics and Automation, 2004, 20(3):602-612.
 Germani A, Manes C, Pepe P. A new approach to state observation of nonlinear systems with delayed output[J]. IEEE Transactions on Automatic Control, 2002, 47(1):96-101.
 Dai P, Huang P F, Lu Z Y. Time delayed teleoperation with stable tracking and high feedback fidelity using modified wave variable[C]//IEEE International Conference on Robotics and Biomimetics. Piscataway, USA:IEEE, 2015:476-480.
 宋爱国.力觉临场感遥操作机器人(1):技术发展与现状[J].南京信息工程大学学报:自然科学版,2013,5(1):1-19.Song A G. Force telepresence telerobot (1):Review of the history and development[J]. Journal of Nanjing University of Information Science and Technology, 2013, 5(1):1-19.
 Li H J, Song A G. Virtual-environment modeling and correction for force-reflecting teleoperation with time delay[J]. IEEE Transactions on Industrial Electronics, 2007, 54(2):1227-1233.
 Hirzinger G, Brunner B, Dietrich J, et al. Sensor-based space robotics-ROTEX and its telerobotic features[J]. IEEE Transactions on Robotics and Automation, 1993, 9(5):649-663.
 Xiong Y J, Li S Q, Xie M. Predictive display and interaction of telerobots based on augmented reality[J]. Robotica, 2006, 24(4):447-453.
 张涛,陈章,王学谦,等.空间机器人遥操作关键技术综述与展望[J].空间控制技术与应用,2014,40(6):1-9,30.Zhang T, Chen Z, Wang X Q, et al. Overview and prospect of key technologies of teleoperation of space robot[J]. Aerospace Control and Application, 2014, 40(6):1-9,30.
 Hirzinger G, Landzettel K, Fagerer C. Telerobotics with large time delays-The ROTEX experience[C]//IEEE/RSJ/GI International Conference on Intelligent Robots and Systems. Piscataway, USA:IEEE, 1994:571-578.
 Hirzinger G, Heindl J, Landzettel K. Predictive and knowledge-based telerobotic control concepts[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA:IEEE, 1989:1768-1777.
 Kikuchi J, Takeo K, Kosuge K. Teleoperation system via computer network for dynamic environment[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA:IEEE, 1998:3534-3539.
 Kotoku T. A predictive display with force feedback and its application to remote manipulation system with transmission time delay[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA:IEEE, 1992:239-246.
 Winck R C, Sketch S M, Hawkes E W, et al. Time-delayed teleoperation for interaction with moving objects in space[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA:IEEE, 2014:5952-5958.
 Lu X, Zhang H S, Wang W, et al. Kalman filtering for multiple time-delay systems[J]. Automatica, 2005, 41(8):1455-1461.
 Wang Y F, Nguyen B M, Kotchapansompote P, et al. Vision-based vehicle body slip angle estimation with multi-rate Kalman filter considering time delay[C]//IEEE International Symposium on Industrial Electronics. Piscataway, USA:IEEE, 2012:1506-1511.
 Armesto L, Tornero J. SLAM based on Kalman filter for multi-rate fusion of laser and encoder measurements[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA:IEEE, 2004:1860-1865.
 Smyth A, Wu M L. Multi-rate Kalman filtering for the data fusion of displacement and acceleration response measurements in dynamic system monitoring[J]. Mechanical Systems and Signal Processing, 2007, 21(2):706-723.
 Ma J, Sun S L. Distributed fusion filter for multi-rate multi-sensor systems with packet dropouts[C]//10th World Congress on Intelligent Control and Automation. Piscataway, USA:IEEE, 2012:4502-4506.
 Sun Y, Jing F S, Liang Z Z. Iterated extended Kalman filter for time-delay systems with multi-sample-rate measurements[C]//11th World Congress on Intelligent Control and Automation. Piscataway, USA:IEEE, 2014:4532-4536.
 Ding F, Liu P X, Liu G J. Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises[J]. Signal Processing, 2009, 89(10):1883-1890.
 Huang P F, Lu Z Y, Liu Z X. State estimation and parame-ter identification method for dual-rate system based on improved Kalman prediction[J]. International Journal of Control, Automation and Systems, 2016, 14(4):998-1004.
 Tatjewski P. Disturbance modeling and state estimation for predictive control with different state-space process models[J]. IFAC Proceedings Volumes, 2011, 18(1):5326-5331.