Multi-information Perception Aided Teleoperated Robot System over Internet
WANG Shi-hua1, XU Bu-gong1, LIU Yun-hui2, JIA Yun-yi1
1. Laboratory of Real-Time Control through Internet and Fieldbuses, College of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China; 2. Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Shatin, N. T. , Hongkong, China
Abstract:With the help of multi-information perception,a teleoperated robot system over Internet is proposed,which provides a tele-control mode through multi-information perception aided decision-making.First,the principle of multi-information perception in Internet-based teleoperated robot system is analyzed,and the multi-information includes data of robot sensors,network back delay,etc.After the multi-information is pre-processed and classified and the decision-making is done,the multi-information can be perceived by the operator with such modes as vision,audio,force,alarm box and interactive text.The use of network delay buffer and double data links decreases the impact from variable network delay.Finally,the usefulness and effectiveness of the developed schemes and system are validated by teleoperation experiments through Internet over long distance.
[1] Goldberg K,Mascha M,Gentner S,et al.Desktop teleoperation via the World Wide Web[A].Proceedings of the IEEE International Conference on Robotics and Automation[C].Piscataway,NJ,USA:IEEE,1995.654-659.
[2] Paulos E,Canny J.Delivering real reality to the World Wide Web via telerobotics[A].Proceedings of the IEEE International Conference on Robotics and Automation[C].Piscataway,NJ,USA:IEEE,1996.1694-1699.
[3] Baruch J E F,Cox M J.Remote control and robots:An Internet solution[J].Computing and Control Engineering Journal,1996,7(1):39-45.
[4] Brady K,Tarn T J.Internet-based remote teleoperation[A].Proceedings of the IEEE International Conference on Robotics and Automation[C].Piscataway,NJ,USA:IEEE,1998.65-70.
[5] Simmons R,Fernandez J L,Goodwin R,et al.Lessons learned from Xavier[J].IEEE Robotics and Automation Magazine,2000,7(2):33 -39.
[6] Stein M R.Interactive Internet artistry[J].IEEE Robotics and Automation Magazine,2000,7 (2):28-32.
[7] Churms C L,Prozesky V M,Springhom K A.The remote control of nuclear microprobes over the Internet[J].Nuclear Instruments and Methods in Physics Research,Section B:Beam Interactions with Materials and Atoms,1999,158(1 -4):124-128.
[8] Saucy P,Mondada F.KhepOnTheWeb:open access to a mobile robot on the Internet[J].IEEE Robotics and Automation Magazine,2000,7(1):41 -47.
[9] Taylor K,Dalton B.Internet robots:A new robotics niche[J].IEEE Robotics and Automation Magazine,2000,7 (1):27-34.
[10] Schilling K,Roth H,Lieb R.Remote control of a "Mars Rover"via Internet-To support education in control and teleoperations[J].Acta Astronautica,2002,50 (3):173-178.
[11] Preusche C,Ortmaier T,Hirzinger G.Teleoperation concepts in minimal invasive surgery[J].Control Engineering Practice,2002,10(11):1245-1250.
[12] Anderson R J,Spong M W.Bilateral control of teleoperators with time delay[J].IEEE Transactions on Automatic Control,1989,34(5):494 -501.
[13] Lawrence D A.Stability and transparency in bilateral teleoperation[J].IEEE Transactions on Robotics and Automation,1993,9(5):624-637.
[14] Xi N,Tarn T J.Stability analysis of non-time referenced Internetbased telerobotic systems[J].Robotics and Autonomous Systems,2000,32(2):173 -178.
[15] Elhajj 1,Xi N,Fung W K,et al.Supermedia-enhanced Internetbased telerobotics[J].Proceedings of the IEEE,2003,91 (3):396-420.
[16] Andreu D,Fraisse P,De Los Rios J A S.Teleoperation over an IP network:From control to architectural considerations[A].Proceedings of the 8th International Conference on Control,Automation,Robotics and Vision[C].New York,USA:IEEE,2004.765-770.
[17] Wang S H,Xu B G,Wang Q Y.Delays analysis for teleoperation over Internet and Smith predictor with adaptive time-delay control[A].Proceedings of the IEEE International Conference on Robotics and Biomimetics[C].Piscataway,NJ,USA:IEEE,2005.664 -669.
[18] Casavola A,Mosca E,Papini M.Predictive teleoperation of constrained dynamic systems via Internet-like channels[J].IEEE Transactions on Control Systems Technology,2006,14(4):681 -694.
[19] Ramos J J G,Maeta S M,Mirisola L G B,et al.Internet-based solutions in the development and operation of an unmanned robotic airship[J].Proceedings of the IEEE,2003,91 (3):463 -473.
[20] Bruemmer D J,Few D A,Walton M C,et al."Turn off the television!":Real-world robotic exploration experiments with a virtual 3-D display[A].Proceedings of the 38th Annual Hawaii International Conference on System Sciences[C].Piscataway,NJ,USA:IEEE,2005.296.
[21] Itoh T,Yudate K,Ito S,et al.New predictive display method of motion and force information for network teleoperation without using virtual environment model[A].Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems[C].Piscataway,NJ,USA:IEEE,2003.2815-2822.
[22] Smith O J.A controller to overcome dead time[J].ISA Journal,1959,6(2):28 -33.
[23] Liu P X.Meng M Q H,Liu P R,et al.An end-to-end transmission architecture for the remote control of robots over IP networks[J].IEEE/ASME Transactions on Mechatronics,2005,10 (5):560 -570.
[24] Oboe R.Force-reflecting teleoperation over the Internet:The JBIT project[J].Proceedings of the IEEE,2003,91 (3):449 -462.
[25] Uchimura Y,Yakoh T.Bilateral robot system on the real-time network structure[J].IEEE Transactions on Industrial Electronics,2004,51 (5):940-946.
[26] Tsuji T,Kato A,Ohnishi K,et al.Safety control of teleoperation system undertime varying communication delay[A].Proceedings of the 8th IEEE International Workshop on Advanced Motion Control[C].Piscataway,NJ,USA:IEEE,2004.463-468.
[27] Fong T,Thorpe C,Baur C.Robot,asker of questions[J].Robotics and Autonomous Systems,2003,42(3 -4):235 -243.
[28] Wang M,Liu J N K.Interactive control for Internet-based mobile robot teleoperation[J].Robotics and Autonomous Systems,2005,52(2 -3):160 -179.
[29] Sim K B,Byun K S,Harashima F.Internet-based teleoperation of an intelligent robot with optimal two-layer fuzzy controller[J].IEEE Transactions on Industrial Electronics,2006,53 (4):1362-1372.
[30] Abidi M A,Eason R O,Gonzalez R C.Autonomous robotic inspection and manipulation using multisensor feedback[J].Computer,1991,24(4):17 -31.
[31] 王世华,胥布工,刘云辉.网络实时系统端对端的时钟同步研究及算法实现[J].信息与控制,2007,36(3):352-356,385.
[32] 王世华,胥布工,刘云辉,等.预估控制下的实时网络遥操作移动机器人[J].机器人,2007,29(4):305-312.