Large time-delay usually exists in the visual localization results of unmanned aerial vehicles (UAVs), which lowers the accuracy of motion estimation. To solve this problem, a real-time motion estimation method based on multi-sensor data fusion is proposed. Firstly, attitude information provided by the inertial measurement unit (IMU) is fused into the monocular visual localization algorithm, so that the delay in localization results can be reduced. Then, the delay of the visual localization results is considered during the motion estimation using Kalman filter, and the measurements of the accelerometer are used to compensate the delay. With the proposed method, motion estimation results with high accuracy are obtained in real time. The method is validated by field experiments on a quadrotor system. By comparing the motion estimation results with the method without delay compensation as well as the ground truth data, the effectiveness of the proposed method is verified.
 白勇强,刘昊,石宗英,等.四旋翼无人直升机鲁棒飞行控制[J].机器人,2012,34(5):519-524. Bai Y Q, Liu H, Shi Z Y, et al. Robust flight control of quadrotor unmanned air vehicles[J]. Robot, 2012, 34(5): 519-524. Yoo C S, Ahn I K. Low cost GPS/INS sensor fusion system for UAV navigation[C]//Proceedings of the 22nd Digital Avionics Systems Conference: vol.2. Piscataway, USA: IEEE, 2003: 8.A.1-1-9. Farhad A, Marcin K, Galina O. Fault-tolerant position/attitude estimation of free-floating space objects using a laser range sensor[J]. IEEE Sensors Journal, 2011, 11(1): 176-185.  Zhao H, Wang Z Y. Motion measurement using inertial sensors, ultrasonic sensors, and magnetometers with extended Kalman filter for data fusion[J]. IEEE Sensors Journal, 2012, 12(5): 943-953.  Klose S, Wang J, Achtelik M. Markerless, vision-assisted flight control of a quadrocopter[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA: IEEE, 2010: 5712-5715. Grzonka S, Grisetti G, Burgard W. A fully autonomous indoor quadrotor[J]. IEEE Transactions on Robotics, 2012, 28(1): 90-100.  Meier L, Tanskanen P, Heng L. PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision[J]. Autonomous Robots, 2012, 33(1/2): 21-39. Artieda J, Sebastian J, Campoy P. Visual 3-D SLAM from UAVs[J]. Journal of Intelligent and Robotic Systems, 2009, 55(4/5): 299-321. de Marina H G, Pereda F J, Giron-Sierra J M, et al. UAV attitude estimation using unscented Kalman filter and TRIAD[J]. IEEE Transactions on Industrial Electronics, 2012, 59(11): 4465-4474.  Mondragon I F, Olivares-Mendez M A, Campoy P, et al. Unmanned aerial vehicles UAVs attitude, height, motion estimation and control using visual systems[J]. Autonomous Robots, 2010, 29(1): 17-34.  Wang C L, Wang T M, Liang J H, et al. Bearing-only visual SLAM for small unmanned arial vehicles in GPS-denied environment[J]. International Journal of Automation and Computing, 2013, 10(5): 387-396.  Zhou F, Zheng W, Wang Z F. Adaptive noise identification in vision-assisted motion estimation for unmanned aerial vehicles[J]. International Journal of Automation and Computing, 2008, DOI: 10.3724/SP.J.1005.2008.00225.