Design and Application of a Robust Vision Tracking System for Unmanned Rotorcraft

doi:10.13973/j.cnki.robot.2014.0600

摘要
图/表
参考文献
相关文章 (2)

全文: PDF (1401 KB) HTML ( ) 输出: BibTeX \| EndNote (RIS)
引用本文:
FAN Baojie, DU Yingkui. Design and Application of a Robust Vision Tracking System for Unmanned Rotorcraft[J]. 机器人, 2014, 36(5): 600-608.DOI: 10.13973/j.cnki.robot.2014.0600. FAN Baojie, DU Yingkui. Design and Application of a Robust Vision Tracking System for Unmanned Rotorcraft. ROBOT, 2014, 36(5): 600-608. DOI: 10.13973/j.cnki.robot.2014.0600.

摘要

In order to satisfy the requirements of UAV’s aerial safety monitoring and surveillance of sensitive areas，a robust vision system for the rotor UAV is designed and implemented，which includes visual airborne subsystem，ground station subsystem and wireless communication subsystem. Complete sky-ground and human-computer interaction loops are constructed. Based on the developed UAV vision platform，a real-time target tracking algorithm under the mean shift tracking framework is developed. The joint color-texture histogram is used to represent the target robustly. With the help of moment information，the scale and the orientation of the tracked target is estimated adaptively during the tracking process. A model updating scheme for the target and the background is introduced to reduce the interferences from background and the locating biases. Numerical simulation and real flight tracking experiments demonstrate that the overall visual tracking system is effective and has superior performance against several state-of-the-art algorithms.

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	FAN Baojie
	DU Yingkui

关键词 ： unmanned aerial vehicle, vision system architecture, joint color-texture histogram, target tracking

Abstract：

In order to satisfy the requirements of UAV's aerial safety monitoring and surveillance of sensitive areas, a robust vision system for the rotor UAV is designed and implemented, which includes visual airborne subsystem, ground station subsystem and wireless communication subsystem. Complete sky-ground and human-computer interaction loops are constructed. Based on the developed UAV vision platform, a real-time target tracking algorithm under the mean shift tracking framework is developed. The joint color-texture histogram is used to represent the target robustly. With the help of moment information, the scale and the orientation of the tracked target is estimated adaptively during the tracking process. A model updating scheme for the target and the background is introduced to reduce the interferences from background and the locating biases. Numerical simulation and real flight tracking experiments demonstrate that the overall visual tracking system is effective and has superior performance against several state-of-the-art algorithms.

Key words： unmanned aerial vehicle vision system architecture joint color-texture histogram target tracking

收稿日期: 2014-05-08 录用日期: 2014-08-28

基金资助:

National Natural Science Foundation of China (6120327)

通讯作者: FAN Baojie，jobfbj@gmail.com E-mail: jobfbj@gmail.com

作者简介: FAN Baojie （1983-），male，Ph.D.，lecturer. Research interests include UAV vision system，space robot，object tracking，pattern recognition.
DU Yingkui （1980-），male，Ph.D.，associate professor. Research interests include UAV，space robot，robot vision and pattern recognition.

链接本文:

https://robot.sia.cn/CN/10.13973/j.cnki.robot.2014.0600 或 https://robot.sia.cn/CN/Y2014/V36/I5/600

[1] Ludington B, Johnson E, Vachtsevanos G. Augmenting UAV autonomy[J]. IEEE Robotics and Automation Magazine, 2006,13(3): 63-71.

[2] Campbell M E, Whitacre W. Cooperative tracking using vision measurements on seascan UAVs[J]. IEEE Transactions on Control Systems Technology, 2007, 15(4): 613-626.

[3] Campoy P, Correa J F, Mondrag′on I, et al. Computer vision onboard UAVs for civilian tasks[J]. Journal of Intelligent and Robotic Systems, 2009, 54(1/2/3): 105-135.

[4] Shim D H, Chung H, Kim H J, et al. Autonomous exploration in unknown urban environments for unmanned aerial vehicles[C]//AIAA Guidance, Navigation, and Control Conference. Reston, USA: AIAA, 2005: 6381-6388.

[5] Shim D H, Kim H J, Sastry S. Decentralized nonlinear model predictive control of multiple flying robots[C]//42nd IEEE Conference on Decision and Control. Piscataway, USA: IEEE,2003: 3621-3626.

[6] Meingast M, Geyer C, Sastry S. Vision based terrain recovery for landing unmanned aerial vehicles[C]//43rd IEEE Conference on Decision and Control. Piscataway, USA: IEEE, 2004:1670-1675.

[7] Ng A Y, Coates A, Diel M, et al. Autonomous inverted helicopter flight via reinforcement learning[M]//Experimental Robotics IX. Berlin, Germany: Springer-Verlag, 2006: 363-372.

[8] Lookingbill A, Lieb D, Stavens D, et al. Learning activity-based ground models from a moving helicopter platform[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA: IEEE, 2005: 3948-3953.

[9] Saripalli S, Montgomery J F, Sukhatme G S. Visually guided landing of an unmanned aerial vehicle[J]. IEEE Transactions on Robotics and Automation, 2003, 19(3): 371-380.

[10] Corke P, Hrabar S, Peterson R, et al. Autonomous deployment and repair of a sensor network using an unmanned aerial vehicle[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA: IEEE, 2004: 3602-3608.

[11] Hrabar S, Sukhatme G S, Corke P, et al. Combined optic-flow and stereo-based navigation of urban canyons for a UAV[C]// IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA: IEEE, 2005: 3309-3316.

[12] Amidi O, Kanade T, Miller R. Vision-based autonomous helicopter research at Carnegie Mellon Robotics Institute 1991-1997[C]//Proceedings of the AHS International Meeting on Advanced Rotorcraft Technology and Disaster Relief. Alexandria, USA: American Helicopter Society, 1998.

[13] Bagnell J A, Schneider J G. Autonomous helicopter control using reinforcement learning policy search methods[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA: IEEE, 2001: 1615-1620.

[14] Gavrilets V, Frazzoli E, Mettler B, et al. Aggressive maneuvering of small autonomous helicopters: A human-centered approach[J]. International Journal of Robotics Research, 2001,20(10): 795-807.

[15] Helble H, Cameron S. OATS: Oxford aerial tracking system[J]. Robotics and Autonomous Systems, 2007, 55(9): 661-666.

[16] Lin F, Dong X X, Chen B M, et al. A robust real-time embedded vision system on an unmanned rotorcraft for ground target following[J]. IEEE Transactions on Industrial Electronics, 2012,59(2): 1038-1049.

[17] Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 971-987.

[18] Comaniciu D, Ramesh V, Meer P. Kernel-based object tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2003, 25(5): 564-577.

[19] Ning J, Zhang L, Zhang D, et al. Scale and orientation adaptive mean shift tracking[J]. IET Computer Vision, 2012, 6(1):52-61.

[20] Mukundan R, Ramakrishnan K R. Moment functions in image analysis: Theory and applications[M]. Singapore: World Scientific,1998.

[21] Zivkovic Z, Krose B. An EM-like algorithm for colorhistogram- based object tracking[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, USA: IEEE, 2004: 798-803.

[22] Parameswaran V, Ramesh V, Zoghlami I. Tunable kernels for tracking[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, USA: IEEE, 2006:2179-2186.

[23] Collins R T. Mean-shift blob tracking through scale space [C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, USA: IEEE, 2003: 234-240.

[24] Yilmaz A, Javed O, Shah M. Object tracking: A survey[J]. ACM Computing Surveys, 2006, 38(4): 13.

[25] Li X, Hu W M, Shen C H, et al. A survey of appearance models in visual object tracking[J]. ACM Transactions on Intelligent Systems and Technology, 2013, 4(4): 58.

[26] Wu Y, Lim J, Yang M H. Online object tracking: A benchmark[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA: IEEE, 2013: 2411-2418.

[27] Zhang S P, Yao H X, Sun X, et al. Sparse coding based visual tracking: Review and experimental comparison[J]. Pattern Recognition, 2013, 46(7): 1772-1788.