Dynamic Hand Gesture Recognition Based on SURF Tracking
BAO Jiatong1, SONG Aiguo1, GUO Yan1, TANG Hongru2
1. School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China; 2. School of Energy and Power Engineering, Yangzhou University, Yangzhou 225300, China
Abstract:A method of dynamic hand gesture recognition based on SURF(speeded up robust feature) tracking is proposed. The main characteristic is that the hand trajectory is described only by tracking the dominant movement directions of matched SURF points in adjacent frames with no need of the previous detection and segmentation of the hand region.The dynamic hand gesture is then modeled by a series of trajectory direction data streams after time warping.Accordingly,the data stream clustering method based on correlation analysis is developed to recognize a dynamic hand gesture and to speed up calculation. The proposed algorithm is tested on 26 alphabetic hand gestures and yields a satisfactory recognition rate,which is 87.1% on the training set and 84.6%on the testing set.Its successful application to the motion control of our self-developed robot Hunter also establishes the effectiveness of the approach.
[1] Malima A,Ozgur E,Cetin M.A fast algorithm for vision-based hand gesture recognition for robot controI[C]//14th IEEE Signal Processing and Communications Applications Conference.Piscataway,NJ,USA:IEEE,2006:1-4.
[2] Sanchez-Nielsen E,Ant6n-Canalis L,Hemandez-Tejera M.Hand gesture recognition for human-machinc intcraction[J].Journal of WSCG,2004,12(1):91-96.
[3] Wu Y,Liu Q,Huang T S.An adaptive self-organizing color segmentation algorithm with application to robust real-time human hand localization[C]//Proceedings of the 9th Asian Conference on Computer Vision.2000:1106-1111.
[4] Zhu Y X,Xu G Y,Kriegman D J.A real-time approach to the spotting,representation,and recognition of hand gestures for human-computer interaction[J].Computer Vision and ImageUnderstanding,2002,85(3):189-208.
[5] Weng C B,Li Y,Zhang M M,et al.Robust hand posture recognition integrating multi-cue hand tracking[M]//Lecture Notes in Computer Science,vol.6249.Berlin,Germany:SpringerVerlag,2010:497-508.
[6] Heap T,Samaria F.Real-time hand tracking and gesture recognition using smart snakes[C]//Proceedings of the Conference on Interface to Real and Virtual Worlds.1995.
[7] Zhong Y,Jain A K,Dubuisson-Jolly M P.Object tracking using deformable templates[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(5):544-549.
[8] MacCormick J,Isard M.Partitioned sampling,articulated objects,and interface-quality hand tracking[C]//6th European Conference on Computer Vision,Part Ⅱ.London,UK:Springer-Verlag,2000:3-19.
[9] Shan C F,Tan T N,Wei Y C.Real-time hand tracking using a mean shift embedded particle filter[J].Pattern Recognition,2007,40(7):1958-1970.
[10] Ong E J,Bowden R.A boosted classifier tree for hand shape detection[C]//6th IEEE Intemational Conference on Automatic Face and Gesture Recognition.Piscataway,NJ,USA:IEEE,2004:889-894.
[11] Mohamed Mansoor Roomi S,Jyothi Priya R,Jayalakshmi H.Hand gesture recognition for human-computer interaction[J].Journal of Computer Science,2010,6(9):994-999.
[12] Yoon H S,Soh J,Bae Y J,et al.Hand gesture recognition using combined features oflocation,angle and velocity[J].Pattem Recognition,2001,34(7):1491-1501.
[13] Bobick A F,Davis J W.The recognition of human movement using temporal templates[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(3):257-267.
[14] McKenna S J,Morrison K.A comparison of skin history and trajectory-based representation schemes for the recognition of user-specified gestures[J].Pattem Recognition,2004,37(5):999-1009.
[15] Bay H,Ess A,Tuytelaars T,et al.SURF:Speeded up robust features[J].Computer Vision and Image Understanding,2008,110(3):346-359.
[16] Lowe D G.Distinctive image features from scale-invariant keypoints[J].Intemational Journal of Computer Vision,2004,60(2):91-110.
[17] Bao J T,Guo Y,Song A G,et al.A multi-agent based robot telesupervision architecture for hazardous materials detection[C]//IEEE International Conference on Information and Automation.Piscataway,NJ,USA:IEEE,2010:2428-2432.