An Efficient Traffic Signs Recognition Method for Autonomous Vehicle
SONG Wenjie1,2, FU Mengyin1,2, YANG Yi1,2
1. Key Laboratory of Complex System Intelligent Control and Decision, Beijing 100081, China;
2. School of Automation, Beijing Institute of Technology, Beijing 100081, China
An efficient traffic signs recognition (TSR) method is presented to solve the problems such as the poor real-time performance and low accuracy of existing methods in the intelligent transportation system (ITS). Firstly, some image areas are selected according to experiments, which are preprocessed to adapt to different environments, and are split into four channel images, i.e. red, blue, yellow and black. Then, the qualified contours are selected from the outer contours of each channel image, and the convex hull processing for those contours is conducted for the second selection. Next, the circle and square contours are selected according to their characteristics such as areas, perimeters and Hu invariant moments, and their internal images are obtained as regions of interest (ROIs) from the original high resolution image. Finally, each ROI image is matched with templates through histogram scaling and translation matching (HSTM algorithm) by using horizontal and vertical histogram characteristics, and the optimal matching result is regarded as the final recognition result. In Chinese Intelligent Vehicle Challenge, the autonomous vehicle equipped with the proposed TSR system has recognized all the specified signs, whose recognition rate is up to 95% and recognition speed is up to 8Hz～10Hz. The proposed method proves its advantages in real-time performance and in accuracy compared with other existed methods.
[1] Mogelmose A, Trivedi M M, Moeslund T B. Vision-based traffic signs detection and analysis for intelligent driver assistance systems: Perspectives and survey[J]. IEEE Transactions on Intelligent Transportation Systems, 2012, 13(4): 1484-1497. [2] Li L B. Detection and classification of traffic signs in natural environments[D]. Harbin: Harbin Institute of Technology, 2008.[3] 韩强,戎蒙恬,刘文江.图像信号处理器中自动白平衡的算法研究[J].信息技术,2009(11):55-59.Han Q, Rong M T, Liu W J. Algorithm research of auto white balance in hardware-based ISP[J]. Information Technology, 2009(11): 55-59.[4] Zaklouta F, Stanciulescu B. Real-time traffic signs recognition in three stages[J]. Robotics and Autonomous Systems, 2014, 62(1): 16-24. [5] Liang M, Yuan M, Hu X, et al. traffic signs detection by ROI extraction and histogram features-based recognition[C]//International Joint Conference on Neural Networks. Piscataway, USA: IEEE, 2013: 1-8.[6] de la Escalera A, Moreno L E, Salichs M A, et al. Road traffic signs detection and classification[J]. IEEE Transactions on Industrial Electronics, 1997, 44(6): 848-859. [7] 张静,何明一,戴玉超,等.综合颜色和形状的圆形交通标志检测方法[J].计算机工程与应用,2011,47(2):233-236.Zhang J, He M Y, Dai Y C, et al. Circular traffic signs detection based on color and shape[J]. Computer Engineering and Applications, 2011, 47(2): 233-236.[8] 黄源水.自主车辆交通标志识别系统关键技术研究[D].北京:北京理工大学,2009.Huang Y S. Research on key technology of traffic signs recognition system of autonomous vehicle[D]. Beijing: Beijing Institute of Technology, 2011[9] Rizon M, Yazid H, Saad P, et al. Object detection using geometric invariant moment[J]. American Journal of Applied Sciences, 2006, 3(6): 1876-1878. [10] 周培德.求凸壳顶点的一种算法[J].北京理工大学学报,1993,13(1): 69-72. Zhou P D. An algorithm for determining the vertex of the convex hull[J]. Journal of Beijing Institute of Technology, 1993, 13(1): 69-72.[11] 刘思平.道路交通标志的检测与识别技术研究[D].南京:南京理工大学,2011.Liu S P. Research on traffic signs detection and recognition[D]. Nanjing: Nanjing University of Science and Technology, 2011.[12] 朱双东,刘兰兰,陆晓峰.一种用于道路交通标志识别的颜色-几何模型[J].仪器仪表学报,2007,28(5):956-960.Zhu S D, Liu L L, Lu X F. Color-geometric model for traffic sign recognition[J].Chines Journal of Scientific Instrument, 2007, 28(5): 956-960.[13] Graham R L. An efficient algorith for determining the convex hull of a finite planar set[J]. Information Processing Letters, 1972, 1(4): 132-133. [14] 周培德.计算几何-算法设计与分析[M].北京:清华大学出版社,2008: 88-92.Zhou P D. Computational geometry algorithm design and analysis[M]. Beijing: Tsinghua University, 2008: 88-92.[15] Parker J R. Algorithms for image processing and computer vision[M]. Hoboken, USA: John Wiley & Sons Inc., 2010.[16] Gu Y, Yendo T, Tehrani M P, et al. Traffic sign detection in dual-focal active camera system[C]//Intelligent Vehicles Symposium. Piscataway, USA: IEEE, 2011: 1054-1059.[17] Gonzalez A, Garrido M A, Llorca D F, et al. Automatic traffic signs and panels inspection system using computer vision[J]. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(2): 485-499. [18] Lafuente-Arroyo S, Salcedo-Sanz S, Maldonado-Bascon S, et al. A decision support system for the automatic management of signs based on support vector machines and geographic information systems[J]. Expert Systems with Applications, 2010, 37(1): 767-773. [19] Barnes N, Loy G. Real-time regular polygonal sign detection[C]//Field and Service Robotics. Berlin, Germany: Springer-Verlag, 2006: 55-66.
