Abstract:To deal with the real 3D scene data faced by the mobile robot, a visual saliency detection method based on spatial-spectral mixture analysis is proposed. Firstly, a multichannel feature fusion algorithm is developed to integrate the color and depth information in RGB-D data. Then, the hypercomplex Fourier transform is applied in frequency domain to getting the multi-scale saliency maps. After that, an uneven superpixel segmentation algorithm is used to smooth each obtained saliency map. In this way, the interference of discrete background noises is eliminated and the detection result in frequency domain is improved. Finally, the cellular automata algorithm is adopted to merge the multi-scale visual saliency maps and extract the final saliency region. Plenty of experiments are conducted on the public database to verify the effectiveness of the proposed method in the real complex scene faced by the mobile robot.
[1] Mathe S, Sminchisescu C. Actions in the eye:Dynamic gaze datasets and learnt saliency models for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(7):1408-1424.
[2] Chang C K, Siagian C, Itti L. Mobile robot vision navigation & localization using gist and saliency[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway, USA:IEEE, 2010:4147-4154.
[3] Jerripothula K R, Cai J F, Yuan J S. Image co-segmentation via saliency co-fusion[J]. IEEE Transactions on Multimedia, 2016, 18(9):1896-1909.
[4] Yang X Y, Qian X M, Xue Y. Scalable mobile image retrieval by exploring contextual saliency[J]. IEEE Transactions on Image Processing, 2015, 24(6):1709-1721.
[5] Hadizadeh H, Baji? I V. Saliency-aware video compression[J]. IEEE Transactions on Image Processing, 2014, 23(1):19-33.
[6] Koch C, Ullman S. Shifts in selective visual attention:Towards the underlying neural circuitry[J]. Human Neurobiology, 1985, 4(4):219-227.
[7] Klein D A, Frintrop S. Center-surround divergence of feature statistics for salient object detection[C]//IEEE International Conference on Computer Vision. Piscataway, USA:IEEE, 2011:2214-2219.
[8] Bruce N D B, Tsotsos J K. Saliency, attention, and visual search:An information theoretic approach[J]. Journal of Vision, 2009, 9(3):No.5.
[9] Perazzi F, Kraehenbuehl P, Pritch Y. Saliency filters:Contrast based filtering for salient region detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2012:733-740.
[10] Zhu L, Klein D A, Frintrop S, et al. Multi-scale region-based saliency detection using W2 distance on N-dimensional normal distributions[C]//IEEE International Conference on Image Processing. Piscataway, USA:IEEE, 2013:176-180.
[11] Achanta R, Süsstrunk S. Saliency detection using maximum symmetric surround[C]//IEEE International Conference on Image Processing. Piscataway, USA:IEEE, 2010:2653-2656.
[12] Yang C, Zhang L H, Lu H C, et al. Saliency detection via graph-based manifold ranking[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2013:3166-3173.
[13] Cheng M M, Zhang G X, Mitra N J, et al. Global contrast based salient region detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2011:409-416.
[14] Rahtu E, Kannala J, Salo M, et al. Segmenting salient objects from images and videos[C]//11th European Conference on Computer Vision. Berlin, Germany:Springer, 2010:366-379.
[15] Hou X D, Zhang L Q. Saliency detection:A spectral residual approach[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2007:8pp.
[16] Guo C L, Ma Q, Zhang L M. Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2008:2908-2915.
[17] Imamoglu N, Lin W S, Fang Y M. A saliency detection model using low-level features based on wavelet transform[J]. IEEE Transactions on Multimedia, 2013, 15(1):96-105.
[18] Feng D, Barnes N, You S, et al. Local background enclosure for RGB-D salient object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2016:2343-2350.
[19] Peng H W, Li B, Xiong W H, et al. RGBD salient object detection:A benchmark and algorithms[C]//13th European Conference on Computer Vision. Cham, Switzerland:Springer, 2014:92-109.
[20] Qin Y, Lu H C, Xu Y Q, et al. Saliency detection via cellular automata[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2015:110-119.
[21] Achantay R, Hemamiz S, Estraday F, et al. Frequency-tuned salient region detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2009:1597-1604..
[22] Li J, Levine M D, An X L, et al. Visual saliency based on scale-space analysis in the frequency domain[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(4):996-1010.
[23] Felzenszwalb P F, Huttenlocher D P. Efficient graph-based image segmentation[J]. International Journal of Computer Vision, 2004, 59(2):167-181.
[24] Otsu N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1):62-66.
[25] Jiang H Z, Wang J D, Yuan Z J, et al. Automatic salient object segmentation based on context and shape prior[C]//British Machine Vision Conference. Surrey, UK:B M V A Press, 2011.
[26] Jiang H Z, Wang J D, Yuan Z J, et al. Salient object detection:A discriminative regional feature integration approach[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2013:2083-2090.
[27] Margolin R, Tal A, Zelnik-Manor L. What makes a patch distinct?[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2013:1139-1146.
[28] Zhai Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues[C]//14th Annual ACM International Conference on Multimedia. New York, USA:ACM, 2006:815-824.
[29] Li H Y, Lu H C, Lin Z, et al. Inner and inter label propagation:Salient object detection in the wild[J]. IEEE Transactions on Image Processing, 2015, 24(10):3176-3186.
[30] Ju R, Ge L, Geng W J, et al. Depth saliency based on anisotropic center-surround difference[C]//IEEE International Conference on Image Processing. Piscataway, USA:IEEE, 2014:1115-1119.
[31] Ren J Q, Gong X J, Yu L, et al. Exploiting global priors for RGB-D saliency detection[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2015:25-32.