Abstract:A new shape prior segmentation method based on graph cuts is used to segment workpiece images and measure the workpiece posture for grasping workpieces in cluttered industry scene. Firstly, a prior shape is built. Minimum bounding rectangle method is proposed to register the workpiece shape model and the manual shape of the target workpiece to get the prior shape. In order to ensure the segmentation accuracy, a single prior shape is used. The target shape prior knowledge is added to the graph cut model. Secondly, the weight of the shape prior term is adjusted in a self-adaptive manner, so that the shape prior term of the energy function in graph cut method becomes adaptive to the image to be segmented. Thirdly, multiple workpieces in a image can be segmented by the shape prior method. Meanwhile, the optimal position of suction cup for grasping the workpiece is determined. Finally, the structured light vision system is used to acquire the point cloud of the workpiece. The plane of the workpiece is fitted and the normal vector is determined. Thus, the grasping orientation is obtained. The effectiveness of the proposed approach is demonstrated on the workpiece segmentation in the scene with occlusion, light variation and cluttered background. The posture of the planar workpiece acquired through calculation is accurate, and can be applied to the grasping operation in conditions of occlusion, reflection and complicated background.
[1] Rother C, Kolmogorov V, Blake A. "GrabCut"——Interactive foreground extraction using iterated graph cuts[J]. ACM Transactions on Graphics, 2004, 23(3):309-314.
[2] Liu X Q, Veksler O, Samarabandu J. Graph cut with ordering constraints on labels and its applications[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2008:990-997.
[3] Lempitsky V, Kohli P, Rother C, et al. Image segmentation with a bounding box prior[C]//IEEE International Conference on Computer Vision. Piscataway, USA:IEEE, IEEE, 2009:277-284.
[4] Slabaugh G, Unal G. Graph cuts segmentation using an elliptical shape prior[C]//IEEE International Conference on Image Processing. Piscataway, USA:IEEE, 2005:1222-1225.
[5] Nhat V, Manjunath B S. Shape prior segmentation of multiple objects with graph cuts[C]//IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, USA:IEEE, 2008:840-847.
[6] Kolmogorov V, Zabih R. What energy functions can be minimized via graph cuts?[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(2):147-159.
[7] Veksler O. Star shape prior for graph-cut image segmentation[C]//10th European Conference on Computer Vision. Berlin, Germany:Springer, 2008:454-467.
[8] 刘陈,李凤霞,张艳.基于图割与泛形信息的对象分割方法[J].计算机辅助设计与图形学学报,2009,21(12):1753-1760. Liu C, Li F X, Zhang Y. An interactive object cutout algorithm based on graph-cut and generalized shape prior[J]. Journal of Computer-aided Design and Computer Graphics, 2009, 21(12):1753-1760.
[9] 朗咸鹏,朱枫.基于图割的矩形目标交互式分割方法[J].计算机应用研究,2010,27(11):4369-4372,4378. Lang X P, Zhu F. Interactive segmentation of rectangle object via graph cut[J]. Application Research of Computers, 2010, 27(11):4369-4372,4378.
[10] Blake A, Kohli P, Rother C. Markov random fields for vision and image processing[M]. Cambridge, USA:MIT Press, 2011.
[11] Oh J K, Baek K K, Kim D, et al. Development of structured light based bin-picking system using primitive models[M]//Frontiers of Assembly and Manufacturing. Berlin, Germany:Springer, 2010:141-155.
[12] Hema C R, Paulraj M P, Nagarajan R. Object localization using stereo sensors for adept SCARA robot[C]//IEEE Conference on Robotics, Automation and Mechatronics. Piscataway, USA:IEEE, 2006:517-521.
[13] 陈伯豪.基于机器视觉的二维复杂轮廓加工对象在线检测系统研究[D].广州:广东工业大学,2014. Chen B H. Online testing system research of two-dimensional complex contour processing object based on machine vision[D]. Guangzhou:Guangdong University of Technology, 2014.
[14] 管经纬.基于机器视觉的工件自动分拣系统研究[D].上海:东华大学,2015. Guan J W. The research on automatic workpiece sorting system based on machine vision[D]. Shanghai:Donghua University, 2015.
[15] 王红涛.基于视觉的工业机器人目标识别定位方法的研究[D].西安:西安理工大学,2007. Wang H T. Research on target recognition and location of industrial robot based on computer vision[D]. Xi'an:Xi'an University of Technology, 2007.
[16] 朱海波.基于视觉引导的工业机器人工件搬运技术研究[D].沈阳:沈阳工业大学,2013. Zhu H B. Research of industrial robot workpiece handling technology based on visual guidance[D]. Shenyang:Shenyang University of Technology, 2013.
[17] 傅卫平,秦川,刘佳,等.基于SIFT算法的图像目标匹配与定位[J].仪器仪表学报,2011,32(1):163-169. Fu W P, Qin C, Liu J, et al. Matching and location of image object based on SIFT algorithm[J]. Chinese Journal of Scientific Instrument, 2011, 32(1):163-169.
[18] 佐立营.面向机器人抓取的散乱零件自动识别与定位技术研究[D].哈尔滨:哈尔滨工业大学,2015. Zuo L Y. Research on automatic identification and location of scattered parts for robot bin-picking[D]. Harbin:Harbin Institute of Technology, 2015.
[19] 黄红艳,杨煌普.基于高阶神经网络的机械零件形状识别[J].上海交通大学学报,2001,35(8):1144-1147.Huang H Y, Yang Y P. Shape recognition of machined parts based on higher order neural network[J]. Journal of Shanghai Jiaotong University, 2001, 35(8):1144-1147.
[20] 查英,刘铁根,杜东.图像识别技术在零件装配自动识别中的应用[J].计算机工程,2006,32(10):178-179,185.Zha Y, Liu T G, Du D. Application of image recognition in automatic recognition system for part assembling[J]. Computer Engineering, 2006, 32(10):179-179,185.
[21] 王修岩,程婷婷.基于单目视觉的工业机器人智能抓取研究[J].机械设计与制造,2011(5):135-136.Wang X Y, Cheng T T. Research on industrial robot intelligent grasp based on monocular vision[J]. Machinery Design & Manufacture, 2011(5):135-136.
[22] Jia Y B, Guo F, Lin H. Grasping deformable planar objects:Squeeze, stick/slip analysis, and energy-based optimalities[J]. International Journal of Robotics Research, 2014, 33(6):866-897.
[23] Seo J, Kim S, Kumar V. Planar, bimanual, whole-arm grasping[C]//IEEE International Conference on Robotics and Automation. Piscataway, USA:IEEE, 2012:3271-3277.
[24] Yu Z, Gu J. Optimized planar grasping synthesis algorithm for multi-fingered robotic hand[C]//IEEE International Conference on Automation and Logistics. Piscataway, USA:IEEE, 2009:1052-1057.
[25] 徐德,谭民,李原.机器人视觉测量与控制[M].2版.北京:国防工业出版社,2010:51-56. Xu D, Tan M, Li Y. Visual measurement and control for robots[M]. 2nd ed. Beijing:National Defense Industry Press, 2010:51-56.
[26] 吕震.反求工程CAD建模中的特征技术研究[D].杭州:浙江大学,2012. Lü Z. Study on feature technology in reverse engineering CAD modeling[D]. Hangzhou:Zhejiang University, 2012.