A 3D Information Measuring Method of Underwater Targets Based on Line-Structured Light
XU Pengfei1, MENG Hao1, LI Tongfei1, ZHENG Jinhai1, LI Zhigang2
1. Hohai University, Nanjing 210024, China; 2. State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
徐鹏飞, 孟昊, 李同飞, 郑金海, 李智刚. 一种基于线结构光的水下目标3维信息测量方法[J]. 机器人, 2022, 44(5): 564-573.DOI: 10.13973/j.cnki.robot.210442.
XU Pengfei, MENG Hao, LI Tongfei, ZHENG Jinhai, LI Zhigang. A 3D Information Measuring Method of Underwater Targets Based on Line-Structured Light. ROBOT, 2022, 44(5): 564-573. DOI: 10.13973/j.cnki.robot.210442.
Abstract:For shortcomings of existing underwater detection methods such as poor accuracy, large calibration errors and low efficiency, a 3D information measuring method of underwater targets based on line-structured light is designed. Firstly, the principle of cross ratio invariance is utilized to solve the relative position of feature points in the world coordinate system, and then their real coordinate values in camera coordinates are solved based on both the direction vector of feature points on image plane and their position information. The structured light plane are calibrated using multiple feature points. The feasibility and effectiveness of the proposed method are verified by target scanning experiments. For calibrating the structured light plane, only one scan of the specially designed simple-structured stereo target is required, without the need for moving the target several times, which avoids the influence of human-induced errors. While calibrating the structured light plane, the displacement velocity of the displacement stage in each dimension can be calibrated simultaneously, which effectively reduces the system error of the experimental platform, improves the system accuracy and also greatly enhances the efficiency of the whole system calibration process. It is very suitable for the underwater field calibration of large-scale line-structured light system. It is proved that the error of the 3D point cloud coordinates obtained from scanning the underwater target is less than 2% along the X and Y axes, and the error along the Z axis is slightly larger, with an average error of only 2.77%.
[1] 乔鹏飞,邵成,覃月明.基于多波束前视声呐的水下静态目标的探测识别技术[J].数字海洋与水下攻防, 2021, 4(1): 46-52. Qiao P F, Shao C, Qin Y M. Detection and recognition technology of underwater static target based on multi-beam forwardlooking sonar[J]. Digital Ocean & Underwater Warfare, 2021, 4(1): 46-52. [2] 冯露,李艳,翟洁,等.海洋测量技术方法在涉水工程水下结构检测中的应用与思考[J].地下水, 2021, 43(6): 173-174,229. Feng L, Li Y, Zhai J, et al. Application and consideration of marine measurement technology methods in the inspection of underwater structures of water-related projects[J]. Ground Water, 2021, 43(6): 173-174,229. [3] 郝宇,邱龙皓,邹男,等.无人平台自主探测声呐的发展现状和展望[J].哈尔滨工程大学学报, 2021, 42(9): 1347- 1354. Hao Y, Qiu L H, Zou N, et al. Development status and the prospect of autonomous detection sonar for unmanned platforms[J]. Journal of Harbin Engineering University, 2021, 42(9): 1347-1354. [4] 解则晓,张安祺.超大尺度线结构光传感器内外参数同时标定[J].光学学报, 2018, 38(3): 322-330. Xie Z X, Zhang A Q. Simultaneous calibration of the intrinsic and extrinsic parameters of ultra-large-scale line structuredlight sensor[J]. Acta Optica Sinica, 2018, 38(3): 322-330. [5] 胡松,王道累.摄像机标定方法的比较分析[J].上海电力学院学报, 2018, 34(4): 366-370. Hu S, Wang D L. Comparative analysis of camera calibration methods[J]. Journal of Shanghai University of Electric Power, 2018, 34(4): 366-370. [6] 刘玉婷,徐祥宇,王超,等.摄像机标定系统方法的研究[J].智能计算机与应用, 2019, 9(3): 133-136,141. Liu Y T, Xu X Y, Wang C, et al. Research on the method of camera calibration system[J]. Intelligent Computer and Applications, 2019, 9(3): 133-136,141. [7] Zhang Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334. [8] Cebrian-Robles D, Ortega-Casanova J. Low-cost 3D underwater surface reconstruction technique by image processing[J]. Ocean Engineering, 2016, 113: 24-33. [9] 王金桥,段发阶,冯帆,等.关节臂激光扫描系统光条中心提取方法研究[J].光电工程, 2015, 42(1): 13-19. Wang J Q, Duan F J, Feng F, et al. Extraction method of structured light stripe center based on AACMM laser scanning system[J]. Opto-Electronic Engineering, 2015, 42(1): 13-19. [10] 潘燕,张伟,赵雨,等.线结构光传感器参数现场标定方法[J].自动化仪表, 2017, 38(9): 48-52. Pan Y, Zhang W, Zhao Y, et al. On-site calibration method for the parameters of light sensor with line structure[J]. Process Automation Instrumentation, 2017, 38(9): 48-52. [11] 陈云赛,杨磊,宫垠,等.基于线结构光的水下目标扫描定位方法[J].机器人, 2018, 40(6): 786-793,802. Chen Y S, Yang L, Gong Y, et al. Underwater target scanning and location method based on line structured light[J]. Robot, 2018, 40(6): 786-793,802. [12] Dewar R. Self-generated targets for spatial calibration of structured light optical sectioning sensors with respect to an external coordinate system[C]//Conference on Robots and Vision. Cleveland, USA: Society of Manufacturing Engineers, 1988. [13] 段发阶,刘凤梅,叶声华.一种新型线结构光传感器结构参数标定方法[J].仪器仪表学报, 2000, 21(1): 108-110. Duan F J, Liu F M, Ye S H. A new accurate method for the calibration of line structured light sensor[J]. Chinese Journal of Scientific Instrument, 2000, 21(1): 108-110. [14] Huynh D Q, Owens R A, Hartmann P E. Calibrating a structured light stripe system: A novel approach[J]. International Journal of Computer Vision, 1999, 33: 73-86. [15] 范建华.基于线结构光的三维重构技术的研究与应用[D]. 广州:华南理工大学, 2016. Fan J H. The research and application of line structured light vision sensor[D]. Guangzhou: South China University of Technology, 2016. [16] 王华,郭于龙,张爽,等.优化的PSO空间高精度线结构光直接标定法[J].应用激光, 2021, 41(4): 860-868. Wang H, Guo Y L, Zhang S, et al. Optimized PSO spatial highprecision line structured light direct calibration method[J]. Applied Laser, 2021, 41(4): 860-868. [17] Cui Z C, Liu Y H, Li X Z. A novel extrinsic calibration method for robotic systems with structured light sensors[C]//IEEE International Conference on Robotics and Biomimetics. Piscataway, USA: IEEE, 2015: 2252-2257.