环形焊缝的双目视觉定位与跟踪研究

刘涛; 左继业; 张晓森; 张连盟

doi:10.13433/j.cnki.1003-8728.20200124

环形焊缝的双目视觉定位与跟踪研究

doi: 10.13433/j.cnki.1003-8728.20200124

刘涛^{1, 2,},
左继业^{1, 2},
张晓森^{1, 2},
张连盟^{1, 2}

1.
燕山大学河北省重型机械流体动力传输与控制重点实验室, 河北秦皇岛 066004
2.
燕山大学先进锻压成形技术与科学教育部重点实验室, 河北秦皇岛 066004

基金项目:

河北省自然基金钢铁联合基金项目 E2017203079

详细信息

作者简介:
刘涛(1973-), 副教授, 博士, 研究方向为机电控制系统和机器视觉, liutao@ysu.edu.cn

中图分类号: TG156
计量
- 文章访问数: 284
- HTML全文浏览量: 52
- PDF下载量: 20
- 被引次数: 0
出版历程
- 收稿日期: 2020-01-18
- 刊出日期: 2021-06-01

Study on Binocular Vision Location and Tracking of Circular Seam

LIU Tao^{1, 2
,},
ZUO Jiye^{1, 2},
ZHANG Xiaosen^{1, 2},
ZHANG Lianmeng^{1, 2}

1.
Hebei Key Laboratory of Fluid Power Transmission and Control of Heavy Machinery, Yanshan University, Qinhuangdao 066004, Hebei, China
2.
The Ministry of Education Key Laboratory of Advanced Forging Technology and Science, Yanshan University, Qinhuangdao 066004, Hebei, China

摘要

摘要: 为有效解决非标罐体的环形焊缝识别问题，设计了一种基于被动双目视觉的环形焊缝定位与跟踪系统。首先改善左右相机采集到图像的图像质量，运用基于霍夫变换实现动态提取感兴趣区域(Region of interest, ROI)。然后经图像处理去噪，采用基于二值矩阵去除预焊点的方法来去除预焊点对焊缝识别的干扰，运用最小二乘法补全焊缝信息，拟合焊缝直线。接着利用改进后的双目视觉模型和基于极线的立体匹配方式，将环形焊缝细分为多个焊缝小区间内的直焊缝处理，计算并得到环形焊缝上焊点的空间坐标。实验结果表明，该系统平均误差为0.14 mm，并且可以准确地识别焊缝位置，验证了系统具有良好的精度。
- 双目视觉 /
- 环形焊缝 /
- 图像处理 /
- 定位
Abstract: In order to effectively solve the circular seam identification for non-standard tanks, a circular seam location and tracking system based on passive binocular vision was designed. Firstly, the quality of the images collected by the left and right cameras is improved, and the Region of Interest (ROI) is dynamically extracted based on the Hough transform. Then image processing is used to denoise, and the method based on binary matrix removal of pre-welds is used to remove the interference of pre-welds on weld recognition. The least-square method is used to complete the weld information and fit the weld straight line. Then, with the improved binocular vision model and the stereo matching method based on the epipolar line, the circular seam is subdivided into straight welds within multiple seam sections, and the space coordinates of the weld points on the circular seam are obtained. The experimental results show that the average error of the system is 0.14 mm, and the weld position can be identified accurately, which verifies that the system has a good accuracy.
- binocular vision /
- circular seam /
- image processing /
- location

HTML全文

图 1 薄壁不锈钢发酵罐

下载: 全尺寸图片幻灯片

图 2 焊接实验平台

下载: 全尺寸图片幻灯片

图 3 焊缝识别流程

下载: 全尺寸图片幻灯片

图 4 图像改善前后对比图

下载: 全尺寸图片幻灯片

图 5 动态ROI区域提取图

下载: 全尺寸图片幻灯片

图 6 图像阈值分割

下载: 全尺寸图片幻灯片

图 7 预焊点的剔除效果

下载: 全尺寸图片幻灯片

图 8 直线拟合过程

下载: 全尺寸图片幻灯片

图 9 改进后的视觉模型

下载: 全尺寸图片幻灯片

图 10 改进后的原理图

下载: 全尺寸图片幻灯片

图 11 立体匹配流程图

下载: 全尺寸图片幻灯片

图 12 环形焊缝识别软件

下载: 全尺寸图片幻灯片

图 13 精度实验图

下载: 全尺寸图片幻灯片

图 14 焊缝坐标误差分析图

下载: 全尺寸图片幻灯片

图 15 环形焊缝识别实验图

下载: 全尺寸图片幻灯片

图 16 环形焊缝空间轨迹

下载: 全尺寸图片幻灯片

参考文献(15)

[1]	罗雨, 张中亮, 焦向东, 等. 球罐全位置焊接机器人研究现状及其关键技术[J]. 电焊机, 2016, 46(10): 25-30 https://www.cnki.com.cn/Article/CJFDTOTAL-DHJI201610007.htm LUO Y, ZHANG Z L, JIAO X D, et al. Research status and key technology of all-position welding robots on spherical tank[J]. Electric Welding Machine, 2016, 46(10): 25-30 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-DHJI201610007.htm
[2]	陈华斌, 孔萌, 吕娜, 等. 视觉传感技术在机器人智能化焊接中的研究现状[J]. 电焊机, 2017, 47(3): 1-16 https://www.cnki.com.cn/Article/CJFDTOTAL-DHJI201703004.htm CHEN H B, KONG M, LV N, et al. Status and development of vision sensors on intelligentized robotic welding techologies[J]. Electric Welding Machine, 2017, 47(3): 1-16 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-DHJI201703004.htm
[3]	HUANG Y, LI G, SHAO W J, et al. A novel dual-channel weld seam tracking system for aircraft T-joint welds[J]. The International Journal of Advanced Manufacturing Technology, 2017, 91(1-4): 751-761 doi: 10.1007/s00170-016-9788-5
[4]	范明洋, 嵇保健, 洪磊. 基于线结构光的曲线焊缝焊接技术[J]. 组合机床与自动化加工技术, 2017(9): 142-145 https://www.cnki.com.cn/Article/CJFDTOTAL-ZHJC201709037.htm FAN M Y, JI B J, HONG L. Curve welding technology based on line structured light[J]. Modular Machine Tool & Automatic Manufacturing Technique, 2017(9): 142-145 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-ZHJC201709037.htm
[5]	ROUT A, DEEPAK B B V L, BISWAL B B. Advances in weld seam tracking techniques for robotic welding: a review[J]. Robotics and Computer-Integrated Manufacturing, 2019, 56: 12-37 doi: 10.1016/j.rcim.2018.08.003
[6]	刘超, 邵文军, 黄禹, 等. 激光焊接中窄拼缝被动光视觉检测方法[J]. 小型微型计算机系统, 2019, 40(4): 798-801 https://www.cnki.com.cn/Article/CJFDTOTAL-XXWX201904021.htm LIU C, SHAO W J, HUANG Y, et al. Weld seam detection method based on passive vision sensor in laser welding[J]. Journal of Chinese Computer Systems, 2019, 40(4): 798-801 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-XXWX201904021.htm
[7]	刘苏宜, 王国荣, 钟继光. 视觉系统在机器人焊接中的应用与展望[J]. 机械科学与技术, 2005, 24(11): 1296-1300 https://www.cnki.com.cn/Article/CJFDTOTAL-JXKX200511010.htm LIU S Y, WANG G R, ZHONG J G. Application and prospect of vision sensing system in robot welding[J]. Mechanical Science and Technology for Aerospace Engineering, 2005, 24(11): 1296-1300 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JXKX200511010.htm
[8]	雷毅, 许晓锋, 姚荣荣. 球罐自动焊应用现状及其焊缝跟踪技术研究[J]. 石油化工设备, 2006, 35(5): 49-52 https://www.cnki.com.cn/Article/CJFDTOTAL-SYSB200605014.htm LEI Y, XU X F, YAO R R. Applied situation of auto-welding technology for spherical tank and research development of its weld seam tracking technology[J]. Petro-chemical Equipment, 2006, 35(5): 49-52 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-SYSB200605014.htm
[9]	LIU S Y, WANG G R, ZHANG H, et al. Design of robot welding seam tracking system with structured light vision[J]. Chinese Journal of Mechanical Engineering, 2010, 23(4): 436-442 http://d.wanfangdata.com.cn/Periodical_jxgcxb-e201004005.aspx
[10]	KIDDEE P, FANG Z J, TAN M. An automated weld seam tracking system for thick plate using cross mark structured light[J]. The International Journal of Advanced Manufacturing Technology, 2016, 87(9-12): 3589-3603 doi: 10.1007/s00170-016-8729-7
[11]	DINHAM M, FANG G. Weld seam detection using computer vision for robotic Arc Welding[C]//2012 IEEE International Conference on Automation Science and Engineering. Seoul: IEEE, 2012: 771-776
[12]	曹守启, 刘洪飞, 冯杰才, 等. 基于焊接路径节点提取的对接焊缝路径规划方法[J]. 计量与测试技术, 2019, 46(11): 49-51 https://www.cnki.com.cn/Article/CJFDTOTAL-JLYS201911016.htm CAO S Q, LIU H F, FENG J C, et al. Butt weld path planning method based on welding path node extraction[J]. Metrology & Measurement Technique, 2019, 46(11): 49-51 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JLYS201911016.htm
[13]	田应仲, 刘洪飞, 冯杰才, 等. 基于二次滤波的对接焊缝路径识别[J]. 计量与测试技术, 2019, 46(11): 17-19, 24 https://www.cnki.com.cn/Article/CJFDTOTAL-JLYS201911005.htm TIAN Y Z, LIU H F, FENG J C, et al. Butt weld path recognition based on secondary filtering[J]. Metrology & Measurement Technique, 2019, 46(11): 17-19, 24 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JLYS201911005.htm
[14]	高振清, 李明刚, 杜艳平, 等. 带双目视觉的全向移动物流机器人设计与实现[J]. 机械科学与技术, 2019, 38(5): 779-782 https://www.cnki.com.cn/Article/CJFDTOTAL-JXKX201905019.htm GAO Z Q, LI M G, DU Y P, et al. Design and implementation of omnidirectional mobile logistics robot with binocular vision[J]. Mechanical Science and Technology for Aerospace Engineering, 2019, 38(5): 779-782 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JXKX201905019.htm
[15]	狄红卫, 柴颖, 李逵. 一种快速双目视觉立体匹配算法[J]. 光学学报, 2009, 29(8): 2180-2184 https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB200908031.htm DI H W, CHAI Y, LI K. A fast binocular vision stereo matching algorithm[J]. Acta Optica Sinica, 2009, 29(8): 2180-2184 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB200908031.htm