Vision Sensing Technology for Welding Robot
- Vol. 53, Issue 9, Pages: 61-69(2023)
DOI: 10.7512/j.issn.1001-2303.2023.09.08
扫 描 看 全 文
扫 描 看 全 文
程进,徐乃涛,郁伟俊.面向焊接机器人的视觉传感技术[J].电焊机,2023,53(9):61-69.
CHENG Jin, XU Naitao, YU Weijun.Vision Sensing Technology for Welding Robot[J].Electric Welding Machine, 2023, 53(9): 61-69.
视觉传感技术可以赋能焊接自动化技术,检测焊缝的形状、尺寸、位置和焊接质量,帮助焊接机器人更准确地完成焊接任务。焊接机器人工作站可有效地改善工人劳动强度,提高企业生产效率。因此,阐述了智能焊接机器人工作站系统的构造、视觉传感的搭载方式及各类视觉传感技术在焊缝寻位、焊缝跟踪、焊接质量检测等方面的工作原理。对当前主流的线结构光法、点结构光扫描法、多线结构光法和面结构光法进行了详细的描述与总结,这些技术的特点各有不同,实际应用时需结合应用场景做出匹配。焊接视觉技术可以提高焊接质量的稳定性和可靠性,减少缺陷和修复成本,进一步提高生产效率、降低生产成本,为焊接行业的发展提供更多的可能性。
The application of welding robots effectively improves labor productivity, reduces worker labor intensity, and has good stability. Visual sensing technology can empower welding automation technology, which can help welding workstations more accurately complete welding tasks by detecting the shape, size, position, and welding quality of welds. This article explains the construction of intelligent welding robot workstations, the way visual sensing is deployed, and the working principles of various visual sensing technologies in welding seam positioning, tracking, and quality inspection. The current mainstream techniques, including line structured light method, point structured light scanning method, multi-line structured light method, and surface structured light method, are described and summarized in detail, each with different characteristics that require matching with specific application scenarios. Welding visual technology can help enterprises better control welding quality, improve production efficiency, reduce production costs, and provide more possibilities for the development of the welding industry.
焊接机器人视觉传感结构光三维视觉
welding robotvisual sensingstructured lightthree-dimensional vision
郭岩宝, 王斌, 王德国,等. 焊接机器人的研究进展与发展趋势[J]. 现代制造工程, 2021(05):53-63.
GUO Y B, WANG B, WANG D G, et al. Research progress and development trend of welding robot[J]. Modern Manufacturing Engineering, 2021(05):53-63.
Tarn T J, Chen S B, Fang G. Robotic Welding, Intelligence and Automation[M]. Springer Berlin Heidelberg, 2011.
陈茂爱, 任文建, 闫建新,等. 焊接机器人技术[M]. 北京:化学工业出版社, 2019.
CHEN M A, REN W J, YAN J X, et al. Welding robot technology[M]. Beijing:Chemical Industry Press,2019.
尹策明, 赵威威. 机器人在隧道施工装备臂架焊接中的应用[J]. 电焊机, 2019, 49(07):62-65.
YIN C M, ZHAO W W. Application of robot in arm welding of tunnel construction equipment[J]. Electric Welding Machine, 2019, 49(7):62-65.
刘古文, 彭国华, 王忠哲. 钢构件焊接机器人免示教技术的尝试性研究[J]. 电焊机, 2019, 49(11):49-52.
LIU G W, PENG G H, WANG Z Z. A tentative study on the teaching-free technique of steel component welding robot[J]. Electric Welding Machine, 2019, 49(11):49-52.
李江. 智能焊接工业互联网平台[J]. 电焊机, 2021, 51(9):95-99.
LI J. Intelligent welding industry internet platform[J]. Electric Welding Machine, 2021, 51(9):95-99.
郭吉昌, 朱志明, 于英飞, 等. 焊接领域激光结构光视觉传感技术的研究及应用[J]. 中国激光, 2017, 44(12):7-16.
GUO J C, ZHU Z M, YU Y F, et al. Research and Application of Visual Sensing Technology Based on Laser Structured Light in Welding Industry[J]. Chinese Journal of Lasers, 2017, 44(12):7-16.
Zhang K, Yan M, Huang T, et al. 3D reconstruction of complex spatial weld seam for autonomous welding by laser structured light scanning[J]. Journal of Manufacturing Processes, 2019, 39(03):200-207.
钟建伟, 盛国福, 余国严, 等. 基于KUKA弧焊机器人的燃料组件上管座焊接工作站[J]. 电焊机, 2020, 50(11):115-119.
ZHONG J W, SHENG G F, YU G Y, et al. Welding workstation for fuel assembly top nozzle based on KUKA arc welding robot[J]. Electric Welding Machine, 2020, 50(11):115-119.
魏艳红, 张玉莲. 焊接工艺智能设计研究进展[J]. 电焊机, 2020, 50(9):213-220.
WEI Y H, ZHANG Y L. Research progress on intelligent design of welding process[J]. Electric Welding Machine, 2020, 50(9):213-220.
陈新禹, 张庆新, 朱琳琳, 等. 基于激光视觉传感器的机器人实时焊缝跟踪方法[J]. 激光与红外, 2021, 51(4):7.
CHEN X Y, ZHANG Q X, ZHU L L, et al. The method of real time seam tracking for robotic welding system based on laser vision sensor[J]. Laser & Infrared,2021,51(4):7.
沈爱华, 罗印升, 宋伟. 一种基于双目视觉的手眼标定方法[J].机械设计与制造工程,2016,45(5):42-46.
SHEN A H, LUO Y S, SONG W. An approach to hand-eye calibration based on stereo vision[J]. Machine Design and Manufacturing Engineering, 2016, 45(5):42-46.
Li M, Du Z, Ma X, et al. A robot hand-eye calibration method of line laser sensor based on 3D reconstruction[J]. Robotics and Computer-Integrated Manufacturing, 2021, 71:102136.
陈汉,任杰亮,闫帅,等. 面向机器人激光增材制造的机器视觉系统标定算法[J]. 电焊机, 2022, 52(2):36-41.
CHEN H, REN J L, YAN S, et al. Laser Additive Manufacturing Machine Vision System Development[J]. Electric Welding Machine, 2022, 52(2): 36-41.
卢张俊. 搬运装配机器人视觉引导智能作业系统与应用软件开发[D]. 江苏:东南大学, 2017.
LU Z J. System and Application Software Development for Intelligent Robot of Handling and Assembly Based on Vision Guidance[D].Jiangsu: Southeast University,2017.
杨晓立,叶乐佳,赵鑫,等.双目立体视觉研究进展与应用[J].激光与光电子学进展,2023,60(8):180-196.
YANG X L, YE L J, ZHAO X, et al. Research Progress on Binocular Stereo Vision Applications[J]. Laser & Optoelectronics Progress, 2023, 60(8): 180-196.
吕银环, 王汝笠, 柴震海,等. 基于衍射光学元件色散特征的三维建模系统[J]. 光子学报, 2004, 33(9):1144-1146.
LV Y H, WANG R L, CHAI Z H, et al. 3-dimensional Modeling System Based on the Chromatic Dispersion Characteristic of Diffractice Optical Element[J]. Acta Photonica Sinica, 2004, 33(9): 1144-1146.
贾佳璐, 应忍冬, 潘光华,等. 基于ToF相机的三维重建技术[J].计算机应用与软件,2020,37(4):127-131.
JIA J L, YING R D, PAN G H, et al. 3D Reconstruction Based on TOF Camera[J]. Computer Applications and Software, 2020, 37(4):127-131.
孔萌,张杰,张纶昭,等. 基于线结构光传感的T型角焊缝跟踪方法[J]. 电焊机, 2018, 48(10):101-104.
KONG M, ZHANG J, ZHANG L Z, et al. T-shaped fillet seam tracking method based on laser stripe visual sensor[J]. Electric Welding Machine, 2018, 48(10):101-104.
杨帆, 丁晓剑, 曹杰. 基于彩色结构光的自由曲面三维重建方法[J]. 光学学报, 2021, 41(2): 69-79.
YANG F, DING X J, CAO J. 3D Reconstruction of Free-Form Surface Based on Color Structured Light[J]. Acta Optica Sinica, 2021, 41(2): 69-79.
谢挺, 张晓杰, 叶智超,等. 面向室内场景的主被动融合视觉定位系统[J]. 中国图象图形学报, 2023, 28(2):0522-0534.
XIE T, ZHANG X J, YE Z C, et al. Visual localization system of integrated active and passive perception for indoor scenes[J]. Journal of Image and Graphics, 28(02):522-534.
张宗华,刘巍,刘国栋,等. 三维视觉测量技术及应用进展[J].中国图象图形学报,2021,26(6):1483-1502.
ZHANG Z H, LIU W, LIU G D, et al. Overview of the development and application of 3D vision measurement technology[J]. Journal of Image and Graphics, 021, 26(6):1483-1502.
Yang L, Liu Y, Peng J. Advances techniques of the structured light sensing in intelligent welding robots: a review[J]. International Journal of Advanced Manufacturing Technology, 2020, 110(3):1027-1046.
李莹莹, 张志毅, 袁林. 线结构光光条中心提取综述[J]. 激光与光电子学进展, 2013, 50(10):13-22.
LI Y Y, ZHANG Z Y, YUAN L. Survey on Linear Structured Light Stripe Center Extraction[J]. Laser & Optoelectronics Progress, 2013, 50(10):13-22.
吴家勇, 王平江, 陈吉红,等. 基于梯度重心法的线结构光中心亚像素提取方法[J]. 中国图象图形学报, 2009, 14(7):1354-1360.
WU J Y, WANG P J, CHEN J H, et al. Method of Linear Structured Light Sub-pixel Center Position Extracting Based on Gradient Barycenter[J]. Journal of Image and Graphics, 2009, 14(7):1354-1360.
陈章兰, 高向东, 陈永平, 等. 焊接视觉图像质心算法及其特性[J]. 焊接学报, 2006, 24(04): 17-20.
CHEN Z L, GAO X D, CHEN Y P, et al. Arithmetic of welding visual image centroid and its characteristics[J]. Transactions of the China Welding Institution, 2006, 24(04): 17-20.
霍平, 李军萌, 曾翰林,等. 一种基于结构光的V型焊缝实时图像处理方法[J]. 电焊机, 2014, 44(12):144-148.
HUO P, LI J M, ZENG H L, et al. The real-time image processing V-shaped seam method based on a structure light[J]. Electric Welding Machine, 2014, 44(12):144-148.
高世一, 杨凯珍. 变边限高斯拟合提取激光条纹中心线方法的研究[J]. 仪器仪表学报, 2011, 32(5):1132-1137.
GAO S Y, YANG K Z. Research on central position extraction of laser strip based on varied-boundary Gaussian fitting[J]. Chinese Journal of Scientific Instrument, 2011, 32(5):1132-1137.
周富强, 陈强, 张广军. 结构光光条提取的混合图像处理方法[J]. 光电子·激光, 2008, 19(11): 1534-1537.
ZHOU F Q, CHEN Q, ZHANG G J. Composite image processing for center extraction of structured light stripe[J]. Journal of Optoelectronics·Laser, 2008, 19(11):1534-1537.
郭雁蓉, 杨剑, 宋文爱,等. 复杂环境中的线结构光中心提取方法[J]. 计算机工程与设计, 2019(4):1133-1138+1144.
GUO Y R, YANG J, SONG W A, et al. Method for extracting line structured light center in complex environment[J]. Computer Engineering and Design, 2019(4):1133-1138+1144.
崔希君,杨川,刘保华,等. 线性结构光心的自适应迭代提取法[J].西安交通大学学报,2007,41(1):73-76.
CUI X J, YANG C, LIU B H, et al. Self-Adaptive Iterative Method of Extracting Center of Linear-Structured Light Stripe[J]. Journal of Xi'an Jiaotong University, 2007, 41(1):73-76.
Servo-robot Inc. Arc Seam Tracking[EB/OL]. [2023-04-23]. https://servo-robot.com/arc-seam-trackinghttps://servo-robot.com/arc-seam-tracking.
谢志孟, 高向东. 基于视觉传感的焊缝跟踪技术研究和展望[J]. 焊接, 2005(04):5-9.
XIE Z M, GAO X D. Study and Prospect of Seam-Tracking Technology Based on Vision Sensors[J]. Welding & Joining, 2005(04):5-9.
Deng B Q, Wang Y S. Research on Welding Seam Tracking Technology Based on Linear Laser CCD Robot[C]//International Conference on Robotics and Automation Sciences, 2019.
邹易. 基于多线结构光的三维测量系统的研究[D].广东:深圳大学,2019.
ZOU Y. Research of 3D measure system based on multi line structure light[D]. Guangdong: Shenzhen University,2019.
Geng J. Structured-light 3D surface imaging: a tutorial[J]. Advances in Optics and Photonics, 2011, 3(2):128-160.
Texas Instruments, Inc. Highly Scalable TI DLP® Technology for 3D Machine Vision[EB/OL]. [2023-04-23]. https://www.ti.com.cn/zh-cn/dlp-chip/3d-scan-machine-vision/overview.htmlhttps://www.ti.com.cn/zh-cn/dlp-chip/3d-scan-machine-vision/overview.html.
Cheng J, Sun X, Zhou S, et al. Ultra-compact structured light projector with all-dielectric metalenses for 3D sensing[J]. AIP Advances, 2019, 9(10):105016.
Wuxi V-Sensor Technology Co., Ltd. 3D Depth Camera[EB/OL]. [2023-04-23]. http://www.mvstek.com/pdn3d/pdn3dd.htmlhttp://www.mvstek.com/pdn3d/pdn3dd.html.
张帆,泮佳俊,刘腾,等.基于机器视觉的焊缝识别研究现状与发展趋势[J]. 电焊机,2022,52(7):24-33.
ZHANG F, PAN J J, LIU T, et al. Research Status and Development Trend of Welding Seam Recognition Based on Machine Vision[J]. Electric Welding Machine, 2022, 52(7): 24-33.
吴家勇, 王平江, 陈吉红, 等. 激光焊接对接接头间隙宽度视觉测量系统[J]. 焊接学报, 2009(08): 105-108.
WU J Y, WANG P J, CHEN J H, et al. Vision system of butt joint gap width measurement for laser welding[J]. Transactions of the China Welding Institution, 2009(08): 105-108.
齐秀滨. 激光焊接过程视觉传感技术的发展现状[J]. 焊接学报, 2008(02): 108-112.
QI X B. State-of-arts of visual sensing technology to monitor laser welding process[J]. Transactions of the China Welding Institution, 2008(02): 108-112.
雷正龙, 吕涛, 陈彦宾, 等. 基于扫描激光视觉传感的焊缝图像特征信息识别[J]. 焊接学报, 2013, 34(05):54-58.
LEI Z L, LV T, CHEN Y B, et al. Weld image feature information recognition based on scanning laser vision sensing[J]. Transactions of the China Welding Institution, 2013, 34(05):54-58.
张鹏贤, 刘志辉, 于桐. 基于激光光栅的焊口数字轮廓视觉测量[J]. 电焊机, 2018, 48(7):8-12.
ZHANG P X, LIU Z H, YU T. Vision measurement for digital contour of weld bore based on laser grating[J]. Electric Welding Machine, 2018, 48(7):8-12.
孙大为, 蔡艳, 佟彤, 等. 基于编码结构光的角焊缝视觉检测[J]. 焊接学报, 2013(7): 47-50.
SUN D W, CAI Y, TONG T, et al. Fillet weld visual inspection based on coded structured light[J]. Transactions of the China Welding Institution,2013(7):47-50.
赵相宾, 李亮玉, 夏长亮, 等. 激光视觉焊缝跟踪系统图像处理[J]. 焊接学报, 2006(12): 42-44+48.
ZHAO X B, LI L Y, XIA C L, et al. Image processing of seam tracking system with laser vision[J]. Transactions of the China Welding Institution, 2006(12): 42-44+48.
王树强, 周游, 陈昊雷, 等. 基于激光视觉的钢结构焊缝图像处理系统[J]. 焊接学报, 2022, 43(02): 101-105+112.
WANG S Q, ZHOU Y, CHEN H L, et al. Image processing system of welding seam of steel structure based on laser vision[J]. Transactions of the China Welding Institution, 2022, 43(02): 101-105+112.
马国红, 秦佳, 姜芙蓉,等. 基于轮式小车的焊缝视觉信息的获取与跟踪[J]. 上海交通大学学报, 2010(S1):8-10.
MA G H, QIN J, JIANG F R, et al. Welding Vision Information Acquisition and Tracking with Welding Wheel[J]. Journal of Shanghai Jiaotong University, 2010(S1):8-10.
钱慧, 杨志永, 黄田. 高速并联机械手视觉软件开发技术研究[J]. 制造技术与机床, 2005(10):34-38.
QIAN H, YANG Z Y, HUANG T. Key Technology to the Vision Software Development of High-speed and Parallel Manipulatot[J]. Manufacturing Technology &Machine Tool, 2005(10):34-38.
潘海鸿, 李睿亮, 刘冠良,等. 基于激光视觉系统的多层多道焊接路径规划[J]. 组合机床与自动化加工技术, 2021(11): 23-26+30.
PAN H H, LI R L, LIU G L, et al. Multilayer and Multichannel Welding Path Planning Based on Laser Vision System[J]. Modular Machine Tool & Automatic Manufacturing Technique, 2021(11):23-26+30.
洪妍,樊星.北京·埃森焊接展之焊接智能化[J].焊接技术,2021,50(S1):78-82.
HONG Y, FAN X. Intelligent Welding in Beijing Essen Welding & Cutting Fair[J]. Welding Technology,2021,50(S1):78-82.
魏丽华,樊星,金顺捷. 北京·埃森焊接展之焊缝跟踪系统[J]. 电焊机,2021,51(12):96-99.
WEI L H, FAN X, JIN S J. Seam tracking system in Beijing Essen Welding & Cutting Fair[J]. Electric Welding Machine, 2021, 51(12): 96-99.
编辑部网址:http://www.71dhj.comhttp://www.71dhj.com
相关文章
相关作者
相关机构