Image processing-based weld detection method, system, equipment and storage medium

By using image processing technology in welding equipment, the welding route and thickness are monitored in real time, the welding accuracy problem caused by mechanical drive jitter is solved, the defective yield rate is reduced, and the automation level of welding equipment is improved.

CN118237794BActive Publication Date: 2024-11-15JIANGZHIHAI JINYE (JIANGSU) TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410390479.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-02
Publication Date
2024-11-15
Estimated Expiration
2044-04-02

AI Technical Summary

Technical Problem

Fully automatic welding equipment is prone to jitter during mechanical driving, resulting in reduced welding accuracy and high defective yield, making it difficult for the prior art to effectively monitor and adjust welding accuracy.

Method used

Weld welding detection method based on image processing is adopted. By setting vertical and horizontal acquisition positions in the welding area, image information is collected, welding route model images are constructed, welding routes are compared and early warning models, welding offsets and thickness are monitored in real time, and welding offsets and thickness are adjusted. Equipment location to reduce defective yield.

Benefits of technology

Real-time supervision and early warning of the welding routes of fully automatic welding equipment is realized, effectively reducing the welding defective yield rate and improving welding accuracy and yield rate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118237794B_ABST
    Figure CN118237794B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of weld detection technology, and discloses a weld detection method, system, device and storage medium based on image processing, including setting at least two mutually perpendicular acquisition positions in the welding area of ​​the welding object, using the acquisition positions to respectively acquire the image information in the vertical direction and the status information in the horizontal direction of the welding area; according to the image information in the vertical direction of the welding area, the welding route of the welding object is obtained, and the distance information between the welding route and the acquisition position in the horizontal direction is determined. In the embodiment of the present invention, the welding route deviation and welding thickness of the fully automatic welding equipment are monitored in real time by performing model image comparison processing on the welding route, and corresponding warnings can be made according to the real-time welding situation of the welding equipment to facilitate subsequent welding adjustments. That is, the yield rate of the welding object is effectively guaranteed to achieve the purpose of reducing the welding defective rate of the fully automatic welding equipment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of weld detection technology, and in particular to a weld detection method, system, equipment and storage medium based on image processing. Background Art

[0002] Most of the current welding equipment uses fully automatic or semi-automatic methods, such as fully automatic laser wire welding equipment. The overall digital control mechanization method is used to achieve fully automatic welding of welded parts, reducing labor costs and the occurrence of safety accidents.

[0003] In actual welding work, since fully automatic welding is affected by its mechanical transmission factors, that is, when the mechanically driven welding equipment moves, it is easy to shake, thus affecting the welding accuracy at the welding level. Therefore, when welding, it is necessary to monitor the welding accuracy in real time to facilitate welding adjustments and reduce the welding defect rate. Summary of the invention

[0004] The purpose of the present invention is to reduce the welding defective rate of fully automatic welding equipment, and to propose a weld detection method, system, equipment and storage medium based on image processing.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] A first aspect of the present invention provides a welding seam welding detection method based on image processing, comprising:

[0007] In the welding area of ​​the welding object, at least two mutually perpendicular acquisition positions are arranged, and the image information in the vertical direction and the condition information in the horizontal direction of the welding area are respectively acquired by the acquisition positions;

[0008] According to the image information in the vertical direction of the welding area, the welding route of the welding object is obtained, and the distance information between the welding route and the acquisition position in the horizontal direction is determined;

[0009] Determine the thickness information of the welding route of the welding object according to the condition information in the horizontal direction of the welding area;

[0010] Determine a welding route model image of the welding object according to the welding route of the welding object and in combination with the thickness information of the welding route of the welding object;

[0011] Formulate welding warning information according to welding requirements of welding objects, and formulate welding warning model according to welding warning information;

[0012] Compare the welding path model image of the welding object with the welding warning model to obtain the welding path deviation information of the welding object;

[0013] Determine the offset adjustment information of the welding equipment according to the welding route offset information of the welding object.

[0014] In some feasible embodiments, the method for determining thickness information of a welding route of a welding object includes:

[0015] According to the welding route of the welding object, a first detection and collection group and a second detection and collection group are arranged at the horizontal direction collection position of the welding area, and the first detection and collection group and the second detection and collection group are respectively located on both sides of the welding route of the welding object;

[0016] Wherein, the first detection acquisition group and the second detection acquisition group respectively include: at least one test group and at least one response group, and the test group and the response group on the first detection acquisition group are staggered with the test group and the response group on the second detection acquisition group;

[0017] According to the image information in the vertical direction of the welding area, respectively determine the distance information between the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object;

[0018] The first detection and acquisition group and the second detection and acquisition group are used respectively to perform position scanning on the welding path of the welding object in different time segments, and the distance information among the first detection and acquisition group, the second detection and acquisition group and the welding path of the welding object is combined to obtain the welding path thickness information of the welding object.

[0019] In some feasible embodiments, the scanning methods of the first detection and acquisition group and the second detection and acquisition group include:

[0020] The laser is used to scan the thickness of the welding path of the welding object.

[0021] In some feasible embodiments, the method for determining thickness information of a welding route of a welding object further includes:

[0022] Determine the setting position information of the measurement group and the response group in the second detection and acquisition group according to the setting position information of the measurement group and the response group in the first detection and acquisition group;

[0023] According to the distance information among the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object, the first detection and acquisition group is allowed to initially emit laser at one side of the welding route of the welding object, and the response group in the first detection and acquisition group or the response group in the second detection and acquisition group is used to receive the initially emitted laser to obtain the collection data information of the initially emitted laser;

[0024] The second detection and acquisition group is made to perform secondary laser emission at the other side of the welding route of the welding object, and the response group in the first detection and acquisition group or the response group in the second detection and acquisition group is used to receive the secondary laser emission to obtain acquisition data information of the secondary laser emission;

[0025] Determine the welding path width information of the welding object according to the image information in the vertical direction of the welding area;

[0026] According to the welding route width information of the welding object, combined with the collected data information of the initial laser emission and the collected data information of the secondary laser emission, the welding route thickness information of the welding object is determined.

[0027] In some feasible embodiments, the arrangement of the test group and the response group in the first detection and acquisition group includes:

[0028] Arranged in layers with intervals up and down;

[0029] Correspondingly, the arrangement of the test group and the response group in the second detection and collection group also includes:

[0030] Arranged in layers with intervals up and down.

[0031] In some feasible embodiments, the method for determining the welding route thickness information of the welding object includes:

[0032] According to the welding route width information of the welding object, and in combination with the distance information between the first detection and collection group, the second detection and collection group and the welding route of the welding object, the transmission and receiving route distance information in the two detection and collection groups is determined;

[0033] The test end on the first detection and acquisition group is used to initially emit laser on one side of the welding route. If the thickness of the welding route is consistent, the response group on the second detection and acquisition group receives the initial laser signal emitted by the test end on the first detection and acquisition group, and determines the thickness of the welding route according to the setting position information of the test end on the first detection and acquisition group; if the thickness on both sides of the welding route is inconsistent, the response group on the first detection and acquisition group receives the initial laser signal emitted by the test end on the first detection and acquisition group, and the thickness of the welding route is to be determined at this time;

[0034] Then, the test end on the second detection and acquisition group is used to emit the laser for the second time on the other side of the welding route. At this time, the response group on the first detection and acquisition group receives the secondary emitted laser signal from the test end on the second detection and acquisition group, and determines the thickness of the welding route based on the setting position information of the test end on the second detection and acquisition group or the response group on the first detection and acquisition group.

[0035] In some feasible embodiments, the method for obtaining the welding route deviation information of the welding object includes:

[0036] According to the welding requirements of the welding object, determine the data information of the allowable welding deviation interval in the welding route of the welding object;

[0037] According to the welding offset interval data information of the welding object and along the welding direction of the welding route of the welding object, a three-dimensional corridor welding warning model of the welding route is constructed;

[0038] The three-dimensional corridor welding warning model of the welding route is substituted into the welding route model image of the welding object to determine the welding route offset information of the welding object.

[0039] A second aspect of the present invention provides a weld detection system based on image processing, which adopts a weld detection method based on image processing as described in any one of the first aspects.

[0040] A third aspect of the present invention provides a fully automatic welding device, which adopts a weld detection method based on image processing as described in any one of the first aspects.

[0041] A fourth aspect of the present invention provides a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, a welding detection method for a weld based on image processing as described in any one of the first aspects is implemented.

[0042] The beneficial effects of the present invention are:

[0043] In the embodiment of the present invention, the welding route deviation and welding thickness of the fully automatic welding equipment are monitored in real time by performing model image comparison processing on the welding route, and a corresponding early warning can be made according to the real-time welding situation of the welding equipment to facilitate subsequent welding adjustments. That is, the good product rate of the welding object is effectively guaranteed to achieve the purpose of reducing the welding defective rate of the fully automatic welding equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 It is a schematic diagram of the overall process of a welding seam welding detection method based on image processing provided in an embodiment of the present invention;

[0045] Figure 2 A schematic diagram of a partial process of a welding seam welding detection method based on image processing provided in an embodiment of the present invention;

[0046] Figure 3 A schematic diagram of the acquisition position setting in a weld detection method based on image processing provided in an embodiment of the present invention;

[0047] Figure 4 A schematic diagram of data interval distribution that allows offsets on both sides of a welding direction in a weld detection method based on image processing provided in an embodiment of the present invention;

[0048] Figure 5 A schematic diagram of welding thickness interval distribution in a weld detection method based on image processing provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0051] In the present invention, unless otherwise clearly specified and limited, the terms "connection", "fixation", etc. should be understood in a broad sense. For example, "fixation" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0052] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the meaning of "and / or" appearing in the full text includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in the field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0053] Example

[0054] Reference Figures 1 to 5In order to achieve the purpose of reducing the low welding yield rate caused by the vibration of the mechanical drive in the welding equipment, the present invention provides a welding seam detection method based on image processing in the first aspect. The detection method monitors the welding route deviation and welding thickness of the automatic welding equipment in real time by performing model image comparison processing on the welding route, and can make corresponding warnings according to the real-time welding situation of the welding equipment to facilitate subsequent welding adjustments. That is, the welding object yield rate is effectively guaranteed to achieve the purpose of reducing the welding defective rate of the automatic welding equipment.

[0055] Specifically, the present invention provides a welding seam welding detection method based on image processing in a first aspect, the detection method comprising:

[0056] According to the welding situation, at least two mutually perpendicular acquisition positions are set in the welding area of ​​the welding object, that is, the welding area of ​​the welding object is provided with an acquisition position for acquiring the welding route situation of the welding object in the vertical direction, and is also provided with an acquisition position for acquiring the welding route situation of the welding object in the horizontal direction, so as to realize the supervision and control of the welding direction and welding thickness situation of the welding route of the welding object, that is, to realize the acquisition of the image information in the vertical direction and the situation information in the horizontal direction of the welding area by using at least two acquisition positions respectively. The image information in the vertical direction of the welding area can be acquired according to the vertical upper position of the welding area of ​​the welding object, so as to realize the acquisition of the welding route of the welding object, and then the distance information between the acquisition position in the horizontal direction and the welding route of the welding object is determined through the image information in the vertical direction of the welding area acquired by the acquisition position in the vertical direction, so as to facilitate the subsequent determination of the thickness distribution of the welding route according to the distance information. That is, the thickness information of the welding route of the welding object can be determined based on the condition information in the horizontal direction of the welding area; and then, based on the length and welding direction of the welding route of the welding object and the thickness information of the welding route of the welding object, a three-dimensional point cloud is constructed to determine the welding route model image of the welding object. This allows the operator to see the welding condition of the welding route of the welding object without having to approach the welding area with the human eye, and also allows the operator to clearly and intuitively observe the welding condition in the welding route of the welding object.

[0057] In order to meet the welding work requirements equipped on the fully automatic welding machine, corresponding welding warning information (such as: welding route allowable offset interval data, welding thickness qualified interval data, etc.) can also be formulated according to the welding work requirements of the welding object, and then a welding warning model is formulated according to the welding warning information; then the welding route model image of the welding object is compared with the welding warning model to obtain the welding route offset information of the welding object; according to the welding route offset information of the welding object, the offset adjustment information of the welding equipment is determined. That is, in this embodiment, by capturing the welding direction and welding thickness of the welding route in different directions, the welding state of the welding route can be mastered, and then the welding state of the welding route is modeled by three-dimensional point cloud, so that the operator can clearly and intuitively observe the welding situation of the welding route. At the same time, according to the value of the allowable offset of the welding route, the welding warning model of the welding route can be constructed by point cloud. By comparing the models between the two, the welding state can be clearly and intuitively understood, so as to facilitate the subsequent judgment of whether the position of the welding equipment needs to be adjusted. That is, the good rate of the welding object is effectively guaranteed to achieve the purpose of reducing the welding defective rate of the fully automatic welding equipment.

[0058] In this embodiment, in order to facilitate understanding of how to obtain the welding thickness on the welding route of the welding object according to the acquisition position set in the horizontal direction of the welding area, the following description is given here. Specifically, the method for determining the thickness information of the welding route of the welding object includes:

[0059] A first detection collection group and a second detection collection group may be provided at the horizontal collection position of the welding area along the welding route of the welding object, and the first detection collection group and the second detection collection group are respectively located on both sides of the welding route of the welding object, that is, the first detection collection group is located on both sides of the welding route of the welding object, so as to realize the collection and grasp of the welding thickness conditions on both sides of the welding route; in this embodiment, at least one test group and at least one response group are respectively provided on the first detection collection group and the second collection group, and the test group and the response group on the first detection collection group are staggered with the test group and the response group on the second detection collection group (such as: On both sides of the welding route, the test group setting position on the first detection and acquisition group is opposite to the response group setting position on the second detection and acquisition group, and the response group setting position on the first detection and acquisition group is opposite to the test group setting position on the second detection and acquisition group); that is, there is at least one test group and at least one response group on the first detection and acquisition group and the second detection and acquisition group, that is, at least one test group and response group are set on both sides of the welding route of the welding object, so that the test group emits a test signal (such as laser) through the upper surface of the welding route, and then the welding thickness distribution of the welding route is judged by the acceptance of the response group on both sides of the welding route. Specifically, the distance information between the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object can be determined respectively according to the image information in the vertical direction of the welding area, so as to grasp the return time and distance of the test group and the response group and the test path on the welding route, that is, in the case of using laser, by recording the laser emission time of the test group and the reception time of the response group, combined with the laser light speed, the distribution of the welding thickness on the welding route can be determined. That is, the first detection and acquisition group and the second detection and acquisition group are used to perform position scanning on the welding path of the welding object in different time segments respectively, and the distance information between the first detection and acquisition group, the second detection and acquisition group and the welding path of the welding object is combined to obtain the welding path thickness information of the welding object.

[0060] In this embodiment, in order to facilitate understanding of how to obtain the welding thickness on the welding route of the welding object according to the first detection and acquisition group and the second detection and acquisition group, the following description is given here. Specifically, the method for determining the thickness information of the welding route of the welding object also includes:

[0061] Since the first detection acquisition group and the second detection acquisition group are respectively arranged on both sides of the welding route, and the test group and the response group on the first detection acquisition group are staggered with the test group and the response group on the second detection acquisition group, the setting position information of the measurement group and the response group in the second detection acquisition group can be determined according to the setting position information of the measurement group and the response group in the first detection acquisition group; correspondingly, the setting position information of the measurement group and the response group in the first detection acquisition group can also be determined according to the setting position information of the measurement group and the response group in the second detection acquisition group. Then, according to the distance information between the first detection acquisition group, the second detection acquisition group and the welding route of the welding object, the first detection acquisition group is allowed to perform the initial laser emission on one side of the welding route of the welding object, and the response group in the first detection acquisition group or the response group in the second detection acquisition group is used to receive the initial laser emission to obtain the acquisition data information of the initial laser emission; then, the second detection acquisition group is allowed to perform the secondary laser emission on the other side of the welding route of the welding object, and the response group in the first detection acquisition group or the response group in the second detection acquisition group is used to receive the secondary laser emission to obtain the acquisition data information of the secondary laser emission. That is, the laser signal is emitted according to the test group in the first detection and acquisition group or the second detection and acquisition group, and then the return time and distance of the test path on the collective welding route are determined according to the reception of the response group on the first detection and acquisition group or the second detection and acquisition group. Then, according to the image information in the vertical direction of the welding area, the welding width information of the welding route of the welding object between the first detection and acquisition group and the second detection and acquisition group is determined; then, according to the welding route width information of the welding object, combined with the collection data information of the initial laser emission and the collection data information of the secondary laser emission, the thickness distribution on the welding route of the welding object is determined.

[0062] In this embodiment, in order to facilitate understanding of how to obtain the welding thickness on the welding route of the welding object according to the receiving situation of the response group, it is assumed that the arrangement of the response group and the test group on the first detection and acquisition group is stacked up and down, that is, the arrangement of multiple response groups and multiple test groups on the first detection and acquisition group is: a response group is set above and below a group of test groups, and a test group is set above and below a response group, and the test group and the response group are stacked up and down (see Figure 3). Similarly, the arrangement of the multiple response groups and the multiple test groups on the second detection acquisition group is also the same as that of the first detection acquisition group, wherein, at the same horizontal setting height, the setting position of the response group on the first detection acquisition group is opposite to the setting position of the test group on the second detection acquisition group, so as to achieve the mutually staggered setting of the test group and the response group on the first detection acquisition group and the test group and the response group on the second detection acquisition group. The arrangement of the test group and the response group on the first detection acquisition group and the test group and the response group on the second detection acquisition group is described as follows, and the method for determining the welding route thickness information of the welding object includes:

[0063] According to the welding route width information of the welding object, and combined with the distance information among the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object, the transmitting and receiving route distance information in the two detection and acquisition groups is determined; that is, the welding route width of the welding object is determined from the image information in the vertical direction of the welding area, and at the same time, the setting positions of the first detection and acquisition group and the second acquisition group and the welding route are determined, and the possible situations of laser emission by the test group in the first detection and acquisition group and the possible situations of reception by the response group are determined.

[0064] Reference Figure 4 and Figure 5 Here, in order to facilitate understanding of how to use the first detection and collection group and the second detection and collection group to detect the thickness of the welding route, the following description is given here. Specifically,

[0065] The test end on the first detection and acquisition group is used to initially emit laser on one side of the welding route. At this time, if the thickness of the welding route is consistent, the response group on the second detection and acquisition group at the same horizontal height can receive the initial laser signal emitted by the test end on the first detection and acquisition group, and determine the thickness of the welding route according to the setting position information of the test end on the first detection and acquisition group; if the thickness on both sides of the welding route is inconsistent (that is, the welding thickness of the welding route at the side close to the first detection and acquisition group is inconsistent with the welding thickness of the welding route at the side close to the second detection and acquisition group), the response group on the first detection and acquisition group receives the initial laser signal emitted by the test end on the first detection and acquisition group fed back by the welding layer on the welding route, and the thickness of the welding route is to be determined; at this time, the distance between the feedback point of the welding layer on the welding route and the first detection and acquisition group can be determined according to the time when the test end on the first detection and acquisition group initially emits the laser signal and the time when the response group receives the initial laser signal, combined with the laser speed, and then the thickness distribution on one side of the first detection and acquisition group can be determined. Then, the test end on the second detection and acquisition group is used to perform secondary laser emission on the other side of the welding route. At this time, the response group on the first detection and acquisition group receives the secondary laser emission signal of the test end on the second detection and acquisition group, and at the same time, according to the setting position information of the test end on the second detection and acquisition group or the response group on the first detection and acquisition group, the thickness of the welding route is determined. In this process, if the response end on the second detection and acquisition group receives the secondary laser emission signal of the test group in the second detection and acquisition group, it means that this feedback point is not the highest point on the second detection and acquisition group side, and the test group and response group in the first detection and acquisition group and the second detection and acquisition group that need to be moved up to a higher setting position repeat the above work. Similarly, if the initial emission laser signal emitted by the test end on the first detection and acquisition group is received by the response end on the second detection and acquisition group, and the secondary emission laser signal emitted by the test end on the second detection and acquisition group is received by the response end on the first detection and acquisition group, it means that the welding thickness of the welding route is not at the lowest end at this time. The test group and response group in the first detection and acquisition group and the second detection and acquisition group that need to be moved down to a lower setting position repeat the above work.

[0066] Reference Figure 4 and Figure 5 In this embodiment, in order to facilitate the operator to more clearly and intuitively understand the distribution of welding conditions of the welding route and confirm whether the welding direction of the welding equipment is offset, the detection method can also give an early warning through a three-dimensional model, which is described as follows. Specifically, the method for obtaining the welding route offset information of the welding object includes:

[0067] According to the welding requirements of the welding object, the data information of the welding offset interval allowed in the welding route of the welding object is determined; according to the welding offset interval data information of the welding object and along the welding direction of the welding route of the welding object, a three-dimensional corridor welding warning model of the welding route is constructed; that is, according to the data interval allowed to be offset in the welding route (including: the data interval allowed to be offset on both sides of the welding direction, and the minimum and / or maximum allowable welding thickness interval), the three-dimensional corridor welding warning model can be a three-dimensional point cloud corridor model composed of the data allowed to be offset on both sides of the welding direction and the minimum and / or maximum allowable welding height interval along the welding direction of the welding route. Then, the three-dimensional corridor welding warning model of the welding route is substituted into the welding route model image of the welding object to determine the welding route offset information of the welding object. Then, it is finally judged whether the welding equipment is displaced.

[0068] The second aspect of the present invention provides a weld welding detection system based on image processing, which adopts a weld welding detection method based on image processing as described in any one of the first aspects. In some embodiments, the detection system can communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and can be interconnected with digital data communication (e.g., communication network) of any form or medium. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), internets (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

[0069] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0070] The third aspect of the present invention provides a fully automatic welding device, which specifically adopts a welding detection method based on image processing as described in any one of the first aspects. Here, by allowing the fully automatic welding device to use the detection method to monitor and control the welding condition of the welding device in real time, the welding accuracy and welding yield of the welding device can be effectively guaranteed, while also reducing the occurrence of manual comparison of welding conditions, reducing labor costs and the occurrence of unexpected situations, and ensuring the high degree of automation of the welding device.

[0071] A fourth aspect of the present invention provides a computer-readable medium having a computer program stored thereon, wherein the program is executed by a processor to implement a method for detecting weld seam welding based on image processing as described in any one of the first aspects. The computer-readable medium in this embodiment can be written in one or more programming languages ​​or a combination thereof to write computer program codes for performing the operations of some embodiments of the present disclosure, wherein the programming languages ​​include object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., using an Internet service provider to connect through the Internet).

[0072] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0073] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer readable medium, and the computer program includes a program code for executing the method shown in the flowchart.

[0074] The fifth aspect of the present invention provides an electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon; when the one or more programs are executed by the one or more processors, the one or more processors implement a weld detection method based on image processing as described in the first aspect. The computer-readable medium may be included in the electronic device; or it may exist separately, that is, it is not assembled in the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device can implement a weld detection method based on image processing as described in the first aspect.

[0075] A sixth aspect of the present invention provides a computer program product, comprising a computer program, which, when executed by a processor, implements a weld detection method based on image processing as described in the first aspect.

[0076] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A welding seam detection method based on image processing, characterized in that: include: In the welding area of ​​the welding object, at least two mutually perpendicular acquisition positions are arranged, and the image information in the vertical direction and the condition information in the horizontal direction of the welding area are respectively acquired by the acquisition positions; According to the image information in the vertical direction of the welding area, the welding route of the welding object is obtained, and the distance information between the welding route and the acquisition position in the horizontal direction is determined; Determine the thickness information of the welding route of the welding object according to the condition information in the horizontal direction of the welding area; Determine a welding route model image of the welding object according to the welding route of the welding object and in combination with the thickness information of the welding route of the welding object; Formulate welding warning information according to welding requirements of welding objects, and formulate welding warning model according to welding warning information; Compare the welding path model image of the welding object with the welding warning model to obtain the welding path deviation information of the welding object; Determine the offset adjustment information of the welding equipment according to the welding route offset information of the welding object; The method for determining the thickness information of the welding route of the welding object comprises: According to the welding route of the welding object, a first detection and collection group and a second detection and collection group are arranged at the horizontal direction collection position of the welding area, and the first detection and collection group and the second detection and collection group are respectively located on both sides of the welding route of the welding object; Wherein, the first detection acquisition group and the second detection acquisition group respectively include: at least one test group and at least one response group, and the test group and the response group on the first detection acquisition group are staggered with the test group and the response group on the second detection acquisition group; According to the image information in the vertical direction of the welding area, respectively determine the distance information between the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object; The arrangement of the test group and the response group in the first detection and collection group includes: Arranged in layers with intervals up and down; Correspondingly, the arrangement of the test group and the response group in the second detection and collection group also includes: Arranged in layers with intervals up and down; In addition, according to the setting position information of the measurement group and the response group in the first detection and acquisition group, the setting position information of the measurement group and the response group in the second detection and acquisition group is determined; According to the distance information among the first detection and acquisition group, the second detection and acquisition group and the welding route of the welding object, the first detection and acquisition group is allowed to initially emit laser at one side of the welding route of the welding object, and the response group in the first detection and acquisition group or the response group in the second detection and acquisition group is used to receive the initially emitted laser to obtain the collection data information of the initially emitted laser; The second detection and acquisition group is made to perform secondary laser emission at the other side of the welding route of the welding object, and the response group in the first detection and acquisition group or the response group in the second detection and acquisition group is used to receive the secondary laser emission to obtain acquisition data information of the secondary laser emission; Determine the welding path width information of the welding object according to the image information in the vertical direction of the welding area; According to the welding route width information of the welding object, and in combination with the distance information between the first detection and collection group, the second detection and collection group and the welding route of the welding object, the transmission and receiving route distance information in the two detection and collection groups is determined; The test end on the first detection and acquisition group is used to initially emit laser on one side of the welding route. If the thickness of the welding route is consistent, the response group on the second detection and acquisition group receives the initial laser signal emitted by the test end on the first detection and acquisition group, and determines the thickness of the welding route according to the setting position information of the test end on the first detection and acquisition group; if the thickness on both sides of the welding route is inconsistent, the response group on the first detection and acquisition group receives the initial laser signal emitted by the test end on the first detection and acquisition group, and the thickness of the welding route is to be determined at this time; Then, the test end on the second detection and acquisition group is used to emit the laser for the second time on the other side of the welding route. At this time, the response group on the first detection and acquisition group receives the secondary emitted laser signal from the test end on the second detection and acquisition group, and determines the thickness of the welding route based on the setting position information of the test end on the second detection and acquisition group or the response group on the first detection and acquisition group.

2. The method for detecting weld seams based on image processing according to claim 1, characterized in that: The method for obtaining the welding route deviation information of the welding object comprises: According to the welding requirements of the welding object, determine the data information of the allowable welding deviation interval in the welding route of the welding object; According to the welding offset interval data information of the welding object and along the welding direction of the welding route of the welding object, a three-dimensional corridor welding warning model of the welding route is constructed; The three-dimensional corridor welding warning model of the welding route is substituted into the welding route model image of the welding object to determine the welding route offset information of the welding object.

3. A weld detection system based on image processing, characterized in that: A weld detection method based on image processing as described in any one of claims 1 to 2 is adopted.

4. A fully automatic welding equipment, characterized in that: Used to execute a weld detection method based on image processing as described in any one of claims 1 to 2.

5. A computer readable medium having a computer program stored thereon, characterized in that: in, When the program is executed by a processor, a welding detection method for a weld based on image processing as claimed in any one of claims 1 to 2 is implemented.