Steel structure self-adaptive intelligent welding method and system based on multi-modal sensing

Abstract

The invention discloses a steel structure self-adaptive intelligent welding method and system based on multi-modal sensing, and the method comprises the steps: 101, arranging a plurality of sensors to carry out multi-modal sensing on a welding region of a bridge steel structure, and obtaining multi-modal welding data of each point in the welding region; 102, the welding area is divided into a plurality of welding sub-areas according to the multi-mode welding data, and each welding sub-area corresponds to one welding mode; and 103, the welding subarea where the current welding head is located is recognized, and welding is conducted in the welding mode corresponding to the welding subarea.

Description

Technical Field

[0001] This invention belongs to the field of bridge steel structure welding technology, and more specifically, relates to an adaptive intelligent welding method and system for steel structures based on multimodal perception. Background Technology

[0002] Bridge steel structure welding refers to the crucial process of firmly connecting different steel components into a single unit through fusion joining technology during bridge manufacturing and construction. This process requires welds to possess high strength, good ductility, and fatigue resistance to ensure the structural safety and stability of the bridge under long-term loads and complex environments. Commonly used welding methods include submerged arc welding, gas shielded welding, and manual arc welding. During construction, welding parameters, heat-affected zone, and welding sequence must be strictly controlled to prevent stress concentration, deformation, and cracking.

[0003] Currently, manual welding is generally used, which has a low degree of automation. Even if there are automated welding methods, the welding accuracy cannot meet the requirements, and the degree of automation is not high. Summary of the Invention

[0004] To address the above technical problems, this invention proposes an adaptive intelligent welding method for steel structures based on multimodal perception, comprising: Step 101: Set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data of each point in the welding area; Step 102: Based on the multimodal welding data, the welding area is divided into multiple welding sub-regions, wherein each welding sub-region corresponds to a welding method; Dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. Step 103: Identify the welding sub-region where the current welding head is located, and perform welding using the corresponding welding method.

[0005] Furthermore, the multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density, and geometric stability at each point.

[0006] Furthermore, step 101 also includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

[0007] Furthermore, step 102 also includes: if the thermal state of the current point is less than the thermal state lower threshold, mark the thermal state of the current point as low; if the thermal state of the current point is greater than the thermal state upper threshold, mark the thermal state of the current point as high; if the thermal state of the current point is less than the thermal state upper threshold and greater than the thermal state lower threshold, mark the thermal state of the current point as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

[0008] Furthermore, dividing the welding area into multiple welding sub-regions also includes: If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

[0009] Furthermore, the number of points within a certain area of ​​the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

[0010] Furthermore, firstly, it is determined whether the current point can be assigned to the first welding sub-region. If not, it is determined whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

[0011] Furthermore, it is determined in turn whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, then the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

[0012] This invention also proposes an adaptive intelligent welding system for steel structures based on multimodal perception, comprising: The data acquisition module is used to set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data of each point in the welding area; The sub-region division module is used to divide the welding area into multiple welding sub-regions based on the multimodal welding data, wherein each welding sub-region corresponds to a welding method; The welding module is used to identify the welding sub-region where the current welding head is located and to perform welding using the corresponding welding method.

[0013] Furthermore, the multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density, and geometric stability at each point.

[0014] In summary, the technical solutions conceived by this invention have the following beneficial effects compared with the prior art: Through the above technical solutions, this invention enables precise welding of bridge steel structures by defining specific welding areas based on multimodal perception. Attached Figure Description

[0015] Figure 1 This is a flowchart of the method in Embodiment 1 of the present invention; Figure 2 This is a system structure diagram of Embodiment 2 of the present invention. Detailed Implementation

[0016] To better understand the above technical solutions, the following will provide a detailed explanation of the technical solutions in conjunction with the accompanying drawings and specific implementation methods.

[0017] The method provided by this invention can be implemented in a terminal environment that may include one or more of the following components: a processor, a storage medium, and a display screen. The storage medium stores at least one instruction, which is loaded and executed by the processor to implement the method described in the following embodiments.

[0018] A processor may include one or more processing cores. The processor uses various interfaces and lines to connect various parts of the terminal, and performs various functions and processes data by running or executing instructions, programs, code sets or instruction sets stored in the storage medium, and by calling data stored in the storage medium.

[0019] Storage media can include random access memory (RAM) or read-only memory (ROM). Storage media can be used to store instructions, programs, code, code sets, or instructions.

[0020] The display screen is used to show the user interface of each application.

[0021] In addition, those skilled in the art will understand that the structure of the terminal described above does not constitute a limitation on the terminal. The terminal may include more or fewer components, or combine certain components, or have different component arrangements. For example, the terminal may also include radio frequency circuits, input units, sensors, audio circuits, power supplies, and other components, which will not be described in detail here.

[0022] Example 1 like Figure 1 This embodiment proposes an adaptive intelligent welding method for steel structures based on multimodal perception, including: Step 101: Set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data for each point in the welding area. The multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density and geometric stability of each point. To illustrate the multimodal welding data, the following example is provided in this embodiment:

[0023] To illustrate geometric stability, the following example is provided in this embodiment: 1. Examples of regions with small geometrical changes (geometrically stable): These regions have almost no abrupt geometric changes and are ideal for continuous welding: Large flat plate areas: such as the middle part of a whole web plate or the bottom plate of a steel box girder, the welding path can travel a long distance in a straight line; Long straight edge weld areas: such as the middle of long right angle welds, lap welds, and splice welds, these areas have small curvature, consistent bevels, and are not prone to misalignment; Regions of long beams with uniform cross-sections: such as the middle section of H-beams, box girders, channel steel, etc., where the cross-sectional changes are minimal and the welding burden is low.

[0024] 2. Examples of regions with large geometrical changes (geometric instability): These regions exhibit significant geometrical abrupt changes, making welding prone to errors or stress accumulation. Component intersections: such as the intersection of longitudinal beams and transverse beams, the intersection of reinforcing bars, and corner joints. These places have intersecting polygons, many weld corners, and rapid changes in direction. Weld termination zone or start zone (end zone): The molten pool is difficult to control and is prone to porosity or shrinkage cracks; Irregular bevel joint areas: such as irregular bevels and steel with gradually changing cross-sections, the trajectory in these areas needs to be continuously adjusted, which can easily lead to mis-welding. Surface corners, steps, and flange transition areas: such as abrupt changes in surface height / normal, which make robot trajectory control difficult and are commonly seen in the rounded corner areas of cantilever plates and web plates. Spiral or curved surface welds: such as cross welding of round pipes, welding of irregularly shaped parts in space, where the curvature of the local space is large and the posture of the welding torch changes drastically.

[0025] Specifically, step 101 further includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

[0026] Step 102: Based on the multimodal welding data, the welding area is divided into multiple welding sub-regions, wherein each welding sub-region corresponds to a welding method; Specifically, step 102 further includes: if the thermal state of the current point is less than the thermal state lower threshold, mark the thermal state of the current point as low; if the thermal state of the current point is greater than the thermal state upper threshold, mark the thermal state of the current point as high; if the thermal state of the current point is less than the thermal state upper threshold and greater than the thermal state lower threshold, mark the thermal state of the current point as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

[0027] Specifically, dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

[0028] Specifically, the number of points in a certain area within the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

[0029] Specifically, first, it is determined whether the current point can be assigned to the first welding sub-region. If not, it is determined whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

[0030] Specifically, it is determined in turn whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, then the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

[0031] Step 103: Identify the welding sub-region where the current welding head is located, and perform welding using the corresponding welding method.

[0032] Example 2 like Figure 2 As shown, this embodiment proposes an adaptive intelligent welding system for steel structures based on multimodal perception, including: The data acquisition module is used to set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data of each point in the welding area. The multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density and geometric stability of each point. Specifically, the data acquisition module also includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

[0033] The sub-region division module is used to divide the welding area into multiple welding sub-regions based on the multimodal welding data, wherein each welding sub-region corresponds to a welding method; Specifically, the sub-region division module also includes: if the thermal state of the current point is less than the upper limit threshold of the thermal state, the thermal state of the current point is marked as low; if the thermal state of the current point is greater than the upper limit threshold of the thermal state, the thermal state of the current point is marked as high; if the thermal state of the current point is less than the upper limit threshold of the thermal state but greater than the lower limit threshold of the thermal state, the thermal state of the current point is marked as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

[0034] Specifically, dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

[0035] Specifically, the number of points in a certain area within the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

[0036] Specifically, first, it is determined whether the current point can be assigned to the first welding sub-region. If not, it is determined whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

[0037] Specifically, it is determined in turn whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, then the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

[0038] The welding module is used to identify the welding sub-region where the current welding head is located and to perform welding using the corresponding welding method.

[0039] Example 3 This invention also proposes a storage medium storing multiple instructions for implementing the aforementioned adaptive intelligent welding method for steel structures based on multimodal perception.

[0040] Optionally, in this embodiment, the storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.

[0041] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: Step 101, setting up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure, and acquiring multimodal welding data of each point in the welding area, wherein the multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density and geometric stability of each point; Specifically, step 101 further includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

[0042] Step 102: Based on the multimodal welding data, the welding area is divided into multiple welding sub-regions, wherein each welding sub-region corresponds to a welding method; Specifically, step 102 further includes: if the thermal state of the current point is less than the thermal state lower threshold, mark the thermal state of the current point as low; if the thermal state of the current point is greater than the thermal state upper threshold, mark the thermal state of the current point as high; if the thermal state of the current point is less than the thermal state upper threshold and greater than the thermal state lower threshold, mark the thermal state of the current point as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

[0043] Specifically, dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

[0044] Specifically, the number of points in a certain area within the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

[0045] Specifically, first, it is determined whether the current point can be assigned to the first welding sub-region. If not, it is determined whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

[0046] Specifically, it is determined in turn whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, then the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

[0047] Step 103: Identify the welding sub-region where the current welding head is located, and perform welding using the corresponding welding method.

[0048] Example 4 This invention also proposes an electronic device, including a processor and a storage medium connected to the processor. The storage medium stores multiple instructions, which can be loaded and executed by the processor to enable the processor to execute the aforementioned adaptive intelligent welding method for steel structures based on multimodal perception.

[0049] Specifically, the electronic device in this embodiment can be a computer terminal, which may include one or more processors and a storage medium.

[0050] The storage medium can be used to store software programs and modules, such as the program instructions / modules of a multimodal perception-based adaptive intelligent welding method for steel structures in this embodiment of the invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the storage medium, thus realizing the aforementioned multimodal perception-based adaptive intelligent welding method for steel structures. The storage medium may include high-speed random access storage media, and may also include non-volatile storage media, such as one or more magnetic storage systems, flash memory, or other non-volatile solid-state storage media. In some instances, the storage medium may further include storage media remotely configured relative to the processor, which can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0051] The processor can call the information and application stored in the storage medium through the transmission system to execute the following steps: Step 101, set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure, and obtain multimodal welding data of each point in the welding area, wherein the multimodal welding data includes: thermal state, attitude gradient, melting state, cumulative energy density and geometric stability of each point; Specifically, step 101 further includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

[0052] Step 102: Based on the multimodal welding data, the welding area is divided into multiple welding sub-regions, wherein each welding sub-region corresponds to a welding method; Specifically, step 102 further includes: if the thermal state of the current point is less than the thermal state lower threshold, mark the thermal state of the current point as low; if the thermal state of the current point is greater than the thermal state upper threshold, mark the thermal state of the current point as high; if the thermal state of the current point is less than the thermal state upper threshold and greater than the thermal state lower threshold, mark the thermal state of the current point as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

[0053] Specifically, dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

[0054] Specifically, the number of points in a certain area within the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

[0055] Specifically, first, it is determined whether the current point can be assigned to the first welding sub-region. If not, it is determined whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

[0056] Specifically, it is determined in turn whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, then the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

[0057] Step 103: Identify the welding sub-region where the current welding head is located, and perform welding using the corresponding welding method.

[0058] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0059] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0060] In the several embodiments provided by this invention, it should be understood that the disclosed technical content can be implemented in other ways. The system embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.

[0061] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0062] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0063] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, optical disks, and other media capable of storing program code.

[0064] Obviously, the above embodiments are merely illustrative examples for clear explanation and are not intended to limit the implementation. Those skilled in the art will recognize that other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all possible implementations here. However, obvious variations or modifications derived therefrom are still within the scope of protection of this invention.

Claims

1. An adaptive intelligent welding method for steel structures based on multimodal perception, characterized in that, include: Step 101: Set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data of each point in the welding area; Step 102: Based on the multimodal welding data, the welding area is divided into multiple welding sub-regions, wherein each welding sub-region corresponds to a welding method; Dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. Step 103: Identify the welding sub-region where the current welding head is located, and perform welding using the corresponding welding method.

2. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 1, characterized in that, The multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density, and geometric stability at each point.

3. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 1, characterized in that, Step 101 further includes preprocessing the multimodal welding data to generate preprocessed multimodal welding data. The preprocessing operation includes aligning the multimodal welding data according to a unified timestamp, deleting missing values ​​in the multimodal welding data, and finally performing normalization processing to generate normalized multimodal welding data.

4. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 2, characterized in that, Step 102 further includes: if the thermal state of the current point is less than the thermal state lower limit threshold, mark the thermal state of the current point as low; if the thermal state of the current point is greater than the thermal state upper limit threshold, mark the thermal state of the current point as high; if the thermal state of the current point is less than the thermal state upper limit threshold and greater than the thermal state lower limit threshold, mark the thermal state of the current point as medium. If the melting state of the current point is less than the upper limit threshold of the melting state, the melting state of the current point is marked as low; if the melting state of the current point is greater than the upper limit threshold of the melting state, the melting state of the current point is marked as high; if the melting state of the current point is less than the upper limit threshold of the melting state but greater than the lower limit threshold of the melting state, the melting state of the current point is marked as medium. If the attitude gradient at the current point is less than the lower bound threshold, mark the attitude gradient at the current point as low; if the attitude gradient at the current point is greater than the upper bound threshold, mark the attitude gradient at the current point as high; if the attitude gradient at the current point is less than the upper bound threshold and greater than the lower bound threshold, mark the attitude gradient at the current point as medium. If the cumulative energy density at the current point is greater than the cumulative energy density threshold, mark the cumulative energy density at the current point as high; otherwise, mark it as low. If the geometric stability of the current point is less than the geometric stability threshold, mark the geometric stability of the current point as stable; otherwise, mark it as unstable.

5. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 4, characterized in that, Dividing the welding area into multiple welding sub-areas also includes: If the thermal state of the current point is marked as high and the attitude gradient of the current point is marked as high, then the current point is assigned to the first welding sub-region. If the thermal state of the current point is marked as low and the molten state of the current point is marked as low, then the current point is assigned to the second welding sub-region; If the attitude gradient of the current point is marked as high and the cumulative energy density of the current point is marked as high, then the current point is assigned to the third welding sub-region; If the geometric stability of the current point is marked as stable, then the current point is assigned to the fourth welding sub-region.

6. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 5, characterized in that, The number of points in a certain area within the welding region that are assigned to each welding sub-region is counted, and the welding sub-region containing the most points is taken as the final welding sub-region of that area.

7. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 6, characterized in that, First, determine whether the current point can be assigned to the first welding sub-region. If not, determine whether the current point can be assigned to the second welding sub-region, and so on, until the current point is assigned to one of the first to the fourth welding sub-regions.

8. The adaptive intelligent welding method for steel structures based on multimodal perception as described in claim 6, characterized in that, The system sequentially determines whether the current point can be assigned to the first welding sub-region, the second welding sub-region, the third welding sub-region, or the fourth welding sub-region. If the current point can be assigned to multiple sub-regions from the first welding sub-region to the fourth welding sub-region, the current point is assigned to the sub-region with the highest priority according to the priority of the first welding sub-region to the fourth welding sub-region.

9. A steel structure adaptive intelligent welding system based on multimodal perception, characterized in that, include: The data acquisition module is used to set up multiple sensors to perform multimodal sensing of the welding area of ​​the bridge steel structure and acquire multimodal welding data of each point in the welding area; The sub-region division module is used to divide the welding area into multiple welding sub-regions based on the multimodal welding data, wherein each welding sub-region corresponds to a welding method; Dividing the welding area into multiple welding sub-areas includes: dividing the welding area into a first welding sub-area, a second welding sub-area, a third welding sub-area, and a fourth welding sub-area; The welding method for the first welding sub-region is high-energy slow welding, the welding method for the second welding sub-region is multi-pass fine welding, the welding method for the third welding sub-region is fluctuating stable welding, and the welding method for the fourth welding sub-region is avoidance welding or skip welding. The welding module is used to identify the welding sub-region where the current welding head is located and to perform welding using the corresponding welding method.

10. The adaptive intelligent welding system for steel structures based on multimodal perception as described in claim 9, characterized in that, The multimodal welding data includes: thermal state, attitude gradient, molten state, cumulative energy density, and geometric stability at each point.

Images