2D gluing quality on-line detection method and device and computer equipment

Abstract

The invention discloses a 2D gluing quality on-line detection method, a 2D gluing quality on-line detection device and computer equipment. The method comprises the steps that shape distribution, gluing positions and gluing areas of all appearance parts of an automobile are collected, a gluing shape distribution diagram is constructed, the gluing shape distribution diagram comprises position marks and area marks of all the shapes, a two-dimensional coordinate system of the shapes of all the appearance parts of the automobile is established according to the gluing shape distribution diagram, and the two-dimensional coordinate system of the shapes of all the appearance parts of the automobile is obtained; based on the two-dimensional coordinate system, determining coordinate positioning of the shape of each appearance part of the automobile, and configuring a gluing coverage area value and a gluing uniformity degree value in the shape area of each appearance part of the automobile according to the coordinate positioning of the shape of each appearance part of the automobile and the position identifier and the area identifier of each shape; and according to the gluing coverage area value and the gluing uniformity degree value, gluing is conducted on the shape areas of all the appearance parts of the automobile. Through the mode, the detection difficulty of the gluing quality can be reduced, and the detection accuracy of the gluing quality is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile gluing, and in particular to a 2D gluing quality online detection method, device and computer equipment. Background Art

[0002] Automobile gluing is a process widely used on automobile bodies. It is a process that mainly uses the mechanical bonding force, physical adsorption force and chemical bonding force generated by the adhesive on the connection surface to connect two adhesive parts. After the glue pattern is formed, the glue coating quality test is required to determine whether the glue coating quality meets the requirements.

[0003] The existing 2D glue coating quality online detection scheme generally uses manually operated equipment to perform an overall inspection of the glue coating quality of the car. However, since the glued car body, hood, windshield in the assembly workshop, etc. have different shapes and are uneven, the contours of the car body, hood, windshield in the assembly workshop, etc. have a certain inclination angle in space, which increases the difficulty of detecting the glue coating quality of the car and leads to an increase in abnormal detections. Summary of the invention

[0004] In view of this, the purpose of the present invention is to propose a 2D glue coating quality online detection method, device and computer equipment, which can reduce the difficulty of gluing quality detection and improve the accuracy of gluing quality detection.

[0005] According to one aspect of the present invention, there is provided a 2D gluing quality online detection method, comprising: collecting the distribution of shapes of various exterior parts of an automobile, glue coating positions and glue coating areas, and constructing a glue coating shape distribution map, wherein the glue coating shape distribution map comprises position identifiers and area identifiers of various shapes; establishing a two-dimensional coordinate system of the shapes of various exterior parts of the automobile according to the glue coating shape distribution map, and determining the coordinate positioning of the shapes of various exterior parts of the automobile based on the two-dimensional coordinate system; configuring a glue coating coverage area value and a glue coating uniformity value within a shape area of ​​each exterior part of the automobile according to the coordinate positioning of the shapes of each exterior part of the automobile and the shape position identifiers and area identifiers; and gluing the shape areas of each exterior part of the automobile according to the glue coating coverage area value and the glue coating uniformity value.

[0006] Among them, the distribution of shapes of various exterior parts of the automobile, the gluing positions and the gluing areas are collected, and a gluing shape distribution map is constructed, wherein the gluing shape distribution map includes various shape position identifiers and area identifiers, including: collecting original images of automobile exterior parts, inputting the original images into a shape segmentation model to obtain the shape areas of various exterior parts of the automobile, the shape segmentation model is trained based on the pre-labeled shape areas of various exterior parts of the automobile, and based on the shape areas of various exterior parts of the automobile, the distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile are collected, and a gluing shape distribution map is constructed, wherein the gluing shape distribution map includes various shape position identifiers and area identifiers.

[0007] Wherein, the steps of establishing a two-dimensional coordinate system of the shapes of each exterior component of the automobile according to the glue shape distribution map, and determining the coordinate positioning of the shapes of each exterior component of the automobile based on the two-dimensional coordinate system, include: according to the glue shape distribution map, taking a fixed point of the automobile as the origin of the coordinate system, and determining the directions of the X-axis and the Y-axis, applying an image processing method, drawing the shapes of each exterior component of the automobile in the two-dimensional coordinate system based on the distribution, glue position and glue area information of the shapes of each exterior component in the glue shape distribution map, establishing a two-dimensional coordinate system of the shapes of each exterior component of the automobile, and determining the coordinate positioning of the shapes of each exterior component of the automobile based on the two-dimensional coordinate system through image processing measurement tools or custom scripts.

[0008] Among them, the configuration of the glue coverage area value and the glue uniformity value within the shape area of ​​each appearance component of the automobile according to the coordinate positioning of the shape of each appearance component of the automobile and the shape position identification and area identification of each shape, includes: clarifying the boundaries of the shapes of each appearance component of the automobile according to the coordinate positioning of the shapes of each appearance component of the automobile and the shape position identification of each shape, and configuring the glue coverage area value within the shape area of ​​each appearance component of the automobile according to the area identification of the shape of each appearance component of the automobile, and configuring the glue uniformity value within the shape area of ​​each appearance component of the automobile by adjusting the parameters of the gluing equipment including the nozzle moving speed and the gluing pressure.

[0009] Wherein, after applying glue to the shape areas of the various exterior parts of the automobile according to the glue coverage area value and the glue uniformity value, it also includes: obtaining actual glue effect values ​​after applying glue to the shape areas of the various exterior parts of the automobile, establishing a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of the various exterior parts of the automobile and the actual glue effect value, and generating a glue control instruction.

[0010] According to another aspect of the present invention, there is provided a 2D gluing quality online detection device, comprising: a building module, a determination module, a configuration module and a gluing module; the building module is used to collect the distribution of shapes of various appearance parts of an automobile, the gluing position and the gluing area, and to construct a gluing shape distribution map, wherein the gluing shape distribution map comprises various shape position identifiers and area identifiers; the determination module is used to establish a two-dimensional coordinate system of the shapes of various appearance parts of the automobile according to the gluing shape distribution map, and to determine the coordinate positioning of the shapes of various appearance parts of the automobile based on the two-dimensional coordinate system; the configuration module is used to configure the glue coverage area value and the glue uniformity value within the shape area of ​​each appearance part of the automobile according to the coordinate positioning of the shapes of each appearance part of the automobile and the shape position identifiers and area identifiers; the gluing module is used to glue the shape areas of each appearance part of the automobile according to the glue coverage area value and the glue uniformity value.

[0011] Among them, the construction module is specifically used to: collect original images of automobile appearance parts, input the original images into the shape segmentation model, and obtain the shape areas of each automobile appearance part, the shape segmentation model is trained according to the pre-marked shape areas of each automobile appearance part, and according to the shape areas of each automobile appearance part, the distribution, glue coating position and glue coating area of ​​each automobile appearance part are collected, and a glue coating shape distribution map is constructed, and the glue coating shape distribution map includes each shape position identifier and area identifier.

[0012] Among them, the determination module is specifically used to: according to the glue shape distribution map, take a fixed point of the car as the origin of the coordinate system, and determine the directions of the X-axis and the Y-axis, apply image processing, based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and the glue area information, draw the shapes of each appearance component of the car in a two-dimensional coordinate system, establish a two-dimensional coordinate system for the shapes of each appearance component of the car, and based on the two-dimensional coordinate system, determine the coordinate positioning of the shapes of each appearance component of the car through image processing measurement tools or custom scripts.

[0013] Among them, the configuration module is specifically used to: clarify the boundaries of the shapes of various appearance parts of the automobile according to the coordinate positioning of the shapes of various appearance parts of the automobile and the position identification of each shape, and configure the glue coverage area value within the shape area of ​​each appearance part of the automobile according to the area identification of the shape of each appearance part of the automobile, and configure the glue uniformity value within the shape area of ​​each appearance part of the automobile by adjusting the parameters of the gluing equipment including the nozzle movement speed and the gluing pressure.

[0014] Among them, the 2D glue coating quality online detection device also includes a generation module, which is used to obtain the actual glue coating effect value after gluing the shape areas of each appearance component of the automobile, establish a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of each appearance component of the automobile and the actual glue coating effect value, and generate a gluing control instruction.

[0015] According to another aspect of the present invention, a computer device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the 2D glue coating quality online detection method as described in any one of the above.

[0016] According to another aspect of the present invention, a computer-readable storage medium is provided, storing a computer program, wherein when the computer program is executed by a processor, the method for online detection of 2D glue coating quality as described in any one of the above is implemented.

[0017] It can be found that the above scheme can collect the distribution of the shapes of various exterior parts of the automobile, the glue coating position and the glue coating area, and construct a glue coating shape distribution map, which includes various shape position identifiers and area identifiers, and can establish a two-dimensional coordinate system of the shapes of various exterior parts of the automobile based on the glue coating shape distribution map, and determine the coordinate positioning of the shapes of various exterior parts of the automobile based on the two-dimensional coordinate system, and can configure the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​each exterior part of the automobile based on the coordinate positioning of the shapes of various exterior parts of the automobile and the shape position identifiers and area identifiers, and can glue the shape area of ​​each exterior part of the automobile based on the glue coating coverage area value and the glue coating uniformity value, which can reduce the difficulty of detecting the glue coating quality and improve the accuracy of the glue coating quality detection.

[0018] Furthermore, the above scheme can collect original images of automobile exterior parts, input the original image into a shape segmentation model, and obtain the shape areas of each automobile exterior part. The shape segmentation model is trained based on the pre-marked shape areas of each automobile exterior part, and based on the shape areas of each automobile exterior part, the distribution, gluing position and gluing area of ​​the shapes of each automobile exterior part are collected, and a gluing shape distribution map is constructed. The gluing shape distribution map includes shape position identifiers and area identifiers. The advantage of this is that by inputting the original image into the shape segmentation model to obtain the shape areas of each automobile exterior part, the efficiency of constructing the gluing shape distribution map and the accuracy of constructing the gluing shape distribution map can be improved.

[0019] Furthermore, the above scheme can be based on the glue shape distribution map, with a fixed point of the car as the origin of the coordinate system, and determine the directions of the X-axis and the Y-axis, and apply image processing methods. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and glue area information, the shapes of each appearance component of the car are drawn in a two-dimensional coordinate system, and a two-dimensional coordinate system for the shapes of each appearance component of the car is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the car is determined through image processing measurement tools or custom scripts. The advantage of this is that accurate coordinate positioning can ensure that the glue position and shape of each appearance component of the car during the gluing process are completely consistent with the design requirements, which helps to reduce gluing errors, improve the accuracy and consistency of gluing, and thus improve the quality of gluing.

[0020] Furthermore, the above scheme can clarify the boundaries of the shapes of various appearance parts of the automobile according to the coordinate positioning of the shapes of various appearance parts of the automobile and the position identification of each shape, and configure the glue coverage area value within the shape area of ​​each appearance part of the automobile according to the area identification of the shape of each appearance part of the automobile, and configure the glue uniformity value within the shape area of ​​each appearance part of the automobile by adjusting the parameters of the glue coating equipment including the nozzle movement speed and the glue coating pressure. The advantage of this is that the coordinate positioning and the shape position identification of each appearance part of the automobile can clarify the boundaries of each appearance part, reducing the difficulty of gluing quality detection, thereby ensuring that no area is exceeded or omitted during the gluing process. At the same time, configuring the glue coverage area value in combination with the area identification can improve the accuracy and rationality of the glue quality detection. In addition, by adjusting the parameters of the glue coating equipment, such as the nozzle movement speed and the glue coating pressure, the gluing process can be further optimized and the gluing efficiency and uniformity can be improved.

[0021] Furthermore, the above scheme can obtain the actual gluing effect value after gluing the shape areas of each exterior component of the automobile, build a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of each exterior component of the automobile and the actual gluing effect value, and generate gluing control instructions. The advantage of this is that the gluing work of the shape areas of each exterior component of the automobile can be controlled according to the generated gluing control instructions, thereby simplifying the gluing planning and improving the gluing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1It is a flow chart of an embodiment of a method for online detection of 2D glue coating quality of the present invention;

[0024] Figure 2 It is a flow chart of another embodiment of the 2D glue coating quality online detection method of the present invention;

[0025] Figure 3 It is a structural schematic diagram of an embodiment of a 2D glue coating quality online detection device of the present invention;

[0026] Figure 4 It is a structural schematic diagram of another embodiment of the 2D glue coating quality online detection device of the present invention;

[0027] Figure 5 It is a structural schematic diagram of an embodiment of a computer device of the present invention. DETAILED DESCRIPTION

[0028] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present invention, but are not intended to limit the scope of the present invention. Similarly, the following examples are only partial embodiments of the present invention rather than all embodiments, and all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of the present invention.

[0029] The present invention provides a 2D glue coating quality online detection method, which can reduce the difficulty of gluing quality detection and improve the accuracy of gluing quality detection.

[0030] See also Figure 1 , Figure 1 2D coating quality online detection method of the present invention is a flow chart of an embodiment of the present invention. It should be noted that if there are substantially the same results, the method of the present invention is not based on Figure 1 The process sequence shown is limited. Figure 1 As shown, the method comprises the following steps:

[0031] S101: collecting the distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile, and constructing a gluing shape distribution map, which includes various shape position identifiers and area identifiers.

[0032] The distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile are collected, and a gluing shape distribution map is constructed. The gluing shape distribution map includes various shape position identifiers and area identifiers, and may include:

[0033] Collect original images of automobile exterior parts, input the original images into a shape segmentation model, and obtain the shape areas of each automobile exterior part. The shape segmentation model is trained based on the shape areas of each automobile exterior part that are marked in advance, and based on the shape areas of each automobile exterior part, collect the shape distribution, glue coating position and glue coating area of ​​each automobile exterior part, and construct a glue coating shape distribution map. The glue coating shape distribution map includes shape position identifiers and area identifiers. This has the advantage that by inputting the original image into the shape segmentation model, the shape areas of each automobile exterior part can be obtained, thereby improving the efficiency of constructing the glue coating shape distribution map and improving the accuracy of the constructed glue coating shape distribution map.

[0034] S102: establishing a two-dimensional coordinate system of the shapes of various appearance components of the automobile according to the glue coating shape distribution map, and determining the coordinate positioning of the shapes of various appearance components of the automobile based on the two-dimensional coordinate system.

[0035] Among them, establishing a two-dimensional coordinate system of the shapes of various appearance parts of the automobile according to the glue coating shape distribution map, and determining the coordinate positioning of the shapes of various appearance parts of the automobile based on the two-dimensional coordinate system may include:

[0036] According to the glue shape distribution map, a fixed point of the car is used as the origin of the coordinate system, and the directions of the X-axis and the Y-axis are determined. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and the glue area information, the shapes of each appearance component of the car are drawn in a two-dimensional coordinate system by applying image processing, and a two-dimensional coordinate system of the shapes of each appearance component of the car is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the car is determined through image processing measurement tools or custom scripts. The advantage of this is that accurate coordinate positioning can ensure that the glue position and shape of each appearance component of the car during the gluing process are completely consistent with the design requirements, which helps to reduce gluing errors and improve the accuracy and consistency of gluing, thereby improving the quality of gluing.

[0037] In this embodiment, first, the glue-coating shape distribution diagram can be used as a reference, and the figure has been marked in detail with the glue-coating shape, position and area of ​​each component. On this basis, a fixed point on the car (such as the center of the front axle of the car body or the midpoint of the rear axle) can be selected as the origin of the coordinate system, and the directions of the X-axis and the Y-axis can be determined (for example, the front of the car is the negative X direction, the rear of the car is the positive X direction; the left side of the car body is the negative Y direction, and the right side is the positive Y direction). Then, using CAD software or other graphics processing tools, the shapes of the various appearance components of the car are drawn in a two-dimensional coordinate system according to the information on the glue-coating shape distribution diagram. During the drawing process, ensure that the shape, size and position of each component are consistent with the annotations on the glue-coating shape distribution diagram. Finally, the precise coordinate positioning of each component shape in the two-dimensional coordinate system can be determined by the measurement tools or custom scripts of the CAD software. These coordinate positioning can be used in subsequent manufacturing, assembly and quality control links to ensure the accuracy and consistency of the various appearance components of the car. In summary, by using the glue shape distribution map, selecting the appropriate coordinate system origin, determining the direction of the coordinate axis, drawing the component shape, and determining the coordinate positioning, a two-dimensional coordinate system for the shapes of various exterior components of the automobile can be established, and the precise coordinate positioning of the shapes of various components can be achieved based on the coordinate system. The advantage of this is that through precise coordinate positioning, it can be ensured that the glue coating position and shape of various exterior components of the automobile during the gluing process are completely consistent with the design requirements, which helps to reduce gluing errors, improve the accuracy and consistency of gluing, and thus improve the quality of gluing.

[0038] S103: According to the coordinate positioning of the shapes of the various appearance components of the automobile and the position identifiers and area identifiers of the various shapes, the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​the various appearance components of the automobile are configured.

[0039] Wherein, configuring the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​each appearance component of the automobile according to the coordinate positioning of the shape of each appearance component of the automobile and the position identification and area identification of each shape, may include:

[0040] The boundaries of the shapes of the various appearance parts of the automobile are clarified according to the coordinate positioning of the shapes of the various appearance parts of the automobile and the position marking of the shapes of the various appearance parts of the automobile, and the glue coverage area value within the shape area of ​​each appearance part of the automobile is configured according to the area marking of the shapes of the various appearance parts of the automobile, and the glue uniformity value within the shape area of ​​each appearance part of the automobile is configured by adjusting the parameters of the glue coating equipment including the nozzle movement speed and the glue coating pressure. The advantage of this is that the boundaries of each appearance part can be clarified through the coordinate positioning and the shape position marking of the shapes of the various appearance parts of the automobile, which reduces the difficulty of detecting the glue coating quality, thereby ensuring that no area is exceeded or omitted during the gluing process. At the same time, configuring the glue coverage area value in combination with the area marking can improve the accuracy and rationality of the glue coating quality detection. In addition, by adjusting the parameters of the glue coating equipment, such as the nozzle movement speed and the glue coating pressure, the glue coating process can be further optimized and the glue coating efficiency and uniformity can be improved.

[0041] S104: Glue the shape areas of the exterior parts of the automobile according to the glue coating coverage area value and the glue coating uniformity value.

[0042] After applying glue to the shape areas of the exterior parts of the automobile according to the glue coverage area value and the glue uniformity value, the method may further include:

[0043] The actual gluing effect value after gluing the shape areas of each exterior component of the automobile is obtained, and a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of each exterior component of the automobile and the actual gluing effect value is established to generate a gluing control instruction. The advantage of this is that the gluing work of the shape areas of each exterior component of the automobile can be controlled according to the generated gluing control instruction, thereby simplifying the gluing planning and improving the gluing efficiency.

[0044] It can be found that in this embodiment, the distribution of the shapes of various exterior parts of the automobile, the glue coating positions and the glue coating areas can be collected, and a glue coating shape distribution map can be constructed, the glue coating shape distribution map includes various shape position identifiers and area identifiers, and a two-dimensional coordinate system of the shapes of various exterior parts of the automobile can be established based on the glue coating shape distribution map, and the coordinate positioning of the shapes of various exterior parts of the automobile can be determined based on the two-dimensional coordinate system, and the glue coating coverage area value and the glue coating uniformity value in the shape area of ​​each exterior part of the automobile can be configured according to the coordinate positioning of the shapes of various exterior parts of the automobile and the shape position identifiers and area identifiers, and the shape area of ​​each exterior part of the automobile can be glued according to the glue coating coverage area value and the glue coating uniformity value, which can reduce the difficulty of detecting the glue coating quality and improve the accuracy of the glue coating quality detection.

[0045] Furthermore, in the present embodiment, the original image of the exterior parts of the automobile can be collected, and the original image can be input into a shape segmentation model to obtain the shape areas of the various exterior parts of the automobile. The shape segmentation model is trained based on the shape areas of the various exterior parts of the automobile that are pre-marked, and based on the shape areas of the various exterior parts of the automobile, the distribution of the shapes, the gluing positions and the gluing areas of the various exterior parts of the automobile are collected, and a gluing shape distribution map is constructed. The gluing shape distribution map includes shape position identifiers and area identifiers. The advantage of this is that by inputting the original image into the shape segmentation model to obtain the shape areas of the various exterior parts of the automobile, the efficiency of constructing the gluing shape distribution map and the accuracy of constructing the gluing shape distribution map can be improved.

[0046] Furthermore, in the present embodiment, according to the glue shape distribution diagram, a fixed point of the automobile can be used as the origin of the coordinate system, and the directions of the X-axis and the Y-axis can be determined. Based on the distribution of the shapes of each appearance component in the glue shape distribution diagram, the glue position and the glue area information, the shapes of each appearance component of the automobile can be drawn in a two-dimensional coordinate system by applying image processing, and a two-dimensional coordinate system of the shapes of each appearance component of the automobile can be established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the automobile can be determined through image processing measurement tools or custom scripts. The advantage of this is that accurate coordinate positioning can ensure that the glue position and shape of each appearance component of the automobile during the gluing process are completely consistent with the design requirements, which helps to reduce gluing errors, improve the accuracy and consistency of gluing, and thus improve the quality of gluing.

[0047] Furthermore, in the present embodiment, the boundaries of the shapes of the various appearance parts of the automobile can be clarified according to the coordinate positioning of the shapes of the various appearance parts of the automobile and the position identification of the shapes of the various shape parts, and the glue coverage area value within the shape area of ​​each appearance part of the automobile can be configured according to the area identification of the shapes of each appearance part of the automobile, and the glue uniformity value within the shape area of ​​each appearance part of the automobile can be configured by adjusting the parameters of the glue coating equipment including the nozzle movement speed and the glue coating pressure. The advantage of this is that the boundaries of each appearance part can be clarified through the coordinate positioning and the shape position identification of the shapes of the various appearance parts of the automobile, which reduces the difficulty of detecting the glue coating quality, thereby ensuring that no area is exceeded or omitted during the gluing process. At the same time, configuring the glue coverage area value in combination with the area identification can improve the accuracy and rationality of the glue quality detection. In addition, by adjusting the parameters of the glue coating equipment, such as the nozzle movement speed and the glue coating pressure, the glue coating process can be further optimized and the glue coating efficiency and uniformity can be improved.

[0048] See also Figure 2 , Figure 2 2D coating quality online detection method of another embodiment of the present invention is a flow chart. In this embodiment, the method comprises the following steps:

[0049] S201: collecting the distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile, and constructing a gluing shape distribution map, which includes various shape position identifiers and area identifiers.

[0050] This can be as described in S101 above and will not be elaborated here.

[0051] S202: establishing a two-dimensional coordinate system of the shapes of various appearance components of the automobile according to the glue coating shape distribution map, and determining the coordinate positions of the shapes of various appearance components of the automobile based on the two-dimensional coordinate system.

[0052] This can be as described in S102 above, and will not be elaborated here.

[0053] S203: According to the coordinate positioning of the shapes of the various exterior components of the automobile and the position identifiers and area identifiers of the various shapes, the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​the various exterior components of the automobile are configured.

[0054] This can be as described in S103 above, and will not be elaborated here.

[0055] S204: Glue the shape areas of the exterior parts of the automobile according to the glue coating coverage area value and the glue coating uniformity value.

[0056] This can be as described in S104 above, and will not be elaborated here.

[0057] S205: Obtain the actual gluing effect value after gluing the shape area of ​​each exterior component of the automobile, establish a mapping relationship between the gluing coverage area value and the gluing uniformity value of the shape area of ​​each exterior component of the automobile and the actual gluing effect value, and generate a gluing control instruction.

[0058] It can be found that in this embodiment, the actual gluing effect value after gluing the shape areas of each exterior component of the automobile can be obtained, and a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of each exterior component of the automobile and the actual gluing effect value can be established to generate a gluing control instruction. The advantage of this is that the gluing work on the shape areas of each exterior component of the automobile can be controlled according to the generated gluing control instruction, thereby simplifying the gluing planning and improving the gluing efficiency.

[0059] The present invention also provides a 2D glue coating quality online detection device, which can reduce the difficulty of gluing quality detection and improve the accuracy of gluing quality detection.

[0060] See also Figure 3 , Figure 32D gluing quality online detection device 30 includes a construction module 31, a determination module 32, a configuration module 33 and a gluing module 34.

[0061] The construction module 31 is used to collect the distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile, and to construct a gluing shape distribution map, which includes various shape position identifiers and area identifiers.

[0062] The determination module 32 is used to establish a two-dimensional coordinate system of the shapes of various appearance parts of the automobile according to the glue coating shape distribution map, and determine the coordinate positioning of the shapes of various appearance parts of the automobile based on the two-dimensional coordinate system.

[0063] The configuration module 33 is used to configure the glue coating coverage area value and glue coating uniformity value within the shape area of ​​each appearance component of the automobile according to the coordinate positioning of the shape of each appearance component of the automobile and the position identification and area identification of each shape.

[0064] The gluing module 34 is used to apply glue to the shape areas of the exterior parts of the automobile according to the gluing coverage area value and the gluing uniformity value.

[0065] Optionally, the building module 31 may be specifically used for:

[0066] Collect original images of automobile exterior parts, input the original images into a shape segmentation model, and obtain the shape areas of each automobile exterior part. The shape segmentation model is trained based on the pre-marked shape areas of each automobile exterior part, and based on the shape areas of each automobile exterior part, the distribution, glue coating position and glue coating area of ​​the shape of each automobile exterior part are collected, and a glue coating shape distribution map is constructed, which includes shape position identifiers and area identifiers.

[0067] Optionally, the determination module 32 may be specifically configured to:

[0068] According to the glue shape distribution map, a fixed point of the automobile is used as the origin of the coordinate system, and the directions of the X-axis and the Y-axis are determined. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and the glue area information, the shapes of each appearance component of the automobile are drawn in a two-dimensional coordinate system by applying image processing, and a two-dimensional coordinate system of the shapes of each appearance component of the automobile is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the automobile is determined by image processing measurement tools or custom scripts.

[0069] Optionally, the configuration module 33 may be specifically used for:

[0070] The boundaries of the shapes of the various exterior parts of the automobile are clearly defined according to the coordinate positioning of the shapes of the various exterior parts of the automobile and the position identification of the shapes, and the glue coverage area values ​​within the shape areas of the various exterior parts of the automobile are configured according to the area identification of the shapes of the various exterior parts of the automobile, and the glue uniformity values ​​within the shape areas of the various exterior parts of the automobile are configured by adjusting the parameters of the glue coating equipment including the nozzle movement speed, the glue coating pressure, etc.

[0071] See also Figure 4 , Figure 4 2 is a schematic diagram of another embodiment of the 2D glue coating quality online detection device of the present invention. Different from the previous embodiment, the 2D glue coating quality online detection device 40 of this embodiment further includes a generation module 41.

[0072] The generation module 41 is used to obtain the actual gluing effect value after gluing the shape areas of the various exterior parts of the automobile, establish a mapping relationship between the gluing coverage area value and the gluing uniformity value of the shape areas of the various exterior parts of the automobile and the actual gluing effect value, and generate a gluing control instruction.

[0073] Each unit module of the 2D glue coating quality online detection device 30 / 40 can respectively execute the corresponding steps in the above method embodiment, so each unit module will not be described in detail here. Please refer to the description of the above corresponding steps for details.

[0074] The present invention further provides a computer device, such as Figure 5 As shown, it includes: at least one processor 51; and a memory 52 that is communicatively connected to the at least one processor 51; wherein the memory 52 stores instructions that can be executed by the at least one processor 51, and the instructions are executed by the at least one processor 51 so that the at least one processor 51 can execute the above-mentioned 2D glue coating quality online detection method.

[0075] The memory 52 and the processor 51 are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors 51 and the memory 52 together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor 51 is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor 51.

[0076] The processor 51 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management and other control functions. The memory 52 can be used to store data used by the processor 51 when performing operations.

[0077] The present invention further provides a computer-readable storage medium storing a computer program, which implements the above method embodiment when executed by a processor.

[0078] It can be found that the above scheme can collect the distribution of the shapes of various exterior parts of the automobile, the glue coating position and the glue coating area, and construct a glue coating shape distribution map, which includes various shape position identifiers and area identifiers, and can establish a two-dimensional coordinate system of the shapes of various exterior parts of the automobile based on the glue coating shape distribution map, and determine the coordinate positioning of the shapes of various exterior parts of the automobile based on the two-dimensional coordinate system, and can configure the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​each exterior part of the automobile based on the coordinate positioning of the shapes of various exterior parts of the automobile and the shape position identifiers and area identifiers, and can glue the shape area of ​​each exterior part of the automobile based on the glue coating coverage area value and the glue coating uniformity value, which can reduce the difficulty of detecting the glue coating quality and improve the accuracy of the glue coating quality detection.

[0079] Furthermore, the above scheme can collect original images of automobile exterior parts, input the original image into a shape segmentation model, and obtain the shape areas of each automobile exterior part. The shape segmentation model is trained based on the pre-marked shape areas of each automobile exterior part, and based on the shape areas of each automobile exterior part, the distribution, gluing position and gluing area of ​​the shapes of each automobile exterior part are collected, and a gluing shape distribution map is constructed. The gluing shape distribution map includes shape position identifiers and area identifiers. The advantage of this is that by inputting the original image into the shape segmentation model to obtain the shape areas of each automobile exterior part, the efficiency of constructing the gluing shape distribution map and the accuracy of constructing the gluing shape distribution map can be improved.

[0080] Furthermore, the above scheme can be based on the glue shape distribution map, with a fixed point of the car as the origin of the coordinate system, and determine the directions of the X-axis and the Y-axis, and apply image processing methods. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and glue area information, the shapes of each appearance component of the car are drawn in a two-dimensional coordinate system, and a two-dimensional coordinate system for the shapes of each appearance component of the car is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the car is determined through image processing measurement tools or custom scripts. The advantage of this is that accurate coordinate positioning can ensure that the glue position and shape of each appearance component of the car during the gluing process are completely consistent with the design requirements, which helps to reduce gluing errors, improve the accuracy and consistency of gluing, and thus improve the quality of gluing.

[0081] Furthermore, the above scheme can clarify the boundaries of the shapes of various appearance parts of the automobile according to the coordinate positioning of the shapes of various appearance parts of the automobile and the position identification of each shape, and configure the glue coverage area value within the shape area of ​​each appearance part of the automobile according to the area identification of the shape of each appearance part of the automobile, and configure the glue uniformity value within the shape area of ​​each appearance part of the automobile by adjusting the parameters of the glue coating equipment including the nozzle movement speed and the glue coating pressure. The advantage of this is that the coordinate positioning and the shape position identification of each appearance part of the automobile can clarify the boundaries of each appearance part, reducing the difficulty of gluing quality detection, thereby ensuring that no area is exceeded or omitted during the gluing process. At the same time, configuring the glue coverage area value in combination with the area identification can improve the accuracy and rationality of the glue quality detection. In addition, by adjusting the parameters of the glue coating equipment, such as the nozzle movement speed and the glue coating pressure, the gluing process can be further optimized and the gluing efficiency and uniformity can be improved.

[0082] Furthermore, the above scheme can obtain the actual gluing effect value after gluing the shape areas of each exterior component of the automobile, build a mapping relationship between the glue coverage area value and the glue uniformity value of the shape areas of each exterior component of the automobile and the actual gluing effect value, and generate gluing control instructions. The advantage of this is that the gluing work of the shape areas of each exterior component of the automobile can be controlled according to the generated gluing control instructions, thereby simplifying the gluing planning and improving the gluing efficiency.

[0083] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device implementation described above is only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0084] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0085] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0086] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0087] The above descriptions are only some embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any equivalent device or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A 2D glue coating quality online detection method, characterized in that: include: The distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile are collected, and a gluing shape distribution map is constructed, wherein the gluing shape distribution map includes position identifiers and area identifiers of various shapes; According to the glue shape distribution map, a two-dimensional coordinate system of the shapes of the various appearance parts of the automobile is established, and based on the two-dimensional coordinate system, the coordinate positioning of the shapes of the various appearance parts of the automobile is determined; According to the coordinate positioning of the shapes of the various exterior parts of the automobile and the position identifiers and area identifiers of the various shapes, the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​the various exterior parts of the automobile are configured; Glue is applied to the shape areas of the exterior parts of the automobile according to the glue coating coverage area value and the glue coating uniformity value.

2. The 2D glue coating quality online detection method according to claim 1, characterized in that: The distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile are collected, and a gluing shape distribution map is constructed. The gluing shape distribution map includes various shape position identifiers and area identifiers, including: Collect original images of automobile exterior parts, input the original images into a shape segmentation model, and obtain the shape areas of the automobile exterior parts. The shape segmentation model is trained based on the pre-labeled shape areas of the automobile exterior parts, and based on the shape areas of the automobile exterior parts, the distribution, gluing position and gluing area of ​​the shapes of the automobile exterior parts are collected, and a gluing shape distribution map is constructed, wherein the gluing shape distribution map includes shape position identifiers and area identifiers.

3. The 2D glue coating quality online detection method according to claim 1, characterized in that: The step of establishing a two-dimensional coordinate system of the shapes of the various appearance components of the automobile according to the distribution map of the glue coating shape, and determining the coordinate positioning of the shapes of the various appearance components of the automobile based on the two-dimensional coordinate system, comprises: According to the glue shape distribution map, a fixed point of the automobile is used as the origin of the coordinate system, and the directions of the X-axis and the Y-axis are determined. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and the glue area information, the shapes of each appearance component of the automobile are drawn in a two-dimensional coordinate system by applying image processing, and a two-dimensional coordinate system of the shapes of each appearance component of the automobile is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the automobile is determined by image processing measurement tools or custom scripts.

4. The 2D glue coating quality online detection method according to claim 1, characterized in that: The configuration of the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​each appearance component of the automobile according to the coordinate positioning of the shape of each appearance component of the automobile and the position identifier and area identifier of each shape includes: The boundaries of the shapes of the various exterior parts of the automobile are clarified according to the coordinate positioning of the shapes of the various exterior parts of the automobile and the position identification of the shapes, and the glue coverage area values ​​within the shape areas of the various exterior parts of the automobile are configured according to the area identification of the shapes of the various exterior parts of the automobile, and the glue uniformity values ​​within the shape areas of the various exterior parts of the automobile are configured by adjusting the parameters of the gluing equipment including the nozzle movement speed and the gluing pressure.

5. The 2D glue coating quality online detection method according to claim 1, characterized in that: After applying glue to the shape areas of the exterior parts of the automobile according to the glue coverage area value and the glue uniformity value, the method further includes: The actual gluing effect value after gluing the shape areas of the various exterior parts of the automobile is obtained, and a mapping relationship between the gluing coverage area value and the gluing uniformity value of the shape areas of the various exterior parts of the automobile and the actual gluing effect value is established to generate a gluing control instruction.

6. A 2D glue coating quality online detection device, characterized in that: include: Building modules, determining modules, configuring modules and gluing modules; The construction module is used to collect the distribution of shapes, gluing positions and gluing areas of various exterior parts of the automobile, and to construct a gluing shape distribution map, wherein the gluing shape distribution map includes various shape position identifiers and area identifiers; The determination module is used to establish a two-dimensional coordinate system of the shapes of the various appearance parts of the automobile according to the distribution map of the glue coating shape, and determine the coordinate positioning of the shapes of the various appearance parts of the automobile based on the two-dimensional coordinate system; The configuration module is used to configure the glue coating coverage area value and the glue coating uniformity value within the shape area of ​​each appearance component of the automobile according to the coordinate positioning of the shape of each appearance component of the automobile and the position identifier and area identifier of each shape; The gluing module is used to apply glue to the shape areas of the exterior parts of the automobile according to the gluing coverage area value and the gluing uniformity value.

7. The 2D glue coating quality online detection device according to claim 6, characterized in that: The building blocks are specifically used for: Collect original images of automobile exterior parts, input the original images into a shape segmentation model, and obtain the shape areas of the automobile exterior parts. The shape segmentation model is trained based on the pre-labeled shape areas of the automobile exterior parts, and based on the shape areas of the automobile exterior parts, the distribution, gluing position and gluing area of ​​the shapes of the automobile exterior parts are collected, and a gluing shape distribution map is constructed, wherein the gluing shape distribution map includes shape position identifiers and area identifiers.

8. The 2D glue coating quality online detection device according to claim 6, characterized in that: The determination module is specifically used for: According to the glue shape distribution map, a fixed point of the automobile is used as the origin of the coordinate system, and the directions of the X-axis and the Y-axis are determined. Based on the distribution of the shapes of each appearance component in the glue shape distribution map, the glue position and the glue area information, the shapes of each appearance component of the automobile are drawn in a two-dimensional coordinate system by applying image processing, and a two-dimensional coordinate system of the shapes of each appearance component of the automobile is established. Based on the two-dimensional coordinate system, the coordinate positioning of the shapes of each appearance component of the automobile is determined by image processing measurement tools or custom scripts.

9. A computer device, characterized in that: include: at least one processor; And, a memory communicatively connected to at least one processor; wherein the memory stores instructions executable by at least one processor, and the instructions are executed by at least one processor so that at least one processor can execute the 2D glue coating quality online detection method as described in any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that: A computer program is stored, and when the computer program is executed by a processor, the 2D glue coating quality online detection method as described in any one of claims 1 to 5 is implemented.

Images