Automobile gluing visual detection method and device and readable storage medium

Abstract

The invention discloses an automobile gluing visual detection method and device and a readable storage medium, and the method comprises the steps: a gluing operation management system checks a vehicle queue to be glued, and obtains a VIN code of a current glued vehicle after each time the vehicle passes through a point; the gluing operation management system sends the VIN code of the vehicle to be glued to the gluing robot and the visual detection system; the gluing robot reads the VIN code of the current gluing vehicle, recognizes vehicle type information, loads preset vehicle type process parameters and executes gluing action; the visual detection system reads a VIN code of a current gluing vehicle, vehicle type information is recognized, preset vehicle type glue type detection parameters are loaded, and a camera and a sensor carry out glue type dynamic detection along with a glue gun; and after the gluing robot completes the operation, a completion signal is transmitted to the visual detection system through the gluing operation management system, and the visual detection system outputs a final detection result of the gluing operation after calculating and fitting data acquired by the camera and the sensor.

Description

Technical Field

[0001] The present invention belongs to the technical field of automobile assembly manufacturing, and in particular relates to a method and equipment for visually inspecting automobile gluing, and a readable storage medium. Background Art

[0002] At present, the development trend of new energy vehicles shows the characteristics of continuous expansion of market scale, continuous acceleration of technological innovation, continuous improvement of industrial chain, continuous strengthening of policy support and increasingly fierce market competition. With the continuous advancement of technology and the continuous development of the market, new energy vehicles will become one of the mainstream products in the automobile market. Faced with the increasingly fierce competition, vehicle manufacturers need to strengthen personalized customization and flexible production capabilities, apply advanced manufacturing technologies such as artificial intelligence, big data, and the Internet of Things, and further improve product quality and shorten delivery cycles.

[0003] In the gluing process of the skylight, skylight, front and rear windshields and other workstations in the general assembly workshop, it is necessary to detect the width, height and adhesive defects of the glue coating, and to achieve real-time detection, abnormal monitoring and traceability of adhesive breaks, adhesive collapse, hard glue, bubbles, position offsets and other defects. At present, manual visual inspection is inefficient and prone to misdetection, which may cause vehicles with unqualified adhesives to flow into the market, causing losses to enterprises and users. Therefore, it is necessary to establish an automated and intelligent visual inspection method for gluing to improve the efficiency and reliability of adhesive result detection. Summary of the invention

[0004] The purpose of the present invention is to provide a method, device and readable storage medium for visual inspection of automobile gluing, so as to perform intelligent inspection of automobile gluing results. The present invention realizes automatic inspection of defects such as broken glue and collapsed glue by adding cameras and sensors to the gluing robot, and integrating the operation management system, the gluing robot and the visual inspection system, thus greatly improving the efficiency of automobile glue type inspection.

[0005] In a first aspect, an embodiment of the present application provides a method for visually inspecting automobile glue coating, the method comprising the following steps:

[0006] S01: In the gluing operation management system, update and check the vehicle queue that will pass through the gluing station so that the system can accurately identify the vehicle model information that passes through the gluing station each time;

[0007] S02: After each vehicle passes the point, the VIN code of the current glue-coated vehicle is obtained;

[0008] S03: Confirm the start of the operation in the gluing operation management system, and send the current vehicle VIN code to the gluing robot and visual inspection system;

[0009] S04: The gluing robot reads the VIN code of the current gluing vehicle, identifies the vehicle model information, loads the preset vehicle model process parameters, and performs the gluing action;

[0010] S05: The visual inspection system reads the VIN code of the current glue-coating vehicle, identifies the vehicle model information, loads the preset vehicle model glue type inspection parameters, and the camera and sensor follow the glue gun to perform dynamic glue type inspection;

[0011] S06: After the gluing robot completes the operation, it transmits the completion signal to the visual inspection system through the middleware. The visual inspection system calculates and fits the data collected by the camera and the sensor, and outputs the final inspection result of this gluing operation. The middleware is the gluing operation management system;

[0012] S07: The gluing operation management system obtains the test result. If it is OK, it means that the test is qualified and the green warning light is on;

[0013] S08: If the test result is NG, it means that the system fails the test, the red warning light turns on and a buzzer sound is triggered to remind the worker to pay attention to the abnormal result;

[0014] S09: Manually inspect the NG glue type. If it is confirmed to be a false alarm of the system, press the release button, the red warning light will go out and the buzzer will stop;

[0015] S10: If it is confirmed that the NG glue type does have quality problems, click the defect button, then the buzzer sound stops and the red warning light continues to light;

[0016] S11: The process ends, the gluing system records the visual system inspection and manual re-inspection results of the vehicle, and starts the inspection process for the next vehicle.

[0017] Optionally, in step S01, the gluing operation management system should have the functions of importing the gluing vehicle AVI queue, reading the AVI system interface and adjusting the AVI queue to ensure that the vehicle queue in the gluing operation management system is consistent with the actual vehicle queue on site.

[0018] Optionally, in step S02, the gluing operation management system automatically updates the VIN code of the current gluing vehicle, that is, after each inspection, the system automatically obtains the VIN code of the next vehicle to ensure that the information of the vehicle to be coated in the gluing operation management system is consistent with the actual vehicle to be coated on site.

[0019] Optionally, in step S03, the gluing operation management system sends the current vehicle VIN code to the gluing robot and the visual inspection system through a data interface, and the interface needs to be customized and developed according to specific system requirements.

[0020] Optionally, in step S05, the visual inspection system performs dynamic inspection of the glue pattern by following the glue gun.

[0021] Optionally, in step S06, the gluing robot completes the operation and transmits a completion signal to the visual inspection system through the middleware data interface. After receiving the completion signal, the visual inspection system calculates and fits the data collected by the camera and the sensor, and outputs the final inspection result of this gluing operation. For abnormal situations, the inspection result outputs the location information of defects such as glue breakage, glue leakage, insufficient glue width and insufficient glue height.

[0022] Optionally, in step S07 and step S08, the gluing operation management system obtains the test results. If the test result is OK, it indicates that the test is qualified, and the green warning light is on; if the test result is NG, it indicates that the system test is unqualified, the red warning light is on and a buzzer sound is triggered to remind workers to pay attention to abnormal results.

[0023] Optionally, in step S09 and step S10, the worker manually inspects the glue type detected as NG by the system. If it is confirmed that it is a false alarm of the system, the worker presses the release button, and the red warning light is turned off and the buzzer sound stops. If it is confirmed that the NG glue type does have quality problems, the worker presses the defect button, and the buzzer sound stops, but the red warning light continues to be on.

[0024] In the second aspect, an embodiment of the present application provides a vehicle glue coating visual inspection device, which includes a processor, a memory, and a vehicle glue coating visual inspection program stored in the memory and executable by the processor, wherein when the vehicle glue coating visual inspection program is executed by the processor, the steps of the vehicle glue coating visual inspection method as described above are implemented.

[0025] In a third aspect, an embodiment of the present application provides a readable storage medium, on which a vehicle glue coating visual inspection program is stored. When the vehicle glue coating visual inspection program is executed by a processor, the steps of the vehicle glue coating visual inspection method as described above are implemented.

[0026] The beneficial effects provided by the present invention are:

[0027] 1) The present invention realizes the intelligent and automated glue type detection through the integrated application of the glue application management system, the glue application robot and the visual inspection system, which greatly improves the work efficiency of automobile glue application quality inspection and is of great significance for ensuring the continuous production of the automobile assembly workshop production line.

[0028] 2) The present invention realizes the application of artificial intelligence in the industrial field through the deployment and implementation of the glue coating visual inspection system at the automobile manufacturing site. It has a wide range of application scenarios and has strong industry promotion value. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1This is a flow chart of an embodiment of a method for visually inspecting automobile glue coating of the present application;

[0030] Figure 2 This is a schematic diagram of the structure of a detection system according to an embodiment of a method for visually detecting automobile glue coating of the present application;

[0031] Figure 3 This is a schematic diagram of the hardware structure of the automobile glue coating visual inspection equipment involved in the embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0034] In a first aspect, an embodiment of the present application provides a method for visual inspection of automobile glue coating.

[0035] In one embodiment, referring to Figure 1 , Figure 1 This is a flow chart of an embodiment of a method for visually inspecting automobile glue coating of the present application. Figure 1 As shown, the automotive glue coating visual inspection method includes:

[0036] S01: In the gluing operation management system, update and check the vehicle queue that will pass through the gluing station so that the system can accurately identify the vehicle model information that passes through the gluing station each time;

[0037] S02: After each vehicle passes the point, the VIN code of the current glue-coated vehicle is obtained;

[0038] S03: Confirm the start of the operation in the gluing operation management system, and send the current vehicle VIN code to the gluing robot and visual inspection system;

[0039] S04: The gluing robot reads the VIN code of the current gluing vehicle, identifies the vehicle model information, loads the preset vehicle model process parameters, and performs the gluing action;

[0040] S05: The visual inspection system reads the VIN code of the current glue-coating vehicle, identifies the vehicle model information, loads the preset vehicle model glue type inspection parameters, and the camera and sensor follow the glue gun to perform dynamic glue type inspection;

[0041] S06: After the gluing robot completes the operation, it transmits the completion signal to the visual inspection system through the middleware (gluing operation management system). The visual inspection system calculates and fits the data collected by the camera and the sensor, and outputs the final inspection result of this gluing operation;

[0042] S07: The gluing operation management system obtains the test result. If it is OK, it means that the test is qualified and the green warning light is on;

[0043] S08: If the test result is NG, it means that the system fails the test, the red warning light turns on and a buzzer sound is triggered to remind the worker to pay attention to the abnormal result;

[0044] S09: The worker conducts manual inspection on the NG glue type. If it is confirmed to be a false alarm of the system, the worker presses the release button, and the red warning light goes out and the buzzer stops;

[0045] S10: If the worker confirms that the NG glue pattern does have quality problems, he / she will click the defect button, and the buzzer sound will stop, but the red warning light will continue to light up;

[0046] S11: The process ends, the gluing system records the visual system inspection and manual re-inspection results of the vehicle, and starts the inspection process for the next vehicle.

[0047] In this embodiment, through the integrated application of the gluing operation management system, the gluing robot, and the visual inspection system, the intelligent and automated glue type detection is realized, which greatly improves the work efficiency of automobile gluing quality inspection, and is of great significance for ensuring the continuous production of the automobile assembly workshop production line. Through the deployment and implementation of the gluing visual inspection system at the automobile manufacturing site, the application of artificial intelligence in the industrial field has been realized, with a wide range of application scenarios and strong industry promotion value.

[0048] Furthermore, in one embodiment, in step S01, the gluing operation management system should have functions such as importing the gluing vehicle AVI queue, reading the AVI system interface, and adjusting the AVI queue to ensure that the vehicle queue in the gluing operation management system is consistent with the actual vehicle queue on site.

[0049] Furthermore, in one embodiment, in step S02, the gluing operation management system automatically updates the VIN code of the current gluing vehicle, that is, after each inspection, the system automatically obtains the VIN code of the next vehicle to ensure that the information of the vehicle to be coated in the gluing operation management system is consistent with the actual vehicle to be coated on site.

[0050] Furthermore, in one embodiment, in step S03, the gluing operation management system sends the current vehicle VIN code to the gluing robot and the visual inspection system through a data interface, and the interface needs to be customized and developed according to specific system requirements.

[0051] Further, in one embodiment, in step S05, the visual inspection system performs dynamic inspection of the glue pattern by following the glue gun, referring to Figure 2 , Figure 2 This is a schematic diagram of the structure of the detection system of an embodiment of the automobile glue visual detection method of the present application. The camera and sensor are installed in the following positions: Figure 2 shown.

[0052] Furthermore, in one embodiment, in step S06, the gluing robot completes its operation and transmits a completion signal to the visual inspection system through the middleware data interface. After receiving the completion signal, the visual inspection system calculates and fits the data collected by the camera and the sensor, and outputs the final inspection result of this gluing operation; for abnormal situations, the location information of defects such as glue breakage, glue leakage, insufficient glue width, and insufficient glue height is output.

[0053] Furthermore, in one embodiment, in step S07 and step S08, the glue application operation management system obtains the test result. If the test result is OK, it indicates that the test is qualified, and the green warning light is on; if the test result is NG, it indicates that the system test is unqualified, the red warning light is on and a buzzer sound is triggered to remind the worker to pay attention to the abnormal result. Figure 2 , the position of the warning light is as follows Figure 2 shown.

[0054] Furthermore, in one embodiment, in step S09 and step S10, the worker manually inspects the glue type detected as NG by the system. If it is confirmed that it is a false alarm of the system, the worker presses the release button, the red warning light of the test goes out, and the buzzer stops; if it is confirmed that the NG glue type does have quality problems, the worker presses the defect button, the buzzer stops, the red warning light continues to be on, and the worker continues to refer to the Figure 2 , the button box position is as follows Figure 2 shown.

[0055] In a second aspect, an embodiment of the present application provides a visual inspection device for automobile glue coating.

[0056] Reference Figure 3 , Figure 3 The hardware structure diagram of the automobile glue coating visual inspection device involved in the embodiment of the present application is shown in FIG. In the embodiment of the present application, the automobile glue coating visual inspection device may include a processor, a memory, a communication interface, and a communication bus.

[0057] The communication bus may be of any type and is used to interconnect the processor, the memory, and the communication interface.

[0058] The communication interface includes input / output (I / O) interface, physical interface and logical interface, etc., which are used to realize the interconnection of devices inside the automobile glue coating visual inspection equipment, and the interface used to realize the interconnection of the automobile glue coating visual inspection equipment with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, a fiber optic interface, an ATM interface, etc.; the user device can be a display (Display), a keyboard (Keyboard), etc.

[0059] The memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical storage, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0060] The processor may be a general-purpose processor, and the general-purpose processor may call the automobile gluing visual detection program stored in the memory, and execute the automobile gluing visual detection method provided by the embodiment of the present application. For example, the general-purpose processor may be a central processing unit (CPU). Among them, the method executed when the automobile gluing visual detection program is called may refer to the various embodiments of the automobile gluing visual detection method of the present application, which will not be repeated here.

[0061] Those skilled in the art will understand that Figure 3 The hardware structure shown in the figure does not constitute a limitation on the present application, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0062] In a third aspect, an embodiment of the present application also provides a readable storage medium.

[0063] The readable storage medium of the present application stores a vehicle gluing visual inspection program, wherein when the vehicle gluing visual inspection program is executed by a processor, the steps of the vehicle gluing visual inspection method as described above are implemented.

[0064] Among them, the method implemented when the automobile glue coating visual inspection program is executed can refer to the various embodiments of the automobile glue coating visual inspection method of the present application, and will not be repeated here.

[0065] It should be noted that the serial numbers of the above-mentioned embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0066] The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. The terms "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit "first", "second" and "third" to different types.

[0067] In the description of the embodiments of the present application, "exemplary", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "for example" or "for example" is intended to present related concepts in a specific way.

[0068] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; the “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.

[0069] In some processes described in the embodiments of the present application, multiple operations or steps that appear in a specific order are included, but it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or in parallel, and the sequence number of the operation is only used to distinguish the different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in sequence or in parallel, and these operations or steps may be combined.

[0070] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present application.

[0071] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for visual inspection of automobile glue coating, characterized in that: The automobile glue coating visual detection method comprises the following steps: S01: In the gluing operation management system, update and check the vehicle queue that will pass through the gluing station so that the system can accurately identify the vehicle model information that passes through the gluing station each time; S02: After each vehicle passes the point, the VIN code of the current glue-coated vehicle is obtained; S03: Confirm the start of the operation in the gluing operation management system, and send the current vehicle VIN code to the gluing robot and visual inspection system; S04: The gluing robot reads the VIN code of the current gluing vehicle, identifies the vehicle model information, loads the preset vehicle model process parameters, and performs the gluing action; S05: The visual inspection system reads the VIN code of the current glue-coating vehicle, identifies the vehicle model information, loads the preset vehicle model glue type inspection parameters, and the camera and sensor follow the glue gun to perform dynamic glue type inspection; S06: After the gluing robot completes the operation, it transmits the completion signal to the visual inspection system through the middleware. The visual inspection system calculates and fits the data collected by the camera and the sensor, and outputs the final inspection result of this gluing operation. The middleware is the gluing operation management system; S07: The gluing operation management system obtains the test result. If it is OK, it means that the test is qualified and the green warning light is on; S08: If the test result is NG, it means that the system fails the test, the red warning light turns on and a buzzer sound is triggered to remind the worker to pay attention to the abnormal result; S09: Manually inspect the NG glue type. If it is confirmed to be a false alarm of the system, press the release button, the red warning light will go out and the buzzer will stop; S10: If it is confirmed that the NG glue type does have quality problems, click the defect button, then the buzzer sound stops and the red warning light continues to light; S11: The process ends, the gluing system records the visual system inspection and manual re-inspection results of the vehicle, and starts the inspection process for the next vehicle.

2. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S01, the gluing operation management system has the functions of importing the gluing vehicle AVI queue, reading the AVI system interface and adjusting the AVI queue to ensure that the vehicle queue in the gluing operation management system is consistent with the actual vehicle queue on site.

3. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S02, the gluing operation management system automatically updates the VIN code of the current gluing vehicle, that is, after each inspection, the system automatically obtains the VIN code of the next vehicle to ensure that the information of the vehicle to be coated in the gluing operation management system is consistent with the actual vehicle to be coated on site.

4. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S03, the gluing operation management system sends the current vehicle VIN code to the gluing robot and visual inspection system through a data interface. The interface needs to be customized and developed according to specific system requirements.

5. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S05, the visual inspection system performs dynamic inspection of the glue pattern by following the glue gun.

6. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S06, the gluing robot completes its operation and transmits a completion signal to the visual inspection system through the middleware data interface. After receiving the completion signal, the visual inspection system calculates and fits the data collected by the camera and sensor, and outputs the final inspection result of this gluing operation. For abnormal situations, the position information of defects such as glue breakage, glue leakage, insufficient glue width and insufficient glue height is output.

7. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S07 and step S08, the gluing operation management system obtains the test results. If the test result is OK, it indicates that the test is qualified and the green warning light is on. If the test result is NG, it indicates that the system test is unqualified, the red warning light is on and a buzzer sound is triggered to remind workers to pay attention to abnormal results.

8. The method for visual inspection of automobile glue coating according to claim 1, characterized in that: In step S09 and step S10, the worker manually inspects the glue type detected as NG by the system. If it is confirmed that it is a false alarm of the system, the worker presses the release button, the red warning light of the test goes out, and the buzzer sound stops; if it is confirmed that the NG glue type does have quality problems, the worker presses the defect button, the buzzer sound stops, and the red warning light continues to be on.

9. A visual inspection device for automobile glue coating, characterized in that: The automobile glue coating visual inspection device includes a processor, a memory, and an automobile glue coating visual inspection program stored in the memory and executable by the processor, wherein when the automobile glue coating visual inspection program is executed by the processor, the steps of the automobile glue coating visual inspection method as described in any one of claims 1 to 8 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a vehicle glue coating visual inspection program, wherein when the vehicle glue coating visual inspection program is executed by a processor, the steps of the vehicle glue coating visual inspection method according to any one of claims 1 to 8 are implemented.

Images