Blanking cover installation detection method and device, electronic equipment and storage medium

Abstract

The invention provides a blanking cap installation detection method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the photographing of a vehicle body in response to a vehicle body in-place signal, and obtaining a vehicle body image; performing image recognition processing on the vehicle body image to determine a target vehicle type corresponding to the vehicle body; and according to a preset comparison image of the target vehicle type, judging whether the blanking cap of the vehicle body is abnormally mounted or not. Compared with the prior art, the vehicle body is photographed, and the target vehicle type corresponding to the current vehicle body is determined through recognition processing; the preset comparison image of the target vehicle model is compared with the vehicle body image, and whether the blanking cap in the current vehicle body is installed abnormally or not can be determined; the automatic detection of the installation and detection of the blanking cap can be realized; therefore, the error rate of installation and detection of the blanking cap can be effectively reduced, and the detection efficiency is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to a method and device for detecting installation of a plug cover, an electronic device, and a storage medium. Background Art

[0002] Some components and metal parts of automobiles have high requirements for the waterproof performance of the vehicle. Automobile waterproofing is of great significance for protecting the vehicle, ensuring driving safety and maintaining the value of the vehicle. In the actual production process, the installation of the plug cover is an important part of ensuring the waterproof sealing performance of the vehicle body.

[0003] There are many plugs installed on the car body, up to 30 or 40 plugs on a car, and tens of thousands of plugs are installed manually every day. At the same time, the sizes of plugs are not completely consistent, and there are two or three different sizes of plugs. Therefore, it is very easy to miss plugs during manual installation. Due to factors such as personnel turnover and possible fatigue caused by long-term operation, it is difficult to ensure that plugs are not missed during the production process. At present, the inspection of whether the plugs are installed is basically carried out by workers in the back-end process. Therefore, it is necessary to realize the automatic detection of plug installation. Summary of the invention

[0004] The present invention provides a method and device for detecting the installation of a plug cover, an electronic device and a storage medium, the main purpose of which is to realize automatic detection of the installation of a vehicle plug cover.

[0005] According to a first aspect of the present disclosure, a method for detecting installation of a plugging cover is provided, comprising:

[0006] In response to a vehicle body arrival signal, photographing the vehicle body to obtain a vehicle body image;

[0007] Performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body;

[0008] According to the preset comparison image of the target vehicle model, it is determined whether the cover of the vehicle body is installed abnormally.

[0009] Optionally, the method further includes:

[0010] If the cover of the vehicle body is installed abnormally, the conveyance of the vehicle body is suspended and an alarm message is generated;

[0011] If the blocking cover of the vehicle body is installed normally, the vehicle body continues to be conveyed.

[0012] Optionally, performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body includes:

[0013] Determine the feature recognition points in the standard images of different car models;

[0014] Based on the feature recognition points, the vehicle body image is respectively identified and matched with standard images of different vehicle models to determine the target vehicle model corresponding to the vehicle body.

[0015] Optionally, after performing image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body, the method further includes:

[0016] Based on the feature recognition points in the vehicle body image, a frame selection matching process is performed on the vehicle body image to determine the cover position in the vehicle body image.

[0017] Optionally, judging whether the cover of the vehicle body has an installation abnormality according to the preset comparison image of the target vehicle body includes:

[0018] Performing grayscale matching processing on the vehicle body image after the frame selection matching processing and the preset comparison image, and judging whether the cover of the vehicle body is installed abnormally;

[0019] If any of the plug covers in the vehicle body is installed abnormally, it is determined that the plug cover of the vehicle body is installed abnormally.

[0020] Optionally, the method further includes:

[0021] In response to a vehicle body release signal, re-inspecting the blocking cover of the vehicle body;

[0022] When the cover of the vehicle body passes the re-inspection, the vehicle body continues to be conveyed.

[0023] Optionally, in response to the vehicle body release signal, re-inspecting the blocking cover of the vehicle body includes:

[0024] Re-photographing the vehicle body to obtain a vehicle body re-inspection image;

[0025] Based on the feature recognition points in the vehicle body re-inspection image, performing frame selection matching processing on the vehicle body re-inspection image to determine the blocking cover position in the vehicle body re-inspection image;

[0026] The vehicle body re-inspection image after the frame selection matching process is subjected to grayscale matching process with a preset comparison image, and it is determined whether the cover of the vehicle body is installed abnormally.

[0027] According to a second aspect of the present disclosure, a device for detecting installation of a plugging cover is provided, comprising:

[0028] A photographing unit, configured to photograph the vehicle body to obtain a vehicle body image in response to a vehicle body arrival signal;

[0029] A recognition unit, used for performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body;

[0030] The judging unit is used to judge whether the cover of the vehicle body is installed abnormally according to a preset comparison image of the target vehicle body.

[0031] Optionally, the device further comprises:

[0032] A generating unit, used for suspending the conveyance of the vehicle body and generating an alarm message when the plug cover of the vehicle body is installed abnormally;

[0033] The first conveying unit is used to continue conveying the vehicle body when the blocking cover of the vehicle body is installed normally.

[0034] Optionally, the identification unit includes:

[0035] A first determination module is used to determine feature recognition points in standard images of different vehicle models;

[0036] The first matching module is used to perform identification and matching processing on the vehicle body image and standard images of different vehicle models based on the feature recognition points to determine the target vehicle model corresponding to the vehicle body.

[0037] Optionally, the device further comprises:

[0038] The first matching unit is used to perform frame matching processing on the vehicle body image based on feature recognition points in the vehicle body image to determine the cover position in the vehicle body image after the recognition unit performs image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body.

[0039] Optionally, the judging unit includes:

[0040] A second matching module is used to perform grayscale matching processing on the vehicle body image after the frame selection matching processing and a preset comparison image, and determine whether the cover of the vehicle body is installed abnormally;

[0041] The second determination module is used to determine that the installation of the blocking cover of the vehicle body is abnormal if any blocking cover of the vehicle body is installed abnormally.

[0042] Optionally, the device further comprises:

[0043] A re-inspection unit, configured to re-inspect the blocking cover of the vehicle body in response to a vehicle body release signal;

[0044] The second conveying unit is used to continue conveying the vehicle body when the re-inspection unit determines that the blocking cover of the vehicle body has passed the re-inspection.

[0045] Optionally, the re-examination unit includes:

[0046] A photographing module, used for re-photographing the vehicle body to obtain a vehicle body re-inspection image;

[0047] A third matching module is used to perform frame selection matching processing on the vehicle body re-inspection image based on the feature recognition points in the vehicle body re-inspection image to determine the position of the cover in the vehicle body re-inspection image;

[0048] The judgment module is used to perform grayscale matching processing on the vehicle body re-inspection image after the frame selection matching processing and the preset comparison image, and to judge whether the cover of the vehicle body is installed abnormally.

[0049] According to a third aspect of the present disclosure, there is provided an electronic device, including:

[0050] at least one processor; and

[0051] a memory communicatively connected to the at least one processor; wherein,

[0052] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0053] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect.

[0054] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method as described in the first aspect above.

[0055] The present disclosure provides a method and device, electronic device and storage medium for detecting the installation of a plug cover. In response to a vehicle body arrival signal, the vehicle body is photographed to obtain a vehicle body image; the vehicle body image is subjected to image recognition processing to determine the target vehicle model corresponding to the vehicle body; and according to the preset comparison image of the target vehicle model, it is determined whether the plug cover of the vehicle body is abnormally installed. Compared with the related art, the present disclosure photographs the vehicle body and performs recognition processing to determine the target vehicle model corresponding to the current vehicle body; compares the preset comparison image of the target vehicle model with the vehicle body image to determine whether the plug cover in the current vehicle body is abnormally installed; image recognition can be used to realize automatic detection of plug cover installation; and thus the error rate of plug cover installation detection can be effectively reduced, and the detection efficiency can be improved.

[0056] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0058] Figure 1 A schematic flow chart of a method for detecting installation of a plugging cover provided in an embodiment of the present disclosure;

[0059] Figure 2 A schematic flow chart of another method for detecting installation of a plugging cover provided in an embodiment of the present disclosure;

[0060] Figure 3 A schematic flow chart of another method for detecting installation of a plugging cover provided in an embodiment of the present disclosure;

[0061] Figure 4 A schematic diagram of the structure of a device for detecting the installation of a plugging cover provided in an embodiment of the present disclosure;

[0062] Figure 5 A schematic diagram of the structure of another device for detecting installation of a plugging cover provided in an embodiment of the present disclosure;

[0063] Figure 6 A schematic block diagram of an exemplary electronic device provided for an embodiment of the present disclosure. DETAILED DESCRIPTION

[0064] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0065] At present, the inspection of plugging caps is basically done by workers in the back-end process. This has the following disadvantages: (1) It takes time. Workers in the back-end process need to use a brush to touch the plugging cap to check the installation status while completing their own operations. Each worker takes about 10 seconds to check. (2) It is difficult to ensure product quality. First, because the back-end workers are not full-time to check the installation of plugging caps, it is very easy to miss inspections, especially in the high-beat production process, the workers have a tight time to complete their own work and will ignore the plugging cap inspection. Second, even if the back-end workers find that the installation is missing, they need to reinstall it after completing their own operations, so occasionally they forget to reinstall it. (3) It is impossible to effectively trace the source. Relying on manual inspection and reinstallation, it is impossible to save photos of the missing installation, and it is difficult to effectively record the location of the missing installation for a long time and calculate the probability of missing installation. It is also impossible to emphasize and train the installation workers in a targeted manner to solve or reduce the occurrence of missing installation problems from the root.

[0066] The following describes the method and device for detecting the installation of a plugging cover, an electronic device, and a storage medium according to an embodiment of the present disclosure with reference to the accompanying drawings.

[0067] Figure 1 A schematic flow chart of a method for detecting installation of a plugging cover provided in an embodiment of the present disclosure.

[0068] like Figure 1 As shown, the method comprises the following steps:

[0069] Step 101 , in response to a vehicle body arrival signal, photograph the vehicle body to obtain a vehicle body image.

[0070] In the embodiment of the present disclosure, after receiving the vehicle body arrival signal, in order to realize the detection of the installation of the plug cover, the plug cover is photographed by the image acquisition device. An automated detection process can be realized; compared with manual detection, automated detection is more efficient and accurate, and can greatly save human resources and time costs. The installation of the plug cover can be monitored in real time; once the plug cover is found to be improperly installed or defective, it can be processed and repaired in time to avoid safety hazards or quality problems. High-definition images can be taken, and detailed information on the installation of the plug cover can be captured more accurately. Data recording and analysis can be performed, and the installation of the plug cover can be counted and analyzed to understand the quality and effect of the installation, providing a reference for subsequent quality control and improvement. Fast and accurate detection can be achieved. Problems can be discovered and handled in time to avoid production delays and rework, and improve production efficiency and product quality.

[0071] In summary, taking photos of the plugging cover installation through the image acquisition device can achieve the beneficial effects of automated detection, real-time monitoring, improved detection accuracy, data recording and analysis, and improved production efficiency. This can improve product quality, reduce production costs, and provide better quality control methods.

[0072] Step 102: performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body.

[0073] Different models can be designed using the same platform; therefore, different models can be produced on the same production line during the vehicle production process. Different models have different data such as the installation position and quantity of the plug cover, so it is necessary to identify the model corresponding to the current body.

[0074] In the embodiment of the present disclosure, the vehicle body image is identified and processed using an image recognition algorithm to determine the target vehicle model corresponding to the current vehicle body. The image recognition algorithm is an image recognition algorithm based on machine vision, for example, it can be a threshold segmentation algorithm or an adaptive threshold segmentation algorithm, which is not limited in the present disclosure.

[0075] The detection of plug cover installation based on image recognition algorithm can be automated and efficient. Compared with manual detection, the algorithm can process and analyze a large number of vehicle body images in a short time, greatly improving the efficiency of detection. This is very beneficial for the detection of plug cover installation on industrial production lines, which can improve production efficiency and reduce production costs.

[0076] Step 103, judging whether the cover of the vehicle body is installed abnormally according to the preset comparison image of the target vehicle body.

[0077] In the embodiments of the present disclosure, by comparing the preset comparison image of the target vehicle model with the captured vehicle body image, it is possible to determine whether there is any installation abnormality in the vehicle body, and the data of the plug cover installation can be recorded and analyzed. The algorithm can extract relevant features of the plug cover installation, such as position, angle, quality, etc., and perform statistics and analysis. This can help production managers understand the quality status of the plug cover installation, identify problems in a timely manner and take corresponding measures to improve product quality and production efficiency.

[0078] The image recognition algorithm can accurately detect the installation of the plug cover. The algorithm can identify the plug cover part in the body image and perform corresponding analysis and judgment to determine whether the plug cover is installed correctly. This can improve the accuracy of the detection and avoid misjudgment and missed detection caused by manual detection.

[0079] The detection of plug cover installation based on image recognition algorithm can achieve real-time quality control. The algorithm can detect and analyze each body image and judge whether the plug cover installation is qualified according to the set standards. This can help production managers to find unqualified products in time and deal with them to ensure that product quality meets the requirements.

[0080] The present disclosure provides a method for detecting the installation of a plug cover, in response to a vehicle body arrival signal, photographing the vehicle body to obtain a vehicle body image; performing image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body; and judging whether the plug cover of the vehicle body is abnormally installed according to a preset comparison image of the target vehicle model. Compared with the related art, the present disclosure photographs the vehicle body and performs recognition processing to determine the target vehicle model corresponding to the current vehicle body; compares the preset comparison image of the target vehicle model with the vehicle body image to determine whether the plug cover in the current vehicle body is abnormally installed; and can realize automated detection of plug cover installation detection; and can effectively reduce the error rate of plug cover installation detection and improve detection efficiency.

[0081] In order to clearly illustrate the embodiments of the present disclosure, this embodiment provides Figure 2 A flow chart of another method for detecting installation of a plugging cover is shown.

[0082] like Figure 2 As shown, the method comprises the following steps:

[0083] Step 201 , in response to a vehicle body arrival signal, photograph the vehicle body to obtain a vehicle body image.

[0084] Specifically, in the embodiment of the present disclosure, after receiving the vehicle body arrival signal, in order to detect the installation of the plug cover, the installation of the plug cover is photographed by an image acquisition device. The vehicle body arrival signal can be a PLC signal or a physical level signal generated by a sensor or other device, which is not limited by the present disclosure. The following provides an application scenario description. After the vehicle body arrives at the installation station of the plug cover, the sensor detects that the vehicle body is in place and generates a vehicle body arrival signal; after receiving the vehicle body arrival signal, the vehicle body is photographed to obtain a vehicle body image.

[0085] Step 202, determining feature recognition points in standard images of different vehicle models.

[0086] Specifically, in the embodiment of the present disclosure, the feature identification point is a body feature that distinguishes a vehicle model from other vehicle models, for example, it may be a pattern obtained by stamping on the vehicle body, which is not limited in the present disclosure.

[0087] Different models have different data such as the installation position and quantity of the plug cover, so it is necessary to identify the model corresponding to the current vehicle body. After taking a photo of the vehicle body, it is necessary to compare the vehicle body image with the standard images of different models to determine the model of the current vehicle body. There are differences in the bodies of different models, and the model information of the current vehicle body can be determined by comparing the feature recognition points between different models.

[0088] Step 203 : Based on the feature recognition points, the vehicle body image is respectively subjected to recognition and matching processing with standard images of different vehicle models to determine a target vehicle model corresponding to the vehicle body.

[0089] Specifically, in the embodiments of the present disclosure, the standard image may be an image that is the same as the preset comparison image, or may be an image that is specially generated to increase the speed of the recognition and matching process, which is not limited in the present disclosure.

[0090] By performing identification and matching processing on the vehicle body image and the standard images of different vehicle models, it is determined whether the vehicle body image and different feature recognition points can be matched successfully. If the match is successful, the vehicle model information of the current vehicle body is determined. The present disclosure does not limit the number of feature recognition points used for each vehicle model for identification and matching. The more feature recognition points there are, the higher the accuracy of identification and matching.

[0091] Step 204 , based on the feature recognition points in the vehicle body image, frame matching processing is performed on the vehicle body image to determine the position of the cover in the vehicle body image.

[0092] Specifically, in the disclosed embodiment, after the current vehicle model is determined, the position of the cover in the vehicle image is framed according to the feature recognition point in the vehicle image, so that the position of the cover can be quickly located and recognized during subsequent recognition. Exemplarily, after the current vehicle model is determined, the position of the cover of the vehicle body relative to the feature recognition point is certain, and the cover position recognition frame of the vehicle body image is matched.

[0093] Step 205 , grayscale matching is performed on the vehicle body image after the frame selection matching process and a preset comparison image, and it is determined whether the cover of the vehicle body is installed abnormally.

[0094] Specifically, in the disclosed embodiment, the preset comparison image is a picture of the vehicle body cover installed normally. After the vehicle body image after the frame selection is matched with the preset comparison image, grayscale matching is performed to determine whether the vehicle body cover is installed abnormally, thereby improving the accuracy of recognition. The following provides an application scenario description. When the worker is installing, the vehicle body is constantly photographed to achieve real-time monitoring of the cover installation, and a prompt message is generated to indicate the location of the cover that is installed abnormally.

[0095] In some embodiments of the present disclosure, if an RGB camera is used, the vehicle body image needs to be binarized to obtain a vehicle body binary image. The vehicle body image is binarized, and the processing process includes but is not limited to: grayscale, threshold segmentation, pixel connection; after the binarization process, a vehicle body binary image related to vehicle body cover installation detection is obtained.

[0096] Step 206: If any cover in the vehicle body is installed abnormally, it is determined that the cover of the vehicle body is installed abnormally.

[0097] Specifically, in the disclosed embodiment, the determination results of the plugging covers of all parts are summarized through conditional detection. As long as there is one abnormality, it is determined that the plugging covers in this area are abnormally installed, and finally the detection result of the identified area is output; logical operations are performed on the results output from all identified areas. As long as there is one abnormality, it is determined that there is an abnormality in the installation of the plugging covers of the entire vehicle.

[0098] Step 207: If the cover of the vehicle body is installed abnormally, the conveyance of the vehicle body is suspended and an alarm message is generated.

[0099] Furthermore, if the blocking cover of the vehicle body is installed normally, the vehicle body continues to be transported.

[0100] Step 208, in response to the vehicle body release signal, re-inspect the blocking cover of the vehicle body.

[0101] As an achievable method of an embodiment of the present disclosure, in response to a vehicle body release signal, re-inspecting the vehicle body cover includes: re-photographing the vehicle body to obtain a vehicle body re-inspection image; based on feature recognition points in the vehicle body re-inspection image, performing frame selection and matching processing on the vehicle body re-inspection image to determine the position of the cover in the vehicle body re-inspection image; performing grayscale matching processing on the vehicle body re-inspection image after the frame selection and matching processing and a preset comparison image, and judging whether the vehicle body cover is abnormally installed.

[0102] Specifically, in the disclosed embodiment, after determining that the plug cover of the vehicle body is installed abnormally, an alarm message is used to prompt the worker to reinstall the plug cover with abnormal installation. After the worker completes the installation, a release signal is issued; after receiving the release signal, the installation status of the plug cover of the vehicle body is inspected again. During the re-inspection, the identification area with abnormal installation is inspected.

[0103] In some embodiments of the present disclosure, when re-inspecting the installation of the plugging cover, the area where the installation abnormality occurs may also be inspected.

[0104] Step 209, when the cover of the vehicle body passes the re-inspection, continue to convey the vehicle body.

[0105] Specifically, in the disclosed embodiment, the vehicle body can be re-inspected to ensure that all the plugging covers in the vehicle body are installed in place, thereby avoiding the situation of missing installation or substandard installation.

[0106] In summary, the image recognition algorithm can accurately detect the installation of the plug cover. The algorithm can identify the plug cover part in the body image, and perform corresponding analysis and judgment to determine whether the plug cover is installed correctly. This can improve the accuracy of the detection and avoid misjudgment and missed detection caused by manual detection. The detection of plug cover installation based on the image recognition algorithm can be automated and efficient. Compared with manual detection, the algorithm can process and analyze a large number of body images in a short time, greatly improving the efficiency of detection. This is very beneficial for the detection of plug cover installation on industrial production lines, which can improve production efficiency and reduce production costs. Through the body recognition image, the data of plug cover installation can be recorded and analyzed. The algorithm can extract relevant features of plug cover installation, such as position, angle, quality, etc., and perform statistics and analysis. This can help production managers understand the quality status of plug cover installation, find problems in time and take corresponding measures to improve product quality and production efficiency. The detection of plug cover installation based on the image recognition algorithm can achieve real-time quality control. The algorithm can detect and analyze each body image and judge whether the plug cover installation is qualified according to the set standards. This can help production managers detect and handle unqualified products in a timely manner, ensuring that product quality meets requirements.

[0107] The embodiment of the present disclosure provides a system for detecting the installation of a plugging cover, including:

[0108] The visual system consists of: industrial computer, camera, sound and light alarm;

[0109] Trigger signal: The workshop PLC reads the vehicle body arrival signal and sends the signal to the industrial computer. The industrial computer triggers the camera to take pictures based on the received signal.

[0110] Detection signal: The detection program detects the photos taken by the camera and determines the results;

[0111] Alarm signal: If it is detected that the plug cover is not installed, the industrial computer will send the signal to the workshop PLC, and the PLC will control the sound and light alarm to alarm;

[0112] Re-inspection signal: After the worker has completed the operation, he presses the vehicle release button, and the PLC receives the release signal and sends the signal to the industrial computer. The industrial computer controls the camera to take pictures according to the received signal;

[0113] Detection signal: The detection program detects the photos taken by the camera and determines the results;

[0114] Feedback signal: If there is no problem in the detection, the feedback signal is OK and the vehicle is released smoothly; if there is a problem in the installation of the plug cover, the feedback signal is NOK, the sound and light alarm sounds, and the transportation is suspended.

[0115] See also Figure 3 , the execution flow of the system is as follows:

[0116] 301: Waiting for a trigger signal indicating that the vehicle body is in place, and four cameras take pictures of four areas of the vehicle body respectively;

[0117] 302: Create a template to identify feature points, locate the vehicle body according to the feature recognition algorithm, and compensate the offset to the designated area for the next image processing;

[0118] 303: Perform image processing on the four shooting areas respectively. The processing flow of each area is the same, and for the sake of program beauty, each flow is encapsulated into a program group. The processing flow is: first, perform image binarization processing, then use grayscale matching to determine whether there is a plugging cover in the area, determine the installation status of each plugging cover, and summarize the determination results of all plugging covers through condition detection. As long as there is an abnormality, it is determined that the plugging cover installation in the area is abnormal, and finally output the detection result of the area;

[0119] 304: Perform logical operations on the output results of the four areas. If there is any abnormality, it is determined that there is an abnormality in the installation of the cover of the entire vehicle, and the signal is returned to the PLC to sound and light alarm.

[0120] 305: After the manual operation is completed, the release button is pressed, and the PLC sends a signal to the industrial computer, which controls the camera to take pictures again for secondary inspection;

[0121] 306: If the detection is abnormal, the result is returned to the PLC, and the sound and light alarm is sounded and the transportation is stopped; if the logic operation result is OK, that is, the installation of the detection cover is normal, then the OK signal is returned to the PLC, and the transportation is carried out normally.

[0122] 307: Regardless of whether it is abnormal or not, the processed images are saved locally for easy analysis and tracing. At the same time, the detection results are sent to the database using C# scripts for easy subsequent retrieval and summary.

[0123] It should be noted that the embodiments of the present disclosure may include multiple steps. For the convenience of description, these steps are numbered, but these numbers do not limit the execution time slots or execution order between the steps; these steps can be implemented in any order, and the embodiments of the present disclosure do not limit this.

[0124] Corresponding to the above-mentioned method for detecting the installation of a plugging cover, the present invention further provides a device for detecting the installation of a plugging cover. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, details not disclosed in the device embodiment can be referred to the above-mentioned method embodiment, and will not be described in detail in the present invention.

[0125] Figure 4 A schematic diagram of a device for detecting the installation of a plugging cover provided in an embodiment of the present disclosure is shown in FIG. Figure 4 As shown, including:

[0126] A photographing unit 41 is used for photographing the vehicle body to obtain a vehicle body image in response to a vehicle body arrival signal;

[0127] The recognition unit 42 is used to perform image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body;

[0128] The judgment unit 43 is used to judge whether the cover of the vehicle body is installed abnormally according to the preset comparison image of the target vehicle body.

[0129] The present disclosure provides a device for detecting the installation of a plug cover, which responds to a vehicle body arrival signal, takes a photo of the vehicle body to obtain a vehicle body image; performs image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body; and determines whether the plug cover of the vehicle body is abnormally installed based on a preset comparison image of the target vehicle model. Compared with the related art, the present disclosure takes a photo of the vehicle body and performs recognition processing to determine the target vehicle model corresponding to the current vehicle body; compares the preset comparison image of the target vehicle model with the vehicle body image to determine whether the plug cover in the current vehicle body is abnormally installed; can realize automated detection of plug cover installation detection; and can effectively reduce the error rate of plug cover installation detection and improve detection efficiency.

[0130] Furthermore, in a possible implementation of this embodiment, Figure 5 As shown, the device also includes:

[0131] A generating unit 44, configured to suspend the conveyance of the vehicle body and generate an alarm message when the plugging cover of the vehicle body is installed abnormally;

[0132] The first conveying unit 45 is used to continue conveying the vehicle body when the plugging cover of the vehicle body is installed normally.

[0133] Furthermore, in a possible implementation of this embodiment, Figure 5 As shown, the identification unit 42 includes:

[0134] A first determination module 421 is used to determine feature recognition points in standard images of different vehicle models;

[0135] The first matching module 422 is used to perform identification and matching processing on the vehicle body image and standard images of different vehicle models based on the feature recognition points to determine the target vehicle model corresponding to the vehicle body.

[0136] Furthermore, in a possible implementation of this embodiment, Figure 5 As shown, the device also includes:

[0137] The matching unit 46 is used to perform frame matching processing on the vehicle body image based on feature recognition points in the vehicle body image to determine the cover position in the vehicle body image after the recognition unit 42 performs image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body.

[0138] Furthermore, in a possible implementation of this embodiment, Figure 5 As shown, the judging unit 43 includes:

[0139] The second matching module 431 is used to perform grayscale matching processing on the vehicle body image after the frame selection matching processing and the preset comparison image, and determine whether the cover of the vehicle body is installed abnormally;

[0140] The second determination module 432 is configured to determine that the installation of the blocking cover of the vehicle body is abnormal if any blocking cover of the vehicle body is installed abnormally.

[0141] Furthermore, in a possible implementation of this embodiment, as Figure 5 As shown, the device also includes:

[0142] A re-inspection unit 47, configured to re-inspect the blocking cover of the vehicle body in response to the vehicle body release signal;

[0143] The second conveying unit 48 is used to continue conveying the vehicle body when the re-inspection unit determines that the cover of the vehicle body has passed the re-inspection.

[0144] Furthermore, in a possible implementation of this embodiment, as Figure 5 As shown, the recheck unit 47 includes:

[0145] A photographing module 471 is used to re-photograph the vehicle body to obtain a vehicle body re-inspection image;

[0146] A third matching module 472 is used to perform frame selection matching processing on the vehicle body re-inspection image based on the feature recognition points in the vehicle body re-inspection image to determine the position of the cover in the vehicle body re-inspection image;

[0147] The judgment module 473 is used to perform grayscale matching processing on the vehicle body re-inspection image after the frame selection matching processing and the preset comparison image, and to judge whether the cover of the vehicle body is installed abnormally.

[0148] It should be noted that the above explanation of the method embodiment is also applicable to the device of this embodiment, and the principle is the same, which is not limited in this embodiment.

[0149] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0150] Figure 6A schematic block diagram of an example electronic device 500 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0151] like Figure 6 As shown, the device 500 includes a computing unit 501, which can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 502 or a computer program loaded from a storage unit 508 to a RAM (Random Access Memory) 503. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An I / O (Input / Output) interface 505 is also connected to the bus 504.

[0152] A number of components in the device 500 are connected to the I / O interface 505, including: an input unit 506, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of displays, speakers, etc.; a storage unit 508, such as a disk, an optical disk, etc.; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0153] The computing unit 501 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a CPU (Central Processing Unit), a GPU (Graphic Processing Units), various dedicated AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, a DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 501 performs the various methods and processes described above, such as a method for detecting the installation of a plug cap. For example, in some embodiments, the method for detecting the installation of a plug cap may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 508. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 500 via the ROM 502 and / or the communication unit 509. When the computer program is loaded into the RAM 503 and executed by the computing unit 501, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to execute the aforementioned method for detecting the installation of the plugging cover in any other appropriate manner (eg, by means of firmware).

[0154] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SOCs (System On Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor that may be a dedicated or general-purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0155] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0156] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an EPROM (Electrically Programmable Read-Only-Memory) or a flash memory, an optical fiber, a CD-ROM (Compact Dis sc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0157] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0158] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0159] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0160] It should be noted that artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, as well as machine learning / deep learning, big data processing technology, knowledge graph technology, and other major directions.

[0161] The various numerical numbers such as first and second involved in the present disclosure are only for the convenience of description and are not used to limit the scope of the embodiments of the present disclosure, but also indicate the order of precedence.

[0162] At least one in the present disclosure may also be described as one or more, and a plurality may be two, three, four or more, which is not limited in the present disclosure. In the embodiments of the present disclosure, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D", etc., and there is no order of precedence or size between the technical features described by the "first", "second", "third", "A", "B", "C" and "D".

[0163] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0164] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for detecting the installation of a plugging cover, characterized in that: include: In response to a vehicle body arrival signal, photographing the vehicle body to obtain a vehicle body image; Performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body; According to the preset comparison image of the target vehicle model, it is determined whether the cover of the vehicle body is installed abnormally.

2. The method according to claim 1, characterized in that The method further comprises: If the cover of the vehicle body is installed abnormally, the conveyance of the vehicle body is suspended and an alarm message is generated; If the blocking cover of the vehicle body is installed normally, the vehicle body continues to be conveyed.

3. The method according to claim 1, characterized in that The performing image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body includes: Determine the feature recognition points in the standard images of different car models; Based on the feature recognition points, the vehicle body image is respectively identified and matched with standard images of different vehicle models to determine the target vehicle model corresponding to the vehicle body.

4. The method according to claim 1, characterized in that: After performing image recognition processing on the vehicle body image to determine the target vehicle model corresponding to the vehicle body, the method further includes: Based on the feature recognition points in the vehicle body image, a frame selection matching process is performed on the vehicle body image to determine the cover position in the vehicle body image.

5. The method according to claim 4, characterized in that The determining, based on the preset comparison image of the target vehicle model, whether the cover of the vehicle body is installed abnormally includes: Performing grayscale matching processing on the vehicle body image after the frame selection matching processing and the preset comparison image, and judging whether the cover of the vehicle body is installed abnormally; If any of the plug covers in the vehicle body is installed abnormally, it is determined that the plug cover of the vehicle body is installed abnormally.

6. The method according to claim 1, characterized in that The method further comprises: In response to a vehicle body release signal, re-inspecting the blocking cover of the vehicle body; When the cover of the vehicle body passes the re-inspection, the vehicle body continues to be conveyed.

7. The method according to any one of claims 1 to 6, characterized in that The step of rechecking the blocking cover of the vehicle body in response to the vehicle body release signal comprises: Re-photographing the vehicle body to obtain a vehicle body re-inspection image; Based on the feature recognition points in the vehicle body re-inspection image, performing frame selection matching processing on the vehicle body re-inspection image to determine the blocking cover position in the vehicle body re-inspection image; The vehicle body re-inspection image after the frame selection matching process is subjected to grayscale matching process with a preset comparison image, and it is determined whether the cover of the vehicle body is installed abnormally.

8. A device for detecting the installation of a plugging cover, characterized in that: include: A photographing unit, configured to photograph the vehicle body to obtain a vehicle body image in response to a vehicle body arrival signal; A recognition unit, used for performing image recognition processing on the vehicle body image to determine a target vehicle model corresponding to the vehicle body; The judging unit is used to judge whether the cover of the vehicle body is installed abnormally according to a preset comparison image of the target vehicle body.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-7.

11. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.

Images