Defect detection method, device and system, electronic equipment and storage medium

By setting up dual inspection and control equipment on the production line, and using image storage disks for image storage and automated inspection, the problems of low efficiency and high false detection rate of traditional manual visual inspection are solved, and efficient and accurate defect detection is achieved.

CN118941538APending Publication Date: 2024-11-12HANGZHOU HIKROBOT TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411049901.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Traditional defect detection methods rely on manual visual inspection, which is inefficient and has a high false detection rate, making it difficult to meet the real-time detection needs of high-speed production lines. Furthermore, human eye fatigue and subjective judgment differences lead to insufficient detection accuracy.

Method used

A dual detection mechanism is adopted, which uses first and second detection devices deployed on the production line to store images and perform automated defect detection using image storage disks, combined with control equipment for target operation control, to achieve automated defect detection.

Benefits of technology

It improves the efficiency and accuracy of defect detection, reduces the probability of false positives and false negatives, and ensures efficient and accurate detection of objects on the production line.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941538A_ABST
    Figure CN118941538A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a defect detection method, device and system, electronic equipment and a storage medium, the method is applied to first detection equipment arranged outside a defect detection process on a production line, and second detection equipment and control equipment are arranged in the defect detection process. And the second detection equipment performs image storage in an image storage disk based on an image used during defect detection. The method comprises the following steps: acquiring a to-be-detected image from the image storage disk; performing defect detection on an object on the production line based on the to-be-detected image to obtain a first detection result; and the first detection result is sent to the control equipment, so that the control equipment controls target equipment on the production line to execute the target operation according to the first detection result and a second detection result which is generated by the second detection equipment and comprises the same object identifier as the object identifier included in the first detection result. The first detection equipment and the second detection equipment can perform automatic defect detection on the object on the production line according to the image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a defect detection method, device, system, electronic device and storage medium. Background Art

[0002] In industrial production, defect detection is a key link to ensure product quality, improve production efficiency and reduce production costs. Taking liquid crystal substrates as an example, various defects may occur in the production process of liquid crystal substrates, such as serious edge collapse and broken pieces. If these defects are not detected in time and the defective liquid crystal substrates are not intercepted, then these defective liquid crystal substrates are very likely to break during the transmission process on the production line, which will cause the residues of the liquid crystal substrates to scatter on the production line. This will not only bring great difficulties to the cleaning work of the production line and increase manpower and material costs, but also affect the normal operation of the production line and reduce production efficiency. What's more serious is that if these defective liquid crystal substrates flow into the hands of customers, serious quality accidents will occur, which will have a great negative impact on the corporate image.

[0003] The traditional defect detection method is manual visual inspection, which is not only inefficient and difficult to meet the real-time detection needs of high-speed production lines, but also has a high false detection rate due to human eye fatigue, differences in subjective judgment and the influence of the external environment. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a defect detection method, device, system, electronic device and storage medium to achieve automated defect detection. The specific technical solution is as follows:

[0005] In a first aspect, an embodiment of the present application provides a defect detection method, which is applied to a first detection device, wherein the first detection device is a detection device outside a defect detection process arranged on a production line, and a second detection device and a control device are arranged in the defect detection process. After the second detection device completes defect detection on an object on the production line each time, the image is stored in a storage disk based on the image used, and the method includes:

[0006] Acquire the image to be detected from the image storage disk;

[0007] Performing defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object;

[0008] The first detection result is sent to the control device so that the control device controls the target device on the production line to perform a target operation on the object targeted by the first detection result based on the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0009] Optionally, the first detection device and the second detection device are in the same local area network, the second detection device is connected to the image storage disk via a data interface of the image storage disk, and in the local area network, the image storage disk is mapped to a virtual disk of the first detection device via a disk mapping method;

[0010] The step of acquiring the image to be detected from the image storage disk comprises:

[0011] Detect in real time whether a new image is stored in the virtual disk;

[0012] If a new image is stored in the virtual disk, the new image is determined as the image to be detected.

[0013] Optionally, the real-time detection of whether a new image is stored in the virtual disk includes:

[0014] Based on the IP address of the second detection device and the storage path of the image in the image storage disk, access the image storage disk in real time and detect whether a new image is stored in the image storage disk;

[0015] If a new image is stored in the image storage disk, it is determined that a new image is stored in the virtual disk.

[0016] Optionally, the first detection device performs defect detection based on a first defect detection method, and the second detection device performs defect detection based on a second defect detection method, and the defect detection algorithms of the first defect detection method and the second defect detection method are different or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different;

[0017] and / or,

[0018] The image to be detected is an image obtained by compressing the image used by the second detection device when performing defect detection on the object on the production line.

[0019] In a second aspect, an embodiment of the present application provides a defect detection method, which is applied to a control device, wherein the control device is arranged in a defect detection process on a production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is also arranged in the defect detection process, and each time the second detection device completes defect detection on an object on the production line, the image is stored in a storage disk based on the image used, and the method includes:

[0020] receiving a first detection result and a second detection result, wherein the first detection result is obtained by the first detection device performing defect detection on the object on the production line based on the image to be detected obtained from the image storage disk, the first detection result includes an object identifier of the object, and the second detection result is a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result;

[0021] According to the first detection result and the second detection result, a target device on the production line is controlled to perform a target operation on the object targeted by the first detection result.

[0022] Optionally, controlling a target device on the production line to perform a target operation on an object targeted by the first detection result according to the first detection result and the second detection result includes:

[0023] When the second detection result is received but the first detection result is not received, a first target operation is determined according to the second detection result, and a target device on the production line is controlled to perform the first target operation on the object targeted by the second detection result; when the second detection result and the first detection result are received, a second target operation is determined according to the first detection result and the second detection result, and it is determined whether the first target operation and the second target operation are the same; if they are different, the target device on the production line is controlled to perform the second target operation on the object targeted by the second detection result;

[0024] or,

[0025] When the first detection result and the second detection result are received, a second target operation is determined according to the first detection result and the second detection result, and a target device on the production line is controlled to perform the second target operation on the object targeted by the first detection result.

[0026] Optionally, determining a second target operation according to the first detection result and the second detection result includes:

[0027] Determine whether there is a detection result indicating that the object has a defect in the first detection result and the second detection result, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation;

[0028] or,

[0029] Determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result used to indicate that the object has a defect. If so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

[0030] In a third aspect, an embodiment of the present application provides a defect detection device, which is applied to a first detection device, wherein the first detection device is a detection device arranged outside a defect detection process on a production line, and a second detection device and a control device are arranged in the defect detection process. After the second detection device completes defect detection on an object on the production line each time, the image is stored in a storage disk based on the image used, and the device includes:

[0031] An image acquisition module, used for acquiring the image to be detected from the image storage disk;

[0032] A defect detection module, configured to perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object;

[0033] A detection result sending module is used to send the first detection result to the control device, so that the control device controls the target device on the production line to perform a target operation on the object targeted by the first detection result according to the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0034] Optionally, the first detection device and the second detection device are in the same local area network, and the second detection device is connected to the image storage disk via the data interface of the image storage disk. In the local area network, the image storage disk is mapped to a virtual disk of the first detection device via disk mapping; the image acquisition module comprises: a detection unit, used to detect in real time whether there is a new image stored in the virtual disk; and an image acquisition unit, used to determine a new image as an image to be detected if the new image is stored in the virtual disk.

[0035] Optionally, the detection unit is specifically used to access the image storage disk in real time and detect whether there is a new image stored in the image storage disk based on the IP address of the second detection device and the storage path of the image in the image storage disk; if a new image is stored in the image storage disk, determine that a new image is stored in the virtual disk.

[0036] Optionally, the first detection device performs defect detection based on a first defect detection method, and the second detection device performs defect detection based on a second defect detection method, the defect detection algorithms of the first defect detection method and the second defect detection method are different, or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different; and / or, the image to be detected is an image obtained by compressing the image used by the second detection device to perform defect detection on objects on the production line.

[0037] In a fourth aspect, an embodiment of the present application provides a defect detection device, which is applied to a control device, wherein the control device is arranged in a defect detection process on a production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is arranged in the defect detection process, and each time the second detection device completes defect detection on an object on the production line, the image is stored in a storage disk based on the image used, and the device includes:

[0038] a detection result receiving module, configured to receive a first detection result and a second detection result, wherein the first detection result is obtained by the first detection device performing defect detection on the object on the production line based on the image to be detected obtained from the image storage disk, the first detection result includes an object identifier of the object, and the second detection result is a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result;

[0039] A control module controls a target device on the production line to perform a target operation on an object targeted by the first detection result according to the first detection result and the second detection result.

[0040] Optionally, the control module is specifically used to: when the second detection result is received but the first detection result is not received, determine a first target operation based on the second detection result, and control the target device on the production line to perform the first target operation on the object targeted by the second detection result; when the second detection result and the first detection result are received, determine a second target operation based on the first detection result and the second detection result, and judge whether the first target operation and the second target operation are the same; if different, control the target device on the production line to perform the second target operation on the object targeted by the second detection result; or, when the first detection result and the second detection result are received, determine a second target operation based on the first detection result and the second detection result, and control the target device on the production line to perform the second target operation on the object targeted by the first detection result.

[0041] Optionally, the control module is specifically used to: determine whether there is a detection result between the first detection result and the second detection result that is used to indicate that there is a defect in the object, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation; or, determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result that is used to indicate that there is a defect in the object, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

[0042] In a fifth aspect, an embodiment of the present application provides a defect detection system, the defect detection system comprising: a first detection device arranged outside a defect detection process on a production line, a second detection device arranged in the defect detection process, and a control device arranged in the defect detection process;

[0043] The second detection device is used to perform defect detection on the objects on the production line, and after completing the defect detection, send the defect detection result to the control device and store the image on the image storage disk based on the image used in the defect detection;

[0044] The first detection device is used to obtain the image to be detected from the image storage disk, and perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object;

[0045] The first detection device is further used to send the first detection result to the control device;

[0046] The control device is used to control the target device on the production line to perform a target operation on the object targeted by the first detection result based on the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0047] In a sixth aspect, an embodiment of the present application provides an electronic device, including:

[0048] Memory, used to store computer programs;

[0049] The processor is used to implement any of the methods described in the first aspect or the second aspect when executing the program stored in the memory.

[0050] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the first aspect or the second aspect is implemented.

[0051] Beneficial effects of the embodiments of the present application:

[0052] In the scheme provided by the embodiment of the present application, the defect detection method can be applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, and a second detection device and a control device are arranged in the defect detection process. After the second detection device completes defect detection on the object on the production line each time, the image is stored in the image storage disk based on the image used. The method includes: obtaining the image to be detected from the image storage disk; performing defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: the object identification of the object; sending the first detection result to the control device, so that the control device controls the target device on the production line to perform the target operation on the object targeted by the first detection result according to the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identification that is the same as the object identification included in the first detection result. The above-mentioned first detection device and the second detection device can both perform automatic defect detection on the objects on the production line based on the image, without relying on manual visual inspection, thereby improving the efficiency and accuracy of defect detection. Moreover, through dual detection by two detection devices, the probability of false detection and missed detection can be greatly reduced. Even if the second detection device fails to accurately detect defects for some reason, the second detection device may still capture these defects, thereby further improving the accuracy of defect detection.

[0053] Of course, implementing any product or method of the present application does not necessarily require achieving all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0055] Figure 1 A schematic diagram of a defect detection method provided in an embodiment of the present application;

[0056] Figure 2 Based on Figure 1 A schematic diagram of a process of an image acquisition method in the illustrated embodiment;

[0057] Figure 3 A schematic diagram of a flow chart of another defect detection method provided in an embodiment of the present application;

[0058] Figure 4 Based on Figure 3 A schematic flow chart of a control method of the illustrated embodiment;

[0059] Figure 5 Based on Figure 3 A schematic flow chart of another control method of the illustrated embodiment;

[0060] Figure 6 Based on Figure 4 or Figure 5 A schematic diagram of a flow chart of a method for determining a second target operation in the illustrated embodiment;

[0061] Figure 7 Based on Figure 4 or Figure 5 A schematic flow chart of another method of determining a second target operation according to the illustrated embodiment;

[0062] Figure 8 A schematic diagram of the structure of a defect detection device provided in an embodiment of the present application;

[0063] Fig. 9 A schematic diagram of the structure of another defect detection device provided in an embodiment of the present application;

[0064] Fig.10 A schematic diagram of the structure of a defect detection system provided in an embodiment of the present application;

[0065] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field based on the present application belong to the scope of protection of the present application.

[0067] In order to realize automated defect detection, the embodiments of the present application provide a defect detection method, apparatus, system, electronic device, computer-readable storage medium and computer program product. The following first introduces a defect detection method applied to a first detection device provided in the embodiments of the present application.

[0068] A defect detection method provided in an embodiment of the present application can be applied to a first detection device, wherein the first detection device can be any device that can implement a defect detection function, for example, a terminal device deployed with a defect detection algorithm or a server deployed with a defect detection algorithm, etc., which is not specifically limited here. For the sake of clear description, it is referred to as the first detection device below.

[0069] like Figure 1 As shown, a defect detection method is applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, a second detection device and a control device are arranged in the defect detection process, and the second detection device stores images on a storage disk based on the used images after completing defect detection on the objects on the production line each time, and the above method includes:

[0070] S101, obtaining an image to be detected from a storage disk.

[0071] S102: Perform defect detection on objects on the production line based on the image to be detected to obtain a first detection result.

[0072] The first detection result includes: an object identifier of the object.

[0073] S103, sending the first detection result to the control device, so that the control device controls the target device on the production line to perform a target operation on the object targeted by the first detection result according to the first detection result and the second detection result.

[0074] The second detection result is: a defect detection result generated by a second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0075] In the scheme provided by the embodiment of the present application, the defect detection method can be applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, and a second detection device and a control device are arranged in the defect detection process. After the second detection device completes defect detection on the object on the production line each time, the image is stored in the image storage disk based on the image used. The method includes: obtaining the image to be detected from the image storage disk; performing defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: the object identification of the object; sending the first detection result to the control device, so that the control device controls the target device on the production line to perform the target operation on the object targeted by the first detection result according to the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identification that is the same as the object identification included in the first detection result. The above-mentioned first detection device and the second detection device can both perform automatic defect detection on the objects on the production line based on the image, without relying on manual visual inspection, thereby improving the efficiency and accuracy of defect detection. Moreover, through dual detection by two detection devices, the probability of false detection and missed detection can be greatly reduced. Even if the second detection device fails to accurately detect defects for some reason, the second detection device may still capture these defects, thereby further improving the accuracy of defect detection.

[0076] In order to perform defect detection on objects on the production line, a second detection device and a control device may be arranged on the production line to form a defect detection process. In the defect detection process, the second detection device may obtain an image of the object on the production line, and perform defect detection on the object on the production line based on the image. Then, the second detection device may store the image on a storage disk based on the image used in defect detection, and send the defect detection result to the control device. The control device may control the target device on the production line to perform corresponding operations on the object targeted by the defect detection result according to the received defect detection result.

[0077] The second detection device can obtain images of objects on the production line in the following two ways:

[0078] In one embodiment, when the second detection device is a camera with a defect detection function, it itself has an image acquisition function. In this case, the second detection device can take pictures of objects on the production line to obtain images of the objects on the production line.

[0079] In another embodiment, an image acquisition device may be arranged on the production line, and the second detection device may be connected to the image acquisition device. In this case, after the image acquisition device takes a picture of the object on the production line to obtain an image, the image may be sent to the second detection device. In this way, the second detection device can obtain the image of the object on the production line.

[0080] Among them, when the second detection device stores the image in the image storage disk based on the image used during defect detection, the image used during defect detection can be directly stored in the image storage disk, or the image used during defect detection can be compressed to obtain a compressed image and then stored in the image storage disk. No specific limitation is made here.

[0081] In order to further improve the accuracy of defect detection on objects on the production line, a first detection device can be deployed outside the defect detection process on the production line. After the second detection device stores the image used in defect detection on the image storage disk, the first detection device can obtain the image to be detected from the image storage disk, and then perform defect detection on the objects on the production line based on the image to be detected to obtain a first detection result, and send the first detection result to the control device.

[0082] Because the production line includes multiple objects, and the multiple objects are transmitted sequentially, the first detection device and the second detection device will generate defect detection results for multiple objects within a period of time. And because the first detection device and the second detection device will send the defect detection results to the control device after defect detection. Therefore, within a period of time, the control device will obtain the defect detection results of multiple objects sent by the first detection device and the defect detection results of multiple objects sent by the second detection device.

[0083] For objects on the production line, each object may have an object identifier for uniquely identifying the object. For example, for liquid crystal substrates on the production line, each liquid crystal substrate has an identification code for uniquely identifying the liquid crystal substrate. When the first detection device and the second detection device perform defect detection on the objects on the production line based on the image, the object identifier identified from the image may be added to the defect detection result to identify the object targeted by the defect detection result.

[0084] Therefore, each time the control device controls the target device according to the defect detection results sent by the first detection device and the second detection device, it can determine the two defect detection results for the same object sent by the first detection device and the second detection device from the received defect detection results according to the object identifier included in the defect detection results, that is, obtain the first detection result and the second detection result. Then, the control device can control the target device on the production line to perform the target operation on the object targeted by the first detection result according to the two defect detection results. The specific method of controlling the target device according to the two defect detection results will be described later. Figure 4-7 The embodiments shown are described in detail and will not be repeated here.

[0085] Among them, the type of the above-mentioned target device can be set according to the type of object on the production line and the actual use requirements, and is not specifically limited here. For example, the above-mentioned target device can be a conveyor belt. When the control device determines that the object has defects based on the first detection result and the second detection result, the conveyor belt can be controlled to stop, thereby intercepting the object. The above-mentioned target device can also be an alarm device that can emit sound or light signals. When the control device determines that the object has defects based on the first detection result and the second detection result, the alarm device can be controlled to turn on, thereby prompting personnel to manually intercept the object. The above-mentioned target device can also be an interception device such as a mechanical interception arm or an electromagnetic interception door. When the control device determines that the object has defects based on the first detection result and the second detection result, the interception device can be controlled to intercept the object.

[0086] For the first detection device, the second detection device and the control device:

[0087] In one embodiment, the second detection device and the control device may be devices in an existing production line, and the first detection device may be additional equipment added on the basis of the existing production line. That is to say, the existing production line is arranged with a defect detection process including the second detection device and the control device. The solution provided by the embodiment of the present application is to add the first detection device on the basis of the existing production line, and then through the interaction between the second detection device, the control device and the first detection device, a re-inspection link is added on the basis of the existing defect detection process.

[0088] In another embodiment, the second detection device, the control device and the first detection device can all be devices additionally added on the basis of the existing production line. That is to say, the defect detection process is not arranged in the existing production line. The solution provided by the embodiment of the present application is to add the second detection device, the control device and the first detection device on the basis of the existing production line, and then through the interaction between the second detection device, the control device and the first detection device, a double detection defect detection process is added on the basis of the existing production line.

[0089] In the solution provided by the embodiment of the present application, the above-mentioned first detection device and the second detection device can both perform automated defect detection on objects on the production line based on images, without relying on manual visual inspection, thereby improving the efficiency and accuracy of defect detection. And through the dual detection of the two detection devices, the probability of false detection and missed detection can be greatly reduced. Even if the second detection device fails to accurately detect defects for some reason, the second detection device may also capture these defects, thereby further improving the accuracy of defect detection. In addition, the solution provided by the embodiment of the present application can not only increase the re-inspection link on the basis of the existing defect detection process when the existing production line has a defect detection process, thereby improving the accuracy of defect detection, but also increase the defect detection process of dual detection on the basis of the existing production line when the existing production line does not have a defect detection process, so that the production line has an accurate defect detection function.

[0090] As an implementation method of the above-mentioned step S101, the above-mentioned first detection device and the second detection device are in the same local area network, the second detection device is connected to the image storage disk through the data interface of the image storage disk, and in the local area network, the image storage disk is mapped to the virtual disk of the first detection device through disk mapping.

[0091] The second detection device can be connected to the image storage disk via the data interface of the image storage disk. In this way, after the second detection device completes defect detection on the object based on the image of the object on the production line each time, it can store the image of the object on the production line in the image storage disk through the data interface or compress the image of the object on the production line to obtain a compressed image and then store the compressed image in the image storage disk.

[0092] Because the first detection device also needs to obtain images of objects on the production line to perform defect detection on the objects, the first detection device and the second detection device can be networked in advance through devices such as routers or switches, so that the first detection device and the second detection device are in the same local area network, and then in the local area network, the image storage disk is mapped to the virtual disk of the first detection device through disk mapping, so that the first detection device can share the image stored in the image storage disk with the second detection device.

[0093] Correspondingly, such as Figure 2 As shown, the above step S101 may include:

[0094] S201, detecting in real time whether there is a new image stored in the virtual disk.

[0095] When an object on the production line passes through the defect detection of the second detection device, its corresponding image will be stored in the image storage disk by the second detection device. This behavior indicates that the object has completed the first stage of defect detection. To ensure the efficiency of defect detection, the first detection device needs to respond quickly to re-inspection operations at this time.

[0096] Therefore, the first detection device can detect the virtual disk in real time to determine whether a new image is stored in the virtual disk, that is, to determine whether the second detection device has completed defect detection on a certain object on the production line. If the judgment result is yes, the first detection device can execute step S202. If the judgment result is no, the first detection device can continue to detect the virtual disk in real time to determine whether a new image is stored in the virtual disk.

[0097] The first detection device may detect in real time whether a new image is stored in the virtual disk in the following two ways.

[0098] In one embodiment, after the first detection device and the second detection device are networked and the image storage disk is mapped to the virtual disk of the first detection device through disk mapping, the IP (Internet Protocol) address of the second detection device and the storage path of the image in the image storage disk can be pre-stored in the first detection device. In this way, the first detection device can access the image storage disk in real time based on the IP address of the second detection device and the storage path of the image in the image storage disk and detect whether there is a new image stored in the image storage disk. If there is a new image stored in the image storage disk, it is determined that a new image is stored in the virtual disk.

[0099] In another embodiment, after the first detection device and the second detection device are networked and the image storage disk is mapped to the virtual disk of the first detection device through disk mapping, the IP address of the second detection device can be pre-stored in the first detection device. In this way, the first detection device can access the image storage disk in real time based on the IP address of the second detection device and detect whether there is a new file stored in the image storage disk. If there is a new file stored in the image storage disk, the first detection device can further determine whether the new file is an image file through the extension of the file. If so, it is determined that a new image is stored in the virtual disk.

[0100] S202: Determine the new image as the image to be detected.

[0101] When the judgment result of step S201 is yes, it means that the second detection device has completed defect detection on a certain object on the production line. In this case, the first detection device can execute step S202, use the new image as the image to be detected, and start the re-inspection process for the object on the production line to ensure efficient and accurate defect detection of each object on the production line.

[0102] In the solution provided by the embodiment of the present application, because when an object on the production line is inspected by the second inspection device, its corresponding image will be stored in the image storage disk, this behavior indicates that the object has completed the first stage of defect detection. And the image storage disk has been mapped to the virtual disk of the first inspection device. Therefore, the first inspection device can detect the virtual disk in real time. Once a new image is found to be stored in the virtual disk, it is determined that the second inspection device has completed the inspection of an object on the production line. On this basis, the first inspection device can use the new image as the image to be inspected to start the corresponding re-inspection process, thereby ensuring efficient and accurate defect detection of each object on the production line.

[0103] As an implementation of an embodiment of the present application, in order to improve the comprehensiveness of defect detection, the defect detection performed by the first detection device and the defect detection performed by the second detection device may differ in the image to be detected and / or the defect detection method adopted.

[0104] In one implementation, the first detection device may perform defect detection based on a first defect detection method, and the second detection device may perform defect detection based on a second defect detection method. The difference between the first defect detection method and the second defect detection method may be that the types of defect detection algorithms used by the two methods are different, or that the types of defect detection algorithms used by the two methods are the same, but the specific parameters of the defect detection algorithms are different. Specifically:

[0105] The first defect detection method and the second defect detection method may use different types of defect detection algorithms. For example, the first defect detection method uses the Sobel (Sobel operator) algorithm in the edge detection algorithm, and the second defect detection method uses the Prewitt (Prewitt Operator) algorithm in the edge detection algorithm. Alternatively, the first defect detection method uses the Sobel algorithm in the edge detection algorithm, and the second defect detection method uses the grayscale co-occurrence matrix method in the texture detection algorithm. The specific types of defect detection algorithms used by the first defect detection method and the second defect detection method can be set according to the object type on the production line and the actual usage requirements, and are not specifically limited here.

[0106] The first defect detection method and the second defect detection method can use the same type of defect detection algorithm, but the specific parameters of the two defect detection algorithms are different. For example, the first defect detection method and the second defect detection method both use the Sobel algorithm, but the Sobel algorithm can be trained separately through different training samples, training end conditions or parameter update methods, so that the image depth, derivative order, size of the Sobel operator or proportional constant of the scaled derivative of the Sobel algorithm used in the first defect detection method and the Sobel algorithm used in the second defect detection method are different. Among them. The specific training method of the defect detection algorithm used by the first defect detection method and the second defect detection method can be set according to the object type on the production line and the actual use requirements, and is not specifically limited here.

[0107] In another embodiment, the image to be detected acquired by the first detection device may be an image obtained by compressing the image used by the second detection device when performing defect detection on the object on the production line. That is to say, after the second detection device performs defect detection on the object based on the original image corresponding to the object on the production line, the original image may be compressed to obtain a compressed image, and then the second detection device may store the compressed image in the image storage disk. In this way, when the first detection device obtains the image to be detected from the image storage disk, what is obtained is the compressed image corresponding to the object on the production line, and then based on the compressed image corresponding to the object on the production line, the object is subjected to defect detection.

[0108] In another embodiment, the first detection device may perform defect detection based on the first defect detection method and the compressed image, and the second detection device may perform defect detection based on the second defect detection method and the original image. That is, the defect detection performed by the first detection device and the defect detection performed by the second detection device are different in the image to be detected and the defect detection method adopted.

[0109] In the solution provided by the embodiment of the present application, when the first detection device and the second detection device perform defect detection on the same object on the production line, the images to be detected and / or the defect detection methods used by the two may be different. In this way, through the differentiation of the image selection or detection method between the first detection device and the second detection device, more comprehensive and multi-angle defect detection of the same object on the production line can be achieved, thereby improving the accuracy and completeness of defect detection, reducing the risk of missed detection and false detection, and ensuring product quality. At the same time, the diversified detection means can also adapt to different types of defects, enhancing the flexibility and adaptability of defect detection.

[0110] Corresponding to the above-mentioned defect detection method applied to the first detection device, an embodiment of the present application also provides a defect detection method applied to a control device. The following introduces a defect detection method applied to a control device provided by an embodiment of the present application.

[0111] like Figure 3 As shown, a defect detection method is applied to a control device, the control device is arranged in the defect detection process on the production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is also arranged in the defect detection process. After the second detection device completes defect detection on an object on the production line each time, the image is stored in a storage disk based on the used image. The above method includes:

[0112] S301, receiving a first detection result and a second detection result.

[0113] The first detection device and the second detection device can both perform defect detection on the objects on the production line and send the defect detection results to the control device. The specific manner in which the first detection device and the second detection device perform defect detection on the objects on the production line has been described in detail in the above embodiments and will not be repeated here.

[0114] After receiving the defect detection results sent by the first detection device and the second detection device, the control device can determine the two defect detection results for the same object sent by the first detection device and the second detection device from the received defect detection results based on the object identifier included in the defect detection results, that is, determine the first detection result and the second detection result.

[0115] S302: According to the first detection result and the second detection result, control the target device on the production line to perform a target operation on the object targeted by the first detection result.

[0116] For an object on a production line, the second detection device will store the image on the image storage disk based on the image used in defect detection after completing defect detection on the object to obtain the second detection result, so as to trigger the first detection device to perform defect detection on the object to obtain the first detection result. Therefore, when the control device receives the first detection result and the second detection result, it first receives the second detection result and then receives the first detection result. On this basis, when the control device controls the target device according to the first detection result and the second detection result, it can adopt Figure 4 and Figure 5 The two methods shown are controlled, specifically:

[0117] exist Figure 4In the manner shown, the control device may use steps S401 to S405 to control the target device according to the first detection result and the second detection result.

[0118] S401, when a second detection result is received but a first detection result is not received, determining a first target operation according to the second detection result.

[0119] When the control device receives the second detection result but has not yet received the first detection result, it can first determine the first target operation based on the second detection result. For example, taking the target device as an interception device, if the second detection result indicates that the object has a defect, the interception operation can be determined as the first target operation, and if the second detection result indicates that the object does not have a defect, the release operation can be determined as the first target operation.

[0120] S402: Control a target device on the production line to perform a first target operation on an object targeted by the second detection result.

[0121] After determining the first target operation, the control device may first control the target device based on the first target operation, that is, control the target device on the production line to perform the first target operation on the object targeted by the second detection result.

[0122] S403: When the second detection result and the first detection result are received, determine a second target operation according to the first detection result and the second detection result.

[0123] When the control device receives the first detection result again as time goes by, because the control device has received both the second detection result and the first detection result, in order to improve the control accuracy of the target device, the control device can combine the first detection result and the second detection result to determine the second target operation. The specific method of determining the second target operation based on the first detection result and the second detection result will be described later. Figure 6-7 The embodiment shown is described in detail and will not be repeated here.

[0124] S404: Determine whether the first target operation and the second target operation are the same.

[0125] The first target operation and the second target operation determined by the control device through the above steps S401 and S403 may be the same or different. When the first target operation and the second target operation are the same, because the control device has controlled the target device to perform the first target operation in the previous control process, in this case, the control device does not need to control the target device to perform the second target operation that is the same as the first target operation, that is, the control device does not need to perform any operation at this time.

[0126] Therefore, after determining the second target operation, the control device may first determine whether the first target operation and the second target operation are the same to determine whether to control the target device to perform the second target operation. If the determination result is yes, the control device may not perform the operation, and if the determination result is no, the control device may perform step S405.

[0127] S405: Control the target device on the production line to perform a second target operation on the object targeted by the second detection result.

[0128] When the first target operation and the second target operation are different, because the second target operation is determined by combining the first detection result and the second detection result, the second target operation is more reasonable than the first target operation determined solely according to the second detection result. Therefore, when the first target operation and the second target operation are different, the control device can control the target device to perform the second target operation on the object targeted by the second detection result.

[0129] exist Figure 5 In the illustrated manner, the control device may use steps S501 and S502 to control the target device according to the first detection result and the second detection result.

[0130] S501, when a first detection result and a second detection result are received, determining a second target operation according to the first detection result and the second detection result.

[0131] In order to improve the control accuracy of the target device, the control device may not perform the operation when receiving one detection result, but wait until it receives two detection results before performing the operation. Specifically, when the control device receives the second detection result but has not received the first detection result, it may not perform the operation first, and wait until it receives the first detection result again, the control device can determine the second target operation based on the first detection result and the second detection result. The specific method of determining the second target operation based on the first detection result and the second detection result will be described later. Figure 6-7 The embodiment shown is described in detail and will not be repeated here.

[0132] S502: Control a target device on the production line to perform a second target operation on the object targeted by the first detection result.

[0133] After comprehensively determining the second target operation according to the first detection result and the second detection result, the control device may control the target device to perform the second target operation on the object targeted by the second detection result.

[0134] In the solution provided by the embodiment of the present application, the control device can adopt a method of first controlling according to the second detection result, and then controlling according to the first detection result and the second detection result. For this method, when the control device only receives the second detection result, it can immediately perform the corresponding operation without waiting for the first detection result, thereby reducing the waiting time of the production line and improving production efficiency. The control device can also adopt a method of waiting until the first detection result and the second detection result are received, and then controlling according to the first detection result and the second detection result. For this method, when both detection results are received, the control device directly determines the second target operation according to the two detection results and controls the target device to perform the second target operation, without additional judgment or operation, simplifying the control process. And the operation is performed only when both detection results are received, which ensures the consistency and accuracy of the operation and reduces the control errors caused by the inconsistency of the two detection results.

[0135] As an implementation of the above step S403 and step S501, when the control device determines the second target operation according to the first detection result and the second detection result, the control device may adopt Figure 6 and Figure 7 The two methods shown are as follows:

[0136] exist Figure 6 In the manner shown, the control device may use “OR” logic to determine the second target operation.

[0137] S601, determining whether there is a detection result indicating that a defect exists in the object in the first detection result and the second detection result.

[0138] In order to improve the accuracy of detection and ensure that all possible defects are not missed as much as possible, the control device can use "or" logic to determine the second target operation, that is, to determine whether there is a detection result used to indicate that the object has a defect in the first detection result and the second detection result. As long as there is a detection result used to indicate that the object has a defect in the two detection results, it is determined that the object has a defect. Only when both detection results are not detection results used to indicate that the object has a defect, it is determined that the object has a defect.

[0139] When the judgment result of step S601 is yes, the control device may execute step S602 , and when the judgment result of step S601 is no, the control device may execute step S603 .

[0140] S602: Determine the interception operation as the second target operation.

[0141] When the "OR" logic is used to determine the second target operation, as long as there is a detection result among the two detection results that indicates that the object has defects, that is, the judgment result of step S601 is yes, then it is determined that the object has defects. Therefore, at this time, the interception operation is determined as the second target operation, so that the control device can control the target device on the production line to perform an interception operation on the object targeted by the detection result, so as to prevent the defective object from continuing to be transmitted on the production line.

[0142] S603: Determine the release operation as the second target operation.

[0143] When the "OR" logic is used to determine the second target operation, it can be determined that the object has defects only when both test results are not test results indicating that the object has defects, that is, the judgment result of step S601 is no. Therefore, at this time, the release operation is determined as the second target operation, so that the control device can control the target device on the production line to perform the release operation on the object targeted by the first test result, so that the object can continue to enter the subsequent production process.

[0144] exist Figure 7 In the manner shown, the control device may determine the second target operation by a preset weight.

[0145] S701, determining whether the detection result with a higher weight between the first detection result and the second detection result is a detection result used to indicate that a defect exists in the object.

[0146] The weight corresponding to the detection result sent by the first detection device and the weight corresponding to the detection result sent by the second detection device can be set in advance in the control device. In this way, after receiving the first detection result and the second detection result, the control device can determine the detection result with a higher weight in the first detection result and the second detection result according to the pre-set weights, and then determine whether the detection result with a higher weight is a detection result used to indicate that there is a defect in the object.

[0147] Among them, the weight corresponding to the detection result sent by the first detection device and the weight corresponding to the detection result sent by the second detection device can be set according to the specific production line scenario and actual usage requirements, and no specific limitation is made here. For the sake of clarity, one of the ways to set the weight is used as an example here. In the case where the second detection device and the control device are devices in the existing production line, and the first detection device is an additional device added on the basis of the existing production line, considering that the existing production line is relatively old and the defect detection method is relatively backward, and the second detection device is a newly added device, which can be deployed with a more advanced defect detection method, the detection result sent by the first detection device can be set to a higher weight, and the detection result sent by the second detection device can be set to a lower weight.

[0148] When the judgment result of step S701 is yes, the control device may execute step S702 , and when the judgment result of step S701 is no, the control device may execute step S703 .

[0149] S702: Determine the interception operation as the second target operation.

[0150] When the detection result with a higher weight is a detection result used to indicate that the object has defects, that is, when the judgment result of step S701 is yes, it indicates that the object is likely to have defects. At this time, the interception operation can be determined as the second target operation, so that the control device can control the target device on the production line to perform an interception operation on the object targeted by the first detection result to prevent the defective object from continuing to be transmitted on the production line.

[0151] S703: Determine the release operation as the second target operation.

[0152] When the detection result with a higher weight is the detection result used to indicate that the object has no defects, that is, when the judgment result of step S701 is no, it indicates that the object is very likely to have no defects. At this time, the release operation can be determined as the second target operation, so that the control device can control the target device on the production line to perform the release operation on the object targeted by the first detection result, so that the object can continue to enter the subsequent production process.

[0153] In the solution provided by the embodiment of the present application, the control device can determine the interception operation as the second target operation when there is a detection result for indicating that the object has a defect in the first detection result and the second detection result. For this method, as long as any detection result indicates that the object has a defect, the interception operation is taken for the object, which ensures a higher level of security. The control device can also determine the interception operation as the second target operation when the detection result with a higher weight between the first detection result and the second detection result is a detection result for indicating that the object has a defect. For this method, it is allowed to allocate weights according to the reliability and importance of the detection method, and it can be flexibly adjusted according to the actual situation. By giving priority to detection results with higher weights, misjudgments caused by secondary detection results can be reduced.

[0154] Corresponding to the above-mentioned defect detection method applied to the first detection device, an embodiment of the present application also provides a defect detection device applied to the first detection device. The following is an introduction to a defect detection device applied to the first detection device provided in an embodiment of the present application.

[0155] like Figure 8As shown, a defect detection device is applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, and a second detection device and a control device are arranged in the defect detection process. After the second detection device completes defect detection on the object on the production line each time, the image is stored in the image storage disk based on the used image. The above device includes:

[0156] The image acquisition module 810 is used to acquire the image to be detected from the image storage disk.

[0157] The defect detection module 820 is used to perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identification of the object.

[0158] The detection result sending module 830 is used to send the first detection result to the control device, so that the control device controls the target device on the production line to perform the target operation on the object targeted by the first detection result according to the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0159] As an implementation method of an embodiment of the present application, the first detection device and the second detection device are in the same local area network, the second detection device is connected to the image storage disk through the data interface of the image storage disk, and in the local area network, the image storage disk is mapped to the virtual disk of the first detection device through disk mapping.

[0160] The image acquisition module 810 includes:

[0161] The detection unit is used to detect in real time whether a new image is stored in the virtual disk.

[0162] The image acquisition unit is used to determine a new image as an image to be detected if a new image is stored in the virtual disk.

[0163] As an implementation method of an embodiment of the present application, the detection unit is specifically used to access the image storage disk in real time and detect whether there is a new image stored in the image storage disk based on the IP address of the second detection device and the storage path of the image in the image storage disk.

[0164] If a new image is stored in the image storage disk, it is determined that a new image is stored in the virtual disk.

[0165] As an implementation manner of an embodiment of the present application, a first detection device performs defect detection based on a first defect detection method, and a second detection device performs defect detection based on a second defect detection method. The defect detection algorithms of the first defect detection method and the second defect detection method are different or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different; and / or, the image to be detected is an image obtained by compressing the image used by the second detection device to perform defect detection on objects on the production line.

[0166] Corresponding to the above-mentioned defect detection method applied to the control device, an embodiment of the present application also provides a defect detection device applied to the control device. The following introduces a defect detection device applied to the control device provided by an embodiment of the present application.

[0167] like Fig. 9 As shown, a defect detection device is applied to a control device, the control device is arranged in the defect detection process on the production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is also arranged in the defect detection process. After the second detection device completes defect detection on the object on the production line each time, the image is stored in the image storage disk based on the used image. The above device includes:

[0168] The detection result receiving module 910 is used to receive a first detection result and a second detection result, wherein the first detection result is obtained by a first detection device performing defect detection on an object on a production line based on an image to be detected obtained from an image storage disk, and the first detection result includes an object identifier of the object; and the second detection result is a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

[0169] The control module 920 controls the target device on the production line to perform a target operation on the object targeted by the first detection result according to the first detection result and the second detection result.

[0170] As an implementation of the embodiment of the present application, the control module 920 is specifically used to:

[0171] When the second detection result is received but the first detection result is not received, the first target operation is determined based on the second detection result, and the target device on the production line is controlled to perform the first target operation on the object targeted by the second detection result; when the second detection result and the first detection result are received, the second target operation is determined based on the first detection result and the second detection result, and it is determined whether the first target operation and the second target operation are the same; if they are different, the target device on the production line is controlled to perform the second target operation on the object targeted by the second detection result; or, when the first detection result and the second detection result are received, the second target operation is determined based on the first detection result and the second detection result, and the target device on the production line is controlled to perform the second target operation on the object targeted by the first detection result.

[0172] As an implementation of the embodiment of the present application, the control module 920 is specifically used to:

[0173] Determine whether there is a detection result for indicating that there is a defect in the object between the first detection result and the second detection result. If so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation; or, determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result for indicating that there is a defect in the object. If so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

[0174] Corresponding to the above-mentioned defect detection method, an embodiment of the present application further provides a defect detection system. The following is an introduction to a defect detection system provided by an embodiment of the present application.

[0175] like Fig.10 As shown, a defect detection system includes: a first detection device 1001 arranged outside the defect detection process on the production line, a second detection device 1002 arranged in the defect detection process, and a control device 1003 arranged in the defect detection process.

[0176] The second detection device 1002 is used to perform defect detection on objects on the production line, and after completing the defect detection, send the defect detection result to the control device 1003 and store the image based on the image used in the defect detection on the image storage disk.

[0177] The first detection device 1001 is used to obtain the image to be detected from the image storage disk, and perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identification of the object.

[0178] The first detection device 1001 is further configured to send a first detection result to the control device 1003 .

[0179] The control device 1003 is used to control the target device on the production line to perform a target operation on the object targeted by the first detection result based on the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device 1002 and including an object identifier that is the same as the object identifier included in the first detection result.

[0180] As an implementation method of an embodiment of the present application, the first detection device 1001 and the second detection device 1002 are in the same local area network, and the second detection device 1002 is connected to the image storage disk through the data interface of the image storage disk. In the local area network, the image storage disk is mapped to the virtual disk of the first detection device 1001 through disk mapping.

[0181] The first detection device 1001 is specifically used for detecting in real time whether there is a new image stored in the virtual disk; if there is a new image stored in the virtual disk, the new image is determined as the image to be detected.

[0182] As an implementation method of an embodiment of the present application, the first detection device 1001 is specifically used to access the image storage disk in real time and detect whether there is a new image stored in the image storage disk based on the IP address of the second detection device 1002 and the storage path of the image in the image storage disk; if a new image is stored in the image storage disk, it is determined that a new image is stored in the virtual disk.

[0183] As an implementation method of an embodiment of the present application, the first detection device 1001 performs defect detection based on a first defect detection method, and the second detection device 1002 performs defect detection based on a second defect detection method. The defect detection algorithms of the first defect detection method and the second defect detection method are different, or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different.

[0184] and / or,

[0185] The image to be detected is an image obtained by compressing the image used for defect detection on the object on the production line by the second detection device 1002.

[0186] As an implementation of the embodiment of the present application, the control device 1003 is specifically used to:

[0187] When the second detection result is received but the first detection result is not received, the first target operation is determined based on the second detection result, and the target device on the production line is controlled to perform the first target operation on the object targeted by the second detection result. When the second detection result and the first detection result are received, the second target operation is determined based on the first detection result and the second detection result, and it is determined whether the first target operation and the second target operation are the same. If different, the target device on the production line is controlled to perform the second target operation on the object targeted by the second detection result.

[0188] or,

[0189] When the first detection result and the second detection result are received, a second target operation is determined according to the first detection result and the second detection result, and a target device on the production line is controlled to perform the second target operation on the object targeted by the first detection result.

[0190] As an implementation of the embodiment of the present application, the control device 1003 is specifically used to:

[0191] It is determined whether there is a detection result indicating that the object has a defect in the first detection result and the second detection result. If so, the interception operation is determined as the second target operation; if not, the release operation is determined as the second target operation.

[0192] or,

[0193] Determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result used to indicate that the object has a defect. If so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

[0194] The present application also provides an electronic device, such as Fig.11 As shown, including:

[0195] The memory 1101 is used to store computer programs.

[0196] The processor 1102 is used to implement the defect detection method described in any of the above embodiments when executing the program stored in the memory 1101.

[0197] In addition, the electronic device may further include a communication bus and / or a communication interface, and the processor 1102, the communication interface, and the memory 1101 communicate with each other via the communication bus.

[0198] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0199] The communication interface is used for communication between the above electronic device and other devices.

[0200] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0201] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0202] In another embodiment provided in the present application, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the defect detection method described in any of the above embodiments is implemented.

[0203] In another embodiment provided in the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute the defect detection method described in any of the above embodiments.

[0204] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a solid-state hard disk (SSD), etc.

[0205] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0206] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, system, electronic device, computer-readable storage medium, and computer program product embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0207] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A defect detection method, characterized in that: Applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, a second detection device and a control device are arranged in the defect detection process, and the second detection device stores images on a storage disk based on the used images after completing defect detection on the objects on the production line each time, the method includes: Acquire the image to be detected from the image storage disk; Performing defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object; The first detection result is sent to the control device so that the control device controls the target device on the production line to perform a target operation on the object targeted by the first detection result based on the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

2. The method according to claim 1, characterized in that: The first detection device and the second detection device are in the same local area network, the second detection device is connected to the image storage disk via a data interface of the image storage disk, and in the local area network, the image storage disk is mapped to a virtual disk of the first detection device via a disk mapping method; The step of acquiring the image to be detected from the image storage disk comprises: Detect in real time whether a new image is stored in the virtual disk; If a new image is stored in the virtual disk, the new image is determined as the image to be detected.

3. The method according to claim 2, characterized in that The real-time detection of whether a new image is stored in the virtual disk includes: Based on the IP address of the second detection device and the storage path of the image in the image storage disk, access the image storage disk in real time and detect whether a new image is stored in the image storage disk; If a new image is stored in the image storage disk, it is determined that a new image is stored in the virtual disk.

4. The method according to any one of claims 1 to 3, characterized in that: The first detection device performs defect detection based on a first defect detection method, and the second detection device performs defect detection based on a second defect detection method, and the defect detection algorithms of the first defect detection method and the second defect detection method are different or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different; and / or, The image to be detected is an image obtained by compressing the image used by the second detection device when performing defect detection on the object on the production line.

5. A defect detection method, characterized in that: The method is applied to a control device, wherein the control device is arranged in a defect detection process on a production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is arranged in the defect detection process. After the second detection device completes defect detection on an object on the production line each time, the image is stored in a storage disk based on the used image. The method comprises: receiving a first detection result and a second detection result, wherein the first detection result is obtained by the first detection device performing defect detection on the object on the production line based on the image to be detected obtained from the image storage disk, the first detection result includes an object identifier of the object, and the second detection result is a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result; According to the first detection result and the second detection result, a target device on the production line is controlled to perform a target operation on the object targeted by the first detection result.

6. The method according to claim 5, characterized in that The controlling, according to the first detection result and the second detection result, of a target device on the production line to perform a target operation on an object targeted by the first detection result includes: When the second detection result is received but the first detection result is not received, a first target operation is determined according to the second detection result, and a target device on the production line is controlled to perform the first target operation on the object targeted by the second detection result; when the second detection result and the first detection result are received, a second target operation is determined according to the first detection result and the second detection result, and it is determined whether the first target operation and the second target operation are the same; if they are different, the target device on the production line is controlled to perform the second target operation on the object targeted by the second detection result; or, When the first detection result and the second detection result are received, a second target operation is determined according to the first detection result and the second detection result, and a target device on the production line is controlled to perform the second target operation on the object targeted by the first detection result.

7. The method according to claim 6, characterized in that The determining a second target operation according to the first detection result and the second detection result includes: Determine whether there is a detection result indicating that the object has a defect in the first detection result and the second detection result, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation; or, Determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result used to indicate that the object has a defect. If so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

8. A defect detection device, characterized in that: Applied to a first detection device, the first detection device is a detection device arranged outside the defect detection process on the production line, a second detection device and a control device are arranged in the defect detection process, and the second detection device stores images on a storage disk based on the used images after completing defect detection on the objects on the production line each time, the device comprises: An image acquisition module, used for acquiring the image to be detected from the image storage disk; A defect detection module, configured to perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object; A detection result sending module is used to send the first detection result to the control device, so that the control device controls the target device on the production line to perform a target operation on the object targeted by the first detection result according to the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

9. The device according to claim 8, characterized in that The first detection device and the second detection device are in the same local area network, the second detection device is connected to the image storage disk via a data interface of the image storage disk, and in the local area network, the image storage disk is mapped to a virtual disk of the first detection device via a disk mapping method; The image acquisition module includes: a detection unit for detecting in real time whether a new image is stored in the virtual disk; an image acquisition unit for determining a new image as an image to be detected if a new image is stored in the virtual disk; and / or, The detection unit is specifically used to access the image storage disk in real time and detect whether a new image is stored in the image storage disk based on the IP address of the second detection device and the storage path of the image in the image storage disk; if a new image is stored in the image storage disk, determine that a new image is stored in the virtual disk; and / or, The first detection device performs defect detection based on a first defect detection method, and the second detection device performs defect detection based on a second defect detection method, the defect detection algorithms of the first defect detection method and the second defect detection method are different, or the parameters of the defect detection algorithms of the first defect detection method and the second defect detection method are different; and / or, the image to be detected is an image obtained by compressing the image used by the second detection device to perform defect detection on objects on the production line.

10. A defect detection device, characterized in that: The device is applied to a control device, the control device is arranged in a defect detection process on a production line, a first detection device is arranged outside the defect detection process on the production line, and a second detection device is arranged in the defect detection process, and each time the second detection device completes defect detection on an object on the production line, the image is stored in a storage disk based on the used image, and the device comprises: a detection result receiving module, configured to receive a first detection result and a second detection result, wherein the first detection result is obtained by the first detection device performing defect detection on the object on the production line based on the image to be detected obtained from the image storage disk, the first detection result includes an object identifier of the object, and the second detection result is a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result; A control module controls a target device on the production line to perform a target operation on an object targeted by the first detection result according to the first detection result and the second detection result.

11. The device according to claim 10, characterized in that The control module is specifically configured to: when the second detection result is received but the first detection result is not received, determine a first target operation according to the second detection result, and control the target device on the production line to perform the first target operation on the object targeted by the second detection result; when the second detection result and the first detection result are received, determine a second target operation according to the first detection result and the second detection result, and determine whether the first target operation and the second target operation are the same; if they are different, control the target device on the production line to perform the second target operation on the object targeted by the second detection result; or, upon receiving the first detection result and the second detection result, determining a second target operation according to the first detection result and the second detection result, and controlling the target device on the production line to perform the second target operation on the object targeted by the first detection result; and / or, The control module is specifically used to: determine whether there is a detection result for indicating that there is a defect in the object between the first detection result and the second detection result, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation; or, determine whether the detection result with a higher weight between the first detection result and the second detection result is a detection result for indicating that there is a defect in the object, and if so, determine the interception operation as the second target operation; if not, determine the release operation as the second target operation.

12. A defect detection system, characterized in that: The defect detection system comprises: a first detection device arranged outside the defect detection process on the production line, a second detection device arranged in the defect detection process, and a control device arranged in the defect detection process; The second detection device is used to perform defect detection on the objects on the production line, and after completing the defect detection, send the defect detection result to the control device and store the image on the image storage disk based on the image used in the defect detection; The first detection device is used to obtain the image to be detected from the image storage disk, and perform defect detection on the object on the production line based on the image to be detected to obtain a first detection result, wherein the first detection result includes: an object identifier of the object; The first detection device is further used to send the first detection result to the control device; The control device is used to control the target device on the production line to perform a target operation on the object targeted by the first detection result based on the first detection result and the second detection result, wherein the second detection result is: a defect detection result generated by the second detection device and including an object identifier that is the same as the object identifier included in the first detection result.

13. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor, for implementing the method described in any one of claims 1-4 or 5-7 when executing a program stored in a memory.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1-4 or 5-7 is implemented.

Citation Information

Patent Citations

  • Product defect detection method, storage medium, detection equipment and system

    CN117969523A

  • Defect inspection device and defect inspection method

    JP2004028654A

  • Vision inspection apparatus and control method thereof, vision inspection control system

    KR1020170007938A