Defect detection network construction method, anomaly detection method and system, and storage medium

A construction method and defect detection technology, applied in the field of image processing, can solve problems such as large number of good product samples, inability to meet real-time detection and distributed detection requirements, and high computing overhead

Pending Publication Date: 2020-11-27
SHENZHEN HUAHAN WEIYE TECH
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are still the following problems in the industrial deployment of object surface anomaly detection applications: it is easy to obtain good product samples in the industry, and it is difficult to obtain defective samples in the production process, resulting in unbalanced sample data caused by many good product samples and few defective samples; Defects such as scratches are related to the shooting angle during the shooting process, and the defects of the object can only be reproduced in a specific direction; although the causes of sample defects are different, they are relatively similar in image presentation, making it difficult to distinguish which one belongs to class one defect
However, most similar methods face the curse of dimensionality, that is, common similarity measures tend to fail on high-dimensional data
For high-dimensional data, the purpose is to find a good space / representation, and then finding anomalies becomes a simple problem of measuring similarity. Another problem brought about by high-dimensional data is scalability. It is well known that the system for measuring similarity The computational overhead is high, for example, the complexity of the distance measurement is above O(n). At this time, it is necessary to use data structure optimization or dynamic programming to reduce the complexity, which brings difficulties to control the data dimension
[0004] The currently applied surface anomaly detection methods still have the following deficiencies: (1) The feature extraction network is unstable and cannot achieve better cross-domain migration; (2) In order to extract better features, the network structure design is more complicated, resulting in The calculation time is long, which cannot meet the requirements of real-time detection and distributed detection; (3) when the traditional method is used for anomaly detection, the feature selection depends on the engineer's algorithm design experience, which requires high human experience, and it is easy to fail in manual detection; (4) ) feature simplification, poor defect detection stability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Defect detection network construction method, anomaly detection method and system, and storage medium
  • Defect detection network construction method, anomaly detection method and system, and storage medium
  • Defect detection network construction method, anomaly detection method and system, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] Please refer to figure 1 , this embodiment discloses a defect detection system, the defect detection system 1 includes at least one user terminal 11, and each user terminal 11 is used to perform defect detection on the object to be detected passing on the conveying channel. Here, the user terminal 11 includes a camera 111 , a processor 112 and a display 113 .

[0048] In this embodiment, the user terminal 11 may be a detection device that is fixed or erected on the product transmission channel, and can perform defect detection on each product passing through the detection area. In some cases, the defect detection system may include multiple user terminals 11, so that they are set on different conveying channels of the same product, or on different conveying channels of products. In addition, the user can set the configuration parameters of each user terminal 11 to adapt to the working modes of different products, and can also view the results of defect detection.

[0...

Embodiment 2

[0066] Please refer to figure 1 and image 3 , the construction unit 121 in the server 12 may specifically include an acquisition module 1211, a configuration module 1212, a first training module 1213 and a second training module 1214, which will be described respectively below.

[0067] The obtaining module 1211 is used to obtain the sample image in the preset open data set and the reference image of the standard product corresponding to the object to be detected. Open datasets can be ImageNet, COCO, PASCAL VOC and other datasets, preferably ImageNet datasets; open datasets can be set on the cloud or on a specific server, and the sample images can be retrieved only through network access. The reference image of the standard product corresponding to the object to be detected can be pre-stored on the user terminal or server, and the stored reference image data can be directly read.

[0068] The configuration module 1212 is connected with the acquisition module 1211, and is us...

Embodiment 3

[0086] In order to clearly understand the construction process of the defect detection network, a method for constructing a defect detection network will be disclosed in this embodiment. The construction method can be applied to a server or a user terminal, and constitute a functional module of the server or user terminal (such as implementing As for the construction unit 121 in Example 1, it can be understood that the functional modules corresponding to the construction method need to be executed by a processor to realize the corresponding functions.

[0087] Please refer to Figure 5 , The method for constructing the defect detection network for which protection is claimed includes steps S110-S160, which are described below respectively.

[0088] Step S110, acquiring the sample image in the preset open data set and the reference image of the standard product corresponding to the object to be detected.

[0089] It should be noted that open datasets can be ImageNet, COCO, PAS...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a defect detection network construction method, an anomaly detection method and system, and a storage medium. The construction method comprises: obtaining a sample image in apreset open data set and a reference image of a standard product of a to-be-detected object; configuring a convolutional neural network module or a plurality of convolutional neural network modules with different scales and forming a defect detection network; training a main feature extraction model by using the sample image to obtain corresponding network parameters, and inputting the reference image into the main feature extraction model and the slave feature extraction model to obtain a corresponding first feature vector and a corresponding second feature vector respectively; and constructing a loss function of the slave feature extraction model according to the first feature vector and the second feature vector, and training and learning to obtain network parameters of the slave feature extraction model, thereby configuring and forming a defect detection network. The defect detection network can complete automatic extraction of features according to input image information, effectively reduces dependence on experience of workers in the process of product defect detection, and has practical value.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a defect detection network construction method, an anomaly detection method and device, and a storage medium. Background technique [0002] In the process of quality control of industrial products, it is better to have over-inspection than omission of inspection. The surface flaw detection method in industrial applications can often be regarded as the application of image-based object surface anomaly detection technology, which can be understood as "a multi-classification problem of unbalanced data sets under unsupervised or weak supervision", which is different from balanced learning. Anomaly detection is generally in an unsupervised form, which seems to be a binary classification but is actually a multi-classification (the reasons for the anomalies are different). Without knowing how many classes there are in fact and without real labels, anomaly detection often does ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06T7/001G06N3/084G06T2207/10004G06T2207/30164G06V10/44G06V10/464G06N3/045G06F18/22
Inventor 杨洋
Owner SHENZHEN HUAHAN WEIYE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products