Unlock instant, AI-driven research and patent intelligence for your innovation.

A defect detection method, device, medium and equipment based on semantic segmentation model

A semantic segmentation and defect detection technology, applied in the field of computer vision and deep learning, can solve problems such as complex mechanical structure facilities, unknown relationship between defect area and projected area, and low defect quantification accuracy, achieving fast and high-precision visual inspection, satisfying The effect of online real-time detection of demand and reduction of model calculation load

Active Publication Date: 2020-09-29
SEIZET TECH SHEN ZHEN CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (1) The 2D camera cooperates with the backlight to calculate the area of ​​the shadow area, but its mechanical structure and facilities are relatively complex, and the 3D defects of the workpiece obtained under this method are mostly in the form of shadows, the relationship between the actual defect area and the projected area is unknown, and the defect quantification accuracy is low ;
[0006] (2) 3D point cloud defect area segmentation technology, but this method cannot balance the amount of data calculation and defect accuracy, that is, if the point cloud is relatively dense, the defect area is relatively clear, but the corresponding data calculation amount is large, and it relies too much on high-dimensional Data processing; if the point cloud is down-sampled, the defect detection rate can be guaranteed to a certain extent, but the 3D point cloud data is relatively sparse, which will reduce the defect detection accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A defect detection method, device, medium and equipment based on semantic segmentation model
  • A defect detection method, device, medium and equipment based on semantic segmentation model
  • A defect detection method, device, medium and equipment based on semantic segmentation model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0068] like figure 1 and figure 2 As shown, the present application provides a defect detection method based on a semantic segmentation model, including the following steps:

[0069] S1 acquires the image data of the workpiece to be detected;

[0070] S2 input the image data into the trained semantic segmentation model, and obtain the defect prediction Label map of the workpiece;

[0071] The semantic segmentation model includes a sequentially connected feature extraction network and feature prediction network;

[0072] The feature extraction network is used to predict the position of the defect area, which includes a feature extraction layer, a feature compression layer, a feature flattening layer, and a feature classification layer;

[0073] performing feature extraction on the image data according to the feature extraction layer, and obtaining a feature map of the image data;

[0074] compressing the feature map according to the feature compression layer and outputting...

Embodiment 2

[0090] In the first embodiment, the defect sample is scanned by a line laser to obtain its corresponding three-dimensional point cloud data. After converting to a grayscale image, the corresponding pixel value distribution range is [0, 255], but the difference between the pixel value of the defect area and the neighboring pixel value is The range is [1, 3]. If the grayscale image and label image are directly combined and input to the semantic segmentation network model for training, the feature vector extracted from the defect area image is similar to the dimension of the feature vector extracted from the adjacent image, and the defect segmentation accuracy is relatively poor.

[0091] On the basis of the above-mentioned semantic segmentation model, this application further limits the training data of the semantic segmentation model. The training data is a synthetic image of a workpiece defect and a Label image corresponding to a defect in the synthetic image of a workpiece defe...

Embodiment 3

[0139] On the basis of the second embodiment above, this embodiment further preprocesses the input image of the workpiece to be detected, that is, the image data of the workpiece to be detected is a composite image of the defect of the workpiece to be detected, so that the representation of the defect form is more intuitive. Get better detection results.

[0140] In the defect detection method based on the semantic segmentation model shown in this embodiment, the defect point cloud data of the workpiece is obtained by line laser scanning, and then the depth map of the point cloud and the corresponding gradient map are obtained, and the 3D defect sample image of the workpiece is synthesized by using the three-channel fusion technology. The feature extraction of synthetic images by deep learning semantic segmentation model can improve the detection rate of such defects.

[0141] The defect synthetic image acquisition of the workpiece to be detected includes the following steps: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a defect detection method based on a semantic segmentation model, comprising: acquiring image data of a workpiece to be detected; inputting the image data into a trained semantic segmentation model to obtain a defect prediction Label graph of the workpiece; the semantic segmentation model includes The feature extraction network and feature prediction network connected in sequence; the feature extraction network is used to predict the location of the defect area, which includes a feature extraction layer, a feature compression layer, a feature flattening layer, and a feature classification layer; the feature prediction network is used to classify the feature Extract each pixel in the defect area determined by the network to classify, and output the defect prediction Label map of the workpiece after locating and segmenting the defect area; the defect detection of the workpiece based on the defect prediction Label map can effectively reduce the calculation amount of the model, and is fast and high-precision Realize the visual detection of workpiece defects.

Description

technical field [0001] The invention belongs to the field of computer vision and deep learning, and more specifically relates to a workpiece defect detection method, device, storage medium and computer equipment based on a semantic segmentation model. Background technique [0002] With the rapid development of Industry 4.0, big data analysis and artificial intelligence have been applied in the field of industrial visual inspection. Compared with the image extraction features that cannot be quantified by traditional visual technology, the deep learning neural network can effectively optimize the processing, and to a certain extent can improve Accuracy and stability of visual detection of workpiece defects. [0003] Through the 2D camera to effectively collect sample images of workpiece defects, the deep learning semantic segmentation model can predict the defect area of ​​the workpiece with high precision, which is convenient for subsequent defect quantification processing. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/00G06T7/11G06T7/62G06K9/46G06K9/62
CPCG06T7/0008G06T7/11G06T7/62G06T2207/10028G06T2207/20081G06T2207/20084G06T2207/30164G06V10/44G06V10/56G06F18/2415
Inventor 梅爽宋瑞超赵青
Owner SEIZET TECH SHEN ZHEN CO LTD