Unlock instant, AI-driven research and patent intelligence for your innovation.

Multi-level smartphone screen defect detection method

A smart phone and defect detection technology, applied in computer parts, image data processing, biological neural network models, etc., can solve the problems of not meeting the independent and identical distribution conditions, uneven data set quality, and low discrimination of defect samples. , to achieve the effect of reducing the input of human labeling, improving the detection ability and improving the efficiency and real-time performance.

Active Publication Date: 2021-08-06
ZHEJIANG UNIV CITY COLLEGE
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 2) Background information is extremely disruptive
[0005] 3) There are many types of defects and the definition is vague
Due to differences in production environments, production standards, and production technologies, mobile phone screens in different production scenarios have different types of defects, and there is currently no unified classification standard, and there are problems in the calibration of defect types that vary from person to person.
[0006] 4) The quality of the calibration data set is uneven
Due to factors such as the lack of awareness of artificial intelligence technology by the calibration personnel subjectively and the low degree of discrimination of defect samples objectively, there are two main problems in the smartphone screen defect industrial defect dataset: First, the sample data volume under different categories varies greatly , does not satisfy the condition of independent and identical distribution; second, the overall sample size is not large enough
[0007] The above-mentioned first three points are specific difficulties in the task of mobile phone screen appearance defect detection. The reason is that the definition of defects varies from scene to scene. The fourth point is a common difficulty in the application of various deep learning algorithms.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-level smartphone screen defect detection method
  • Multi-level smartphone screen defect detection method
  • Multi-level smartphone screen defect detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] A multi-level smart phone screen defect detection method, the overall process is as follows figure 1 shown, including:

[0052] Step 1, such as figure 2 , manually mark the defects in the image, and then separate the foreground defect image from the background image; on the basis of the marked foreground defect image, enhance the color and size of the foreground defect image (such as image 3 shown), to expand the number of samples and morphological diversity of foreground defects; finally, combine the enhanced foreground defect images and background images to generate a data set with reliable labels and balanced categories, suitable for actual production scenarios; defects include hair, dirt, black Spots, scratches and discoloration;

[0053] Step 1.1. Manually mark the location and category information of the rectangular area where each foreground defect image is located in a small number of images, and then separate the foreground defect image and the background i...

Embodiment 2

[0086] On the basis of Example 1, the multi-level convolutional neural network model training and testing is carried out by using the data set generated in step 1. The experimental data includes 5422 pieces of real scene annotation data, and the experimental evaluation indicators are defect detection accuracy, recall Rate and F1 score, the accuracy rate (precision) indicates how many samples in the predicted results are correct, and the recall rate (recall) indicates how many positive samples in the predicted results are correctly detected. F1 is defined as follows:

[0087]

[0088] The definition of correct detection is that the IoU (overlap) between the detected area and the marked area is greater than or equal to 0.5, and the detected type is consistent with the marked type. The IoU calculation is the ratio of the area of ​​the intersection and union of the "predicted area" and the "real area". The experimental results are shown in Table 1 below.

[0089] Table 1 Defec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a multi-level smartphone screen defect detection method, which comprises the following steps of: manually marking defects in an image, and then separating a foreground defect image from a background image; performing multi-scale defect region feature extraction on the data set by using a deep residual network and a feature pyramid network to obtain a multi-scale feature image; and extracting a target interest detection area. The beneficial effects of the method are that through interest detection area extraction, the image preprocessing efficiency is effectively improved, and the problem that an existing general target detection technology is greatly interfered by background factors in a small target detection task of mobile phone screen defect detection is avoided; and a targeted enhancement mode is provided for the problem of lack of data sets of actual landing applications, so that the manpower annotation investment in the early stage is greatly reduced, and the efficiency of the overall scheme is further improved.

Description

technical field [0001] The invention belongs to the field of mobile phone screen defect detection, and in particular relates to a multi-level smart phone screen defect detection method. Background technique [0002] As the core component of the smartphone, the screen is the key to human-computer interaction, and its quality seriously affects the user's experience of the mobile phone. Therefore, major mobile phone manufacturers are increasingly demanding the production process of mobile phone screens. However, during the production process of the mobile phone screen, it is extremely vulnerable to the influence of the production environment and production process. In order to prevent mobile phones with defective screens from flowing into the market to damage the interests of consumers and affect the reputation of mobile phone screen manufacturers, major mobile phone screen manufacturers have taken some necessary measures to test the quality of mobile phone screens. The tradi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/32G06K9/62G06N3/04G06T3/40G06T5/00G06T5/20G06T5/50G06T7/00G06T7/194
CPCG06T7/194G06T7/0004G06T5/20G06T3/40G06T5/50G06T2207/20221G06V10/25G06N3/045G06F18/214G06T5/94G06T5/73G06T5/70
Inventor 陈垣毅
Owner ZHEJIANG UNIV CITY COLLEGE