Unlock instant, AI-driven research and patent intelligence for your innovation.

A multi-level approach to smartphone screen defect detection

A technology for smart phones and defect detection, applied in computer parts, image enhancement, instruments, etc., can solve the problems of not meeting the independent and identical distribution conditions, uneven data set quality, and low degree of discrimination of defect samples, so as to reduce manpower. Labeling investment, improving detection capability and the effect of improving efficiency and real-time performance

Active Publication Date: 2022-03-22
杭州臻味食集科技有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 2) Background information is extremely disruptive
[0005] 3) There are many types of defects and the definition is vague
Due to differences in production environments, production standards, and production technologies, mobile phone screens in different production scenarios have different types of defects, and there is currently no unified classification standard, and there are problems in the calibration of defect types that vary from person to person.
[0006] 4) The quality of the calibration data set is uneven
Due to factors such as the lack of awareness of artificial intelligence technology by the calibration personnel subjectively and the low degree of discrimination of defect samples objectively, there are two main problems in the smartphone screen defect industrial defect dataset: First, the sample data volume under different categories varies greatly , does not satisfy the condition of independent and identical distribution; second, the overall sample size is not large enough
[0007] The above-mentioned first three points are specific difficulties in the task of mobile phone screen appearance defect detection. The reason is that the definition of defects varies from scene to scene. The fourth point is a common difficulty in the application of various deep learning algorithms.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-level approach to smartphone screen defect detection
  • A multi-level approach to smartphone screen defect detection
  • A multi-level approach to smartphone screen defect detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] A multi-level smart phone screen defect detection method, the overall process is as follows figure 1 shown, including:

[0052] Step 1, such as figure 2 , manually mark the defects in the image, and then separate the foreground defect image from the background image; on the basis of the marked foreground defect image, enhance the color and size of the foreground defect image (such as image 3 shown), to expand the number of samples and morphological diversity of foreground defects; finally, combine the enhanced foreground defect images and background images to generate a data set with reliable labels and balanced categories, suitable for actual production scenarios; defects include hair, dirt, black Spots, scratches and discoloration;

[0053] Step 1.1. Manually mark the location and category information of the rectangular area where each foreground defect image is located in a small number of images, and then separate the foreground defect image and the background i...

Embodiment 2

[0086] On the basis of Example 1, the multi-level convolutional neural network model training and testing is carried out by using the data set generated in step 1. The experimental data includes 5422 pieces of real scene annotation data, and the experimental evaluation indicators are defect detection accuracy, recall Rate and F1 score, the accuracy rate (precision) indicates how many samples in the predicted results are correct, and the recall rate (recall) indicates how many positive samples in the predicted results are correctly detected. F1 is defined as follows:

[0087]

[0088] The definition of correct detection is that the IoU (overlap) between the detected area and the marked area is greater than or equal to 0.5, and the detected type is consistent with the marked type. The IoU calculation is the ratio of the area of ​​the intersection and union of the "predicted area" and the "real area". The experimental results are shown in Table 1 below.

[0089] Table 1 Defec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a multi-level smart phone screen defect detection method, which comprises the steps of manually marking the defects in the image, and then separating the foreground defect image from the background image; using a deep residual network and a feature pyramid network to perform multiple Scale defect area feature extraction to obtain multi-scale feature images; extract target interest detection areas. The beneficial effects of the present invention are: the extraction of interest detection regions effectively improves the efficiency of image preprocessing, and avoids that the existing general target detection technology is greatly disturbed by background factors in the small target detection task of mobile phone screen defect detection. In view of the lack of data sets in practical applications, a targeted enhancement method is proposed, which greatly reduces the investment in human labeling in the early stage and further improves the efficiency of the overall solution.

Description

technical field [0001] The invention belongs to the field of mobile phone screen defect detection, and in particular relates to a multi-level smart phone screen defect detection method. Background technique [0002] As the core component of the smartphone, the screen is the key to human-computer interaction, and its quality seriously affects the user's experience of the mobile phone. Therefore, major mobile phone manufacturers are increasingly demanding the production process of mobile phone screens. However, during the production process of the mobile phone screen, it is extremely vulnerable to the influence of the production environment and production process. In order to prevent mobile phones with defective screens from flowing into the market to damage the interests of consumers and affect the reputation of mobile phone screen manufacturers, major mobile phone screen manufacturers have taken some necessary measures to test the quality of mobile phone screens. The tradi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/774G06V10/25G06K9/62G06N3/04G06T3/40G06T5/00G06T5/20G06T5/50G06T7/00G06T7/194
CPCG06T7/194G06T7/0004G06T5/20G06T3/40G06T5/50G06T2207/20221G06V10/25G06N3/045G06F18/214G06T5/94G06T5/73G06T5/70
Inventor 陈垣毅
Owner 杭州臻味食集科技有限公司