A method, device and storage medium for positioning bright clusters of sub-pixels of a display screen

Abstract

The present application discloses a method, device and storage medium for positioning a bright group of sub-pixels of a display screen, which is used to improve the efficiency of De-Mura compensation of the display screen. The present application includes: lighting up the display screen, collecting the display screen, and generating a display screen image; determining the local maximum point on the display screen image and generating a maximum value image; generating a positioning template matrix; generating a two-channel image; selecting a local maximum point and putting it into a reference point queue, and recording the coordinate information of the reference point into the two-channel image; aligning the positioning template matrix to the reference point of the maximum value image, and determining the corresponding target local maximum point set; recording the coordinate information of the target local maximum point set into the two-channel image; setting the target local maximum point set as the reference point and inputting it into the reference point queue, and repeating the above steps until there is no reference point in the reference point queue; marking the coordinate information on the two-channel image to the pixel group of the target sub-pixel of the display screen image.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of pixel cluster positioning, and in particular to a method, device and storage medium for positioning a bright cluster of sub-pixels in a display screen. Background Art

[0002] With the rapid development of industry and Internet technology, the industry's requirements for industrial product quality are becoming more and more refined and standardized. As far as the display panel industry is concerned, the quality of products directly affects its product competitiveness. Among them, the accuracy of product shape and size specifications is the most basic process indicator of product quality.

[0003] Due to the complexity of the OLED manufacturing process and the difficulty in achieving very good flatness through the evaporation process, the luminous brightness of each sub-pixel varies greatly under the same external conditions, resulting in poor visual experience for most products and failure to meet shipping standards. Additional De-Mura compensation must be performed on each sub-pixel to meet the panel display standards.

[0004] The key to the quality of De-Mura lies in the accurate extraction of sub-pixel brightness, and the extraction of sub-pixels lies in the positioning of sub-pixels. Since the sub-pixels of OLED displays are closely arranged one by one, and OLED displays may have problems such as panel irregularities and missing sub-pixels, the positioning of sub-pixels is somewhat difficult. Among similar technologies currently available, the positioning of panel sub-pixels mostly requires the use of a large number of positioning patterns to position the sub-pixels of OLED displays. With the continuous increase in the application fields of display screens, the morphological structure of display screens is also undergoing many changes. For example, curved screens, spliced ​​screens, VR screens, and AR screens all have different structures from ordinary flat-panel displays. More additional positioning patterns are required in the positioning of sub-pixels, which increases the amount of computation required for sub-pixel positioning and reduces the efficiency of the De-Mura compensation process. Summary of the invention

[0005] The present application discloses a method, a device and a storage medium for positioning a bright group of a sub-pixel of a display screen, which are used to improve the efficiency of De-Mura compensation of the display screen.

[0006] The first aspect of the present application discloses a method for locating a bright group of a sub-pixel of a display screen, comprising:

[0007] The target pixel corresponding to one of the three RGB colors on the display screen is lit up, and the camera collects the target pixel on the display screen to generate a display screen image. There are pixel clusters formed by the target pixel on the display screen image. The arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixels on the display screen;

[0008] Determine the local maximum point corresponding to each pixel group on the display screen image and generate a maximum value image;

[0009] Generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image, the positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1;

[0010] Generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image;

[0011] A local maximum point is selected in the maximum value image as a reference point and put into the reference point queue, and the coordinate information of the reference point is recorded to the reference coordinate position of the two-channel image;

[0012] Align the central area of ​​the positioning template matrix to the reference point of the maximum image, and determine the target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image;

[0013] Record the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0014] Set the target local maximum point set as the reference point and input it into the reference point queue;

[0015] Performing alignment of the positioning template matrix, target local maximum point search, and coordinate information recording of the two-channel images for the reference points in the reference point queue until there are no reference points in the reference point queue;

[0016] The coordinate information on the two-channel image is marked on the pixel cluster of the target sub-pixel of the display screen image.

[0017] Optionally, the arrangement type is non-interlaced pixel arrangement;

[0018] Generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel groups of the display screen image, including:

[0019] When the arrangement type is non-interlaced pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel clusters of the display screen image, and OffsetY is the vertical distance between adjacent pixel clusters of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0020] Generate an initial matrix of corresponding size according to the matrix width and matrix height;

[0021] Assign the center point of the central area of ​​the initial matrix a value of 1, and the central area is an area with a size of at least 1*1;

[0022] Assign the value of 1 to the points at the horizontal OffsetX distance on the left and right sides of the initial matrix to generate two horizontal points;

[0023] Assign the value of 1 to the points at the vertical OffsetY distance above and below the initial matrix to generate two vertical points;

[0024] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0025] Assign the remaining positions of the initial matrix to 0.

[0026] Optionally, the arrangement type is staggered pixel arrangement;

[0027] Generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel groups of the display screen image, including:

[0028] When the arrangement type is staggered pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel groups of the display screen image, and OffsetY is the vertical distance between adjacent pixel groups of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0029] Generate two initial matrices of corresponding sizes according to the matrix width and matrix height;

[0030] Assign the center of the central area of ​​the two initial matrices to 1, and the central area is an area with a size of at least 1*1;

[0031] Assign the points at the vertical OffsetY distance of the two initial matrices to 1 to generate two vertical areas;

[0032] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the top of the first initial matrix to generate two horizontal points;

[0033] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the bottom of the second initial matrix to generate two vertical points;

[0034] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0035] Assign the remaining positions of the initial matrix to 0.

[0036] Optionally, assign values ​​to points around the horizontal point and the vertical point according to the defect type of the target display screen, assign a value of 1, and generate a horizontal area and a vertical area, including;

[0037] Get the number and arrangement of target pixels on the display screen;

[0038] Generate an initial pixel group template according to the number and arrangement of pixels;

[0039] Determine the distortion direction of the initial pixel group template according to the defect extension mode of the defect type of the target display screen;

[0040] Determine the degree of distortion amplification of the initial pixel cluster template according to the number of pixels, arrangement mode and defect influence range of the defect type;

[0041] The initial pixel cluster template is expanded according to the distortion direction and the distortion amplification degree to generate a target pixel cluster template;

[0042] Align the center point of the target pixel group template with the horizontal and vertical points, assign a value of 1 to the point located in the target pixel group template, and generate a horizontal area and a vertical area.

[0043] Optionally, after recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images and before setting the target local maximum point set as a reference point and inputting it into the reference point queue, the positioning method further includes:

[0044] Determine a horizontal area to be measured from the two horizontal areas, and determine a target local maximum point of the horizontal area to be measured;

[0045] Determine at least one gradient pixel point region on the display screen image and located in the horizontal region to be tested, the gradient pixel point region being a set of pixels having a pixel cluster grayscale except for the target local maximum point;

[0046] Determine the target gradient pixel point area corresponding to the target local maximum point;

[0047] Perform edge pixel analysis on the target gradient pixel area and the horizontal area to be tested;

[0048] When the edge pixel point analysis result shows that the target gradient pixel point area and the horizontal area to be measured have edge overlap, determining the overlapped edge pixel point set;

[0049] According to the number of pixels and the positions of the pixels in the edge pixel set, the horizontal area to be measured is expanded and assigned a value;

[0050] The remaining horizontal and vertical areas are subjected to target gradient pixel area determination, edge pixel analysis, edge pixel set determination and amplification assignment.

[0051] Optionally, after determining the local maximum point corresponding to each pixel cluster on the display screen image and generating the maximum value image, before generating the positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters on the display screen image, the positioning method further includes:

[0052] Determine the ROI area of ​​the display screen image;

[0053] Calculate the width and height of the ROI area;

[0054] The horizontal and vertical distances between pixel clusters are calculated based on the region width and region height and the physical resolution of the display.

[0055] Optionally, after recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images and before setting the target local maximum point set as a reference point and inputting it into the reference point queue, the positioning method further includes:

[0056] Generate a marker image according to the physical resolution of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the marker image;

[0057] Each reference point that has been searched is recorded at the coordinate position of the recording point on the mark image. The recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image.

[0058] The second aspect of the present application discloses a positioning device for a bright group of a sub-pixel of a display screen, comprising:

[0059] The acquisition unit is used to light up the target pixel corresponding to one of the three colors of RGB in the display screen. The camera acquires the target pixel on the display screen to generate a display screen image. There are pixel clusters formed by the target pixel on the display screen image. The arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixels of the display screen;

[0060] A first generating unit is used to determine the local maximum point corresponding to each pixel group on the display screen image and generate a maximum value image;

[0061] A second generating unit is used to generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel groups of the display screen image, wherein the positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1;

[0062] A third generating unit is used to generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum value image has a corresponding coordinate position on the two-channel image;

[0063] A first recording unit is used to select a local maximum point in the maximum value image as a reference point and put it into a reference point queue, and record the coordinate information of the reference point to the reference coordinate position of the two-channel image;

[0064] A first determination unit is used to align the central area of ​​the positioning template matrix to the reference point of the maximum value image, and determine a target local maximum point set corresponding to two horizontal areas and two vertical areas on the maximum value image;

[0065] A second recording unit, used for recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0066] An input unit, used for recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0067] A search unit, used for aligning the positioning template matrix, searching for the target local maximum point, and recording the coordinate information of the two-channel images for the reference points in the reference point queue, until there are no reference points in the reference point queue;

[0068] The marking unit is used to mark the coordinate information on the two-channel image to the pixel group of the target sub-pixel of the display screen image.

[0069] Optionally, the arrangement type is non-interlaced pixel arrangement;

[0070] The second generation unit includes:

[0071] When the arrangement type is non-interlaced pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel clusters of the display screen image, and OffsetY is the vertical distance between adjacent pixel clusters of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0072] Generate an initial matrix of corresponding size according to the matrix width and matrix height;

[0073] Assign the center point of the central area of ​​the initial matrix a value of 1, and the central area is an area with a size of at least 1*1;

[0074] Assign the value of 1 to the points at the horizontal OffsetX distance on the left and right sides of the initial matrix to generate two horizontal points;

[0075] Assign the value of 1 to the points at the vertical OffsetY distance above and below the initial matrix to generate two vertical points;

[0076] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0077] Assign the remaining positions of the initial matrix to 0.

[0078] Optionally, the arrangement type is staggered pixel arrangement;

[0079] The second generation unit includes:

[0080] When the arrangement type is staggered pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel groups of the display screen image, and OffsetY is the vertical distance between adjacent pixel groups of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0081] Generate two initial matrices of corresponding sizes according to the matrix width and matrix height;

[0082] Assign the center of the central area of ​​the two initial matrices to 1, and the central area is an area with a size of at least 1*1;

[0083] Assign the points at the vertical OffsetY distance of the two initial matrices to 1 to generate two vertical areas;

[0084] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the top of the first initial matrix to generate two horizontal points;

[0085] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the bottom of the second initial matrix to generate two vertical points;

[0086] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0087] Assign the remaining positions of the initial matrix to 0.

[0088] Optionally, the points around the horizontal point and the vertical point are assigned a value of 1 according to the defect type of the target display screen, and the horizontal area and the vertical area are generated, including:

[0089] Get the number and arrangement of target pixels on the display screen;

[0090] Generate an initial pixel group template according to the number and arrangement of pixels;

[0091] Determine the distortion direction of the initial pixel group template according to the defect extension mode of the defect type of the target display screen;

[0092] Determine the degree of distortion amplification of the initial pixel cluster template according to the number of pixels, arrangement mode and defect influence range of the defect type;

[0093] The initial pixel cluster template is expanded according to the distortion direction and the distortion amplification degree to generate a target pixel cluster template;

[0094] Align the center point of the target pixel group template with the horizontal and vertical points, assign a value of 1 to the point located in the target pixel group template, and generate a horizontal area and a vertical area.

[0095] Optionally, after the second recording unit and before the input unit, the positioning device further includes:

[0096] A second determining unit is used to determine a horizontal area to be measured from the two horizontal areas, and determine a target local maximum point of the horizontal area to be measured;

[0097] A third determination unit is used to determine at least one gradient pixel point region on the display screen image and located in the horizontal region to be measured, where the gradient pixel point region is a set of pixels having a pixel cluster grayscale except for a target local maximum point;

[0098] A fourth determining unit, used to determine a target gradient pixel point region corresponding to a target local maximum point;

[0099] An analysis unit, used for performing edge pixel analysis on a target gradient pixel area and a horizontal area to be measured;

[0100] A fifth determining unit, configured to determine a set of overlapping edge pixels when the edge pixel analysis result shows that the target gradient pixel area and the horizontal area to be measured have edge overlap;

[0101] An amplification unit, used for amplifying and assigning values ​​to the horizontal area to be measured according to the number of pixels and the positions of the pixels in the edge pixel set;

[0102] The processing unit is used to determine the target gradient pixel area, analyze the edge pixels, determine the edge pixel set and perform amplification and value assignment on the remaining horizontal area and vertical area.

[0103] Optionally, after the first generating unit and before the second generating unit, the positioning device further includes:

[0104] A sixth determining unit, used to determine the ROI area of ​​the display screen image;

[0105] A first calculation unit is used to calculate the area width and area height of the ROI area;

[0106] The second calculation unit is used to calculate the horizontal distance and the vertical distance between the pixel clusters according to the area width and the area height and the physical resolution of the display screen.

[0107] Optionally, after the second recording unit and before the input unit, the positioning device further includes:

[0108] A fourth generating unit, used for generating a marker image according to the physical resolution of the display screen, wherein each local maximum point in the maximum value image has a corresponding coordinate position on the marker image;

[0109] The third recording unit is used to record each searched reference point at the recording point coordinate position on the mark image. The recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image.

[0110] The third aspect of the present application provides a defect classification device based on a micro display device, comprising:

[0111] Processor, memory, input-output unit, and bus;

[0112] The processor is connected to the memory, the input and output unit, and the bus;

[0113] The memory stores a program, and the processor calls the program to execute the first aspect and any optional positioning method of the first aspect.

[0114] A fourth aspect of the present application provides a computer-readable storage medium, on which a program is stored. When the program is executed on a computer, the program executes the first aspect and any optional positioning method of the first aspect.

[0115] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0116] In the present application, first, the target pixel corresponding to one of the three RGB colors in the display screen is lit, and the camera collects the target pixel on the display screen to generate a display screen image. There are pixel clusters formed by the target pixel on the display screen image, and the arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixel of the display screen. There are different types of pixels on the display screen, and the arrangement types of different pixels are different, which can accurately detect different types of pixels. Determine the local maximum point corresponding to each pixel cluster on the display screen image and generate a maximum image. According to the arrangement type, the horizontal distance and vertical distance between the adjacent pixel clusters of the display screen image, the positioning template matrix is ​​generated. The positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1. The central area, the horizontal area and the vertical area are mainly used to detect the position of the pixel cluster on the maximum image. A two-channel image is generated according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image. The size of the two-channel image is larger than the maximum image. Select a local maximum point in the maximum image as a reference point and put it into the reference point queue, and record the coordinate information of the reference point to the reference coordinate position of the two-channel image. Use the reference point as the starting point of the detection, align the central area of ​​the positioning template matrix to the reference point of the maximum image, and determine the target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image. That is, detect the pixel cluster around the reference point. Record the coordinate information of the target local maximum point set to the corresponding coordinate position of the two-channel image. Set the target local maximum point set as the reference point and input it into the reference point queue. Then set the target local maximum point set as the reference point and input it into the reference point queue. Align the positioning template matrix, search for the target local maximum point, and record the coordinate information of the two-channel image for the reference point in the reference point queue until there is no reference point in the reference point queue. Mark the coordinate information on the two-channel image to the pixel cluster of the target sub-pixel of the display screen image.

[0117] The positioning template matrix is ​​designed according to the arrangement of the target pixels and the physical resolution of the display screen, and then a two-channel image for recording the coordinates is generated according to the physical resolution of the display screen. Only one reference point needs to be determined in the maximum image to locate according to the central area of ​​the positioning template matrix, and then the pixels are retrieved through the four areas of the positioning template matrix. Because the area of ​​the positioning template matrix is ​​set according to the arrangement of the target pixels, only one reference point needs to be determined to continuously detect the local maximum values, and then the local maximum value is determined as the next reference point. The positioning template matrix is ​​used for repeated detection to locate the coordinate positions of all pixel groups on the display screen image. Only one display screen image and one reference point are needed, and no additional positioning map is required to complete the full-image positioning, thereby improving the efficiency of De-Mura compensation of the display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0118] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0119] Figure 1 A schematic diagram of an embodiment of a method for locating a bright group of a sub-pixel on a display screen of the present application;

[0120] Figure 2 A schematic diagram of an embodiment of a method for generating a positioning template matrix based on non-interlaced pixel arrangement of the present application;

[0121] Figure 3 A schematic diagram of an embodiment of a method for generating a positioning template matrix based on staggered pixel arrangement according to the present application;

[0122] Figure 4 A schematic diagram of an embodiment of a method for assigning values ​​to points around a horizontal point and a vertical point in the present application;

[0123] Figure 5 A schematic diagram of an embodiment of the amplification method of the positioning template matrix of the present application;

[0124] Figure 6 A schematic diagram of an embodiment of a method for calculating horizontal distances and vertical distances between pixel groups of the present application;

[0125] Figure 7 A schematic diagram of an embodiment of a method for using a marked image in the present application;

[0126] Figure 8A schematic diagram of an embodiment of a positioning device for a sub-pixel bright group of a display screen of the present application;

[0127] Fig. 9 A schematic diagram of another embodiment of a positioning device for a sub-pixel bright group of a display screen of the present application;

[0128] Fig.10 A schematic diagram of a display screen image without staggered pixel arrangement of the present application;

[0129] Fig.11 A schematic diagram of a maximum value image without staggered pixel arrangement in the present application;

[0130] Fig.12 A schematic diagram of a positioning template matrix without staggered pixel arrangement in the present application;

[0131] Fig.13 A local image of a two-channel image of this application;

[0132] Fig.14 A schematic diagram of marking the positions of each pixel group on a calibration template for this application;

[0133] Fig.15 A schematic diagram of a display screen image with staggered pixel arrangement according to the present application;

[0134] Fig.16 A schematic diagram of a maximum value image with staggered pixel arrangement in the present application;

[0135] Fig.17 A schematic diagram of the positional relationship of pixel clusters with staggered pixel arrangement in the present application;

[0136] Fig.18 A schematic diagram of an upper convex dot positioning template matrix with staggered pixel arrangement in the present application;

[0137] Fig.19 A schematic diagram of a recessed point positioning template matrix with staggered pixel arrangement in the present application;

[0138] Fig. 20 A schematic diagram of marking the positions of each pixel group on a calibration template for this application;

[0139] Fig.21 A schematic diagram of a display screen image without staggered pixel arrangement according to the present application. DETAILED DESCRIPTION

[0140] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0141] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0142] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0143] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0144] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0145] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0146] In the field of OLED display manufacturing, the quality of De-Mura depends on the accurate extraction of sub-pixel brightness, and the extraction of sub-pixels depends on the positioning of sub-pixels. Since the sub-pixels of OLED displays are closely arranged one by one, and OLED displays may have problems such as panel irregularities and missing sub-pixels, the positioning of sub-pixels is somewhat difficult. Among similar technologies currently available, the positioning of panel sub-pixels mostly requires the use of a large number of positioning patterns to position the sub-pixels of OLED displays. With the continuous increase in the application fields of display screens, the morphological structure of display screens is also undergoing many changes. For example, curved screens, spliced ​​screens, VR screens, and AR screens all have different structures from ordinary flat panel displays. More additional positioning patterns are required in the positioning of sub-pixels, which increases the amount of calculation for sub-pixel positioning and reduces the efficiency of the De-Mura compensation process.

[0147] Based on this, the present application discloses a method, device and storage medium for positioning bright clusters of sub-pixels of a display screen, which are used to improve the efficiency of De-Mura compensation of the display screen.

[0148] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0149] The method of the present application can be applied to a server, a device, a terminal or other devices with logic processing capabilities, and the present application does not limit this. For the convenience of description, the following description is made by taking the execution subject as an example of a terminal.

[0150] See also Figure 1 The present application provides an embodiment of a method for locating a bright group of a sub-pixel of a display screen, comprising:

[0151] 101. Light up a target pixel corresponding to one of the three colors of RGB on the display screen, collect the target pixel on the display screen with a camera, generate a display screen image, and a pixel cluster formed by the target pixel on the display screen image. The arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixels on the display screen;

[0152] In this embodiment, the target pixels to be detected on the display screen are first determined. There are three color pixels of R, G, and B on the display screen, and their numbers may be inconsistent. However, the resolution of the display screen is consistent, but the resolution of each color is inconsistent, so the pixel density may be inconsistent.

[0153] There are two main situations for lighting up the pixels of the display screen. One is the arrangement of odd and even columns (rows) with invalid errors. Based on this arrangement, the four adjacent groups of pixels are in the four directions of the image. For the way of staggered arrangement of pixels in odd and even columns (rows), there are two possible positions of the four adjacent pixel groups in the upper, lower, left and right directions.

[0154] For example: in a display screen image captured by the RGB pixels of a display screen, the G pixels are twice as many, so the G pixels are arranged very neatly, while the RB are arranged in an interlaced manner. Therefore, the G color pixel arrangement here is non-interlaced. The image of the G color screen of the panel captured by the camera is an image of non-interlaced pixel arrangement, whereas the R and B pixels are an image of interlaced arrangement.

[0155] The display screen image (Pattern original image) in this embodiment corresponds one-to-one to the RGB pixels of the panel, but different display screen images need to be generated for each RGB color and its arrangement. If all G pixels need to be lit up, the grayscale value of the G pixel corresponding to the display screen image is set to a valid grayscale value, and the grayscale of the pixel corresponding to RB is set to 0.

[0156] 102. Determine the local maximum point corresponding to each pixel group on the display screen image, and generate a maximum value image;

[0157] In this embodiment, the terminal determines the local maximum point corresponding to each pixel cluster on the display screen image to generate a maximum value image. Specifically, a threshold processing method is used. After the threshold processing, the local maximum point corresponding to each pixel cluster is determined (only the point with the largest central gray value is retained) to obtain a maximum value image. ,exist The pixel value at the maximum is the same as the pixel value at the same position on the original image (display screen image), and the non-local maximum point is zero.

[0158] 103. Generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image, wherein the positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1;

[0159] In this embodiment, the terminal generates a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image. The specific horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image are fixed, so the positioning template matrix of the corresponding size can be designed with reference to the horizontal distance and the vertical distance, and a central area, a horizontal area and a vertical area are set in the positioning template matrix, and the parts of these areas copied as 1 are used as the retrieval position.

[0160] 104. Generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image;

[0161] The terminal generates a two-channel image based on the physical resolution of the display , maximum image Each local maximum point has a corresponding coordinate position on the two-channel image.

[0162] Specifically, the two-channel image is used to record the coordinate position information of the local maximum point of the pixel cluster. The resolution of the two-channel image is (Width+100)*(Height+100), where Width and Height are the physical resolutions of the display screen.

[0163] 105. Select a local maximum point in the maximum value image as a reference point and put it into the reference point queue, and record the coordinate information of the reference point to the reference coordinate position of the two-channel image;

[0164] The terminal selects a local maximum point from the maximum value image as a reference point, puts it into the reference point queue first, and then records the coordinate information of the reference point to the reference coordinate position of the two-channel image.

[0165] In the maximum value image (local maximum point image) Find the first local maximum point P (X, Y) regardless of the center, and record the coordinates of point P into the two-channel image A (((X-X0) / RoiX)*Width, ((Y-Y0) / RoiY)*Height) position, where X0 and Y0 are the starting coordinates (X0, Y0) in the ROI area of ​​the display image, RoiX and RoiY are the width and height of the display image, and Width and Height are the physical resolution of the display.

[0166] 106. Align the central area of ​​the positioning template matrix to the reference point of the maximum image, and determine a target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image;

[0167] 107. Record the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0168] 108. Set the target local maximum point set as the reference point and input it into the reference point queue;

[0169] 109. Performing alignment of the positioning template matrix, target local maximum point search, and coordinate information recording of the two-channel images for the reference points in the reference point queue until there are no reference points in the reference point queue;

[0170] The terminal aligns the central area of ​​the positioning template matrix to the reference point of the maximum image, and determines the target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image. Then the coordinate information of the target local maximum point set is recorded to the corresponding coordinate position of the two-channel image, and then the terminal sets the target local maximum point set as the reference point and inputs it into the reference point queue.

[0171] Specifically, the terminal aligns the 1 in the center area of ​​the positioning template matrix to Point P is located in the horizontal and vertical areas of the template matrix, and four local maximum points above, below, left and right of point P are found. The coordinates of the four corresponding extreme points are recorded at the upper, lower, left and right positions adjacent to point A. The coordinates of the newly found extreme points are placed in the reference point queue, and then the reference points in the queue are taken out one by one. Align the positioning template matrix in the middle, and search for the adjacent local extreme point positions of the four extreme points in the upper, lower, left and right directions in turn (if a point has a non-zero adjacent position on the marker map, it does not need to be searched; if a point has no extreme point in a certain orientation, it does not need to be used as a new reference point), and so on, until all the reference points in the reference queue have found their adjacent local maximum points.

[0172] 110. Mark the coordinate information on the two-channel image onto the pixel cluster of the target sub-pixel of the display screen image.

[0173] Finally, the terminal marks the coordinate information on the two-channel image to the pixel group of the display screen image to complete the positioning. Specifically, the terminal clips the two-channel image By removing the extra rows and columns in the image, we can get the coordinate positions of Width*Height pixel clusters on the display screen image. By marking the positions of each pixel cluster on the display screen image, we can verify the accuracy of the cluster positioning.

[0174] In this embodiment, first, the target pixel corresponding to one of the three RGB colors in the display screen is lit, and the camera collects the target pixel on the display screen to generate a display screen image. There are pixel clusters formed by the target pixel on the display screen image, and the arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixel of the display screen. There are different types of pixels on the display screen, and the arrangement types of different pixels are different, so different types of pixels can be accurately detected. The local maximum point corresponding to each pixel cluster on the display screen image is determined to generate a maximum value image. According to the arrangement type, the horizontal distance and the vertical distance between the adjacent pixel clusters of the display screen image, the positioning template matrix is ​​generated. The positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1. The central area, the horizontal area and the vertical area are mainly used to detect the position of the pixel cluster on the maximum value image. A two-channel image is generated according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum value image has a corresponding coordinate position on the two-channel image. The size of the two-channel image is larger than the maximum value image. Select a local maximum point in the maximum image as a reference point and put it into the reference point queue, and record the coordinate information of the reference point to the reference coordinate position of the two-channel image. Use the reference point as the starting point of the detection, align the central area of ​​the positioning template matrix to the reference point of the maximum image, and determine the target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image. That is, detect the pixel cluster around the reference point. Record the coordinate information of the target local maximum point set to the corresponding coordinate position of the two-channel image. Set the target local maximum point set as the reference point and input it into the reference point queue. Then set the target local maximum point set as the reference point and input it into the reference point queue. Align the positioning template matrix, search for the target local maximum point, and record the coordinate information of the two-channel image for the reference point in the reference point queue until there is no reference point in the reference point queue. Mark the coordinate information on the two-channel image to the pixel cluster of the target sub-pixel of the display screen image.

[0175] The positioning template matrix is ​​designed according to the arrangement of the target pixels and the physical resolution of the display screen, and then a two-channel image for recording the coordinates is generated according to the physical resolution of the display screen. Only one reference point needs to be determined in the maximum image to locate according to the central area of ​​the positioning template matrix, and then the pixels are retrieved through the four areas of the positioning template matrix. Because the area of ​​the positioning template matrix is ​​set according to the arrangement of the target pixels, only one reference point needs to be determined to continuously detect the local maximum values, and then the local maximum value is determined as the next reference point. The positioning template matrix is ​​used for repeated detection to locate the coordinate positions of all pixel groups on the display screen image. Only one display screen image and one reference point are needed, and no additional positioning map is required to complete the full-image positioning, thereby improving the efficiency of De-Mura compensation of the display screen.

[0176] See also Figure 2 The present application provides an embodiment of a method for generating a positioning template matrix based on non-interlaced pixel arrangement, comprising:

[0177] 201. When the arrangement type is non-interlaced pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel groups of the display screen image, and OffsetY is the vertical distance between adjacent pixel groups of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0178] 202. Generate an initial matrix of corresponding size according to the matrix width and the matrix height;

[0179] 203. Assign a value of 1 to the center point of the center area of ​​the initial matrix, where the center area is an area with a size of at least 1*1;

[0180] 204. Assign a value of 1 to the points at the horizontal OffsetX distance on the left and right sides of the initial matrix, and generate two horizontal points;

[0181] 205. Assign a value of 1 to the points at the vertical distance OffsetY above and below the initial matrix, and generate two vertical points;

[0182] 206. Assign values ​​to points around the horizontal point and the vertical point according to the defect type of the target display screen, assign the value to 1, and generate a horizontal area and a vertical area;

[0183] 207. Assign values ​​to the remaining positions of the initial matrix, which are 0.

[0184] Please refer to Fig.10 , Fig.10It is a schematic diagram of a display screen image with non-interlaced pixel arrangement. A picture with non-interlaced pixel arrangement is input into the target display screen, and corresponding pixel points of a type are lit up, and subsequent acquisition is performed to generate a display screen image with non-interlaced pixel arrangement.

[0185] Please refer to Fig.11 , Fig.11 Schematic diagram of a maximum image without interlaced pixel arrangement.

[0186] Please refer to Fig.12 , Fig.12 A schematic diagram of a positioning template matrix without staggered pixel arrangement.

[0187] Please refer to Fig.13 , Fig.13 is a local image of a two-channel image.

[0188] Please refer to Fig.14 , Fig.14 Schematic diagram of marking the positions of each pixel group on the calibration template.

[0189] In this embodiment, when the arrangement type is a non-interlaced pixel arrangement, it is necessary to calculate a positioning template matrix according to the horizontal distance and the vertical distance.

[0190] For example, a positioning template matrix is ​​generated. The positioning template matrix is ​​a pixel matrix with a width of 2*OffsetX+3 and a height of 2*OffsetY+3, respectively. The center area is 1*1, the center value of the center area is 1, the values ​​of the horizontal left and right OffsetX distances of the matrix are set to 1, and the values ​​of the horizontal upper and lower OffsetY distances are set to 1. Considering factors such as defect distortion that may cause the position of the pixel cluster to change, multiple positions around the horizontal points and vertical points in the four directions are expanded to 1 to form vertical and horizontal areas, and finally form a positioning template matrix.

[0191] The above-mentioned method for generating a positioning template matrix based on a non-interlaced pixel arrangement can generate a positioning template matrix that conforms to the non-interlaced pixel arrangement, and the positioning template matrix can improve the accuracy of subsequent pixel group positioning.

[0192] See also Figure 3 The present application provides an embodiment of a method for generating a positioning template matrix based on staggered pixel arrangement, comprising:

[0193] 301. When the arrangement type is staggered pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel groups of the display screen image, and OffsetY is the vertical distance between adjacent pixel groups of the display screen image. M and N are integers greater than 0, and both the matrix width and the matrix height are odd numbers.

[0194] 302. Generate two initial matrices of corresponding sizes according to the matrix width and the matrix height;

[0195] 303. Assign the center value of the central area of ​​the two initial matrices to 1, where the central area is an area with a size of at least 1*1;

[0196] 304. Assign a value of 1 to the points at the vertical distance OffsetY between the two initial matrices, thereby generating two vertical regions.

[0197] 305. Assign a value of 1 to the point at a distance of OffsetX / 2 to the left and right horizontally and a distance of OffsetY / 2 to the top vertically of the first initial matrix, to generate two horizontal points;

[0198] 306. Assign a value of 1 to the point at a distance of OffsetX / 2 to the left and right horizontally and a distance of OffsetY / 2 to the bottom vertically of the second initial matrix, to generate two vertical points;

[0199] 307. Assign values ​​to points around the horizontal point and the vertical point according to the defect type of the target display screen, assign the value to 1, and generate a horizontal area and a vertical area;

[0200] 308. Assign values ​​to the remaining positions of the initial matrix as 0.

[0201] Please refer to Fig.15 , Fig.15 It is a schematic diagram of a display screen image with staggered pixel arrangement. The display screen image with staggered pixel arrangement is input into the target display screen, and subsequent acquisition is performed to generate the display screen image with staggered pixel arrangement.

[0202] Please refer to Fig.16 , Fig.16 Schematic diagram of a maximum image with staggered pixel arrangement.

[0203] Please refer to Fig.17 , Fig.17 Schematic diagram of the positional relationship of pixel clusters with staggered pixel arrangement.

[0204] Please refer to Fig.18 , Fig.18A schematic diagram of an upper bump positioning template matrix with staggered pixel arrangement.

[0205] Please refer to Fig.19 , Fig.19 Schematic diagram of a concave dot positioning template matrix with staggered pixel arrangement.

[0206] Please refer to Fig. 20 , Fig. 20 Schematic diagram of marking the positions of each pixel group on the calibration template.

[0207] In this embodiment, when the arrangement type is staggered pixel arrangement, it is necessary to calculate the positioning template matrix according to the horizontal distance and the vertical distance.

[0208] Because of the odd-even staggered pixel arrangement, the pixels in each row are staggered up and down. Analysis shows that there are two positional relationships between the pixel clusters adjacent to the current pixel cluster. One is that if the column where the current pixel cluster is located is convex, the positions of the two adjacent pixel clusters on the left and right are at the upper left and upper right positions. If the column where the current pixel cluster is located is concave, the positions of the two adjacent pixel clusters on the left and right are at the lower left and lower right positions. Based on these two relative positional relationships, two positioning templates need to be generated. For example: the positioning template matrix is ​​2*OffsetX+1 and 2*OffsetY+1 in width and height respectively, the center value of the matrix is ​​1, the value of the horizontal upper and lower OffsetY is 1, and the marks of the left and right positions are at the lower left [-OffsetX / 2,OffsetY / 2] and lower right [OffsetX / 2,OffsetY / 2] or the upper left [-OffsetX / 2,-OffsetY / 2] and upper right [OffsetX / 2,-OffsetY / 2].

[0209] Taking into account factors such as defect distortion that may cause the position of pixel clusters to change, multiple positions around the horizontal and vertical points in the four directions are expanded to 1 to form vertical and horizontal areas, and finally form a positioning template matrix.

[0210] The above-mentioned method for generating a positioning template matrix based on staggered pixel arrangement can generate a positioning template matrix that conforms to staggered pixel arrangement, and the positioning template matrix can improve the accuracy of subsequent pixel group positioning.

[0211] There is no staggered pixel arrangement. When using dual templates, the image is at the local maximum point. Find the first local maximum point P (X, Y) in the central area of ​​​​the image and record the coordinates of point P in the image A (((X-X0) / RoiX)*Width, ((Y-Y0) / RoiY)*Height) position. And put point A (((X-X0) / RoiX)*Width, ((Y-Y0) / RoiY)*Height) into the queue as the reference point, and then use the upper convex point template matrix to search up and down for all local maximum points in the column where the reference point is located and the left and right adjacent columns. If Height local maximum points can be found in all three columns, the column where the current reference point is located is the upper convex column. If the lower convex point template matrix is ​​used to search up and down for all local maximum points in the column where the reference point is located and the left and right adjacent columns, if Height local maximum points can be found in all three columns, the current column is the concave column. In the next cyclic search process, the column with an even difference with the reference column has the same template matrix used for the column, and the column with an odd difference selects another template matrix.

[0212] Then align the center of the positioning template matrix to the local maximum point image Point P, find the four maximum points above, below, left and right of point P, and add them in the figure The coordinates of the corresponding extreme points are recorded in the upper, lower, left and right positions adjacent to A, and the coordinates of the newly searched extreme points are placed in the queue. Then, the reference points in the queue are taken out one by one to determine whether the same template matrix is ​​used as the reference column. Align the positioning template matrix in the middle, and search for the adjacent extreme point positions of the four extreme points in turn (if a point has a non-zero adjacent position on the marker map, there is no need to search; if a point has no extreme point in a certain direction, it is not used as a new reference point), and so on, until all the reference points in the queue have found the maximum points of their neighbors.

[0213] See also Figure 4 The present application provides an embodiment of a method for assigning values ​​of points around a horizontal point and a vertical point, including:

[0214] 401. Obtain the number and arrangement of the target pixels on the display screen;

[0215] 402. Generate an initial pixel group template according to the number and arrangement of pixels;

[0216] In this embodiment, firstly Figure 2 and Figure 3The embodiment shown generates horizontal and vertical points. Next, it is necessary to consider the effect of defects on the display range of the pixel position. At this time, it is necessary to consider the number and arrangement of pixels in the pixel cluster on the pixel point. These two data are standard and are not affected by defects. The terminal generates an initial pixel cluster template based on the number and arrangement of pixels, and a standard initial pixel cluster template can be generated. For example: If the number of pixels is 9 and the arrangement is a 3*3 rectangular array, the generated initial pixel cluster template is also a rectangular array with 9 pixels and an arrangement of 3*3.

[0217] Generally, the initial pixel group template designed must have a unique center position to facilitate subsequent alignment and point search.

[0218] 403. Determine a distortion direction of the initial pixel group template according to a defect extension mode of a defect type of the target display screen;

[0219] 404. Determine the degree of distortion amplification of the initial pixel cluster template according to the number of pixels, arrangement mode, and defect influence range of the defect type;

[0220] 405. Expand the initial pixel cluster template according to the distortion direction and the distortion amplification degree to generate a target pixel cluster template;

[0221] The defects that may occur on the target display screen of the terminal tool predict the position offset or range change of the initial pixel group template. It is specifically reflected in the distortion direction and the degree of distortion amplification. For example: Defect A can cause a portion of the pixel to protrude in the vertical direction. The vertical direction is the "distortion direction", and the "protruding portion" will be amplified according to the normal growth ratio of the defect. Assuming that the initial pixel group template also has 9 pixels and is arranged in a 3*3 rectangular array, the distortion direction of defect A is vertically upward, and it is calculated that the distortion amplification accounts for approximately 30% of the original pixel points, then the three points above the three points on the initial pixel group template are selected to supplement and form a 3*4 target pixel group template.

[0222] In this embodiment, only the enlarged defects are considered, and the reduced defects are not considered, because the position of the local maximum point of the enlarged defect may change, but the position of the local maximum point of the reduced defect is still within the original area.

[0223] 406. Align the center point of the target pixel group template with the horizontal point and the vertical point, assign a value of 1 to the point located in the target pixel group template, and generate a horizontal area and a vertical area.

[0224] Finally, the terminal aligns the center point of the target pixel group template with the horizontal and vertical points, assigns a value of 1 to the points located in the target pixel group template, and generates a horizontal area and a vertical area. For example: the center position of the 3*4 target pixel group template is still the original 3*3 center point. Use this target pixel group template to align the center point with the horizontal and vertical points, set the positions covered by the target pixel group template to be within the range of the horizontal area or the vertical area, and assign a value of 1.

[0225] In this embodiment, an initial pixel cluster template is set up and the initial pixel cluster template is amplified by the defects to be tested or possible defects of the target display screen, in order to increase the range of the horizontal area and the vertical area accordingly, so that even if a defect occurs on the target display screen, the local maximum point will be retrieved by the point position in the horizontal area or the vertical area, and there will be no missed detection, thereby improving the detection accuracy.

[0226] See also Figure 5 The present application provides an embodiment of a method for amplifying a positioning template matrix, comprising:

[0227] 501. Determine a horizontal area to be measured from two horizontal areas, and determine a target local maximum point of the horizontal area to be measured;

[0228] 502. Determine at least one gradient pixel point region on the display screen image and located in the horizontal region to be tested, where the gradient pixel point region is a set of pixels having a pixel cluster grayscale except for the target local maximum point;

[0229] 503. Determine a target gradient pixel point region corresponding to a target local maximum point;

[0230] In this embodiment, due to the large number of defect types, it is impossible to expand the horizontal area and the vertical area for most defects, and the size of the horizontal area and the vertical area may still be insufficient.

[0231] In this embodiment, a method for real-time amplification of a positioning template matrix is ​​created. First, a horizontal region to be tested is determined, and a target local maximum point in the horizontal region to be tested is determined.

[0232] Next, the terminal first aligns the center of the positioning template matrix with the reference point marked on the display screen image, determines the pixel area covered by the horizontal area to be tested in the display screen image, and finds that there are two situations in the pixel area.

[0233] One is that there is one pixel cluster in the pixel area, and the other is that there are multiple pixel clusters (a target pixel cluster and the edge area of ​​other pixel clusters). At this time, the terminal needs to determine the pixel cluster with the largest proportion in the pixel area and set its area as the target gradient pixel point area (excluding the target local maximum point).

[0234] It should be noted that the pixel area and the target gradient pixel area are not included in the relationship, but are intersected. This embodiment is mainly aimed at this situation. Figure 4 After the defect amplification of the embodiment, new defects still appear, causing the pixel cluster corresponding to the local maximum point of the target to be more offset. The horizontal area and the vertical area cannot cover the entire pixel cluster, but can only cover the target gradient pixel point area. At this time, real-time amplification is required to prevent new defects from causing the local maximum point to leave the horizontal area and the vertical area.

[0235] 504. Perform edge pixel analysis on the target gradient pixel area and the horizontal area to be measured;

[0236] 505. When the edge pixel point analysis result shows that the target gradient pixel point region and the horizontal region to be measured have edge overlap, determine the overlapped edge pixel point set;

[0237] 506. Amplify and assign values ​​to the horizontal area to be measured according to the number of pixels and positions of the edge pixel set;

[0238] 507. Determine the target gradient pixel area, analyze the edge pixels, determine the edge pixel set, and perform amplification and value assignment on the remaining horizontal area and vertical area.

[0239] The terminal first performs edge pixel point analysis on the target gradient pixel point area and the horizontal area to be tested, that is, checks where the intersecting parts are. For example: the target gradient pixel point area is located above the horizontal area to be tested, and it is only necessary to check the edge point occupancy. The horizontal area to be tested is a 5*5 matrix, and the target gradient pixel point area occupies the middle three of the five points on the upper edge of the 5*5 rectangle. These three points are the overlapping edge pixel point set. The terminal amplifies and assigns values ​​to the horizontal area to be tested according to the number of pixels and pixel positions of the edge pixel point set. The horizontal area to be tested is amplified in real time above these three points, and the positioning template matrix is ​​updated with the updated horizontal area to be tested, so that the corresponding point position of the positioning template matrix is ​​assigned 1. This prevents the local maximum point from being offset too much due to subsequent defects, resulting in detection failure.

[0240] See also Figure 6 The present application provides an embodiment of a method for calculating the horizontal distance and the vertical distance between pixel clusters, including:

[0241] 601. Determine the ROI area of ​​the display screen image;

[0242] 602. Calculate the area width and area height of the ROI area;

[0243] 603. Calculate the horizontal distance and vertical distance between pixel clusters according to the region width, region height and the physical resolution of the display screen.

[0244] In this embodiment, the terminal first determines the ROI area of ​​the display screen image, searches for the ROI area of ​​the OLED display screen, and calculates the starting coordinates of the ROI area as (X0, Y0), as well as the area width and area height, which are RoiX and RoiY respectively. According to the width and height of the ROI area and the resolution of the corresponding physical pixels, the horizontal distance OffsetX and the vertical distance OffsetY of adjacent pixel groups are calculated.

[0245] See also Figure 7 The present application provides an embodiment of a method for using a marked image, including:

[0246] 701. Generate a marker image according to the physical resolution of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the marker image;

[0247] 702. Each reference point that has been searched is recorded at the coordinate position of the recording point on the mark image. The recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image.

[0248] Please refer to Fig.21 , Fig.21 It is the effective area morphological image of the two-channel image and the marked image after the search.

[0249] In this embodiment, the terminal generates a marker image according to the physical resolution of the display screen. Each local maximum point in the maximum value image has a corresponding coordinate position on the marker image. Each reference point that has been searched is recorded at the coordinate position of the recorded point on the marker image. The recorded marker image is also used to cut the two-channel image to remove the redundant rows and columns in the two-channel image. Create a marker image with a resolution of (Width+100)*(Height+100) for marking the local maximum points that have been searched. .

[0250] Specifically, the method of using the marked image is shown in the following example: At the local maximum point image Find the first local maximum point P (X, Y) in the central area of ​​​​the image and record the coordinates of point P in the image A (((X-X0) / RoiX)*Width, ((Y-Y0) / RoiY)*Height) position. At the same time, mark the image The corresponding position is marked as 1, and point A (((X-X0) / RoiX)*Width, ((Y-Y0) / RoiY)*Height) is put into the queue as the reference point.

[0251] See also Figure 8 The present application provides an embodiment of a positioning device for a sub-pixel bright group of a display screen, comprising:

[0252] The acquisition unit 801 is used to light up the target pixel corresponding to one of the three colors of RGB in the display screen. The camera acquires the target pixel on the display screen to generate a display screen image. There are pixel clusters formed by the target pixel on the display screen image. The arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixels of the display screen;

[0253] The first generating unit 802 is used to determine the local maximum point corresponding to each pixel group on the display screen image and generate a maximum value image;

[0254] The sixth determining unit 803 is used to determine the ROI area of ​​the display screen image;

[0255] A first calculation unit 804 is used to calculate the area width and area height of the ROI area;

[0256] A second calculation unit 805 is used to calculate the horizontal distance and the vertical distance between the pixel clusters according to the area width and the area height and the physical resolution of the display screen;

[0257] A second generating unit 806 is used to generate a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel groups of the display screen image, wherein the positioning template matrix includes a central area, two horizontal areas and two vertical areas, and the values ​​of the central area, the horizontal area and the vertical area are all 1;

[0258] Optionally, the arrangement type is non-interlaced pixel arrangement;

[0259] The second generating unit 806 includes:

[0260] When the arrangement type is non-interlaced pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel clusters of the display screen image, and OffsetY is the vertical distance between adjacent pixel clusters of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0261] Generate an initial matrix of corresponding size according to the matrix width and matrix height;

[0262] Assign the center point of the central area of ​​the initial matrix a value of 1, and the central area is an area with a size of at least 1*1;

[0263] Assign the value of 1 to the points at the horizontal OffsetX distance on the left and right sides of the initial matrix to generate two horizontal points;

[0264] Assign the value of 1 to the points at the vertical OffsetY distance above and below the initial matrix to generate two vertical points;

[0265] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0266] Assign the remaining positions of the initial matrix to 0.

[0267] Optionally, the arrangement type is staggered pixel arrangement;

[0268] The second generating unit 806 includes:

[0269] When the arrangement type is staggered pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel groups of the display screen image, and OffsetY is the vertical distance between adjacent pixel groups of the display screen image. M and N are integers greater than 0, and the matrix width and matrix height are both odd numbers;

[0270] Generate two initial matrices of corresponding sizes according to the matrix width and matrix height;

[0271] Assign the center of the central area of ​​the two initial matrices to 1, and the central area is an area with a size of at least 1*1;

[0272] Assign the points at the vertical OffsetY distance of the two initial matrices to 1 to generate two vertical areas;

[0273] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the top of the first initial matrix to generate two horizontal points;

[0274] Assign the value of 1 to the point at the horizontal OffsetX / 2 distance to the left and right and the vertical OffsetY / 2 distance to the bottom of the second initial matrix to generate two vertical points;

[0275] According to the defect type of the target display screen, the points around the horizontal point and the vertical point are assigned a value of 1 to generate a horizontal area and a vertical area;

[0276] Assign the remaining positions of the initial matrix to 0.

[0277] Optionally, the points around the horizontal point and the vertical point are assigned a value of 1 according to the defect type of the target display screen, and the horizontal area and the vertical area are generated, including:

[0278] Get the number and arrangement of target pixels on the display screen;

[0279] Generate an initial pixel group template according to the number and arrangement of pixels;

[0280] Determine the distortion direction of the initial pixel group template according to the defect extension mode of the defect type of the target display screen;

[0281] Determine the degree of distortion amplification of the initial pixel cluster template according to the number of pixels, arrangement mode and defect influence range of the defect type;

[0282] The initial pixel cluster template is expanded according to the distortion direction and the distortion amplification degree to generate a target pixel cluster template;

[0283] Align the center point of the target pixel group template with the horizontal and vertical points, assign a value of 1 to the point located in the target pixel group template, and generate a horizontal area and a vertical area.

[0284] The third generating unit 807 is used to generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, and each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image;

[0285] A first recording unit 808 is used to select a local maximum point in the maximum value image as a reference point and put it into a reference point queue, and record the coordinate information of the reference point to the reference coordinate position of the two-channel image;

[0286] A first determining unit 809 is used to align the central area of ​​the positioning template matrix to the reference point of the maximum image, and determine a target local maximum point set corresponding to two horizontal areas and two vertical areas on the maximum image;

[0287] The second recording unit 810 is used to record the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0288] The fourth generating unit 811 is used to generate a marker image according to the physical resolution of the display screen, and each local maximum point in the maximum value image has a corresponding coordinate position on the marker image;

[0289] The third recording unit 812 is used to record each searched reference point at the recording point coordinate position on the mark image. The recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image.

[0290] A second determining unit 813 is used to determine a horizontal area to be measured from the two horizontal areas, and determine a target local maximum point of the horizontal area to be measured;

[0291] The third determining unit 814 is used to determine at least one gradient pixel point region on the display screen image and located in the horizontal region to be measured, where the gradient pixel point region is a set of pixels having a pixel cluster grayscale except for the target local maximum point;

[0292] A fourth determining unit 815 is used to determine a target gradient pixel point region corresponding to a target local maximum point;

[0293] An analysis unit 816, configured to perform edge pixel analysis on the target gradient pixel area and the horizontal area to be measured;

[0294] A fifth determining unit 817, configured to determine a set of overlapping edge pixels when the edge pixel analysis result shows that the target gradient pixel area and the horizontal area to be measured have edge overlap;

[0295] An amplification unit 818, configured to amplify and assign values ​​to the horizontal area to be measured according to the number of pixels and the positions of the pixels in the edge pixel set;

[0296] The processing unit 819 is used to determine the target gradient pixel area, analyze the edge pixels, determine the edge pixel set and perform amplification and value assignment on the remaining horizontal area and vertical area;

[0297] An input unit 820, used to record the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images;

[0298] A search unit 821 is used to perform alignment of the positioning template matrix, target local maximum point search, and coordinate information recording of the two-channel images for the reference points in the reference point queue until there are no reference points in the reference point queue;

[0299] The marking unit 822 is used to mark the coordinate information on the two-channel image to the pixel group of the target sub-pixel of the display screen image.

[0300] See also Fig. 9 , the present application provides a defect classification device based on a micro display device, comprising:

[0301] Processor 901 , memory 902 , input-output unit 903 , and bus 904 .

[0302] The processor 901 is connected to the memory 902 , the input and output unit 903 , and the bus 904 .

[0303] The memory 902 stores a program, and the processor 901 calls the program to execute the following steps: Figure 1 , Figure 2 and Figure 3 , Figure 4 , Figure 5 , Figure 6 and Figure 7 The positioning method in .

[0304] The present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed on a computer, the program performs the following steps: Figure 1 , Figure 2 and Figure 3 , Figure 4 , Figure 5 , Figure 6 and Figure 7 The positioning method in .

[0305] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0306] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0307] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0308] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0309] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), disk or optical disk and other media that can store program code.

Claims

1. A method for locating bright clusters of sub-pixels on a display screen, characterized in that: include: Lighting up a target pixel corresponding to one of the three RGB colors on the display screen, capturing the target pixel on the display screen with a camera to generate a display screen image. The display screen image includes a pixel cluster formed by the target pixel, and the arrangement information of the pixel cluster on the display screen image is determined by the arrangement type of the target sub-pixels on the display screen; Determine the local maximum point corresponding to each pixel cluster on the display screen image to generate a maximum image; Generate a positioning template matrix according to the arrangement type and the horizontal and vertical distances between adjacent pixel clusters of the display screen image, wherein the positioning template matrix includes a central area, two horizontal areas, and two vertical areas, and the point positions of the central area, the horizontal areas, and the vertical areas are all assigned values ​​of 1; Generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, wherein each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image; Selecting a local maximum point in the maximum value image as a reference point and placing it in a reference point queue, and recording the coordinate information of the reference point to the reference coordinate position of the two-channel image; Aligning the central area of ​​the positioning template matrix to the reference point of the maximum image, and determining a target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image; Recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel images; generating a marker image according to the physical resolution of the display screen, wherein each local maximum point in the maximum image has a corresponding coordinate position on the marker image; Recording each searched reference point at a recording point coordinate position on the mark image, wherein the recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image; Setting the target local maximum point set as reference points and inputting it into a reference point queue; Performing alignment of the positioning template matrix, target local maximum point search, and coordinate information recording of the two-channel images for the reference points in the reference point queue until there are no reference points in the reference point queue; The coordinate information on the two-channel image is marked on a pixel group of a target sub-pixel of the display screen image.

2. The positioning method according to claim 1, wherein: The arrangement type is a non-staggered pixel arrangement; Generating a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image, including: When the arrangement type is non-interlaced pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel clusters of the display screen image, and OffsetY is the vertical distance between adjacent pixel clusters of the display screen image. M and N are integers greater than 0, and both the matrix width and the matrix height are odd numbers. Generate an initial matrix of corresponding size according to the matrix width and the matrix height; Assigning a value of 1 to the center point of the central area of ​​the initial matrix, where the central area is an area of ​​at least 1*1 in size; Assign values ​​of 1 to the left and right points of the initial matrix at a horizontal distance from the center point OffsetX to generate two horizontal points; Assign values ​​of 1 to the two points above and below the center point OffsetY in the vertical direction of the initial matrix to generate two vertical points; Assigning values ​​to points around the horizontal point and the vertical point according to the defect type of the display screen, assigning a value of 1 to generate a horizontal area and a vertical area; The remaining positions of the initial matrix are assigned values ​​of 0.

3. The positioning method according to claim 1, wherein: The arrangement type is a staggered pixel arrangement; Generating a positioning template matrix according to the arrangement type, the horizontal distance and the vertical distance between adjacent pixel clusters of the display screen image, including: When the arrangement type is staggered pixel arrangement, the matrix width of the positioning template matrix is ​​set to 2*OffsetX+M, and the matrix height is set to 2*OffsetY+M, where OffsetX is the horizontal distance between adjacent pixel clusters of the display screen image, and OffsetY is the vertical distance between adjacent pixel clusters of the display screen image. M and N are integers greater than 0, and both the matrix width and the matrix height are odd numbers. Generate two initial matrices of corresponding sizes according to the matrix width and the matrix height; Assigning a value of 1 to the center of a central region of each of the initial matrices, wherein the central region is a region having a size of at least 1*1; Assigning a value of 1 to the points in the upper and lower regions of each of the initial matrices at a vertical distance from the center point OffsetY to generate two vertical points; Assign a value of 1 to the point on the left side of the first initial matrix at OffsetX / 2 from the center point in the horizontal direction and at OffsetY / 2 from the center point in the vertical direction, and assign a value of 1 to the point on the right side of the first initial matrix at OffsetX / 2 from the center point in the horizontal direction and at OffsetY / 2 from the center point in the vertical direction, to generate two horizontal points; Assign a value of 1 to the point of the second initial matrix at OffsetX / 2 on the left side of the center point in the horizontal direction and at OffsetY / 2 on the bottom side of the center point in the vertical direction, and assign a value of 1 to the point of the first initial matrix at OffsetX / 2 on the right side of the center point in the horizontal direction and at OffsetY / 2 on the bottom side of the center point in the vertical direction, to generate two horizontal points; Assigning values ​​to points around the horizontal point and the vertical point according to the defect type of the display screen, assigning a value of 1 to generate a horizontal area and a vertical area; The remaining positions of the initial matrix are assigned values ​​of 0.

4. The positioning method according to any one of claims 2 to 3, characterized in that: Assigning values ​​to points around the horizontal point and the vertical point according to the defect type of the display screen, assigning values ​​of 1, and generating a horizontal area and a vertical area, including: Obtaining the number and arrangement of the target pixels on the display screen; Generate an initial pixel cluster template according to the number and arrangement of the pixel points; determining a distortion direction of the initial pixel cluster template according to a defect extension mode of a defect type of the display screen; Determining the degree of distortion amplification of the initial pixel cluster template according to the number of pixels, the arrangement mode, and the defect impact range of the defect type; Expanding the initial pixel cluster template according to the distortion direction and the distortion amplification degree to generate a target pixel cluster template; The center point of the target pixel group template is aligned with the horizontal point position and the vertical point position, and the point position located in the target pixel group template is assigned a value of 1 to generate a horizontal area and a vertical area.

5. The positioning method according to claim 4, characterized in that: After recording the coordinate information of the target local maximum point set to the corresponding coordinate positions of the two-channel image, and before setting the target local maximum point set as a reference point and inputting it into a reference point queue, the positioning method further includes: Determine a horizontal area to be measured from the two horizontal areas, and determine a target local maximum point of the horizontal area to be measured; Determine at least one gradually changing pixel point region on the display screen image and located in the horizontal region to be measured, wherein the gradually changing pixel point region is a set of pixels having a pixel cluster grayscale excluding a target local maximum point; Determine a target gradient pixel point area corresponding to the target local maximum point; Performing edge pixel analysis on the target gradient pixel area and the horizontal area to be measured; When the edge pixel point analysis result shows that the target gradient pixel point area and the horizontal area to be measured have edge overlap, determining a set of overlapping edge pixel points; Amplifying and assigning values ​​to the horizontal area to be measured according to the number and positions of pixels in the edge pixel set; The remaining horizontal and vertical areas are subjected to target gradient pixel area determination, edge pixel analysis, edge pixel set determination, and amplification assignment.

6. The positioning method according to any one of claims 1 to 3, characterized in that: After determining the local maximum point corresponding to each pixel cluster on the display screen image and generating a maximum image, and before generating a positioning template matrix based on the arrangement type and the horizontal and vertical distances between adjacent pixel clusters on the display screen image, the positioning method further includes: Determine the ROI area of ​​the display screen image; Calculate the width and height of the ROI area; The horizontal distance and the vertical distance between the pixel clusters are calculated according to the region width, the region height and the physical resolution of the display screen.

7. A device for positioning a bright cluster of a sub-pixel on a display screen, characterized in that: include: An acquisition unit is configured to illuminate target pixels corresponding to one of the three RGB colors on the display screen. A camera acquires the target pixels on the display screen to generate a display screen image. The display screen image includes pixel clusters formed by the target pixels. The arrangement information of the pixel clusters on the display screen image is determined by the arrangement type of the target sub-pixels on the display screen. A first generating unit is configured to determine a local maximum point corresponding to each pixel cluster on the display screen image and generate a maximum value image; a second generating unit, configured to generate a positioning template matrix according to the arrangement type and the horizontal and vertical distances between adjacent pixel clusters of the display screen image, wherein the positioning template matrix includes a central area, two horizontal areas, and two vertical areas, and the point positions of the central area, the horizontal areas, and the vertical areas are all assigned values ​​of 1; a third generating unit, configured to generate a two-channel image according to the physical resolution of the target sub-pixel of the display screen, wherein each local maximum point in the maximum image has a corresponding coordinate position on the two-channel image; A first recording unit is configured to select a local maximum point in the maximum value image as a reference point and place it in a reference point queue, and record the coordinate information of the reference point in the reference coordinate position of the two-channel image; a first determining unit, configured to align a central area of ​​the positioning template matrix to a reference point of the maximum image, and determine a target local maximum point set corresponding to the two horizontal areas and the two vertical areas on the maximum image; A second recording unit, configured to record the coordinate information of the target local maximum point set to corresponding coordinate positions of the two-channel image; a fourth generating unit, configured to generate a marker image according to a physical resolution of the display screen, wherein each local maximum point in the maximum image has a corresponding coordinate position on the marker image; A third recording unit is used to record each searched reference point at the recording point coordinate position on the mark image, and the recorded mark image is also used to cut the two-channel image to remove redundant rows and columns in the two-channel image; An input unit, configured to record the coordinate information of the target local maximum point set to corresponding coordinate positions of the two-channel image; a search unit, configured to align the positioning template matrix, search for target local maximum points, and record coordinate information of the two-channel images for the reference points in the reference point queue until there are no reference points in the reference point queue; The marking unit is used to mark the coordinate information on the two-channel image on the pixel group of the target sub-pixel of the display screen image.

8. A device for positioning a bright cluster of a sub-pixel on a display screen, characterized in that: include: processor, memory, input and output units, and buses; The processor is connected to the memory, the input and output unit, and the bus; The memory stores a program, and the processor calls the program to execute the positioning method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a program stored thereon, wherein the program, when executed on a computer, performs the positioning method according to any one of claims 1 to 6.

Images