A method, device, system and storage medium for positioning and correcting display screen sub-pixels

Abstract

The present application discloses a method, device, system and storage medium for sub-pixel positioning and correction of a display screen, which can correct abnormal points of sub-pixel coordinates after positioning of the display screen by using the coordinates of adjacent normal points, improve sub-pixel accuracy, and make the positioning and correction effect of sub-pixels meet the requirements. The method of the present application includes: collecting a positioning image displayed under the display screen through a camera; obtaining the coordinate points of each pixel in the positioning image according to an affine transformation matrix to obtain an initial array coordinate point set; defining a target neighborhood in the initial array coordinate point set and taking the maximum value within the target neighborhood; searching the initial array coordinate point set through the maximum value to obtain a target array coordinate point set; and obtaining a difference coordinate point set of the coordinate of each pixel point and the coordinate of an adjacent pixel point in the target array coordinate point set.

Description

Technical Field

[0001] The present application relates to the technical field of display panel pixel correction, and in particular, to a method, device, system and storage medium for sub-pixel positioning and correction of a display screen. Background Art

[0002] Organic light-emitting diodes and micro light-emitting diodes have become key materials for small display panels such as mobile phones, tablet computers, and televisions. However, due to the complex manufacturing process of display panels, various defects are inevitable, such as pixel dead points, dark points, and brightness non-uniformity problems. To effectively solve the above problems, these defects can be repaired through brightness uniformity correction technology.

[0003] However, as the size of the display panel shrinks, the distance between image pixels becomes closer, resulting in an increasingly serious crosstalk phenomenon between pixels. The crosstalk between pixels directly affects the positioning and brightness extraction accuracy of sub-pixels. Moreover, if there are a large number of dead points and dark points on the display screen, and there are certain errors in the pixel arrangements of different panels, it will also affect the accuracy of sub-pixel extraction.

[0004] Currently, sub-pixel positioning is generally achieved by using a monochromatic camera to photograph the display panel when it is fully lit, lit in an interlaced row and column manner, or a monochromatic R / G / B image that is only lit in an interlaced row or only in an interlaced column according to the sub-pixel arrangement method. However, this method requires a large number of positioning images to be taken, resulting in a relatively long time required for the brightness uniformity correction process. Therefore, research is currently being conducted on simultaneously positioning RGB sub-pixels to save time. The more mainstream method is to use a prefabricated checkerboard to light up the screen. After the R, G, and B checkerboards roughly locate the R, G, and B sub-pixels, the initial positioning values of the sub-pixels are corrected according to the R, G, and B sub-pixels displayed in the black cells to obtain accurate positioning values.

[0005] However, when there are a large number of dead points and dark points on the display screen, and there are certain errors in the pixel arrangements of different panels, both will affect the extraction accuracy of obtaining the coordinates of sub-pixels by performing two-dimensional data interpolation using the corner coordinates of the R, G, and B checkerboards. Therefore, the existing sub-pixel positioning and correction effects are not ideal. Summary of the Invention

[0006] The present application provides a method, device, system and storage medium for sub-pixel positioning and correction of a display screen, which can correct abnormal points of sub-pixel coordinates after positioning the display screen by using the coordinates of adjacent normal points, improve sub-pixel accuracy, and make the sub-pixel positioning and correction effect meet the requirements.

[0007] In a first aspect of the present application, a method for sub-pixel positioning and correction of a display screen is provided, and the method includes:

[0008] Collect the positioning image displayed under the display screen through a camera;

[0009] Obtain the coordinate points of each pixel in the positioning image according to the affine transformation matrix to obtain an initial array coordinate point set;

[0010] Define a target neighborhood in the initial array coordinate point set and take the maximum value within the target neighborhood;

[0011] Search the initial array coordinate point set through the maximum value to obtain a target array coordinate point set;

[0012] Obtain a difference coordinate point set of the coordinate of each pixel point and the coordinate of the adjacent pixel point in the target array coordinate point set;

[0013] Compare each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set;

[0014] Extract the abnormal pixel point set in the mixed pixel point set;

[0015] Perform iterative interpolation processing on the abnormal pixel point set to obtain target pixel points;

[0016] Merge the target pixel points with the normal pixel points in the target array coordinate point set to obtain a target image, and the target image is the image obtained by performing positioning correction on the initial image.

[0017] Optionally, performing iterative interpolation processing on the abnormal pixel point set to obtain target pixel points includes:

[0018] Obtain a pixel point coordinate deviation set between the target array coordinate point set and the initial array coordinate point set;

[0019] Obtain the adjacent ROI regions of the coordinates of each abnormal pixel point in the abnormal pixel point set;

[0020] Determine the minimum search distance and the maximum search distance;

[0021] Judge whether there are normal pixel points in the ROI region according to the minimum search distance;

[0022] If so, calculate the mean value of the pixel point coordinate deviation sets corresponding to all normal pixel points in the ROI region;

[0023] Correct the abnormal pixel point set according to the mean value to obtain target pixel points.

[0024] Optionally, after judging whether there are normal pixel points in the ROI region according to the minimum search distance, the method further includes:

[0025] If not, search from the minimum search distance to the maximum search distance in sequence, and determine whether there are normal pixel points in the ROI region.

[0026] Optionally, obtaining the position differences between the coordinates of each pixel point in the target array coordinate point set and the coordinates of adjacent pixel points includes:

[0027] Obtaining the coordinates of each pixel point in the target array coordinate point set;

[0028] Calculating the difference between the coordinates of each pixel point in the target array coordinate point set and the coordinates of the nth adjacent pixel point through a first target formula;

[0029] The first target formula is:

[0030]

[0031]

[0032] Wherein, nx and ny are the distances to be translated along the x - direction and the y - direction for the target array point coordinate set (X, Y), ([[]] , ) and ([[]] , ) are the translated array point coordinate sets;

[0033] Subtracting the translated array point coordinate sets from the target array point coordinate set respectively to obtain a difference coordinate point set.

[0034] Optionally, comparing each difference in the difference coordinate point set with an anomaly threshold to obtain a comparison result includes:

[0035] Determining the anomaly threshold;

[0036] Comparing each difference in the difference coordinate point set with the anomaly threshold through a second target formula to obtain a comparison result;

[0037] The second target formula is:

[0038]

[0039]

[0040] Wherein, , are the upper limit and the lower limit of the anomaly threshold for the difference row coordinates, min, max is the upper limit and lower limit of the abnormal threshold for the difference column coordinates;( , ) and ( , ) are the difference points in the difference coordinate point set.

[0041] Optionally, extracting the abnormal pixel point set in the mixed pixel point set includes:

[0042] Extracting the normal pixel point coordinates and abnormal pixel point coordinates in the mixed pixel point set;

[0043] Calculating and obtaining a target normal coordinate point set according to the normal pixel point coordinates;

[0044] Removing the target normal coordinate point set with overlap in the abnormal pixel point coordinates to obtain an abnormal pixel point set.

[0045] Optionally, collecting the positioning image displayed under the display screen by a camera includes:

[0046] Collecting a white screen or a sub-pixel monochromatic screen that is fully lit, lit in an interlaced row and column manner, or lit only in rows or only in columns according to the sub-pixel arrangement by a color camera or a black-and-white camera.

[0047] A second aspect of the present application provides a display screen sub-pixel positioning correction system, and the system includes:

[0048] A collection unit for collecting the positioning image displayed under the display screen by a camera;

[0049] A first obtaining unit for obtaining the coordinate points of each pixel in the positioning image according to the affine transformation matrix to obtain an initial array coordinate point set;

[0050] A definition unit for defining a target neighborhood in the initial array coordinate point set and taking the maximum value within the target neighborhood;

[0051] A search unit for searching the initial array coordinate point set through the maximum value to obtain a target array coordinate point set;

[0052] A second obtaining unit for obtaining a difference coordinate point set of the coordinate points of each pixel and the adjacent pixel points in the target array coordinate point set;

[0053] A comparison unit for comparing each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set;

[0054] An extraction unit for extracting the abnormal pixel point set in the mixed pixel point set;

[0055] An iterative unit for iteratively interpolating the set of abnormal pixel points to obtain target pixels;

[0056] A merging unit for merging the target pixels with the normal pixels in the set of target array coordinate points to obtain a target image, where the target image is an image obtained by performing positioning correction on the initial image.

[0057] A third aspect of the present application provides a display sub-pixel positioning correction device, the device includes:

[0058] A processor, a storage, an input / output unit, and a bus;

[0059] The processor is connected to the storage, the input / output unit, and the bus;

[0060] The storage stores a program, and the processor calls the program to execute the first aspect and any optional method in the first aspect.

[0061] A fourth aspect of the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed on a computer, it executes the first aspect and any optional method in the first aspect.

[0062] It can be seen from the above technical solutions that the present application has the following advantages:

[0063] 1. By obtaining the coordinate points of each pixel in the positioning image through an affine transformation matrix and performing subsequent processing based on these coordinate points, the positioning accuracy of the image can be significantly improved, and abnormal pixel points in the image can be identified and processed, and corrected through methods such as iterative interpolation, thereby enhancing the overall quality of the image.

[0064] 2. It can correct the abnormal sub-pixel coordinate points after positioning for the display screen, and use the coordinates of adjacent normal points to correct the abnormal points, improving the sub-pixel accuracy and making the positioning correction effect of the sub-pixels meet the requirements.

[0065] 3. By defining a target neighborhood and taking the maximum value, key feature points in the image can be identified. Subsequently, by comparing the difference coordinate point set with the abnormal threshold, the set of abnormal pixel points can be accurately extracted, and further iterative interpolation processing is performed on these abnormal pixel points, thereby significantly reducing problems such as noise, blur, and distortion in the image, and enhancing the overall quality of the image.

[0066] 4. It can avoid the abnormal sub-pixel positioning caused by large-area bad points on the display screen and bad points around normal points.

[0067] 5. It can avoid the deviation of the positioning coordinates caused by the mutual crosstalk between RGB sub-pixels when positioning the RGB sub-pixels at one time on a white screen, shorten the time required for positioning in the detection process, and improve the positioning accuracy.

[0068] 6. It is applicable to the sub-pixel positioning extraction and correction in the non-conventional dot-screen mode, and improves the positioning accuracy in the non-conventional dot-screen mode. Brief Description of the Drawings

[0069] In order to more clearly illustrate the technical solutions in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0070] Figure 1 It is a schematic flowchart of an embodiment of the sub-pixel positioning and correction method for the display screen of the present application;

[0071] Figure 2 It is a schematic diagram of another embodiment of the sub-pixel positioning and correction method for the display screen of the present application;

[0072] Figure 3 It is a schematic diagram of another embodiment of the sub-pixel positioning and correction method for the display screen of the present application;

[0073] Figure 4 It is a schematic diagram of another embodiment of the sub-pixel positioning and correction method for the display screen of the present application;

[0074] Figure 5 It is a schematic diagram of another embodiment of the sub-pixel positioning and correction method for the display screen of the present application;

[0075] Figure 6 It is a schematic diagram of an embodiment of the sub-pixel positioning and correction system for the display screen of the present application;

[0076] Figure 7 It is a schematic diagram of an embodiment of the sub-pixel positioning and correction device for the display screen of the present application;

[0077] Figure 8 It is a sub-pixel positioning map after maximum value search;

[0078] Figure 9 It is a positioning map after correcting the coordinates of sub-pixel abnormal points;

[0079] Figure 10 It is a sub-pixel coordinate positioning map after maximum value search for positioning RGB sub-pixels by photographing a white screen;

[0080] Figure 11It is a positioning map after performing maximum value search on RGB sub-pixels for shooting a white picture and correcting the coordinates of sub-pixel abnormal points;

[0081] Figure 12 It is a sub-pixel positioning map after maximum value search in an unconventional dot screen mode;

[0082] Figure 13 It is a positioning map after correcting the coordinates of sub-pixel abnormal points in an unconventional dot screen mode. Specific implementation manners

[0083] This application provides a method, device, system and storage medium for sub-pixel positioning and correction of a display screen, which can correct abnormal points of sub-pixel coordinates after positioning for the display screen, use the coordinates of adjacent normal points to correct the abnormal points, improve the sub-pixel accuracy, and make the positioning and correction effect of the sub-pixels meet the requirements.

[0084] Please refer to Figure 1 , an embodiment of the method for sub-pixel positioning and correction of a display screen provided in the first aspect of this application includes:

[0085] 101. Collect a positioning image displayed under the display screen through a camera;

[0086] 102. Obtain the coordinate points of each pixel in the positioning image according to the affine transformation matrix to obtain an initial array coordinate point set;

[0087] 103. Define a target neighborhood in the initial array coordinate point set and take the maximum value within the target neighborhood;

[0088] 104. Search the initial array coordinate point set through the maximum value to obtain a target array coordinate point set;

[0089] 105. Obtain a difference coordinate point set of the coordinate of each pixel point and the coordinate of the adjacent pixel point in the target array coordinate point set;

[0090] 106. Compare each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set;

[0091] 107. Extract the abnormal pixel point set in the mixed pixel point set;

[0092] 108. Perform iterative interpolation processing on the abnormal pixel point set to obtain target pixel points;

[0093] 109. Merge the target pixel points with the normal pixel points in the target array coordinate point set to obtain a target image, and the target image is an image obtained by performing positioning and correction on the initial image.

[0094] In the embodiment of the present application, first, a positioning image displayed under the display screen is collected by a camera. Then, according to the affine transformation matrix, the coordinate points of each pixel in the positioning image are obtained to obtain an initial array coordinate point set. After that, a target neighborhood is defined in the initial array coordinate point set, and the maximum value within the target neighborhood is taken. The initial array coordinate point set is searched through the maximum value to obtain a target array coordinate point set. Then, the difference coordinate point set of the coordinate of each pixel point and the coordinate of the adjacent pixel point in the target array coordinate point set is obtained. Each difference in the difference coordinate point set is compared with an abnormal threshold to obtain a mixed pixel point set. Further, the abnormal pixel point set in the mixed pixel point set is extracted, and the abnormal pixel point set is iteratively interpolated to obtain target pixel points. The target pixel points are merged with the normal pixel points in the target array coordinate point set to obtain a target image, and the target image is an image obtained by performing positioning correction on the initial image.

[0095] In step 101, a positioning image displayed under the display screen is collected by a camera. Specifically, a white screen or a sub-pixel monochromatic screen that is fully lit, lit in an interlaced row and column manner, or lit only in rows or only in columns according to the sub-pixel arrangement is collected by a color camera or a black-and-white camera, and the obtained white screen or sub-pixel monochromatic screen is used as the positioning image.

[0096] It should be noted that during shooting, the relative position between the color camera or the black-and-white camera and the display screen should be fixed to reduce errors during the shooting process, and the camera should be set to appropriate exposure, focal length, and white balance to ensure that the collected image is clear and has good contrast.

[0097] In step 102, according to the affine transformation matrix, the coordinate points of each pixel in the positioning image are obtained to obtain an initial array coordinate point set. Specifically, taking the positioning map in the form of being lit in an interlaced row and column manner obtained in step 101 as an example, after obtaining the affine transformation matrix based on the four corner points of the screen position and the screen resolution in the captured W255 gray-scale image, the initial array coordinate point set (X1, Y1) corresponding to the first group of positioning maps is obtained.

[0098] The affine transformation matrix is a linear transformation that can be used to describe the transformation relationship of pixel point positions in an image and can map the pixel coordinates in the positioning image to the actual coordinates on the display screen. Therefore, each pixel of the positioning image can be mapped to the display screen by using the affine transformation matrix, thereby obtaining an initial array coordinate point set, and the initial array coordinate point set represents the preliminary estimated position of each pixel on the display screen.

[0099] In step 103, a target neighborhood is defined in the initial array coordinate point set, and the maximum value within the target neighborhood is taken. That is, based on the initial array coordinate point set (X1, Y1), the maximum value within the neighborhood is obtained, so as to iteratively and accurately locate the maximum value position where the pixel cluster is located. The array point coordinate point set after the maximum value search is (X, Y), and the second, third, and fourth groups of coordinates are respectively (X + MR, Y), (X, Y + MR), (X + MR, Y + MR), where MR represents how many image pixels a single screen pixel occupies in the image.

[0100] Among them, for each point in the initial array coordinate point set, a target neighborhood is defined. This neighborhood can be a window of a fixed size, such as a 3x3 or 5x5 pixel area, and no specific limitation is made here.

[0101] Within each target neighborhood, the maximum value is searched. This maximum value point represents the clearest pixel position within the neighborhood.

[0102] In step 104, the initial array coordinate point set is searched through the maximum value to obtain the target array coordinate point set. Specifically, the maximum value point found in step 103 is used as the new pixel position to replace the corresponding point in the initial array coordinate point set. In this process, a more accurate target array coordinate point set will be generated, where each point represents the accurate position of the sub-pixel on the display screen.

[0103] In step 105, the difference coordinate point set of each pixel point coordinate and its adjacent pixel point coordinate in the target array coordinate point set is obtained. By traversing the target array coordinate point set, the coordinate differences between each pixel point and its adjacent pixel points, usually in the four directions of up, down, left, and right, are calculated. These difference coordinate point sets reflect the relative position relationship between pixel points and help to identify abnormal or offset pixel points.

[0104] In step 106, each difference in the difference coordinate point set is compared with the abnormal threshold to obtain the mixed pixel point set. By setting the abnormal threshold, this abnormal threshold is used to determine whether the position difference between pixel points exceeds the normal range.

[0105] Each difference in the difference coordinate point set is compared with the abnormal threshold. If the difference exceeds the threshold, the pixel point is marked as an abnormal point. If the difference does not exceed the threshold, the pixel point is marked as a normal point, and the compared difference coordinate points are all put into the mixed pixel point set. That is, the mixed pixel point set contains multiple abnormal pixel points and normal pixel points.

[0106] In step 107, the abnormal pixel point set in the mixed pixel point set is extracted. Specifically, all the pixel points marked as abnormal are screened out from the mixed pixel point set, and after processing, the abnormal pixel point set is obtained.

[0107] In step 108, iterative interpolation processing is performed on the abnormal pixel point set to obtain target pixel points. After the abnormal pixel point set is obtained in step 107, further, for each abnormal pixel point in the abnormal pixel point set, interpolation calculation is performed using the values of the surrounding normal pixel points to obtain the correct position of this point.

[0108] It should be noted that the iterative interpolation processing can be performed multiple times until the position or value of the abnormal pixel points converges to a stable range. The target pixel point set finally obtained through the iterative interpolation processing represents the corrected positions of the abnormal pixel points.

[0109] In step 109, the target pixel points are merged with the normal pixel points in the target array coordinate point set to obtain a target image. Specifically, the target pixel point set obtained through interpolation processing is merged with the normal pixel points in the target array coordinate point set. The merged point set represents the exact positions of all pixels on the display screen. After that, based on this exact point set, a target image after positioning correction can be generated. This image more accurately reflects the actual display situation of the display screen, thereby enabling precise positioning correction of the sub-pixels of the display screen and improving the display quality and accuracy of the display screen.

[0110] Referring to Figure 2 , according to some embodiments of the present invention, the iterative interpolation processing of the abnormal pixel point set in step 108 to obtain target pixel points may specifically include, but is not limited to, the following:

[0111] 201. Obtain the pixel point coordinate deviation set between the target array coordinate point set and the initial array coordinate point set;

[0112] 202. Obtain the adjacent ROI regions of the coordinates of each abnormal pixel point in the abnormal pixel point set;

[0113] 203. Determine the minimum search distance and the maximum search distance;

[0114] 204. Judge whether there are normal pixel points in the ROI region according to the minimum search distance;

[0115] 205. If there are, calculate the mean value of the pixel point coordinate deviation sets corresponding to all normal pixel points in the ROI region;

[0116] 206. Correct the abnormal pixel point set according to the mean value to obtain target pixel points;

[0117] 207. If not, search from the minimum search distance to the maximum search distance in sequence and judge whether there are normal pixel points in the ROI region.

[0118] In an embodiment of the present application, after obtaining the target array coordinate point set and the initial array coordinate point set, the coordinate differences of the corresponding pixel points in these two sets of points are further calculated. These differences constitute the pixel point coordinate deviation set, which reflects the position change of each pixel point before and after correction.

[0119] After that, the adjacent ROI regions of each abnormal pixel point coordinate in the abnormal pixel point set are obtained. Specifically, for each abnormal pixel point in the abnormal pixel point set, an ROI region is defined. This ROI region is a window with a fixed size centered on the abnormal pixel point, which contains several normal pixel points around the point. The size of the ROI region can be adjusted according to the actual situation to ensure that enough normal pixel points are included for subsequent analysis.

[0120] Then, the minimum search distance and the maximum search distance are defined. The minimum search distance and the maximum search distance are parameters used to search for normal pixel points within the ROI region. The minimum search distance is set to the distance adjacent to the abnormal pixel point to ensure that the search starts from the nearest normal pixel point. The maximum search distance can be set according to the size of the ROI region and the desired search range, which limits the farthest search distance.

[0121] After determining the minimum search distance and the maximum search distance, first, it is judged whether there are normal pixel points in the ROI region according to the minimum search distance. Specifically, centered on the abnormal pixel point, search within the ROI region according to the minimum search distance, and check whether the searched pixel points belong to normal pixel points, that is, the pixel points not marked as abnormal. If normal pixel points are found within the minimum search distance, the mean value of the pixel point coordinate deviation sets corresponding to all normal pixel points within the ROI region is obtained, that is, the mean value of the pixel point coordinate deviation sets corresponding to these normal pixel points is calculated. This mean value reflects the average position offset of normal pixel points within the ROI region. The mean value calculation can adopt methods such as simple arithmetic mean or weighted mean, depending on the application scenario and accuracy requirements.

[0122] Then, the obtained mean value is used to correct the abnormal pixel points. The correction method is to adjust the position of the abnormal pixel points to the position corresponding to the mean value, or calculate a new position based on the mean value and the original position of the abnormal pixel points. After correction, the abnormal pixel points are replaced with new target pixel points, and these points are closer to their supposed positions.

[0123] If no normal pixel points are found within the minimum search distance, the search range is gradually expanded, and the search is carried out from the minimum search distance to the maximum search distance in sequence. At each new search distance, the judgment operation in step 204 is repeated, that is, it is checked whether there are normal pixel points within the current search distance.

[0124] If normal pixel points are found within a certain search distance, subsequent operations are performed according to steps 205 and 206, and the search distance is the maximum search distance.

[0125] Therefore, through the above steps, abnormal pixel points can be accurately corrected, thereby improving the display quality and accuracy of the display screen. These steps combine the analysis of pixel point coordinate deviation and the search strategy within the ROI region, and can effectively locate and correct abnormal pixel points.

[0126] In practical applications, the specific steps are as follows:

[0127] Step 1: Obtain the pixel point coordinate deviation set (X_bias, Y_bias) based on the target array point coordinate set (X, Y) after maximum value search and the initial array coordinate set (X1, Y1). The specific calculation formula is:

[0128]

[0129] Step 2: Iteratively determine whether there are normal points in the adjacent ROI regions of each abnormal pixel point coordinate in the abnormal pixel point coordinate set according to the search distance Dis. The adjacent ROI regions are , -Dis, , +Dis.

[0130] Step 3: Set the minimum search distance Dis_min and the maximum search distance Dis_max, and start judging whether there are normal points in the current ROI region from the minimum search distance Dis_min.

[0131] Step 4: If there are, calculate the mean value of the pixel point coordinate deviation set (X_bias, Y_bias) corresponding to all normal points in this region ;

[0132] Step 5: If not, Dis_min + 1, and repeat Step 3 until the current search distance < the maximum search distance Dis_max.

[0133] Step 6: After obtaining the mean value set corresponding to the abnormal pixel point coordinate set ( , ), correct the abnormal pixel point coordinate set ( ,, ). The correction calculation formula is:

[0134]

[0135] Refer to Figure 3, According to some embodiments of the present invention, obtaining the difference coordinate point set of each pixel point coordinate and the adjacent pixel point coordinate in the target array coordinate point set in step 105 may specifically include, but is not limited to, the following:

[0136] 301. Obtain each pixel point coordinate in the target array coordinate point set;

[0137] 302. Calculate the difference between each pixel point coordinate in the target array coordinate point set and the coordinate of the adjacent nth pixel point through the first target formula;

[0138] The first target formula is:

[0139]

[0140]

[0141] Wherein, nx and ny are the distances that the target array point coordinate set (X, Y) needs to be translated in the x direction and the y direction, ([[]] , ) and ([[]] , ) are the translated array point coordinate sets;

[0142] 303. Subtract the translated array point coordinate set from the target array point coordinate point set respectively to obtain the difference coordinate point set.

[0143] In the embodiments of the present application, specifically, first calculate the coordinate , of each pixel point in the target array coordinate point set (X, Y) , ) of the adjacent nth pixel point, and the specific calculation formula is:

[0144]

[0145]

[0146] Wherein, nx and ny are the distances that the target array point coordinate set (X, Y) needs to be translated in the x direction and the y direction, ([[]] , ) and ([[]] , ) are the translated array point coordinate sets;

[0147] Subsequently, for the translated array point coordinate set ([[]] , ), ( , ) are respectively subtracted from the target array coordinate point set (X, Y) to obtain the difference coordinate point set ( , ) and ( , ).

[0148] Referring to Figure 4 , according to some embodiments of the present invention, each difference in the difference coordinate point set in step 106 is compared with an anomaly threshold to obtain the mixed pixel point set, which may specifically include, but is not limited to, the following:

[0149] 401. Determine the anomaly threshold;

[0150] 402. Compare each difference in the difference coordinate point set with the anomaly threshold through a second target formula to obtain the mixed pixel point set;

[0151] The second target formula is:

[0152]

[0153]

[0154] Wherein, , are the upper limit and lower limit of the anomaly threshold for the difference row coordinate, min, max are the upper limit and lower limit of the anomaly threshold for the difference column coordinate.

[0155] In the embodiments of the present application, for each difference point ( , ) in the difference coordinate set ( , ), a threshold judgment is made, that is, when ( , ) simultaneously satisfies the following formula, it is judged as the first normal coordinate point ( , ), otherwise it is the first abnormal pixel point coordinate ( , ).

[0156] Furthermore, for ( , ) within ( , ), similarly, the first normal coordinate point ( , ) and the first abnormal pixel point coordinate ( , );

[0157]

[0158]

[0159] Wherein, and are the upper and lower limits of the abnormal threshold of the difference row coordinates, min, max are the upper and lower limits of the abnormal threshold of the difference column coordinates; ( , ) and ( , ) are the difference points in the difference coordinate point set.

[0160] Referring to Figure 5 , according to some embodiments of the present invention, the extraction of the abnormal pixel point set in the mixed pixel point set in step 10 / 7 may specifically include, but is not limited to, the following:

[0161] 501. Extract the normal pixel point coordinates and abnormal pixel point coordinates in the mixed pixel point set;

[0162] 502. Calculate and obtain the target normal coordinate point set according to the normal pixel point coordinates;

[0163] 503. Remove the overlapping target normal coordinate point set in the abnormal pixel point coordinates to obtain the abnormal pixel point set.

[0164] In the embodiments of the present application, first, the normal pixel point coordinates and abnormal pixel point coordinates in the mixed pixel point set are extracted. Specifically, after the above steps, the mixed pixel point set can be obtained. In the mixed pixel point set, there are normal pixel point coordinates and abnormal pixel coordinates. First, the normal pixel point coordinates and abnormal pixel coordinates need to be extracted from the mixed pixel point set. The purpose of extracting the normal pixel point coordinates and abnormal pixel point coordinates is for subsequent processing. The normal pixel point coordinates will be used to calculate the target normal coordinate point set, while the abnormal pixel point coordinates will be used for further calibration processing.

[0165] After extracting the normal pixel point coordinates, the target normal coordinate point set is calculated according to these coordinates, aiming to obtain a more accurate and stable set of normal pixel point positions.

[0166] The target normal coordinate point set is calculated using interpolation or fitting techniques to smooth the position data of the normal pixel points, thereby obtaining more accurate target coordinates and a set of normal pixel point positions as close as possible to the real situation.

[0167] After that, the overlapping target normal coordinate point sets in the abnormal pixel point coordinates are removed to obtain the abnormal pixel point set. Specifically, this set is compared with the abnormal pixel point coordinates to identify and remove those abnormal pixel points that overlap with the normal pixel point positions. The determination of overlap can be based on the proximity of coordinates or a distance threshold. If the coordinates of an abnormal pixel point are very close to the coordinates of a point in the target normal coordinate point set, that is, the distance is less than a certain threshold, it is considered that they overlap.

[0168] For the abnormal pixel points with overlap, they are removed from the abnormal pixel point set. After processing, an abnormal pixel point set that does not contain points overlapping with the target normal coordinate point set can be obtained. The abnormal pixel point set will be used for subsequent correction processing to improve the display quality of the display screen.

[0169] Specifically, according to the first normal coordinate point ( , ) and ( , ), the final normal coordinate point set can be calculated again, that is, the first normal coordinate point that satisfies the 4-side row-column distance or 3-side row-column distance or 2-side row-column distance or single-side row-column distance is the final normal coordinate point set ( , ). Subsequently, for the first abnormal pixel point coordinates ( , ) and ( , ), the overlapping part of ( , ) is removed to obtain the final abnormal pixel point coordinate set ( , ).

[0170] After the sub-pixel positioning coordinates of this application are corrected, the positioning accuracy is greatly improved, which is specifically reflected in the following embodiments:

[0171] 1. Avoid the abnormal sub-pixel positioning caused by large-area dead pixels and dead pixels around normal points on the display screen. Please refer to Figure 8 and Figure 9 . Among them, Figure 8 is the sub-pixel positioning map after maximum value search. The green color represents the sub-pixel positioning points. There is a large-area pixel dead point area in the central area of the picture, resulting in deviation of sub-pixel positioning in this area. Figure 9 is the positioning map after correcting the abnormal sub-pixel point coordinates. The green color represents the corrected sub-pixel positioning points. It can be seen that the positioning points in the pixel dead point area are regularly spaced, which conforms to the sub-pixel distribution rules of the product. Therefore, this application can avoid the abnormal sub-pixel positioning caused by large-area dead pixels and dead pixels around normal points.

[0172] II. To avoid the deviation of the positioning coordinates caused by the mutual crosstalk between RGB sub-pixels when positioning RGB sub-pixels at one time on a white screen, refer to Figure 10 and Figure 11 , where Figure 10 A positioning map obtained by simultaneously positioning RGB sub-pixels by shooting a white screen and correcting the coordinates of sub-pixel abnormal points.

[0173] In this embodiment, a color camera is used to shoot a white screen positioning map of the screen. Taking the form that the positioning map is lit row by row and column by column as an example. After obtaining the white screen positioning map, the corresponding RGB positioning maps are obtained by channel separation. Different from shooting a monochromatic RGB screen with a monochromatic camera, in the white screen positioning map shot by the color camera, there will be mutual crosstalk between RGB sub-pixels, and the sub-pixel intervals in the RGB monochromatic positioning maps obtained by channel separation are not obvious, resulting in positioning to adjacent pixels, as Figure 10 shown.

[0174] After correcting the coordinates of sub-pixel abnormal points, the sub-pixels can be correctly extracted, the deviation of the positioning coordinates caused by the mutual crosstalk between RGB sub-pixels can be avoided, and the positioning map after correcting the coordinates of sub-pixel abnormal points is as Figure 11 shown. Compared with the traditional pixel extraction method of shooting a monochromatic positioning map with a monochromatic camera, the present application can effectively shorten the required beats for positioning in the Demura or detection process and improve the positioning accuracy.

[0175] III. Applicable to sub-pixel positioning extraction and correction in unconventional dot screen modes, refer to Figure 12 and Figure 13 , where Figure 12 is the sub-pixel positioning map after maximum value search in the case of unconventional dot screen. In this dot screen mode, the sub-pixels are lit diagonally. It can be seen that there is interference from an adjacent abnormally lit sub-pixel in the red frame area, resulting in abnormal sub-pixel positioning. Figure 13 is the positioning map after correcting the coordinates of the abnormal positioning points. Therefore, the sub-pixel positioning and correction method of the present application is also applicable to unconventional dot screen cases, is not limited to the dot screen mode of sub-pixels, and has the characteristic of wide applicability, and can improve the positioning accuracy in unconventional dot screen modes.

[0176] Referring to Figure 6 , the second aspect of the present application provides a display screen sub-pixel positioning and correction system, and the system includes:

[0177] An acquisition unit 601, configured to acquire a positioning image displayed under a display screen through a camera;

[0178] A first acquisition unit 602, configured to obtain the coordinate points of each pixel in the positioning image according to an affine transformation matrix to obtain an initial array coordinate point set;

[0179] A defining unit 603, configured to define a target neighborhood in the initial array coordinate point set and take the maximum value within the target neighborhood;

[0180] A searching unit 604, configured to search the initial array coordinate point set through the maximum value to obtain a target array coordinate point set;

[0181] A second obtaining unit 605, configured to obtain a difference coordinate point set of each pixel point coordinate and an adjacent pixel point coordinate in the target array coordinate point set;

[0182] A comparing unit 606, configured to compare each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set;

[0183] An extracting unit 607, configured to extract an abnormal pixel point set in the mixed pixel point set;

[0184] An iterative unit 608, configured to perform iterative interpolation processing on the abnormal pixel point set to obtain target pixel points;

[0185] A merging unit 609, configured to merge the target pixel points with the normal pixel points in the target array coordinate point set to obtain a target image, where the target image is an image obtained by performing positioning correction on the initial image.

[0186] Reference Figure 7 , a sub-pixel positioning correction device for a display screen provided in the third aspect of the present application, the device includes:

[0187] A processor 701, a storage 702, an input / output unit 703, and a bus 704;

[0188] The processor 701 is connected to the storage 702, the input / output unit 703, and the bus 704;

[0189] The storage 702 stores a program, and the processor 701 calls the program to execute the method described in the first aspect and any one of the first aspect.

[0190] The present application further relates to a computer-readable storage medium, on which a program is stored. When the program runs on a computer, the computer is caused to execute the method described in the first aspect and any one of the first aspect.

[0191] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be described herein again.

[0192] In several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms.

[0193] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0194] In addition, each functional unit in various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0195] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in various embodiments of the present application. The aforementioned storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs, and other media that can store program codes.

Claims

1. A display screen sub-pixel positioning correction method, characterized in that: The method comprises: The positioning image displayed on the display screen is collected by the camera; Obtaining the coordinate point of each pixel in the positioning image according to the affine transformation matrix to obtain an initial array coordinate point set; Defining a target neighborhood in the initial array coordinate point set, and taking a maximum value in the target neighborhood; Searching the initial array coordinate point set by the maximum value to obtain a target array coordinate point set; Obtaining a difference coordinate point set between the coordinates of each pixel point in the target array coordinate point set and the coordinates of adjacent pixel points; Compare each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set; Extracting normal pixel point coordinates and abnormal pixel point coordinates in the mixed pixel point set; Obtain a target normal coordinate point set according to the normal pixel point coordinates; Removing target normal coordinate point sets that overlap in the abnormal pixel point coordinates to obtain an abnormal pixel point set; Acquire a pixel point coordinate deviation set between the target array coordinate point set and the initial array coordinate point set; Obtaining the adjacent ROI area of ​​the coordinates of each abnormal pixel point in the abnormal pixel point set; Determine the minimum search distance and the maximum search distance; Determine whether there is a normal pixel in the ROI area according to the minimum search distance; If not, searching from the minimum search distance to the maximum search distance in sequence, and determining whether there is a normal pixel point in the ROI area; If it exists, then calculate the mean of the pixel point coordinate deviation set corresponding to all normal pixels in the ROI area; Correcting the abnormal pixel point set according to the mean value to obtain the target pixel point; The target pixel point is merged with the normal pixel points in the target array coordinate point set to obtain a target image, wherein the target image is an image obtained by positioning and correcting the initial image.

2. The display screen sub-pixel positioning correction method according to claim 1, characterized in that: Obtaining a difference coordinate point set between the coordinates of each pixel point in the target array coordinate point set and the coordinates of adjacent pixel points, including: Obtaining the coordinates of each pixel point in the target array coordinate point set; Calculate the difference between the coordinates of each pixel point in the target array coordinate point set and the coordinates of the adjacent n-th pixel point by using the first target formula; The first target formula is: in, nx and ny is the distance that the target array point coordinate set (X, Y) needs to be translated along the x direction and the distance along the y direction. ( , )and( , ) is the coordinate set of array points after translation; The coordinate set of the translated array points is subtracted from the coordinate point set of the target array points to obtain a difference coordinate point set.

3. The display screen sub-pixel positioning correction method according to claim 1, characterized in that: Comparing each difference in the difference coordinate point set with an abnormal threshold to obtain a mixed pixel point set, including: Determine anomaly thresholds; Compare each difference in the difference coordinate point set with the abnormal threshold through a second target formula to obtain a mixed pixel point set; The second objective formula is: in, , is the lower and upper threshold of the abnormality threshold of the difference row coordinates, min, max is the lower and upper limits of the abnormal threshold of the difference column coordinates; ( , )and( , ) is the difference point in the difference coordinate point set.

4. The display screen sub-pixel positioning correction method according to claim 1, characterized in that: The camera captures the positioning image displayed on the display screen, including: A color camera or a black and white camera is used to capture a white image or a sub-pixel monochrome image that is fully lit, lit in alternate rows and columns, or lit in alternate rows or columns according to the sub-pixel arrangement.

5. A display screen sub-pixel positioning correction system, characterized in that: The system comprises: A collection unit, used for collecting the positioning image displayed on the display screen through a camera; A first acquisition unit, used for acquiring the coordinate point of each pixel in the positioning image according to the affine transformation matrix to obtain an initial array coordinate point set; A definition unit, used to define a target neighborhood in the initial array coordinate point set and take a maximum value in the target neighborhood; A searching unit, configured to search the initial array coordinate point set by using the maximum value to obtain a target array coordinate point set; A second acquisition unit, used to acquire a difference coordinate point set between the coordinates of each pixel point in the target array coordinate point set and the coordinates of adjacent pixel points; A comparison unit, used for comparing each difference in the difference coordinate point set with an abnormal threshold value to obtain a mixed pixel point set; An extraction unit is used to extract normal pixel point coordinates and abnormal pixel point coordinates from the mixed pixel point set; calculate and obtain a target normal coordinate point set according to the normal pixel point coordinates; and remove the target normal coordinate point set that overlaps in the abnormal pixel point coordinates to obtain an abnormal pixel point set; An iterative unit is used to obtain a pixel point coordinate deviation set between the target array coordinate point set and the initial array coordinate point set; obtain an adjacent ROI area of ​​each abnormal pixel point coordinate in the abnormal pixel point set; determine a minimum search distance and a maximum search distance; determine whether there is a normal pixel point in the ROI area according to the minimum search distance; if not, search from the minimum search distance to the maximum search distance in sequence, and determine whether there is a normal pixel point in the ROI area; if yes, calculate the mean of the pixel point coordinate deviation set corresponding to all normal pixels in the ROI area; correct the abnormal pixel point set according to the mean to obtain the target pixel point; The merging unit is used to merge the target pixel point with the normal pixel point in the target array coordinate point set to obtain a target image, wherein the target image is an image obtained by positioning and correcting the initial image.

6. A display screen sub-pixel positioning correction device, characterized in that: The device comprises: processor, memory, input-output unit, and bus; The processor is connected to the storage, the input and output unit, and the bus; The storage stores a program, and the processor calls the program to execute the method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program, and when the program is executed on a computer, the method according to any one of claims 1 to 4 is performed.

Images