Pixel-level brightness extraction method and system of near-to-eye display module

Abstract

The invention relates to the technical field of near-to-eye display modules, and provides a pixel-level brightness extraction method and system. The method comprises the following steps: determining a distortion correction coefficient; providing a positioning dot matrix graphic card, displaying the positioning dot matrix graphic card by the driving display module, and acquiring a positioning dot matrix shot image by the imaging equipment; correcting the positioning dot matrix shot image img2 through a distortion correction coefficient to generate a distortionless image; coordinates of the positioning points are obtained according to the distortionless images, and the positioning points are sorted; obtaining coordinates of the positioning points before distortion correction through an anti-distortion algorithm according to the sorted positioning points; a driving display module displays a gray-scale picture, and an imaging device obtains a gray-scale image of the gray-scale picture; and determining the brightness of the pixel of the driving display module according to the coordinate of the positioning point before distortion correction and the gray scale image. According to the invention, the accuracy and robustness of pixel-level brightness extraction of the near-to-eye display module can be obviously improved.

Description

Technical Field

[0001] The present invention generally relates to the technical field of near-eye display modules, and in particular to a method and system for extracting pixel-level brightness of a near-eye display module. Background Art

[0002] With the rapid development of virtual reality (VR) and augmented reality (AR) technologies, the performance indicators of near-eye display modules as core components have attracted much attention. Among them, brightness is an important parameter to measure the display effect, and its accurate extraction is crucial to optimizing the user experience. However, due to the complexity of the optical system, obtaining accurate brightness information faces many challenges.

[0003] In the prior art, lenses and optical imaging systems (such as birdbath (BB), optical waveguide, etc.) will cause distortion in the displayed image. In addition, although cameras and other equipment used to measure brightness are calibrated before leaving the factory, they still have certain distortions. These distortions cause the module brightness image obtained by shooting to be distorted, which makes it difficult to accurately extract pixel-level brightness information. Summary of the invention

[0004] In order to at least partially solve the above problems in the prior art, the present invention proposes a method for determining a distortion correction coefficient of a near-eye display module, comprising:

[0005] The display module is driven to display the distortion correction chart, and the image of the distortion correction chart displayed by the display module is acquired by an imaging device, which is named as the distortion correction captured image img1;

[0006] Determining the centroid coordinates of the distortion correction chart;

[0007] Determine the centroid coordinates of the target points of the distortion-corrected captured image img1, and sort the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart to determine the sorted centroid coordinates of the target points of the distortion-corrected captured image img1; and

[0008] According to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1, a distortion correction coefficient is determined by a distortion correction algorithm.

[0009] In one embodiment of the present invention, it is provided that the shape of the distortion correction chart and / or the distortion correction captured image img1 is a square, a rectangle, a circle, a polygon or an irregular shape.

[0010] In one embodiment of the present invention, it is provided that the centroid coordinates (x c ,y c), expressed as the following formula:

[0011]

[0012] Among them, (x i ,y i ) represents the coordinates of the i-th pixel point on the distortion correction chart, I(x i ,y i ) represents the grayscale value of the pixel, and n represents the number of pixels.

[0013] In one embodiment of the present invention, determining the centroid coordinates of the target point of the distortion-corrected captured image img1 includes: obtaining the centroid coordinates of the target point of the distortion-corrected captured image img1 using threshold segmentation, morphological processing or connected domain analysis.

[0014] In one embodiment of the present invention, it is provided that sorting the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart includes:

[0015] The target points of the distortion correction chart are sorted in ascending order according to the size of the y coordinates using a zigzag sort, and each row is sorted according to the number of points in each row of the target points of the distortion correction chart to generate a sorted point set coordinate (x dk ,y dk );

[0016] According to the distance of the target point in the distortion-corrected image img1, the centroid coordinates of the target point of the distortion-corrected chart are transformed to determine the centroid coordinates (x uk ,y uk ), expressed as the following formula:

[0017] x uk =(x ck -x c0 )×sx+x d0

[0018] y uk =(y ck -y c0 )×sy+y d0

[0019] Among them, (x ck ,y ck ) represents the centroid coordinates of the distortion correction chart, x c0 Indicates the x-coordinate and y-coordinate of the first point on the upper left corner of the distortion correction chart c0represents the y coordinate of the first point on the upper left of the distortion correction chart, sx represents the scale of the correction chart in the x direction of the actual image, sy represents the scale of the correction chart in the y direction of the actual image, and x d0 Indicates the x-coordinate and y-coordinate of the first point in the upper left corner of the sorted point set of the captured image. d0 Indicates the y coordinate of the first upper left point in the sorted point set of the captured image.

[0020] In one embodiment of the present invention, it is provided that a target point near the center point of the distortion correction chart is selected according to the Euclidean distance d, which is expressed as the following formula:

[0021]

[0022] Wherein, w represents the width of the distortion-corrected image img1, and h represents the height of the distortion-corrected image img1.

[0023] In one embodiment of the present invention, it is provided that the calculation process of sx and sy is expressed as the following formula:

[0024]

[0025] Among them, x d(i+1)j Indicates the x-coordinate of the point represented by the i+1th column and jth row when the distorted target points are arranged in two dimensions, x dij Indicates the x-coordinate of the point represented by the i-th column and the j-th row when the distorted target points are arranged in two dimensions, di(j+1) Indicates the y coordinate of the point represented by the i-th column and j+1-th row when the distorted target points are arranged in two dimensions, y dij Indicates the y coordinate of the point represented by the i-th column and j-th row when the distorted target points are arranged in two dimensions, x c(i+1)j Indicates the x-coordinate of the point represented by the i+1th column and jth row when the target points are arranged in two dimensions. ci(j+1) Indicates the y coordinate of the point represented by the i-th column and j+1-th row when the target points are arranged in two dimensions, cij Indicates the x-coordinate of the point represented by the i-th column and the j-th row when the target points are arranged in two dimensions. cij Indicates the y coordinate of the point represented by the i-th column and j-th row when the target points are arranged in two dimensions.

[0026] In one embodiment of the present invention, it is provided that, according to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1, determining the distortion correction coefficient by a distortion correction algorithm includes: obtaining the distortion correction coefficient a by an adjustment optimization algorithm ij and b ij , and determine the distortion correction coefficient a by evaluating the accuracy of the distortion correction ij and b ij , expressed as the following formula:

[0027]

[0028] Among them, (x dk ,y dk ) represents the coordinates of the kth distorted target point, Indicates the standard coordinate position corresponding to the kth distorted target point.

[0029] In one embodiment of the present invention, it is provided that the accuracy RMSE of evaluating distortion correction is expressed as follows:

[0030]

[0031] Among them, (x′ dk , y′ dk ) represents the corrected coordinates of the kth distorted target point.

[0032] The present invention also provides a system for determining a distortion correction coefficient of a near-eye display module, comprising:

[0033] An image acquisition module is configured to drive the display module to display a distortion correction chart, and an imaging device acquires an image of the distortion correction chart displayed by the display module, which is named as a distortion correction captured image img1;

[0034] A barycentric coordinate module, configured to determine the barycentric coordinates of the distortion correction chart;

[0035] a sorting module configured to determine the centroid coordinates of the target points of the distortion-corrected captured image img1, and sort the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart to determine the sorted centroid coordinates of the target points of the distortion-corrected captured image img1; and

[0036] The distortion correction coefficient module is configured to determine the distortion correction coefficient through a distortion correction algorithm according to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1.

[0037] The present invention also proposes a pixel-level brightness extraction method for a near-eye display module, comprising:

[0038] Determining a distortion correction coefficient of a display module;

[0039] The display module is driven to display the positioning dot matrix card, and the imaging device obtains the positioning dot matrix captured image img2 when the display module displays the positioning dot matrix card image;

[0040] Correcting the positioning point array captured image img2 by using the distortion correction coefficient to generate a distortion-free image img3;

[0041] Acquire coordinates of positioning points according to the undistorted image img3, and sort the positioning points to generate sorted positioning points;

[0042] According to the sorted positioning points, the coordinates of the positioning points before distortion correction are obtained by using an anti-distortion algorithm;

[0043] The display module is driven to display a grayscale picture, and a grayscale image img4 is acquired by an imaging device when the display module displays the grayscale picture; and

[0044] The brightness of the pixels of the display module is determined according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

[0045] In one embodiment of the present invention, it is provided that the distortion correction coefficient of the display module is determined by using the method for determining the distortion correction coefficient of the near-eye display module.

[0046] In one embodiment of the present invention, it is provided that the positioning dot matrix card and / or the positioning dot matrix captured image img2 are in a shape of a square, a rectangle, a circle, a polygon or an irregular shape.

[0047] In one embodiment of the present invention, it is provided that, according to the sorted positioning points, obtaining the coordinates of the positioning points before distortion correction by using an anti-distortion algorithm includes:

[0048] According to the sorted positioning points, the coordinates of the lamp beads driving the display module are obtained by an interpolation algorithm; and

[0049] The coordinates of the positioning points before distortion correction are obtained through the anti-distortion algorithm.

[0050] In one embodiment of the present invention, it is provided that determining the brightness of the pixel of the driving display module according to the coordinates of the positioning point before the distortion correction and the grayscale image img4 includes:

[0051] The coordinates of the positioning point before the distortion correction are used to obtain the average brightness of pixels in the neighborhood corresponding to the positioning point, and the brightness of each pixel of the driving display module is obtained.

[0052] In one embodiment of the present invention, it is provided that determining the brightness of the pixel of the driving display module according to the coordinates of the positioning point before the distortion correction and the grayscale image img4 further includes:

[0053] Determining the brightness value of the corresponding pixel on the driving display module according to the grayscale value of the pixel in the grayscale image img4;

[0054] Determining the position of the positioning point before distortion correction in the grayscale image according to the coordinates of the positioning point before distortion correction; and

[0055] And the grayscale value corresponding to the positioning point before the distortion correction is extracted to determine the brightness value of the pixel corresponding to the positioning point before the distortion correction on the driving display module.

[0056] The present invention also proposes a control system for pixel-level brightness extraction of a near-eye display module, comprising:

[0057] A distortion correction coefficient module, configured to determine a distortion correction coefficient of a display module;

[0058] A positioning dot matrix card module is configured to provide a positioning dot matrix card, control the display module to display the positioning dot matrix card, and control the imaging device to obtain a positioning dot matrix captured image img2 of the positioning dot matrix card;

[0059] A distortion correction module, configured to correct the positioning point array captured image img2 by using the distortion correction coefficient to generate a distortion-free image img3;

[0060] A positioning point coordinate acquisition module, configured to acquire the coordinates of the positioning points according to the undistorted image img3, sort the positioning points to generate sorted positioning points, and acquire the coordinates of the positioning points before distortion correction by an anti-distortion algorithm according to the sorted positioning points;

[0061] a grayscale image module, configured to control the display module to display a grayscale picture, and control the imaging device to acquire a grayscale image img4 of the grayscale picture; and

[0062] The brightness extraction module is configured to determine the brightness of the pixels of the display module according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

[0063] The present invention also proposes a pixel-level brightness extraction system for a near-eye display module, comprising:

[0064] Near-eye display module;

[0065] an imaging device configured to capture an image of the near-eye display module; and

[0066] A controller is configured to execute the steps of the above-mentioned pixel-level brightness extraction method of the near-eye display module.

[0067] In one embodiment of the present invention, it is provided that the near-eye display module includes a micro light emitting diode chip, and the micro light emitting diode chip is used for luminous imaging.

[0068] In one embodiment of the present invention, the micro light emitting diode chip comprises:

[0069] Pixel driver backplane;

[0070] A light-emitting semiconductor module is arranged on the pixel driving backplane, and comprises a light-emitting layer, a first epitaxial layer closer to the pixel driving backplane than the light-emitting layer, and a second epitaxial layer farther from the pixel driving backplane than the light-emitting layer;

[0071] An insulating layer, which is arranged on the light-emitting semiconductor module, and the insulating layer is provided with an opening at a position located on the second epitaxial layer;

[0072] a transparent conductive layer, which is arranged on the insulating layer, and the transparent conductive layer is electrically connected to the light-emitting semiconductor module through the opening; and

[0073] The microlens is arranged on the insulating layer and the transparent conductive layer at a position above the light emitting semiconductor module.

[0074] In one embodiment of the present invention, the micro light emitting diode chip further comprises:

[0075] A metal bonding layer is arranged between the pixel driving backplane and the light emitting semiconductor module to bond the pixel driving backplane and the light emitting semiconductor module together.

[0076] In one embodiment of the present invention, the micro light emitting diode chip further comprises:

[0077] A first electrode electrically connected to the integrated circuit backplane; and

[0078] The second electrode is arranged on the transparent conductive layer connection surface and is electrically connected to the light emitting semiconductor module through the transparent conductive layer.

[0079] The pixel driving backplane is provided with a plurality of integrated circuit copper pillars, wherein the light emitting semiconductor module is located above the integrated circuit copper pillars, and the first electrode is electrically connected to the pixel driving backplane through the integrated circuit copper pillars.

[0080] The present invention has at least the following beneficial effects: the present invention can significantly improve the accuracy and robustness of pixel-level brightness extraction of near-eye display modules, can be used for brightness and chromaticity measurement of VR / AR devices and subsequent non-uniformity correction of near-eye display modules, and can effectively improve the display effect and user experience of near-eye display devices. It has the advantages of low cost and convenient operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0081] To further illustrate the advantages and features of various embodiments of the present invention, a more detailed description of various embodiments of the present invention will be presented with reference to the accompanying drawings. It will be understood that these drawings only depict typical embodiments of the present invention and are therefore not to be considered as limiting the scope thereof. In the accompanying drawings, for clarity, identical or corresponding parts will be represented by identical or similar reference numerals.

[0082] Figure 1 A schematic flow chart of a method for extracting pixel-level brightness of a near-eye display module according to an embodiment of the present invention is shown.

[0083] Figure 2A A schematic diagram of a distortion correction chart according to an embodiment of the present invention is shown.

[0084] Figure 2B A schematic diagram of a distortion-corrected captured image according to an embodiment of the present invention is shown.

[0085] Figure 3A A schematic diagram of a positioning bitmap card according to an embodiment of the present invention is shown.

[0086] Figure 3B A schematic diagram of a distortion-corrected captured image according to an embodiment of the present invention is shown.

[0087] Figure 4 A schematic diagram of a pixel-level brightness extraction system for a near-eye display module according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0088] It should be noted that the components in the figures may be shown exaggeratedly for the sake of illustration and are not necessarily true to scale. In the figures, identical or functionally identical components are provided with the same reference numerals.

[0089] In the present invention, unless otherwise specified, "arranged on...", "arranged above..." and "arranged above..." do not exclude the existence of an intermediate between the two. In addition, "arranged on or above..." merely indicates the relative positional relationship between two components, and in certain cases, such as after reversing the product direction, it can also be converted into "arranged below or below...", and vice versa.

[0090] In the present invention, each embodiment is only intended to illustrate the aspects of the present invention and should not be construed as limiting.

[0091] In the present invention, unless otherwise specified, the quantifiers "a", "an" and "an" do not exclude the presence of a plurality of elements.

[0092] It should also be noted that in the embodiments of the present invention, for the sake of clarity and simplicity, only a portion of the parts or components may be shown, but those of ordinary skill in the art will understand that under the teachings of the present invention, the required parts or components may be added according to the needs of the specific scenario. In addition, unless otherwise specified, the features in different embodiments of the present invention may be combined with each other. For example, a feature in the second embodiment may be used to replace a corresponding or functionally identical or similar feature in the first embodiment, and the resulting embodiment also falls within the disclosure scope or recorded scope of the present application.

[0093] It should also be noted that within the scope of the present invention, the terms "same", "equal", "equal to" and the like do not mean that the values ​​of the two are absolutely equal, but allow a certain reasonable error, that is, the terms also cover "substantially the same", "substantially equal", "substantially equal to". By analogy, in the present invention, the terms "perpendicular to", "parallel to" and the like indicating directions also cover the meanings of "substantially perpendicular to" and "substantially parallel to".

[0094] In the present application, the term "configuration" refers to the setting of the shape, structure, material and / or function of the target object to achieve the desired technical effect, wherein "configuration" includes a variety of alternative technical means for achieving the technical effect, which become obvious under the teaching of the present application.

[0095] In addition, the numbering of the steps of the methods of the present invention does not limit the execution order of the method steps. Unless otherwise specified, the method steps can be executed in different orders.

[0096] The present invention will be further described below in conjunction with specific embodiments with reference to the accompanying drawings.

[0097] Figure 1 FIG. 2 is a flow chart showing a method for extracting pixel-level brightness of a near-eye display module according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0098] Step 101 : driving the display module to display the distortion correction chart, and obtaining, by an imaging device, the image of the distortion correction chart displayed by the display module, which is named as the distortion correction captured image img1 .

[0099] Step 102: Obtain the centroid coordinates of the distortion correction chart and the centroid coordinates of the target point of the distortion correction chart.

[0100] Step 103, obtaining the centroid coordinates of the target points of the distortion-corrected image img1, and sorting the centroid coordinates of the target points of the distortion-corrected image img1 based on the coordinate order of the centroid coordinates of the target points of the distortion-corrected chart;

[0101] Step 104 : determining a distortion correction coefficient according to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1 by using a distortion correction algorithm.

[0102] Step 105 , providing a positioning dot matrix card, driving the display module to display the positioning dot matrix card, and obtaining, by an imaging device, a positioning dot matrix captured image img2 when the display module displays the positioning dot matrix card image.

[0103] Step 106: Correct the positioning point array captured image img2 using a distortion correction coefficient to generate a distortion-free image img3.

[0104] Step 107: Obtain coordinates of positioning points according to the undistorted image img3, and sort the positioning points.

[0105] Step 108: determine the coordinates of the lamp beads of the display module according to the coordinates of the sorted positioning points, and obtain the coordinates of the lamp beads of the display module before distortion correction by using an anti-distortion algorithm.

[0106] Step 109 , driving the display module to display a grayscale picture, and obtaining, by an imaging device, a grayscale image img4 when the display module displays the grayscale picture.

[0107] Step 110 : determining the brightness of the pixels of the display module according to the coordinates of the positioning points before the distortion correction and the grayscale image img4 .

[0108] The steps of the method are described in detail below with reference to the accompanying drawings.

[0109] In step 101, a distortion correction chart is provided, a display module is driven to display the distortion correction chart, and an imaging device acquires a distortion-corrected captured image img1 of the distortion correction chart.

[0110] Figure 2A A schematic diagram of a distortion correction chart according to an embodiment of the present invention is shown. Figure 2B A schematic diagram of a distortion-corrected captured image according to an embodiment of the present invention is shown. In some embodiments, the distortion-corrected chart and the distortion-corrected captured image are rectangular in shape. In other embodiments, the distortion-corrected chart and the distortion-corrected captured image are square, polygonal, circular, or irregular in shape.

[0111] In step 102, the centroid coordinates of the distortion correction chart and the centroid coordinates of the target point of the distortion correction chart are obtained.

[0112] In some embodiments, the centroid coordinates (x ck ,y ck Here, the centroid coordinates (x ck ,y ck ) is obtained by using a standard distortion correction chart generated by an image processing algorithm. It is the theoretical center position of each target point on the distortion correction chart under ideal distortion-free conditions. These coordinates are known and serve as a reference for distortion correction.

[0113] In some embodiments, the centroid coordinates (x c ,y c ), expressed as the following formula:

[0114]

[0115] Among them, (x i ,y i ) represents the coordinates of the pixel points on the distortion correction chart, I(x i ,y i ) represents the gray value of the pixel, and n represents the number of pixels.

[0116] In step 103, the centroid coordinates of the sorted target points of the distortion-corrected captured image img1 are obtained.

[0117] In some embodiments, threshold segmentation, morphological processing or connected domain analysis (Blob analysis) is used to obtain the centroid coordinates of the target point of the distortion-corrected image img1, and the centroid coordinates of the target point of the distortion-corrected image img1 are sorted according to the coordinate order of the distortion-corrected chart.

[0118] In some embodiments, the target point set of the distortion correction chart is first sorted from small to large according to the size of the y coordinate using a zigzag sort, and each row is sorted according to the number of points in each row of the target point to generate a sorted point set coordinate (x dk ,y dk ).

[0119] Furthermore, according to the distance of the target point in the distortion-corrected image img1, the centroid coordinates of the target point of the distortion-corrected chart are transformed to obtain the centroid coordinates (x uk ,y uk ), expressed as the following formula:

[0120] x uk =(x ck -x c0)×sx+x d0

[0121] y uk =(y ck -y c0 )×sy+y d0

[0122] Among them, (x ck ,y ck ) represents the centroid coordinates of the distortion correction chart, x c0 Indicates the x-coordinate and y-coordinate of the first point on the upper left corner of the distortion correction chart c0 represents the y coordinate of the first point on the upper left of the distortion correction chart, sx represents the scale of the correction chart in the x direction of the actual image, sy represents the scale of the correction chart in the y direction of the actual image, and x d0 Indicates the x-coordinate and y-coordinate of the first point in the upper left corner of the sorted point set of the captured image. d0 Indicates the y coordinate of the first upper left point in the sorted point set of the captured image.

[0123] The target point near the center point of the distortion correction chart (the optical distortion in the center area is the smallest) is selected according to the Euclidean distance (i.e., the minimum value of the coordinates of the target point near the center point), which is expressed as the following formula:

[0124]

[0125] Wherein, w represents the width of the distortion-corrected image img1, and h represents the height of the distortion-corrected image img1.

[0126]

[0127] Among them, x d(i+1)j Indicates the x-coordinate and y-coordinate of the point represented by the i+1th column and jth row when the distorted target points are arranged in two dimensions. dij Indicates the y coordinate of the point represented by the i-th column and j-th row when the distorted target points are arranged in two dimensions, x cij Indicates the x-coordinate of the point represented by the i-th column and the j-th row when the target points are arranged in two dimensions. cij Indicates the y coordinate of the point represented by the i-th column and j-th row when the target points are arranged in two dimensions.

[0128] In step 104, a distortion correction coefficient is determined by a distortion correction algorithm.

[0129] In some embodiments, the distortion correction coefficient a is obtained by an adjustment optimization algorithm. ij and b ij , and distortion correction is performed, which is expressed as follows:

[0130]

[0131] Among them, (x dk ,y dk ) represents the coordinates of the kth distorted target point, (x uk ,y uk ) represents the standard coordinate position corresponding to the kth distorted target point, where the distortion correction coefficient a is determined by evaluating the accuracy of the distortion correction ij and b ij .

[0132] In some embodiments, the accuracy of the distortion correction is evaluated by the following formula:

[0133]

[0134] Among them, RMSE represents the root mean square error, (x dk ,y dk ) represents the coordinates of the kth distorted target point, (x′ dk , y′ dk ) represents the corrected coordinates of the kth distorted target point, and n represents the number of points selected for evaluation.

[0135] In step 105, a positioning dot matrix card is provided, a display module is driven to display the positioning dot matrix card, and an imaging device acquires a positioning dot matrix captured image img2 of the positioning dot matrix card. Figure 3A A schematic diagram of a positioning bitmap card according to an embodiment of the present invention is shown. Figure 3B FIG. 2 is a schematic diagram showing a distortion correction method for capturing an image according to an embodiment of the present invention. Figure 3A As shown, the positioning dot matrix card is composed of neatly arranged dots, with obvious intervals between dots, consistent shapes and sizes, and even distribution. The precise position of the center point of the positioning dot matrix card is known and used as a reference for subsequent distortion correction. Figure 3B As shown in the figure, the dot matrix of the distortion-corrected image is no longer regular, the positions of the dots are offset, the intervals between the dots are uneven, and the overall image may be curved or deformed. The distortion-corrected image is a dot matrix actually captured. Due to lens distortion and other reasons, the positions of the dots are offset, which is different from the ideal image. Figure 3A In comparison, there is a difference between the actual position of the point and the ideal position, which is distortion.

[0136] In step 106, the positioning point array captured image img2 is corrected by using a distortion correction coefficient to generate a distortion-free image img3.

[0137] In step 107, the coordinates of the positioning points are obtained according to the undistorted image img3, and the positioning points are sorted.

[0138] In step 108, the coordinates of the positioning points before distortion correction are obtained by using an anti-distortion algorithm according to the sorted positioning points.

[0139] In some embodiments, the coordinates of the lamp beads driving the display module are obtained through an interpolation algorithm based on the sorted positioning points, and the coordinates of the positioning points before distortion correction are obtained through an anti-distortion algorithm. The use of this algorithm can minimize the loss of accuracy caused by the interpolation of the anti-distortion algorithm for the image, and there is no need to perform distortion correction on the images of all the lamp beads when extracting the brightness, which can effectively reduce the time consumption of the algorithm.

[0140] In step 109 , the display module is driven to display a grayscale picture, and the imaging device acquires a grayscale image img4 of the grayscale picture.

[0141] In step 110, the brightness of the pixels of the driving display module is determined according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

[0142] In some embodiments, the coordinates of the positioning point before the distortion correction are used to obtain the average brightness of pixels in a neighborhood corresponding to the positioning point, and the brightness of each pixel of the driving display module is obtained.

[0143] In some embodiments, the brightness value of the corresponding pixel on the driving display module is determined according to the grayscale value of the pixel in the grayscale image img4, the position of the positioning point before distortion correction in the grayscale image is determined by the coordinates of the positioning point before distortion correction, and the grayscale value corresponding to the positioning point before distortion correction is extracted to determine the brightness value of the pixel corresponding to the positioning point before distortion correction on the driving display module.

[0144] The present invention also proposes a control system for pixel-level brightness extraction of a near-eye display module, comprising:

[0145] A distortion correction coefficient module, configured to determine a distortion correction coefficient of a display module;

[0146] A positioning dot matrix card module is configured to provide a positioning dot matrix card, control the display module to display the positioning dot matrix card, and control the imaging device to obtain a positioning dot matrix captured image img2 of the positioning dot matrix card;

[0147] A distortion correction module, configured to correct the positioning point array captured image img2 by using the distortion correction coefficient to generate a distortion-free image img3;

[0148] A positioning point coordinate acquisition module, configured to acquire the coordinates of the positioning points according to the undistorted image img3, sort the positioning points to generate sorted positioning points, and acquire the coordinates of the positioning points before distortion correction by an anti-distortion algorithm according to the sorted positioning points;

[0149] a grayscale image module, configured to control the display module to display a grayscale picture, and control the imaging device to acquire a grayscale image img4 of the grayscale picture; and

[0150] The brightness extraction module is configured to determine the brightness of the pixels of the display module according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

[0151] In one embodiment of the present invention, a pixel-level brightness extraction system for a near-eye display module is also provided, and the system is configured to execute the steps according to the method.

[0152] The present invention also proposes a pixel-level brightness extraction system for a near-eye display module. Figure 4 FIG. 2 is a schematic diagram of a pixel-level brightness extraction system for a near-eye display module according to an embodiment of the present invention. Figure 4 As shown, the system includes an imaging device 401 , a near-eye display module 402 , a controller 403 , an optional router 404 , and an optional network 405 .

[0153] In some embodiments, the imaging device 401 is configured to capture a pixel image of the near-eye display module 402 .

[0154] In some embodiments, the controller 403 may be in various forms, such as a microprocessor CPU, a microcontroller MCU, an application-specific integrated circuit AISC, a field programmable gate array FPGA, a personal computer, etc. Here, the controller 403 is shown as a computer. The controller 403 is configured to perform pixel-level brightness extraction on the near-eye display module 402, for example, through software or hardware programming.

[0155] In some embodiments, the router 404 is configured to connect the imaging device 401 to the network 405. Alternatively, in another application scenario, the router 404 is configured to enable communication between the imaging device 401 and the controller 403, for example, the imaging device 401 and the controller 403 are both connected to the router 404, so that they can communicate directly by wire or wirelessly. The router 404 can be, for example, a wired router or a Wi-Fi router.

[0156] In some embodiments, the network 405 is configured to enable communication between the controller 403 and the router 404, and further enable communication between the controller 403 and the imaging device 401. The network 405 may be, for example, the Internet, an intranet, etc. The near-eye display module 402 may optionally also be connected to the network 405 or the router 404, so that the controller 403 can send a control signal to the near-eye display module 402 through the network 405 or the router 404 to light up the corresponding first pixel, thereby realizing remote testing. Here, the near-eye display module 402 is connected to the router 404. Of course, the near-eye display module 402 may also be connected to a controller located on site to achieve direct control.

[0157] It performs pixel-level brightness extraction according to the method. The near-eye display module has a micro-LED chip for emitting light. The size of the micro-LED chip does not exceed 1 cm, preferably does not exceed 20 microns. The micro-LED structure is formed in the micro-LED chip 102 in an array form, and the resolution is, for example, 720*480, 640*480, 1920*1080, 1280*720, 2K or 4K. The diameter of the micro-LED structure is at the nanometer level, for example, 20nm to 100nm.

[0158] The micro-LED chip includes an integrated circuit (IC) backplane and an active area arranged on the integrated circuit backplane, wherein the active area includes a pixel array formed by micro-LEDs, and the pixel array includes a plurality of micro-LED pixels. Each pixel may include one or more micro-LEDs. That is, each micro-LED may form at least a portion of a pixel element on the micro-LED chip. For example, each pixel may include a micro-LED of one color, whereby the active area of ​​the micro-LED chip is a monochrome pixel array. Alternatively, each pixel may include micro-LEDs of two or more colors, whereby the active area of ​​the micro-LED chip is a color pixel array.

[0159] In some embodiments, the IC backplane can be electrically connected to each micro-LED in the micro-LED array via a separate metal interconnect. In some embodiments, each micro-LED can be electrically controlled individually by the IC backplane. In some embodiments, the IC backplane can be electrically connected to the electrodes of the micro-LED chip via metal interconnects. In some embodiments, a dielectric layer can be formed in the gaps between the micro-LEDs. In some embodiments, a dielectric layer can also be formed in the gaps between the interconnects.

[0160] In some embodiments, the IC backplane is provided with an array of drive circuits. Each drive circuit is a pixel driver. In some cases, the drive circuit is a thin film transistor pixel driver or a silicon CMOS pixel driver. The drive circuits form individual pixel drivers to control the operation of individual multi-color Micro-LED pixels.

[0161] The micro LED chip includes a plurality of micro LED arrays, each of which includes a plurality of micro LEDs. The driving mode of the micro LEDs is, for example, passive matrix (PM) driving, wherein the cathodes of all the micro LEDs in each array are connected to the cathode line NL, and the micro LEDs with the same number in each array are connected to the corresponding anode line PL. Thus, the on / off and the light emitting brightness of each LED can be individually controlled by controlling the model numbers on the corresponding cathode line and anode line.

[0162] In some embodiments, each micro-LED in the micro-LED array may include a micron-scale light-emitting mesa structure. In some embodiments, the micron-scale light-emitting mesa structure may include a first type epitaxial layer (or first epitaxial layer), a light-emitting layer, and a second type epitaxial layer (or second epitaxial layer) from bottom to top. That is, in the three-layer structure, the first type epitaxial layer is closest to the IC backplane; the light-emitting layer is located above the first type epitaxial layer and further away from the IC backplane; the second type epitaxial layer is located above the light-emitting layer and farthest away from the IC backplane. In some embodiments, the light-emitting layer is formed by a plurality of stacked quantum well layers, in particular, quantum well layers stacked in a superlattice. Preferably, the quantum well layer stacked in a superlattice includes a plurality of pairs of quantum well layers stacked with quantum barrier layers. In one embodiment of the present invention, the quantum well layer is an InGaN / GaN multi-quantum well layer or an InGaN / AIGaN multi-quantum well layer or an InGaAs / AIGaAs multi-quantum well layer. In one embodiment of the present invention, the light-emitting layer further includes an electron blocking layer, which is disposed on a first side of the light-emitting layer, and the first side refers to a side along which electrons migrate out of the light-emitting layer.

[0163] In some embodiments, the first type epitaxial layer is a semiconductor material having a first conductivity type and includes a plurality of semiconductor layers. The main matrix material of the first type epitaxial layer may be, but is not limited to, Ga, N, As, P, In, or Al. In addition, the first type epitaxial layer may include, but is not limited to, a waveguide layer, a confinement layer, a transition layer, and a window layer from top to bottom; in addition, an ohmic contact layer may be formed below the window layer. In some embodiments, the second type epitaxial layer is a semiconductor material having a second conductivity type and includes a plurality of semiconductor layers. The main matrix material of the second type epitaxial layer may be, but is not limited to, Ga, N, As, P, In, or Al. In addition, the first type epitaxial layer may include, but is not limited to, a confinement layer and a waveguide layer from top to bottom; in addition, in some embodiments, an ohmic contact layer may be formed on the confinement layer. In one embodiment of the present invention, the first type epitaxial layer is an N-type GaN layer or an N-type AlGaN layer, and the second type epitaxial layer is a P-type GaN layer or a P-type AlGaN layer. In another embodiment of the present invention, the first type of epitaxial layer may also be a P-type GaN layer or a P-type AlGaN layer, and the second type of epitaxial layer may be an N-type GaN layer or an N-type AlGaN layer. In an embodiment of the present invention, the semiconductor light-emitting mesa 501 is stepped or trapezoidal. In some embodiments, the micron-scale light-emitting mesa structure may emit red light, blue light, green light, or light of any other color.

[0164] In some embodiments, a top conductive layer can be formed on the top surface of the micro light emitting diode array. In some embodiments, the top conductive layer can be shared by all micro light emitting diodes in the micro light emitting diode array.

[0165] In one embodiment of the present invention, the top conductive layer can be shared by all micro-LEDs in the micro-LED array. In one embodiment of the present invention, the top conductive layer is disposed above the micro-LED array, and contacts and covers the top of each light-emitting mesa, and is in electrical contact with the second epitaxial layer of the light-emitting mesa, so as to connect the second epitaxial layers of each semiconductor light-emitting mesa 1 in series, and is a transparent conductive layer.

[0166] In one embodiment of the present invention, the micro-LED array further comprises a passivation insulating layer. The passivation insulating layer covers the surface and side of the light-emitting mesa, but exposes at least part of the surface of the second epitaxial layer, and the top conductive layer is arranged on the surface of the passivation insulating layer. In one embodiment of the present invention, the passivation insulating layer can be formed by CVD deposition of SiO2 or ALD deposition of Al2O3 film layer to effectively reduce the chip leakage rate. In some embodiments of the present invention, the passivation insulating layer only covers the side of the light-emitting mesa, but not the top surface of the light-emitting mesa, and the highest point of the passivation insulating layer is flush with the top surface of the light-emitting mesa. In these embodiments, the continuous top conductive layer covering the top of the light-emitting mesa is in a horizontal or substantially horizontal plane. In some embodiments of the present invention, the passivation insulating layer not only covers the side of the light-emitting mesa, but also covers the edge of the top surface of the light-emitting mesa, so that there is a bulge at the top edge of the light-emitting mesa, so that the continuous top conductive layer covering it also forms a bulge at the top edge of the light-emitting mesa.

[0167] As mentioned above, there is a partition between the pixels formed by each light-emitting mesa, and a second electrode is arranged at the partition, and the second electrode is arranged on the surface of the top conductive layer. In one embodiment of the present invention, the second electrode is a ring-shaped reflective electrode, which is arranged around the light-emitting mesa, and is formed by magnetron sputtering or evaporation, and its material, for example, can use Al or Al alloy metal as a side wall reflector, and the electrode stack metal can be Ni, Al, Ti, Ni, Pt, Au and other metal materials. In one embodiment of the present invention, each second electrode is connected to each other. In some embodiments of the present invention, a deep groove is arranged at the partition between two adjacent light-emitting mesas, and the deep groove runs through the micro-light-emitting diode array, and the second electrode is arranged at the deep groove. In some embodiments of the present invention, a deep groove is not arranged at the partition between two adjacent light-emitting mesas, but a passivation isolation layer and a top conductive layer are directly formed, so that the surface of the top conductive layer between two adjacent light-emitting mesas is a horizontal or substantially horizontal plane, and the second electrode is formed here, and its morphological interface is a trapezoid or approximately a trapezoid, and the surface of the second electrode is not higher than the highest point of the continuous top conductive layer.

[0168] In one embodiment of the present invention, the micro light-emitting diode array is bonded to the driving backplane through a metal bonding layer and is electrically connected to the IC copper pillars on the driving backplane. In one embodiment of the present invention, the IC copper pillars include a first IC copper pillar and a second IC copper pillar, wherein the first IC copper pillar is electrically connected to the first epitaxial layer of the semiconductor light-emitting module one by one. The second IC copper pillar is electrically connected to the first electrode 6. In one embodiment of the present invention, the polarity of the first electrode is opposite to that of the second electrode. In one embodiment of the present invention, each semiconductor light-emitting module has a common first electrode. The first electrode may be, for example, a P electrode or an anode electrode, and the second electrode is an electrode with a polarity opposite to that of the first electrode 506, such as an N electrode or a cathode electrode. In one embodiment of the present invention, the first and second electrodes and their connecting components may be made of materials such as graphene, IT0, aluminum-doped zinc oxide (AZ0), or fluorine-doped tin oxide (FT0), or any combination of the above materials. In yet another embodiment of the present invention, the first and second electrodes and their connecting components may be made of a non-transparent or transparent conductive material, such as indium tin oxide (IT0).

[0169] In some embodiments, the light-emitting layer may include at least one quantum well layer. In some embodiments, the micro light-emitting diode array may include a single-layer micro light-emitting diode structure. In some embodiments, the micro light-emitting diode array may include a multi-layer vertically stacked micro light-emitting diode structure.

[0170] In some embodiments, the micro light-emitting diode array may include micro light-emitting diodes of one or more colors. In some embodiments, the pitch of the micro light-emitting diode array, i.e., the minimum center-to-center distance between micro light-emitting diodes, may be between about 2 microns and about 50 microns. In some embodiments, the number of pixels on the micro light-emitting diode chip may be between several thousand and several million.

[0171] In some embodiments, a microlens is disposed above the micro light-emitting diode array, and the lateral dimension of the bottom of the microlens is larger than the lateral dimension of the light-emitting region of the micro light-emitting diode, or the lateral dimension of the bottom of the microlens may be smaller than or equal to the lateral dimension of the light-emitting region of the micro light-emitting diode.

[0172] In some embodiments, one microlens may cover one or more micro light-emitting diodes without lenses. A plurality of microlenses form a microlens array. The microlenses in the microlens array are generally the same. Examples of microlenses include spherical microlenses, aspherical microlenses, Fresnal microlenses, and cylindrical microlenses. Each microlens in the microlens array of the micro light-emitting diode chip 102 may be the same or different in terms of shape, curvature, optical power, size, base, spacing, etc.

[0173] In some embodiments, the microlens can be made of various materials that are transparent to the wavelengths of light emitted by the micro-LED. Exemplary transparent materials for the microlens include polymers, dielectric materials. In some embodiments, the dielectric material includes one or more materials such as silicon oxide, silicon nitride, silicon carbide, titanium oxide, zirconium oxide, aluminum oxide, etc. In some embodiments, the microlens is made of photoresist. In some embodiments, the microlens is directly deposited on the surface of the micro-LED by chemical vapor deposition (CVD) technology.

[0174] The present invention can significantly improve the accuracy and robustness of pixel-level brightness extraction of near-eye display modules, and can be used for brightness and chromaticity measurement of VR / AR devices and subsequent non-uniformity correction of near-eye display modules, which can effectively improve the display effect and user experience of near-eye display devices. It has the advantages of low cost and convenient operation.

[0175] Although various embodiments of the present invention are described above, it should be understood that they are presented as examples only and not as limitations. It is obvious to those skilled in the relevant art that various combinations, modifications and changes can be made thereto without departing from the spirit and scope of the present invention. Therefore, the breadth and scope of the present invention disclosed herein should not be limited by the exemplary embodiments disclosed above, but should only be defined according to the attached claims and their equivalents.

Claims

1. A method for determining a distortion correction coefficient of a near-eye display module, characterized in that: include: The display module is driven to display the distortion correction chart, and the image of the distortion correction chart displayed by the display module is acquired by an imaging device, which is named as the distortion correction captured image img1; Determining the centroid coordinates of the distortion correction chart; Determine the centroid coordinates of the target points of the distortion-corrected captured image img1, and sort the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart to determine the sorted centroid coordinates of the target points of the distortion-corrected captured image img1; and According to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1, a distortion correction coefficient is determined by a distortion correction algorithm.

2. The method for determining the distortion correction coefficient of the near-eye display module according to claim 1, characterized in that: The shape of the distortion correction chart and / or the distortion correction captured image img1 is square, rectangular, circular, polygonal or irregular.

3. The method for determining the distortion correction coefficient of the near-eye display module according to claim 1, characterized in that: Calculate the centroid coordinates (x c ,y c ), expressed as the following formula: Among them, (x i ,y i ) represents the coordinates of the i-th pixel point on the distortion correction chart, I(x i ,y i ) represents the grayscale value of the pixel, and n represents the number of pixels.

4. The method for determining the distortion correction coefficient of the near-eye display module according to claim 3, characterized in that: Determining the centroid coordinates of the target point of the distortion-corrected captured image img1 includes: using threshold segmentation, morphological processing or connected domain analysis to obtain the centroid coordinates of the target point of the distortion-corrected captured image img1.

5. The method for determining the distortion correction coefficient of the near-eye display module according to claim 4, characterized in that: Sorting the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart includes: The target points of the distortion correction chart are sorted in ascending order according to the size of the y coordinates using a zigzag sort, and each row is sorted according to the number of points in each row of the target points of the distortion correction chart to generate a sorted point set coordinate (x dk ,y dk ); According to the distance of the target point in the distortion-corrected image img1, the centroid coordinates of the target point of the distortion-corrected chart are transformed to determine the centroid coordinates (x uk ,y uk ), expressed as the following formula: x uk =(x ck -x c0 )×sx+x d0 and uk (and ck -and c0 )×sy+y d0 Among them, (x ck ,y ck ) represents the centroid coordinates of the distortion correction chart, x c0 Indicates the x-coordinate and y-coordinate of the first point on the upper left corner of the distortion correction chart c0 represents the y coordinate of the first point on the upper left of the distortion correction chart, sx represents the scale of the correction chart in the x direction of the actual image, sy represents the scale of the correction chart in the y direction of the actual image, and x d0 Indicates the x-coordinate and y-coordinate of the first point in the upper left corner of the sorted point set of the captured image. d0 Indicates the y coordinate of the first upper left point in the sorted point set of the captured image.

6. The method for determining the distortion correction coefficient of the near-eye display module according to claim 5, characterized in that: The target point near the center point of the distortion correction chart is selected according to the Euclidean distance d, which is expressed as follows: Wherein, w represents the width of the distortion-corrected image img1, and h represents the height of the distortion-corrected image img1.

7. The method for determining the distortion correction coefficient of the near-eye display module according to claim 6, characterized in that: The calculation process of sx and sy is expressed as follows: Among them, x d(i+1)j Indicates the x-coordinate of the point represented by the i+1th column and jth row when the distorted target points are arranged in two dimensions, x dij Indicates the x-coordinate of the point represented by the i-th column and the j-th row when the distorted target points are arranged in two dimensions, di(j+1) Indicates the y coordinate of the point represented by the i-th column and j+1-th row when the distorted target points are arranged in two dimensions, y dij Indicates the y coordinate of the point represented by the i-th column and j-th row when the distorted target points are arranged in two dimensions, x c(i+1)j Indicates the x-coordinate of the point represented by the i+1th column and jth row when the target points are arranged in two dimensions. ci(j+1) Indicates the y coordinate of the point represented by the i-th column and j+1-th row when the target points are arranged in two dimensions, cij Indicates the x-coordinate of the point represented by the i-th column and the j-th row when the target points are arranged in two dimensions. cij Indicates the y coordinate of the point represented by the i-th column and j-th row when the target points are arranged in two dimensions.

8. The method for determining the distortion correction coefficient of the near-eye display module according to claim 7, characterized in that: According to the centroid coordinates of the sorted target points of the distortion-corrected image img1, determining the distortion correction coefficient by the distortion correction algorithm includes: obtaining the distortion correction coefficient a by the over-adjustment optimization algorithm ij and b ij , and determine the distortion correction coefficient a by evaluating the accuracy of the distortion correction ij and b ij , expressed as the following formula: Among them, (x dk ,y dk ) represents the coordinates of the kth distorted target point, Indicates the standard coordinate position corresponding to the kth distorted target point.

9. The method for determining the distortion correction coefficient of the near-eye display module according to claim 8, characterized in that: The RMSE of the accuracy of distortion correction is expressed as follows: Among them, (x′ dk , y′ dk ) represents the corrected coordinates of the kth distorted target point.

10. A system for determining a distortion correction coefficient of a near-eye display module, characterized in that: include: An image acquisition module is configured to drive the display module to display a distortion correction chart, and an imaging device acquires an image of the distortion correction chart displayed by the display module, which is named as a distortion correction captured image img1; A barycentric coordinate module, configured to determine the barycentric coordinates of the distortion correction chart; a sorting module configured to determine the centroid coordinates of the target points of the distortion-corrected captured image img1, and sort the centroid coordinates of the target points of the distortion-corrected captured image img1 according to the coordinate sequence of the distortion-corrected chart to determine the sorted centroid coordinates of the target points of the distortion-corrected captured image img1; and The distortion correction coefficient module is configured to determine the distortion correction coefficient through a distortion correction algorithm according to the centroid coordinates of the sorted target points of the distortion-corrected captured image img1.

11. A pixel-level brightness extraction method for a near-eye display module, characterized in that: include: Determining a distortion correction coefficient of a display module; The display module is driven to display the positioning dot matrix card, and the imaging device obtains the positioning dot matrix captured image img2 when the display module displays the positioning dot matrix card image; Correcting the positioning point array captured image img2 by using the distortion correction coefficient to generate a distortion-free image img3; Acquire coordinates of positioning points according to the undistorted image img3, and sort the positioning points to generate sorted positioning points; According to the sorted positioning points, the coordinates of the positioning points before distortion correction are obtained by using an anti-distortion algorithm; The display module is driven to display a grayscale picture, and a grayscale image img4 is acquired by an imaging device when the display module displays the grayscale picture; and The brightness of the pixels of the display module is determined according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

12. The pixel-level brightness extraction method for a near-eye display module according to claim 11, characterized in that: The distortion correction coefficient of the display module is determined by using the method for determining the distortion correction coefficient of the near-eye display module described in any one of claims 1 to 9.

13. The pixel-level brightness extraction method for a near-eye display module according to claim 11, It is characterized in that The positioning dot matrix card and / or the positioning dot matrix captured image img2 may be in a shape of a square, a rectangle, a circle, a polygon or an irregular shape.

14. The pixel-level brightness extraction method for a near-eye display module according to claim 11, characterized in that: According to the sorted positioning points, obtaining the coordinates of the positioning points before distortion correction by using an anti-distortion algorithm includes: According to the sorted positioning points, the coordinates of the lamp beads driving the display module are obtained by an interpolation algorithm; and The coordinates of the positioning points before distortion correction are obtained through the anti-distortion algorithm.

15. The pixel-level brightness extraction method for a near-eye display module according to claim 11, characterized in that: Determining the brightness of the pixel of the driving display module according to the coordinates of the positioning point before the distortion correction and the grayscale image img4 includes: The coordinates of the positioning point before the distortion correction are used to obtain the average brightness of pixels in the neighborhood corresponding to the positioning point, and the brightness of each pixel of the driving display module is obtained.

16. The pixel-level brightness extraction method for a near-eye display module according to claim 15, characterized in that: Determining the brightness of the pixel of the driving display module according to the coordinates of the positioning point before the distortion correction and the grayscale image img4 further includes: Determining the brightness value of the corresponding pixel on the driving display module according to the grayscale value of the pixel in the grayscale image img4; Determining the position of the positioning point before distortion correction in the grayscale image according to the coordinates of the positioning point before distortion correction; and And the grayscale value corresponding to the positioning point before the distortion correction is extracted to determine the brightness value of the pixel corresponding to the positioning point before the distortion correction on the driving display module.

17. A control system for pixel-level brightness extraction of a near-eye display module, characterized in that: include: A distortion correction coefficient module, configured to determine a distortion correction coefficient of a display module; A positioning dot matrix card module is configured to provide a positioning dot matrix card, control the display module to display the positioning dot matrix card, and control the imaging device to obtain a positioning dot matrix captured image img2 of the positioning dot matrix card; A distortion correction module, configured to correct the positioning point array captured image img2 by using the distortion correction coefficient to generate a distortion-free image img3; A positioning point coordinate acquisition module, configured to acquire the coordinates of the positioning points according to the undistorted image img3, sort the positioning points to generate sorted positioning points, and acquire the coordinates of the positioning points before distortion correction by an anti-distortion algorithm according to the sorted positioning points; A grayscale image module, configured to control the display module to display a grayscale picture, and control an imaging device to acquire a grayscale image img4 of the grayscale picture; as well as The brightness extraction module is configured to determine the brightness of the pixels of the display module according to the coordinates of the positioning points before the distortion correction and the grayscale image img4.

18. A pixel-level brightness extraction system for a near-eye display module, characterized in that: include: Near-eye display module; An imaging device configured to capture an image of the near-eye display module; as well as A controller configured to perform the steps of the method according to any one of claims 1-14.

19. The pixel-level brightness extraction system for a near-eye display module according to claim 18, characterized in that: The near-eye display module includes a micro light emitting diode chip, and the micro light emitting diode chip is used for luminous imaging.

20. The pixel-level brightness extraction system for a near-eye display module according to claim 19, characterized in that: The micro light emitting diode chip comprises: Pixel driver backplane; A light-emitting semiconductor module is arranged on the pixel driving backplane, and comprises a light-emitting layer, a first epitaxial layer closer to the pixel driving backplane than the light-emitting layer, and a second epitaxial layer farther from the pixel driving backplane than the light-emitting layer; An insulating layer, which is arranged on the light-emitting semiconductor module, and the insulating layer is provided with an opening at a position located on the second epitaxial layer; a transparent conductive layer, which is arranged on the insulating layer, and the transparent conductive layer is electrically connected to the light-emitting semiconductor module through the opening; and The microlens is arranged on the insulating layer and the transparent conductive layer at a position above the light emitting semiconductor module.

21. The pixel-level brightness extraction system for a near-eye display module according to claim 19, characterized in that: The micro light emitting diode chip further comprises: A metal bonding layer is arranged between the pixel driving backplane and the light emitting semiconductor module to bond the pixel driving backplane and the light emitting semiconductor module together.

22. The pixel-level brightness extraction system for a near-eye display module according to claim 19, characterized in that: The micro light emitting diode chip further comprises: A first electrode electrically connected to the integrated circuit backplane; and The second electrode is arranged on the transparent conductive layer connection surface and is electrically connected to the light emitting semiconductor module through the transparent conductive layer. The pixel driving backplane is provided with a plurality of integrated circuit copper pillars, wherein the light emitting semiconductor module is located above the integrated circuit copper pillars, and the first electrode is electrically connected to the pixel driving backplane through the integrated circuit copper pillars.

Images