Chromatic aberration defect compensation data determination and compensation method and augmented reality equipment

Abstract

The embodiment of the invention provides a color difference defect compensation data determination and compensation method and augmented reality equipment, and the method comprises the steps: obtaining an imaging image of an augmented reality device, and carrying out the preprocessing of the imaging image, and obtaining a first image; detecting a chromatic aberration defect in the first image by using a preset filtering algorithm; obtaining the position of the chromatic aberration defect area and chromatic aberration defect data; and generating corresponding chromatic aberration defect compensation data based on the chromatic aberration defect data. According to the color difference defect compensation data determination method provided by the embodiment of the invention, the position of the color difference defect area and the corresponding color difference defect compensation data are determined through the preset filtering algorithm detection result, and the augmented reality device can execute the color difference defect compensation data compensation method provided by the embodiment of the invention; the display content of the augmented reality display device is compensated, the compensated display picture is obtained, the display effect of the augmented reality display device is improved, and color deviation is corrected.

Description

Technical Field

[0001] The present disclosure relates to the field of augmented reality, and in particular, to a method for determining compensation data for chromatic aberration defects, a compensation method, and an augmented reality device. Background Art

[0002] In augmented reality (AR) technology, waveguide display technology is a commonly used implementation method, which presents virtual images by guiding light to the user's eyes. However, in the existing AR glasses waveguide display technology, due to the defects of the waveguide and the display panel, the quality of the imaged image is affected. Due to the propagation and refraction of light in the waveguide material and the defects of the display panel itself, defects such as uneven brightness, chromatic aberration, distortion of image chromaticity information, graininess of the image, and uneven pixels may occur on the image. This difference is the AR display chromatic aberration defect. With the continuous improvement of the requirements for the imaging quality of AR display devices, there is an urgent need for a method to correct the AR display chromatic aberration defect to improve the imaging quality of AR display devices. Summary of the Invention

[0003] Embodiments of the present disclosure provide a method for determining compensation data for chromatic aberration defects, a compensation method, and an augmented reality device, which are used to correct the AR display chromatic aberration defect, thereby improving the imaging quality of the AR display device.

[0004] Based on the above problems, in a first aspect, a method for determining compensation data for chromatic aberration defects provided by an embodiment of the present disclosure includes:

[0005] Obtain an imaged image of the augmented reality device, and preprocess the imaged image to obtain a first image;

[0006] Detect chromatic aberration defects in the first image by using a preset filtering algorithm;

[0007] In the case of detecting chromatic aberration defects, identify the corresponding chromatic aberration defect regions to obtain the positions of the chromatic aberration defect regions and chromatic aberration defect data;

[0008] Generate corresponding chromatic aberration defect compensation data based on the chromatic aberration defect data, and provide the positions of the chromatic aberration defect regions and the corresponding chromatic aberration defect compensation data to the augmented reality device for chromatic aberration defect compensation.

[0009] In combination with the first aspect, in a possible implementation manner, the obtaining an imaged image of the augmented reality device and preprocessing the imaged image to obtain a first image includes:

[0010] Obtain the imaged image output by the image output end of the augmented reality device; wherein, the imaged image is collected by using an imaging colorimeter and a photographic device;

[0011] Detect the main body and background of the imaging image, eliminate the background of the imaging image, and retain the main body of the imaging image;

[0012] Perform image enhancement on the main body of the imaging image to obtain a first image;

[0013] Wherein, the image enhancement includes at least one of the following: adjusting the brightness and / or contrast of the main body of the imaging image; reducing moiré phenomena using anti-aliasing algorithms and / or low-pass filters; smoothing the image and reducing noise using spatial filters; correcting image distortion.

[0014] Combined with the first aspect, in a possible implementation manner, the detecting of color difference defects in the first image using a preset filtering algorithm includes:

[0015] Determine the edge detection filter sizes and detection thresholds respectively corresponding to different color difference defects;

[0016] For each color difference defect, traverse the pixels of the first image according to the edge detection filter size corresponding to the color difference defect and perform convolution operations, and compare the operation results obtained each time with the detection threshold corresponding to the color difference defect;

[0017] When the operation result meets the detection threshold corresponding to the color difference defect, determine that the corresponding pixel has the color difference defect.

[0018] Combined with the first aspect, in a possible implementation manner, when a color difference defect is detected, identifying the corresponding color difference defect area to obtain the position of the color difference defect area and color difference defect data includes:

[0019] For each color difference defect, when it is determined that the first image has a first pixel with the color difference defect, determine the position coordinates of the first pixel with the color difference defect in the first image;

[0020] According to the positional relationship between the first pixel position coordinates, determine the color difference defect area in the first image where the color difference defect exists and the position of the color difference defect area;

[0021] According to the display index values of the pixels in the color difference defect area, determine the color difference defect data corresponding to the color difference defect area; and / or

[0022] The color difference defects include: dot-like color difference defects, line-like color difference defects, and band-like color difference defects; the edge detection filters corresponding to the dot-like color difference defects include one-dimensional filters; the edge detection filters corresponding to the line-like color difference defects and band-like color difference defects include one-dimensional filters.

[0023] In combination with the first aspect, in a possible implementation manner, generating corresponding color difference defect compensation data based on the color difference defect data, and providing the position of the color difference defect area and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation, including:

[0024] For each first pixel in each color difference defect area, according to a preset compensation method, determine the pixel values and position coordinates of at least two second pixels having a preset positional relationship with the first pixel from the pixels without color difference defects adjacent to the first pixel;

[0025] According to the pixel value and position coordinate of the first pixel, and the pixel values and position coordinates of the second pixels, determine the color difference defect compensation data corresponding to the first pixel;

[0026] Determine the color difference defect sub-areas corresponding to the first pixels with similar color difference defect compensation data in the color difference defect area;

[0027] Provide the positions of each color difference defect sub-area and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation.

[0028] In combination with the first aspect, in a possible implementation manner, for each first pixel in each color difference defect area, according to a preset compensation method, determine the pixel values and position coordinates of at least two second pixels having a preset positional relationship with the first pixel from the pixels without color difference defects adjacent to the first pixel, including:

[0029] In the case where the preset compensation method adopts a one-dimensional compensation method, for each first pixel in each color difference defect area, respectively determine the pixel values and one-dimensional position coordinates of at least two second pixels whose coordinate values are less than and greater than the one-dimensional coordinate of the first pixel from the pixels without color difference defects adjacent to the first pixel;

[0030] In the case where the preset compensation method adopts a two-dimensional compensation method, for each first pixel in each color difference defect area, respectively determine the pixel values and two-dimensional position coordinates of a plurality of second pixels, and the two-dimensional position coordinates of the plurality of second pixels satisfy: connecting the plurality of second pixels in sequence can enclose the first pixel.

[0031] In combination with the first aspect, in a possible implementation manner, the detecting of the color difference defects in the first image by using the preset filtering algorithm further includes:

[0032] Traverse the pixels of the first image using a smoothing filter and perform a convolution operation to smooth the edges of the color difference defects in the first image; wherein, the smoothing filter includes a two-dimensional filter; or in the case where the edge detection filter is a one-dimensional filter, the smoothing filter serves as the other dimension and forms a two-dimensional filter with the edge detection filter.

[0033] For each type of color difference defect, determine the detection threshold corresponding to the color difference defect in the following manner:

[0034] For each type of color difference defect, for the edge detection filter of the same size used for the color difference defect, compare different candidate detection thresholds with the corresponding operation results to obtain different comparison results;

[0035] Using a preset edge detection algorithm, compare the color difference defects determined by the comparison results of each candidate detection threshold with the corresponding color difference defect areas in the first image to determine the effectiveness of each candidate detection threshold for detecting the corresponding color difference defect;

[0036] Determine the candidate detection threshold with the highest effectiveness as the detection threshold corresponding to the color difference defect.

[0037] The second aspect of the embodiments of the present disclosure provides a method for compensating color difference defects, including:

[0038] Receive a power-on instruction;

[0039] Start the display optimization service to read the color difference defect compensation parameters from a preset storage medium and load them into the memory; the color difference defect compensation parameters include: the position of the color difference defect area and the color difference defect compensation data;

[0040] Call the display service to read the color difference defect compensation parameters from the memory and update them to a preset register inside a preset processor;

[0041] Control the display panel to compensate the display data rendered by the GPU through the color difference defect compensation parameters in the preset register;

[0042] Wherein, the color difference defect compensation parameters are determined based on the method for determining the color difference defect compensation data according to any one of the first aspect.

[0043] Combined with the second aspect, in a possible implementation manner,

[0044] A first compensation parameter storage register is provided in the DPU;

[0045] Calling the display service to read the color difference defect compensation parameters from the memory and update them to a preset register inside a preset processor includes:

[0046] Call the display service to read the color difference defect compensation parameters from the memory and update them to the first compensation parameter storage register in the DPU;

[0047] Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the preset register, including:

[0048] Transmit the color difference defect compensation parameters in the first compensation parameter register to the preset memory of the display controller in the display panel through the MIPI bus;

[0049] The display controller compensates the display data rendered by the GPU with the color difference defect compensation parameters in the preset memory; or

[0050] A second compensation parameter storage register is provided in the display controller of the display panel;

[0051] Call the display service to read the color difference defect compensation parameters from the memory and update them to the preset register inside the preset processor, including:

[0052] Call the display service to read the color difference defect compensation parameters from the memory and update them to the memory of the display panel;

[0053] Read the color difference defect compensation parameters into the second compensation parameter storage register in the display controller through the display controller;

[0054] Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the preset register, including:

[0055] Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the second compensation parameter storage register.

[0056] A third aspect of the embodiments of the present disclosure provides an augmented reality device, including: a display panel, a waveguide, and an image processing device;

[0057] The waveguide is used to transmit the content displayed by the display panel to the user's eyes;

[0058] The image processing device is used to drive the display panel and store the color difference defect compensation parameters, and compensate the data displayed by the display panel by using a color difference defect compensation method described in the second aspect.

[0059] The beneficial effects of the embodiments of the present disclosure include:

[0060] A method for determining compensation data for color difference defects, a compensation method, and an augmented reality device provided by an embodiment of the present disclosure include: obtaining an imaging image of an augmented reality device, and preprocessing the imaging image to obtain a first image; detecting color difference defects in the first image by using a preset filtering algorithm; in the case where color difference defects are detected, identifying corresponding color difference defect regions to obtain the positions of the color difference defect regions and color difference defect data; generating corresponding color difference defect compensation data based on the color difference defect data, and providing the positions of the color difference defect regions and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation. The method for determining compensation data for color difference defects provided by the embodiment of the present disclosure detects color difference defects in the first image through a preset filtering algorithm, determines the positions of the color difference defect regions and the corresponding color difference defect compensation data according to the detection results, and provides these data to the augmented reality device. The augmented reality device can execute the compensation data compensation method for color difference defects provided by the embodiment of the present disclosure to compensate the display content of the augmented reality display device, obtain a compensated display screen, improve the display effect of the augmented reality display device, and correct color deviation. Description of the Drawings

[0061] Figure 1 It is a schematic flowchart of a method for determining compensation data for color difference defects provided by an embodiment of the present disclosure;

[0062] Figure 2 It is a schematic diagram of the relationship between a filter and a corresponding pixel region provided by an embodiment of the present disclosure;

[0063] Figure 3 It is a schematic diagram of the convolution result of the color difference defect edge provided by an embodiment of the present disclosure;

[0064] Figure 4 It is a schematic diagram of a two-dimensional filter provided by an embodiment of the present disclosure;

[0065] Figure 5 It is a schematic diagram of a one-dimensional filter provided by an embodiment of the present disclosure;

[0066] Figure 6 It is a line graph of the filtering operation result provided by an embodiment of the present disclosure;

[0067] Figure 7 It is a schematic diagram of a two-dimensional display area provided by an embodiment of the present disclosure;

[0068] Figure 8 It is a schematic diagram of the combination of a one-dimensional filter and a Gaussian filter provided by an embodiment of the present disclosure;

[0069] Figure 9 It is a schematic flowchart of a color difference defect compensation method provided by an embodiment of the present disclosure;

[0070] Figure 10 Schematic diagram of an AR display device that compensates using the color difference defect compensation parameters in the SPR of the CPU provided by an embodiment of the present disclosure;

[0071] Figure 11 Schematic diagram of an AR display device that compensates using the color difference defect compensation parameters in the display controller provided by an embodiment of the present disclosure;

[0072] Figure 12 Schematic diagram of an augmented reality device provided by an embodiment of the present disclosure;

[0073] Figure 13 Schematic diagram of an AR display device that uses the Linux Android display subsystem provided by an embodiment of the present disclosure. Specific implementation manners

[0074] Embodiments of the present disclosure provide a method for determining compensation data for color difference defects, a compensation method, and an augmented reality device. The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings of the specification. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present disclosure and are not used to limit the present disclosure. And without conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0075] Embodiments of the present disclosure provide a method for determining compensation data for color difference defects, as Figure 1 shown, including:

[0076] S101. Obtain the imaging image of the augmented reality device, and preprocess the imaging image to obtain a first image;

[0077] S102. Detect the color difference defects in the first image using a preset filtering algorithm;

[0078] S103. When color difference defects are detected, identify the corresponding color difference defect regions to obtain the positions of the color difference defect regions and the color difference defect data;

[0079] S104. Generate corresponding color difference defect compensation data based on the color difference defect data, and provide the positions of the color difference defect regions and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation.

[0080] In the embodiments of the present disclosure, the execution entity may be a device with image acquisition capabilities, image processing capabilities, and computing capabilities. In one possible implementation, the device may be a combination of a computer device, an imaging colorimeter, and a high-definition camera. During implementation, color difference defects can be detected for the panel of each assembled augmented reality device (or panel samples of each model). Since the propagation and refraction of light in the waveguide material and the defects of the display panel itself are all reflected through the panel of the assembled augmented reality device, therefore, through the method for determining color difference defect compensation data provided by the embodiments of the present disclosure, color difference defect compensation data can be determined for the color difference problems caused by the waveguide and the panel itself, so as to compensate for the color difference defects of the corresponding augmented reality device panel.

[0081] In step S101 above, an output image can be obtained from the image output end of the augmented reality device by using an imaging colorimeter, and an image reflecting the pixel values of the output image is output, and the imaging image is obtained by using a high-definition camera to photograph this image. Among them, the imaging colorimeter can output a grayscale image and a color image. In the embodiments of the present disclosure, the grayscale image is used for illustration. In one possible implementation, the original image output by the augmented reality device may be a solid-color image with the same pixels.

[0082] Further, the computer device obtains the imaging image photographed by the high-definition camera and preprocesses this image to obtain a first image; in one possible implementation, the first image may only include the main content photographed by the high-definition camera (i.e., the display content of the imaging colorimeter).

[0083] In step S102 above, the computer device uses a preset filtering algorithm to detect the first image and determine the color difference defects therein. The color difference defects are the manifestations of the display defects caused by the waveguide and the display panel in the augmented reality device on the grayscale image of the colorimeter. Taking the grayscale image as an example, the color difference defects can be manifested as graphics such as different stripes, dots, and rings of pixel values from the standard grayscale on the grayscale image.

[0084] In step S103 above, for various color difference defects in the first image, the computer device distinguishes the types of color difference defects respectively, determines the position and range of each color difference defect, and the corresponding defect degree of each color difference defect (which can be reflected by the difference between the pixel value of the color difference defect and the target pixel value). So that in step S104 above, corresponding color difference defect compensation data (such as pixel compensation, average brightness, and changed pixel values, etc.) are generated according to different color difference defect data in the first image (such as pixel missing, uneven brightness, and abnormal pixel values, etc.), and the position of the color difference defect area and the corresponding color difference defect compensation data are provided to the augmented reality device. During the process of displaying the image, the augmented reality device uses this color difference defect compensation data to compensate for the color difference defects.

[0085] In another embodiment provided by the present disclosure, in the above step S101, "obtaining the imaging image of the augmented reality device and preprocessing the imaging image to obtain the first image" can be implemented as follows:

[0086] Step 1: Obtain the imaging image output by the image output end of the augmented reality device; wherein, the imaging image is collected by using an imaging colorimeter and a photographic device;

[0087] Step 2: Detect the main body and background of the imaging image, eliminate the background of the imaging image, and retain the main body of the imaging image;

[0088] Step 3: Enhance the image of the main body of the imaging image to obtain the first image;

[0089] Among them, the image enhancement includes at least one of the following: adjusting the brightness and / or contrast of the main body of the imaging image; using an anti-aliasing algorithm and / or a low-pass filter to reduce the moiré phenomenon; using a spatial filter to smooth the image and reduce noise; correcting image distortion.

[0090] In the embodiment of the present disclosure, a computer device can be used to separate the main body and background of the imaging image. After eliminating the background and retaining the main body, the main body part of the imaging image (i.e., the display content of the imaging colorimeter) can be obtained.

[0091] Furthermore, the following method can be used to perform image enhancement processing on the main body part of the imaging image: For the distortion generated during the shooting process of a high-definition camera due to the influence of optical components, a distortion elimination algorithm can be used to eliminate the distortion of the image to obtain an image corresponding to the real coordinate system. For the moiré pattern that appears in the imaging image due to the interference between the sampling frequency of the high-definition camera and the display frequency of the AR display device itself, an anti-aliasing algorithm can be used to smooth the moiré pattern in the image; a low-pass filter can also be applied, and the low-pass filter's own filtering characteristic of eliminating high-frequency signals can be used to eliminate the moiré pattern in the image. For the offset of the brightness and contrast in the image relative to the target brightness and contrast due to waveguide transmission, the computer device can adjust the Gamma curve to change the brightness and contrast of the image to make it reach the target value, so that the subsequent detection of color difference defects in the image can reflect the color difference defects caused by waveguide transmission and be compensated by compensation data. For the image noise caused during the shooting process (i.e., the process of obtaining the imaging image through the imaging meter and the high-definition camera) and during the waveguide transmission process of the image, filtering methods such as spatial filters are used to smooth the image and reduce noise to ensure the accuracy of the subsequent image detection and the generated compensation data.

[0092] In another embodiment provided by the present disclosure, the above step S102, "detecting the color difference defect in the first image by using a preset filtering algorithm", may be executed as the following steps:

[0093] Step 1: Determine the edge detection filter size and detection threshold corresponding to different color difference defects respectively;

[0094] Step 2: For each color difference defect, traverse the pixels of the first image according to the edge detection filter size corresponding to the color difference defect and perform a convolution operation, and compare the operation result obtained each time with the detection threshold corresponding to the color difference defect;

[0095] Step 3: When the operation result meets the detection threshold corresponding to the color difference defect, determine that the corresponding pixel has the color difference defect.

[0096] In the embodiment of the present disclosure, the edge detection filter is an algorithm for image detection. Its main function is to highlight the edge part between different regions in the image (i.e., the place where the gray level value or color change is relatively drastic) by performing specific operations on the pixels in the image. Edge detection filters of different sizes have different detection effects and precisions. Different edge detection filters can be used for different color difference defects, and the continuous range of the color difference defect can be determined by adjusting the size of the filter. The degree of the color difference defect can be judged by using the detection threshold for the operation result.

[0097] Further, for different color difference defects in the first image, each pixel in the image can be traversed according to the size of the edge detection filter corresponding to the corresponding color difference defect. In the operation process, each edge detection filter can be regarded as a fixed numerical matrix respectively, and the numerical values in the numerical matrix are obtained according to a specific calculation formula. In a possible implementation manner, the correspondence between the color difference defect, the size of the edge detection filter, and the detection threshold can be obtained through multiple experiments or empirical values.

[0098] During implementation, the selected edge detection filter can be calculated with the corresponding pixel region in the first image. The size of the pixel region is related to the filter size. As Figure 2 shown, for example: if the size of the filter is a 3×3 matrix, the corresponding pixel region is also 3×3 pixels; if the size of the filter is a 1×4 matrix, the corresponding pixel region is also 1×4 pixels. The calculation method can be to perform a convolution operation on each numerical value of the filter and the pixel values in the corresponding pixel region, and the final operation result can reflect the edge and pixel values of the content in the image (the color difference defect in the first image for the embodiment of the present disclosure), etc.

[0099] For different color difference defects, the first image can be traversed by corresponding edge detection filters respectively. During the traversal, the operation results obtained by each convolution operation are compared with the detection thresholds of the corresponding color difference defects. According to the comparison results, it can be determined whether there is such a type of color difference defect.

[0100] In another embodiment provided by the present disclosure, the above step S103 "in the case of detecting a color difference defect, identify the corresponding color difference defect area to obtain the position of the color difference defect area and the color difference defect data" can be implemented as the following steps:

[0101] Step 1: For each color difference defect, when it is determined that the first image has a first pixel with this color difference defect, determine the position coordinates of the first pixel with this color difference defect in the first image;

[0102] Step 2: According to the positional relationship between the first pixel position coordinates, determine the color difference defect area in the first image where this color difference defect exists and the position of the color difference defect area;

[0103] Step 3: According to the display index values of the pixels in the color difference defect area, determine the color difference defect data corresponding to the color difference defect area.

[0104] Among them, the color difference defects can include: dot color difference defects, line color difference defects and band color difference defects; the edge detection filter corresponding to the dot color difference defect includes a one-dimensional filter; the edge detection filter corresponding to the non-dot color difference defect includes a one-dimensional filter.

[0105] In the embodiment of the present disclosure, each time the edge detection filter corresponding to each color difference defect performs convolution calculation, it is aimed at the pixel corresponding to the current convolution, and the area where there is a color difference defect usually includes pixels corresponding to multiple convolutions. Therefore, it is necessary to combine the results of multiple convolutions to determine the area where there is a color difference defect. During implementation, the positions of the first pixels in the first image that are determined to have the same color difference defect can be integrated (for example: the area composed of continuously positioned first pixels is determined as the same color difference defect area), and at least one color difference defect area composed of these first pixels is determined.

[0106] During the detection process, the zero-crossing points in the output result of the edge detection filter (that is, the result obtained by performing convolution operation on each value of the edge detection filter and the pixel values in the corresponding pixel area) are used, as Figure 3 shown, to detect the edge of the color difference defect area in the first image. These zero-crossing points mean the positions where the sign of the second derivative in the pixel values of the image changes, and these positions correspond to the edges of the image.

[0107] In the case where an image edge is detected, first determine the first pixel of the first image corresponding to this position, and determine this first pixel as the edge pixel corresponding to the color difference defect.

[0108] According to the positional relationship between the position coordinates of the obtained first pixels, determine the color difference defect area in the first image where the color difference defect is located. Taking a dot-like color difference defect as an example, since a dot-like color difference defect is usually a dot-like area formed by multiple adjacent pixels, by analyzing the positional relationship of these pixels, they can be combined together to form a complete dot-like area (i.e., the dot-like color difference defect area).

[0109] Further, confirm the edge pixels of the determined color difference defect area, identify the range of the relative coordinate values of this color difference defect area on the first image, confirm the position of this defect in the first image, and then obtain the position corresponding to this color difference defect area on the display panel of the AR display device.

[0110] Further, analyze the display index values of the pixels in the color difference defect area to determine the color difference defect data corresponding to this area. The display index values can include information such as pixel values, brightness, and contrast. By analyzing these indexes and comparing them with the target display index values, corresponding adjustments are made. For example, if the brightness of this area is lower than the target brightness, increase the brightness of this area to the target brightness and record the increased brightness value as the subsequent color difference defect compensation data.

[0111] Further, in the embodiments of the present disclosure, according to the shape of the color difference defect display, it can be divided into: dot-like (point) color difference defects, line-like (line) color difference defects, and band-like (band) color difference defects.

[0112] For dot-like color difference defects (i.e., continuously displayed as an area with similar pixel values and an approximately circular or similar spot-like shape in the first image), the corresponding edge detection filter can be a two-dimensional filter. This two-dimensional filter can be, for example, Figure 4 the Laplacian of Gaussian (LoG) filter shown, which is a LoG operator in both the X direction and the Y direction of the filter; among them, the expression of the LoG operator is shown as the following formula.

[0113]

[0114] Among them, The Laplacian operator, denoted as , calculates the sum of the second-order partial derivatives of a function. The Gaussian function is represented by G(x, y), where σ is the standard deviation of the Gaussian function, which controls the width of the Gaussian function. The LoG operator is obtained by taking the second-order partial derivative of the Gaussian function and organizing it. The LoG operator is mainly used for edge detection in image processing and computer vision. It can highlight the regions where the gray values change rapidly in the image, and these regions usually correspond to the edges and details of the image. By adjusting the value of the standard deviation σ, the scale and level of details of the detected edges can be controlled. A smaller value of σ will detect edges and details with a small range scale; a larger value of σ will detect edges with a large range scale. Adjusting the value of σ can change the size of the corresponding filter formed by this operator, so as to achieve the detection of chromatic aberration defect regions of different scales.

[0115] For non-point chromatic aberration defects, the one-dimensional filter used can be, for example, Figure 5 as shown, the filter formed by the LoG operator in the X-axis direction or Y-axis direction; it can also be a filter formed by combining the LoG operator and the Gaussian operator. The one-dimensional filter can specifically detect features in a specific direction.

[0116] Filters of different sizes are adapted to different chromatic aberration defects. For linear chromatic aberration defects and band-shaped chromatic aberration defects, the sizes of the corresponding one-dimensional filters and the corresponding detection thresholds are different (the corresponding detection thresholds can be obtained through multiple experiments or empirical values). Use the corresponding one-dimensional filter sizes to traverse the pixels of the first image in the X-axis direction or Y-axis direction respectively. In a possible implementation manner, for a chromatic aberration defect that is continuously long in the X-axis direction, a filter with a larger size in the X-axis direction can be used for operation.

[0117] In the embodiments of the present disclosure, an example is also provided to describe the differences in the defect detection capabilities of one-dimensional filters of different sizes, as Figure 6 shown. Figure 6 It is a line graph of the results obtained by performing filtering operations on a display area with a width of 1 pixel in the first image using filters of different sizes; where the lines are respectively the actual gray levels of this section of the display area, the processing results of the 3×1 edge detection filter, and the processing results of the 13×1 edge detection filter. After being processed by the 3×1 edge detection filter, a chromatic aberration defect corresponding to the 3×1 edge detection filter will be displayed at the 5th pixel position in this display area (because its gray level value exceeds the detection threshold corresponding to the 3×1 edge detection filter), and the defects in the pixel positions of 7-21 in the display area during this detection will not be prominently displayed (only partially reflecting its edge region).

[0118] After being processed by the edge detection filter of size 13×1, the color difference defect corresponding to the 5th pixel position in the display area will not be displayed, while the color difference defects corresponding to the pixel positions of 13×1 edge detection filters in the pixel positions 7-21 of the display area will be prominently displayed (because their gray scale values exceed the detection threshold corresponding to the 13×1 edge detection filter).

[0119] In another embodiment provided by the embodiments of the present disclosure, the above step S104 "generating corresponding color difference defect compensation data based on the color difference defect data, and providing the position of the color difference defect area and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation" can be implemented as follows:

[0120] Step 1: For each first pixel in each color difference defect area, according to a preset compensation method, determine the pixel values and position coordinates of at least two second pixels having a preset positional relationship with the first pixel from the pixels without color difference defects adjacent to the first pixel;

[0121] Step 2: Determine the color difference defect compensation data corresponding to the first pixel according to the pixel value and position coordinate of the first pixel, and the pixel values and position coordinates of the second pixels;

[0122] Step 3: Determine the color difference defect sub-areas corresponding to the first pixels with similar color difference defect compensation data in the color difference defect area;

[0123] Step 4: Provide the positions of each color difference defect sub-area and the corresponding color difference defect compensation data to the augmented reality device for color difference defect compensation.

[0124] In the embodiments of the present disclosure, after determining the positions and ranges of each color difference defect area, the computer system calculates the compensation values for the corresponding color difference defect areas using a preset compensation method.

[0125] In a possible implementation manner, in order to make the display effect smoother, the computer system can obtain the coordinate range of the corresponding color difference defect area and the coordinates and pixel values of the pixels without color difference defects closest to the edge of the color difference defect area (i.e., the outermost first pixel of the color difference defect area). The color difference defect compensation data of the first pixels within the color difference defect area can be obtained by using an interpolation algorithm according to the pixel value and position coordinate of the first pixel, and the pixel values and position coordinates of the second pixels.

[0126] In the actual application process, the color difference defect area can be divided into multiple color difference defect sub-areas, and the first pixels within each color difference defect sub-area have a certain correlation (for example, the color difference compensation data is similar, that is, if the values of the color difference compensation data are within a preset range, they can be considered similar). For each color difference defect sub-area, the color difference compensation data of any one of the first pixels within the color difference defect sub-area can be used as the color difference compensation data of the color difference defect sub-area, and the AR display device can use the color difference compensation data to uniformly compensate the first pixels within the color difference defect sub-area. In this way, the AR display device can store the correspondence between each color difference defect sub-area and the color difference compensation data, rather than the correspondence between each first pixel and the color difference compensation data, improving the efficiency of color difference compensation and reducing the memory occupancy of the AR device.

[0127] In another embodiment provided by the embodiments of the present disclosure, in the above step 1, "for each first pixel in each color difference defect area, according to a preset compensation method, determine the pixel values and position coordinates of at least two second pixels having a preset positional relationship with the first pixel from the pixels without color difference defects adjacent to the first pixel" can be implemented as:

[0128] In the case where the preset compensation method adopts a one-dimensional compensation method, for each first pixel in each color difference defect area, determine the pixel values and one-dimensional position coordinates of at least two second pixels whose coordinate values are less than and greater than the one-dimensional coordinate of the first pixel respectively from the pixels without color difference defects adjacent to the first pixel;

[0129] In the case where the preset compensation method adopts a two-dimensional compensation method, for each first pixel in each color difference defect area, determine the pixel values and two-dimensional position coordinates of multiple second pixels respectively from the pixels without color difference defects adjacent to the first pixel, and the two-dimensional position coordinates of the multiple second pixels satisfy: connecting the multiple second pixels in sequence can enclose the first pixel.

[0130] In the embodiments of the present disclosure, the preset compensation method may include a one-dimensional compensation method and a two-dimensional compensation method. The one-dimensional compensation method mainly targets the one-dimensional coordinates of the first pixel (for the first pixel with two-dimensional coordinates, one of the one-dimensional coordinates can be selected), and determines at least two second pixels from the adjacent color difference defect-free pixels in the dimension where the one-dimensional coordinates are located. Taking the determination of two second pixels as an example, in order to make the display effect of the first pixel smoother after compensation, the two second pixels can be selected from both sides of the first pixel. For example, the one-dimensional coordinates of the two second pixels are respectively greater than and less than the one-dimensional coordinates of the first pixel. The two-dimensional compensation method mainly targets the two-dimensional coordinates of the first pixel, and determines multiple second pixels from the color difference defect-free pixels around the first pixel. Taking the determination of four second pixels as an example, in order to make the display effect of the first pixel smoother after compensation, the four second pixels can be selected from the upper left corner, upper right corner, lower left corner, and lower right corner of the first pixel. The following is an example:

[0131] For a strip-shaped display area with a width of one pixel, the one-dimensional compensation method can be adopted to determine the pixel values and position coordinates of two second pixels, and according to the pixel value and position coordinates of the first pixel, as well as the pixel values and position coordinates of the two second pixels, determine the color difference defect compensation data corresponding to the first pixel through an interpolation algorithm. The one-dimensional compensation method adopted can be the single linear interpolation algorithm shown in the following formula:

[0132]

[0133] Where, Y out is the output color difference defect compensation data; x 1 and x 2 are respectively the coordinate values of two second pixels in the display area. These two coordinates can be the points closest to the color difference defect area. y 1 and y 2 are the pixel values of these two second pixels; x in is the coordinate value of the first pixel in the color difference defect area. Assume x 1 =0, x 2 =10, y 1 =100, y 1 =150, x in =5. Through the one-dimensional interpolation algorithm, Y out =125 can be obtained. This value is the color difference defect compensation data corresponding to the first pixel with the coordinate of 5 in the display area. The computer system records this value and the corresponding coordinate value, and provides them to the enhanced display device for color difference defect compensation.

[0134] For a two-dimensional display area, a two-dimensional compensation method can be adopted to determine the pixel values and position coordinates of four second pixels, and according to the pixel value and position coordinates of the first pixel, as well as the pixel values and position coordinates of the four second pixels, the chromatic aberration defect compensation data corresponding to the first pixel is determined by using an interpolation algorithm. For example Figure 7 For the two-dimensional display area shown as follows, the two-dimensional compensation method adopted can be the bilinear interpolation algorithm shown in the following formula:

[0135]

[0136] Among them, the coordinates of the selected four second pixels are A(x 3 , y 3 ), B(x 3 , y 4 ), C(x 4 , y 3 ), D(x 4 , y 4 ). The values of the four second pixels are Q A , Q B , Q C , Q D respectively. The coordinates of the first pixel for which the chromatic aberration defect compensation data is to be obtained are (x 5 , y 5 ), and P out is the output chromatic aberration defect compensation data.

[0137] Taking x 3 = 0, x 4 = 2, y 3 = 0, y 4 = 2, and the values of Q A , Q B , Q C , Q D being 150, 160, 145, 150 respectively as an example, assuming that the coordinates of the first pixel for which the chromatic aberration defect compensation data is to be obtained are (1, 1). It can be obtained that P out = 151.25, and this value is the chromatic aberration defect compensation data corresponding to the first pixel with coordinates (1, 1) in this display area.

[0138] In another embodiment provided by the present disclosure, the above step S102 "detecting chromatic aberration defects in the first image by using a preset filtering algorithm" may further include the following steps:

[0139] Traverse the pixels of the first image using a smoothing filter to perform a convolution operation to smooth the edges of the color difference defects in the first image; wherein, the smoothing filter includes a two-dimensional filter; or in the case where the edge detection filter is a one-dimensional filter, the smoothing filter serves as the other dimension and forms a two-dimensional filter with the edge detection filter.

[0140] In the embodiments of the present disclosure, the smoothing filter may be a Gaussian filter. In a possible implementation manner, its combination with the edge detection filter is as Figure 8 shown. Figure 8 It is a filter formed by a LoG operator in the X-axis direction and a Gaussian filtering operator in the Y-axis direction.

[0141] During the process of using the filter to detect edges, if the continuity of the edges of the color difference defects in the first image is low, it will cause the function level set of the detection operator (taking the LoG operator as an example in the embodiments of the present disclosure) to not stop converging, thus affecting the detection ability of the filter. Here, the Gaussian filtering operator can be used to perform a convolution operation first to smooth the corresponding edges of the color difference defects, improve the continuity of the edges of the color difference defects, and help improve the detection accuracy. And compared with other smoothing filters, such as the mean filter, etc., the Gaussian filter has less impact on the image and can retain more image features.

[0142] During the implementation of this combined filter, first use the smoothing filter to smooth the pixel region corresponding to the filter, and then perform edge detection through step S102. It can improve the detection ability of edge detection and eliminate the influence on the detection result caused by factors such as edge discontinuity.

[0143] In another embodiment provided by the present disclosure, for each color difference defect, the following method can be used to determine the detection threshold corresponding to the color difference defect:

[0144] Step 1: For each color difference defect, for the edge detection filter of the same size used for the color difference defect, use different candidate detection thresholds to compare with the corresponding operation results to obtain different comparison results;

[0145] Step 2: Use a preset edge detection algorithm to compare the color difference defects determined by the comparison results using each candidate detection threshold with the corresponding color difference defect region in the first image to determine the effectiveness of each candidate detection threshold for detecting the corresponding color difference defect;

[0146] Step 3: Determine the candidate detection threshold with the highest effectiveness as the detection threshold corresponding to the color difference defect.

[0147] In the embodiments of the present disclosure, different thresholds may correspond to edge detection filters of different sizes for detecting different color difference defects. Each size of edge detection filter corresponds to a different detection threshold.

[0148] To determine the detection threshold, binarization processing can be applied to the output image of the edge detection filter using a candidate detection threshold (i.e., the part greater than the candidate detection threshold can be considered as the maximum pixel value, and the part less than the candidate detection threshold can be considered as a minimum pixel value). A visual result is formed. The accuracy of this result for color difference defect detection is judged by combining this result with other edge detection methods (such as the Canny algorithm). Finally, a candidate detection threshold that can accurately detect the color difference defect corresponding to this filter is obtained, and this candidate detection threshold is determined as the final detection threshold corresponding to this edge detection filter.

[0149] The embodiments of the present disclosure also provide a method for compensating color difference defects, as Figure 9 shown, which can be implemented as:

[0150] S901. Receive a power-on instruction;

[0151] S902. Start the display optimization service to read color difference defect compensation parameters from a preset storage medium and load them into the memory; the color difference defect compensation parameters include: the position of the color difference defect area and color difference defect compensation data;

[0152] S903. Call the display service to read the color difference defect compensation parameters from the memory and update them to a preset register inside a preset processor;

[0153] S904. Control the display panel to compensate the display data rendered by the GPU using the color difference defect compensation parameters in the preset register;

[0154] Among them, the color difference defect compensation parameters are determined based on the method for determining color difference defect compensation data in any one of the above embodiments.

[0155] In the embodiments of the present disclosure, the execution subject may be an AR display device having a display function and using preset color difference compensation parameters to correct the display content.

[0156] In a possible implementation, after the AR display device is started, a display optimization service will be started first. This service will read chromatic aberration defect compensation parameters from a preset storage medium. The preset storage medium can be a storage device such as a hard disk, a solid-state drive, or a flash memory. The chromatic aberration defect compensation parameters are stored in the storage device. These parameters include the positions of the chromatic aberration defect areas and the chromatic aberration defect compensation data. The positions of the chromatic aberration defect areas are used to determine the specific positions on the display panel of the AR display device that need to be compensated, while the chromatic aberration defect compensation data contains the information required to optimize these chromatic aberration defect areas, such as pixel correction values, contrast adjustment values, etc.

[0157] Further, the chromatic aberration defect compensation parameters will be loaded from the preset storage medium into the memory and called in the AR display device to the display service for displaying corresponding content in the AR display device.

[0158] The display service will read the previously loaded chromatic aberration defect compensation parameters from the memory and update them to a preset register (such as a special-purpose register in the figure) inside the preset processor. This preset register is a storage unit inside the processor, which is used to enable the processor to quickly read the chromatic aberration defect compensation parameters when performing chromatic aberration correction operations.

[0159] Further, the display data rendered by the graphics processing unit (GPU) is compensated. The GPU is usually responsible for image rendering in the AR display device, sending the rendered image data to the display panel for display, and the display panel will perform compensation operations on the display content according to the chromatic aberration defect compensation parameters in the preset register. This preset register can be a special-purpose register (SPR, Special Purpose Register) with chromatic aberration defect compensation function inside the GPU.

[0160] Optionally, for the AR display device without a GPU or the GPU does not include the above SPR module, the driver chip of the display controller in the AR display device can read the chromatic aberration defect compensation parameters from the register of the processor to optimize the display effect, and this method improves the platform compatibility.

[0161] In another embodiment provided by the present disclosure, a first compensation parameter storage register is set in the data processing unit (DPU).

[0162] In the above step S803, "calling the display service to read the chromatic aberration defect compensation parameters from the memory and update them to the preset register inside the preset processor" can be implemented as:

[0163] Call the display service to read the color difference defect compensation parameters from the memory and update them to the first compensation parameter storage register in the DPU;

[0164] The above step S804, "Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the preset register", includes:

[0165] Step 1: Transmit the color difference defect compensation parameters in the first compensation parameter register to the preset memory of the display controller in the display panel through the Mobile Industry Processor Interface (MIPI) bus;

[0166] Step 2: The display controller compensates the display data rendered by the GPU with the color difference defect compensation parameters in the preset memory.

[0167] In another embodiment provided by the present disclosure, a second compensation parameter storage register is provided in the display controller of the display panel;

[0168] The above step S803, "Call the display service to read the color difference defect compensation parameters from the memory and update them to the preset register inside the preset processor", can be implemented as:

[0169] Step 1: Call the display service to read the color difference defect compensation parameters from the memory and update them to the memory of the display panel;

[0170] Step 2: Read the color difference defect compensation parameters into the second compensation parameter storage register in the display controller through the display controller;

[0171] The above step S804, "Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the preset register", can be executed as:

[0172] Control the display panel to compensate the display data rendered by the GPU with the color difference defect compensation parameters in the second compensation parameter storage register.

[0173] In the embodiment of the present disclosure, as Figure 10 shown, it is a schematic structural diagram of an AR display device that uses the color difference defect compensation parameters in the SPR of the Central Processing Unit (CPU). For the case where there is an SPR for performing color difference compensation operations in the DPU of the CPU in the AR display device, the color difference defect compensation parameters are stored in this SPR (i.e., the first compensation parameter register). When an image compensation operation is required, it is called to the preset memory of the display controller in the display panel through the MIPI bus.

[0174] Optionally, asFigure 11 As shown in the figure, it is a schematic structural diagram of an AR display device that compensates using the color difference defect compensation parameters in the display controller. For the case where a second compensation parameter storage register is set in the display controller of the display panel in the AR display device, the color difference defect compensation parameters are stored in this second compensation parameter register, and the display controller calls the color difference defect compensation parameters from this register to compensate the display data.

[0175] The present disclosure also provides an augmented reality device, such as Figure 12 as shown in the figure, including: a display panel, an optical waveguide, and an image processing device;

[0176] The optical waveguide is used to transmit the content displayed on the display panel to the user's eyes;

[0177] The image processing device is used to drive the display panel, store the color difference defect compensation parameters, and compensate the data displayed on the display panel using a color difference defect compensation method as in the above embodiments.

[0178] In an embodiment of the present disclosure, in a possible implementation manner, the AR display device platform reads and loads the color difference defect compensation parameters, writes them into the hardware abstraction layer through the system application programming interface (API), and can respectively use the GPU for color difference compensation effects or load and read the color difference defect compensation parameters through the display controller of the display panel according to the different hardware of this platform, or implement the color difference compensation effect on the display controller side.

[0179] Such as Figure 13 as shown in the figure, it describes a possible implementation manner of an AR display device using the Linux Android display subsystem. In this implementation manner, the DPU implements processing such as gamma correction, hue calibration, and color difference compensation effects. The hardware abstraction layer will perform interface encapsulation for the display module. After the Android system starts, the display service will run. The display service will read the color difference defect compensation parameters in the EMMC / UFS, and the display service will then call the hardware abstraction layer interface to send the color difference defect compensation parameters through this interface to complete the color difference correction process.

[0180] Through the description of the above embodiments, those skilled in the art can clearly understand that the embodiments of the present disclosure can be implemented by hardware or by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.), including several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present disclosure.

[0181] Those skilled in the art can understand that the drawings are only schematic diagrams of a preferred embodiment, and the modules or processes in the drawings are not necessarily essential for implementing the present disclosure.

[0182] Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment according to the description of the embodiment, or can be correspondingly changed to be located in one or more devices different from this embodiment. The modules of the above embodiments can be combined into one module, or can be further split into multiple sub-modules.

[0183] The serial numbers of the above embodiments of the present disclosure are only for description and do not represent the advantages and disadvantages of the embodiments.

[0184] Obviously, those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. Thus, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalent technologies, the present disclosure also intends to include these changes and modifications.

Claims

1. A method for determining color difference defect compensation data, characterized in that: include: Acquire an image of an augmented reality device, and preprocess the image to obtain a first image; Detecting chromatic aberration defects in the first image using a preset filtering algorithm; When a color difference defect is detected, the corresponding color difference defect area is identified to obtain the position of the color difference defect area and the color difference defect data; Corresponding chromatic aberration defect compensation data is generated based on the chromatic aberration defect data, and the position of the chromatic aberration defect area and the corresponding chromatic aberration defect compensation data are provided to the augmented reality device for chromatic aberration defect compensation.

2. The method according to claim 1, characterized in that The step of acquiring an image of the augmented reality device and preprocessing the image to obtain a first image includes: Acquire the imaging image outputted by the image output terminal of the augmented reality device; wherein the imaging image is collected by using an imaging colorimeter and a photographic device; Detecting the subject and background of the image, and eliminating the background of the image to retain the subject of the image; Performing image enhancement on the subject of the imaging image to obtain a first image; The image enhancement includes at least one of the following: adjusting the brightness and / or contrast of the main body of the image; reducing moiré using an anti-aliasing algorithm and / or a low-pass filter; smoothing the image and reducing noise using a spatial filter; and correcting image distortion.

3. The method according to claim 1, characterized in that The detecting the color difference defect in the first image by using a preset filtering algorithm includes: Determine the edge detection filter size and detection threshold corresponding to different chromatic aberration defects; For each color difference defect, traverse the pixels of the first image according to the edge detection filter size corresponding to the color difference defect and perform a convolution operation, and compare the operation result obtained by each operation with the detection threshold corresponding to the color difference defect; When the calculation result satisfies the detection threshold corresponding to the color difference defect, it is determined that the corresponding pixel has the color difference defect.

4. The method according to claim 3, characterized in that: When a color difference defect is detected, the corresponding color difference defect area is identified to obtain the location of the color difference defect area and the color difference defect data, including: For each color difference defect, when it is determined that a first pixel in the first image has the color difference defect, determine the position coordinates of the first pixel having the color difference defect in the first image; Determining a chromatic aberration defect region where the chromatic aberration defect exists and a position of the chromatic aberration defect region in the first image according to a positional relationship between the first pixel position coordinates; Determining color difference defect data corresponding to the color difference defect area according to display index values ​​of pixels in the color difference defect area; and / or The chromatic aberration defects include: point chromatic aberration defects, linear chromatic aberration defects and band chromatic aberration defects; the edge detection filter corresponding to the point chromatic aberration defects includes a one-dimensional filter; the edge detection filters corresponding to the linear chromatic aberration defects and band chromatic aberration defects include a one-dimensional filter.

5. The method according to claim 1, characterized in that Generating corresponding chromatic aberration defect compensation data based on the chromatic aberration defect data, and providing the position of the chromatic aberration defect area and the corresponding chromatic aberration defect compensation data to the augmented reality device for chromatic aberration defect compensation, including: For each first pixel in each color difference defect area, determine the pixel values ​​and position coordinates of at least two second pixels having a preset positional relationship with the first pixel from pixels without color difference defects adjacent to the first pixel according to a preset compensation method; Determining color difference defect compensation data corresponding to the first pixel according to the pixel value and position coordinates of the first pixel and the pixel value and position coordinates of the second pixel; Determine a chromatic aberration defect sub-region corresponding to a first pixel having similar chromatic aberration defect compensation data in the chromatic aberration defect region; The position of each chromatic aberration defect sub-region and the corresponding chromatic aberration defect compensation data are provided to the augmented reality device for chromatic aberration defect compensation.

6. The method according to claim 5, characterized in that For each first pixel in each color difference defect area, according to a preset compensation method, from pixels without color difference defects adjacent to the first pixel, pixel values ​​and position coordinates of at least two second pixels having a preset position relationship with the first pixel are determined, including: In the case where the preset compensation method adopts a one-dimensional compensation method, for each first pixel in each color difference defect area, pixel values ​​and one-dimensional position coordinates of at least two second pixels whose coordinate values ​​are smaller than and larger than the one-dimensional coordinate of the first pixel are respectively determined from pixels without color difference defects adjacent to the first pixel; When the preset compensation method adopts a two-dimensional compensation method, for each first pixel in each color difference defect area, the pixel values ​​and two-dimensional position coordinates of multiple second pixels are respectively determined from the pixels without color difference defects adjacent to the first pixel, and the two-dimensional position coordinates of the multiple second pixels satisfy: connecting the multiple second pixels in sequence can surround the first pixel.

7. The method according to claim 3, characterized in that The method further comprises: A smoothing filter is used to traverse the pixels of the first image and perform a convolution operation to smooth the edges of the chromatic aberration defects in the first image; wherein the smoothing filter includes a two-dimensional filter; or when the edge detection filter is a one-dimensional filter, the smoothing filter serves as another dimension and forms a two-dimensional filter with the edge detection filter, and / or For each color difference defect, the detection threshold corresponding to the color difference defect is determined in the following manner: For each color difference defect, for the edge detection filter of the same size used for the color difference defect, different candidate detection thresholds are used to compare with the corresponding operation results to obtain different comparison results; Using a preset edge detection algorithm, the color difference defect determined by the comparison result of each candidate detection threshold is compared with the corresponding color difference defect area in the first image to determine the effectiveness of each candidate detection threshold for detecting the corresponding color difference defect; The candidate detection threshold with the highest effectiveness is determined as the detection threshold corresponding to the color difference defect.

8. A method for compensating color difference defects, characterized in that: include: Receive power-on command; Start the display optimization service to read the color difference defect compensation parameters from the preset storage medium and load them into the memory; The color difference defect compensation parameters include: the position of the color difference defect area and the color difference defect compensation data; Calling a display service to read the color difference defect compensation parameter from a memory and update the parameter to a preset register inside a preset processor; Controlling the display panel to compensate the display data rendered by the GPU through the color difference defect compensation parameter in the preset register; The chromatic aberration defect compensation parameter is determined based on the method for determining chromatic aberration defect compensation data as described in any one of claims 1 to 7.

9. The method according to claim 8, characterized in that A first compensation parameter storage register is provided in the DPU; Calling the display service to read the color difference defect compensation parameter from the memory and updating it to the preset register inside the preset processor includes: Calling a display service to read the color difference defect compensation parameter from a memory and update the parameter to a first compensation parameter storage register in the DPU; Controlling the display panel to compensate the display data rendered by the GPU through the color difference defect compensation parameter in the preset register, including: Transmitting the color difference defect compensation parameter in the first compensation parameter register to a preset memory of a display controller in the display panel through a MIPI bus; The display controller compensates the display data rendered by the GPU using the color difference defect compensation parameters in the preset memory; or A second compensation parameter storage register is provided in the display controller of the display panel; Calling the display service to read the color difference defect compensation parameter from the memory and updating it to the preset register inside the preset processor includes: Calling a display service to read the color difference defect compensation parameter from a memory and update the parameter to the memory of the display panel; Reading the color difference defect compensation parameter into a second compensation parameter storage register in the display controller through the display controller; Controlling the display panel to compensate the display data rendered by the GPU through the color difference defect compensation parameter in the preset register, including: The display panel is controlled to compensate the display data rendered by the GPU through the color difference defect compensation parameter in the second compensation parameter storage register.

10. An augmented reality device, characterized in that: include: display panels, optical waveguides, and image processing equipment; The optical waveguide is used to transmit the content displayed by the display panel to the user's eyes; The image processing device is used to drive the display panel and store color difference defect compensation parameters, and uses a color difference defect compensation method as described in claim 8 or 9 to compensate the data displayed by the display panel.

Images