Display compensation method, display compensation system and storage medium

Abstract

The application provides a display compensation method, a display compensation system and a computer readable storage medium. The display compensation method comprises the following steps: obtaining a first compensation matrix and a first compensation parameter alpha. Each first element in the first compensation matrix corresponds to at least one screen pixel point of a display screen. The first compensation parameter alpha indicates a numerical relationship between each first element and a value of the corresponding screen pixel point; determining a second compensation matrix according to the first compensation matrix and the first compensation parameter alpha. Each second element in the second compensation matrix corresponds to at least one screen pixel point of the display screen; obtaining an original image to be compensated; and performing compensation correction on the original image according to the second compensation matrix to obtain a compensation image displayed on the display screen. The application can reduce the bandwidth and data dimension of the compensation data, thereby reducing the requirement for the data storage amount of the display compensation system.

Description

Technical Field

[0001] This invention relates to the field of extended reality technology, and in particular to a display compensation method, a display compensation system, and a computer-readable storage medium. Background Technology

[0002] Display compensation technology is widely used in various image display terminals to solve the problem of uneven brightness, color and / or contrast of the displayed image at different pixels, thereby improving the user's visual comfort and the realism of the displayed image.

[0003] In Extended Reality (XR) display applications, XR display devices resample different areas of the displayed image at varying compression ratios based on the user's eye movement signals. This improves image resolution in key areas while simultaneously reducing the computational demands on the XR display device's hardware. This dynamic gaze-point compression processing causes a dynamic deviation in the pixel position relationship between the original image and the displayed image. However, existing display compensation technologies generally lack the ability to adjust compensation values ​​in conjunction with gaze-point compression parameters, thus failing to achieve accurate statistical analysis and compensation for XR display devices with gaze-point compression processing capabilities.

[0004] In addition, considering the initial hardware display deviation of XR display devices and the display aging deviation after long-term use, directly superimposing uniformity compensation for hardware display deviation and display aging deviation compensation on XR display devices would place a huge data processing load on the XR display devices, thus making it impossible to achieve high frame rate and high resolution XR display at the same time.

[0005] In order to overcome the above-mentioned defects of the prior art, there is an urgent need in the field for an improved display compensation method. First, it is used to reduce the bandwidth and data dimension of the compensation data, thereby reducing the requirements for data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules. Then, preferably, the compensation value is adjusted by combining the gaze point compression parameter to adapt to the display compensation requirements of XR display devices with gaze point compression processing function. Summary of the Invention

[0006] The following provides a brief overview of one or more aspects to offer a basic understanding of them. This overview is not an exhaustive summary of all conceived aspects, nor is it intended to identify key or decisive elements of all aspects, nor to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed descriptions that follow.

[0007] To overcome the aforementioned deficiencies in the prior art, this invention provides a display compensation method, a display compensation system, and a computer storage medium. By using a combination of compensation coefficients and compensation matrices to split and store compensation data, the bandwidth and data dimensionality of the compensation data are effectively reduced, thereby lowering the requirements for data storage, data transmission, and data processing in the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0008] Specifically, the display compensation method provided by the first aspect of the present invention includes the following steps: obtaining a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates the numerical relationship between the values ​​of each first element and the corresponding screen pixel; determining a second compensation matrix based on the first compensation matrix and the first compensation parameter α, wherein each second element in the second compensation matrix corresponds to at least one screen pixel of the display screen; obtaining an original image to be compensated; and compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen. By using a combination of compensation coefficients and compensation matrices to split and store compensation data, the present invention can effectively reduce the bandwidth and data dimension of compensation data, thereby reducing the requirements for data storage, data transmission, and data processing of the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0009] Furthermore, in some embodiments of the present invention, each of the first elements records the value difference between each of the screen pixels, and the first compensation parameter α indicates the bias value between each of the first elements and the value of the corresponding screen pixel. And / or, each of the first elements records the value of a specific screen pixel, and the first compensation parameter α indicates the value difference between each specific screen pixel and its corresponding non-specific screen pixel. And / or, each of the first elements records the value of each screen pixel at a preset grayscale, and the first compensation parameter α indicates the numerical adjustment coefficient of each screen pixel at at least one other grayscale.

[0010] Furthermore, in some embodiments of the present invention, the first compensation parameter α corresponds to a lookup table. The step of determining the second compensation matrix based on the first compensation matrix and the first compensation parameter α includes: searching the lookup table corresponding to the first compensation parameter α according to the value and / or position of each first element in the first compensation matrix to determine the value and / or position of at least one second element corresponding to each first element; and determining the second compensation matrix according to the value and position of each second element.

[0011] Further, in some embodiments of the present invention, the step of determining the second compensation matrix based on the first compensation matrix and the first compensation parameter α includes: determining the first offset value offset1 and / or the first gain value gain1 corresponding to each of the first elements based on the first compensation parameter α; establishing a third compensation matrix based on the first resolution of the first compensation matrix, and determining the value of each of the third elements in the third compensation matrix based on the first offset value offset1 and / or the first gain value gain1 corresponding to each of the first elements; and upsampling the third compensation matrix based on the second resolution of the display screen to determine the value of each of the second elements in the second compensation matrix of the second resolution.

[0012] Furthermore, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: acquiring the user's eye movement signal; performing gaze point compression on the original image and the second compensation matrix according to the eye movement signal; compensating and correcting the original image after gaze point compression via the second compensation matrix after gaze point compression to obtain a compressed compensated image; and performing gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen.

[0013] Further, in some embodiments of the present invention, the step of performing gaze point compression on the second compensation matrix based on the eye movement signal includes: determining a second bias value offset2 and / or a second gain value gain2 corresponding to each second element in the second compensation matrix based on the value of each image pixel in the original image; correcting each corresponding second element in the second compensation matrix based on the second bias value offset2 and / or the second gain value gain2 to determine the value of each fourth element in the fourth compensation matrix; and performing gaze point compression on the fourth compensation matrix based on the eye movement signal to determine a second compensation matrix after gaze point compression.

[0014] Further, in some embodiments of the present invention, the step of determining the second compensation matrix based on the first compensation matrix and the first compensation parameter α includes: determining a first offset value offset1 and / or a first gain value gain1 corresponding to each of the first elements based on the first compensation parameter α; acquiring the user's eye-tracking signal to partition the first compensation matrix and determine a first compression ratio for each partitioned region; determining a corresponding second compression ratio based on the first resolution of the first compensation matrix and the second resolution of the display screen; determining a third compression ratio for each region based on the second compression ratio and the first compression ratio of each region; sampling the first compensation matrix based on the third compression ratio to determine a fifth compensation matrix and determining at least one fifth element corresponding to each of the first elements; and determining the value of each of the second elements in the second compensation matrix based on each of the fifth elements in the fifth compensation matrix and its corresponding first offset value offset1 and / or first gain value gain1.

[0015] Furthermore, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: performing gaze point compression on the original image according to the eye movement signal; performing compensation and correction on the original image after gaze point compression via the second compensation matrix to obtain a compressed compensated image; and performing gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen.

[0016] Furthermore, in some embodiments of the present invention, the display compensation method further includes the following steps: acquiring a first calibration image; transmitting the first calibration image to the display screen for display, and acquiring a first display image output by the display screen via a shooting module; and comparing the values ​​of each image pixel in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0017] Furthermore, in some embodiments of the present invention, the display compensation method further includes the following steps: acquiring multiple second calibration images; transmitting each second calibration image to the display screen for display, and acquiring a second display image output by the display screen via the shooting module; and determining a second bias value offset2 and / or a second gain value gain2 corresponding to each second element in the second compensation matrix based on the difference in values ​​of each image pixel in the first calibration image and each of the second calibration images, and the difference in measured values ​​of each image pixel in the first display image and each of the second display images.

[0018] Further, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: obtaining a comprehensive aging factor indicating the screen aging condition; determining an aging compensation matrix and / or a second compensation parameter β for screen aging compensation according to the comprehensive aging factor; correcting the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to determine the values ​​of the sixth elements in the sixth compensation matrix respectively; and compensating and correcting the original image according to the sixth compensation matrix to obtain a compensated image displayed on the display screen.

[0019] Furthermore, in some embodiments of the present invention, the step of obtaining a comprehensive aging factor indicating screen aging includes: statistically analyzing the brightness of the original image or the compensated image to determine a current aging factor; statistically analyzing the temperature of the display screen to determine a temperature aging factor; and determining the comprehensive aging factor based on the current aging factor and the temperature aging factor.

[0020] Furthermore, in some embodiments of the present invention, the step of statistically analyzing the brightness of the original image or the compensated image to determine the current aging factor includes: determining the current factor of each image pixel in the original image or the compensated image based on the DBV (DisplayBrightness Value) data of the original image or the compensated image, wherein the DBV data is used to indicate the display brightness level of the highest display grayscale of the screen in the current state; and accumulating the current factor over a statistical time to determine the current aging factor of each image pixel.

[0021] Furthermore, in some embodiments of the present invention, the step of statistically analyzing the temperature of the display screen to determine the temperature aging factor includes: determining the real-time temperature of each screen pixel of the display screen via a screen temperature sensor; and determining the temperature aging factor of each screen pixel based on the real-time temperature and a pre-calibrated temperature-aging relationship.

[0022] Furthermore, in some embodiments of the present invention, the step of determining the comprehensive aging factor based on the current aging factor and the temperature aging factor includes: obtaining the current aging factor after gaze point decompression; and fusing the current aging factor after gaze point decompression and the temperature aging factor of the screen resolution to determine the comprehensive aging factor of the screen resolution.

[0023] Furthermore, in some embodiments of the present invention, the step of determining the aging compensation matrix and / or the second compensation parameter β of the screen aging compensation based on the comprehensive aging factor includes: downsampling the comprehensive aging factor according to a preset fourth compression ratio to determine the aging compensation matrix; determining a seventh compensation matrix for storing gray levels and at least one eighth compensation matrix for not storing gray levels based on the aging compensation matrix and the second compensation matrix; and determining the second compensation parameter β based on the difference between each seventh element in the seventh compensation matrix and each eighth element in each of the eighth compensation matrices.

[0024] Furthermore, in some embodiments of the present invention, the step of obtaining the first compensation matrix includes: performing an inverse operation on the seventh compensation matrix and / or the eighth compensation matrix according to the first compensation parameter α to obtain an updated first compensation matrix.

[0025] Further, in some embodiments of the present invention, the step of modifying the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to determine the values ​​of the sixth elements in the sixth compensation matrix includes: determining the values ​​of the seventh elements in the seventh compensation matrix according to the aging compensation matrix and the second compensation matrix; determining the third offset value offset3 and / or the third gain value gain3 corresponding to each of the seventh elements according to the second compensation parameter β; and determining the values ​​of the sixth elements in the sixth compensation matrix according to the seventh elements in the seventh compensation matrix and their corresponding third offset value offset3 and / or third gain value gain3.

[0026] Furthermore, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen further includes: in response to continuing to acquire a preset number of original images or compensated images, performing historical statistics in conjunction with the preset number of original images or compensated images to update the aging compensation matrix and / or the second compensation parameter β; in response to the update of the aging compensation matrix and / or the second compensation parameter β, correcting each corresponding second element in the second compensation matrix according to the updated aging compensation matrix and / or the updated second compensation parameter β to update the value of each sixth element in the sixth compensation matrix respectively; and in response to each acquired original image frame, compensating and correcting the original image according to the current sixth compensation matrix to obtain a compensated image displayed on the display screen.

[0027] Furthermore, the display compensation system provided according to a second aspect of the present invention includes a display pipeline. A display compensation module is disposed in the display pipeline. The display compensation module is configured to: acquire a first compensation matrix and a first compensation parameter α. Each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen. The first compensation parameter α indicates the numerical relationship between each first element and the corresponding screen pixel; determine a second compensation matrix based on the first compensation matrix and the first compensation parameter α. Each second element in the second compensation matrix corresponds to each screen pixel of the display screen; acquire an original image to be compensated; and compensate and correct the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen.

[0028] Furthermore, in some embodiments of the present invention, the display pipeline is further configured with a gaze point compression module and a gaze point decompression module. The gaze point compression module is configured to: acquire the user's eye movement signals; and perform gaze point compression on the original image and / or the second compensation matrix based on the eye movement signals. The display compensation module is configured between the gaze point compression module and the gaze point decompression module, and is configured to: compensate and correct the original image after gaze point compression via the second compensation matrix after gaze point compression to obtain a compressed compensated image. The gaze point decompression module is configured to: perform gaze point decompression on the compressed compensated image based on the eye movement signals to obtain a compensated image displayed on the display screen.

[0029] Furthermore, in some embodiments of the present invention, the display compensation system further includes a calibration system. The calibration system is equipped with an imaging module and configured to: acquire a first calibration image; transmit the first calibration image to the display screen for display, and acquire a first display image output by the display screen via the imaging module; and compare the values ​​of each pixel in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0030] Furthermore, the computer-readable storage medium provided according to the third aspect of the present invention stores computer instructions thereon. When the computer instructions are executed by a processor, the display compensation method provided in the first aspect of the present invention is implemented. Attached Figure Description

[0031] The above-described features and advantages of the present invention will be better understood after reading the following detailed description of embodiments of the present disclosure in conjunction with the accompanying drawings. In the drawings, components are not necessarily drawn to scale, and components having similar related characteristics or features may have the same or similar reference numerals.

[0032] Figure 1 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0033] Figure 2 A schematic flowchart of a display compensation method provided according to some embodiments of the present invention is shown.

[0034] Figures 3A-3C Schematic diagrams of the first compensation matrix according to some embodiments of the present invention are shown respectively.

[0035] Figure 4A and Figure 4B Schematic diagrams of uniformity display compensation provided according to some embodiments of the present invention are shown respectively.

[0036] Figure 5 A schematic diagram illustrating the gaze point compression and decompression principle provided according to some embodiments of the present invention is shown.

[0037] Figure 6 A schematic flowchart of uniformity display compensation provided according to some embodiments of the present invention is shown.

[0038] Figure 7 A schematic flowchart illustrating the process of determining the second compensation matrix according to some embodiments of the present invention is shown.

[0039] Figure 8 A schematic diagram of a combined display compensation process provided according to some embodiments of the present invention is shown.

[0040] Figure 9A and Figure 9B A schematic diagram of a display aging compensation process provided according to some embodiments of the present invention is shown.

[0041] Figure 10 A schematic diagram of determining the aging compensation matrix is ​​shown according to some embodiments of the present invention.

[0042] Figure 11 A schematic diagram of the updated aging compensation matrix and / or the second compensation parameter β provided according to some embodiments of the present invention is shown.

[0043] Figure 12 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0044] Figure 13 A schematic diagram of a display aging compensation process provided according to some embodiments of the present invention is shown. Detailed Implementation

[0045] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Although the description of the present invention is presented in conjunction with preferred embodiments, this does not mean that the features of the invention are limited to these embodiments. On the contrary, the purpose of describing the invention in conjunction with embodiments is to cover other options or modifications that may be derived based on the claims of the present invention. To provide a thorough understanding of the invention, many specific details will be included in the following description. The invention may also be implemented without using these details. Furthermore, to avoid confusion or obscuring the focus of the invention, some specific details will be omitted in the description.

[0046] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0047] Furthermore, the terms "upper," "lower," "left," "right," "top," "bottom," "horizontal," and "vertical" used in the following description should be understood as the orientations shown in the relevant paragraphs and accompanying drawings. These relative terms are for illustrative purposes only and do not imply that the described apparatus must be manufactured or operated in a specific orientation, and therefore should not be construed as limiting the invention.

[0048] It is understood that although terms such as "first," "second," and "third" may be used herein to describe various components, regions, layers, and / or parts, these components, regions, layers, and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers, and / or parts. Therefore, the first components, regions, layers, and / or parts discussed below may be referred to as second components, regions, layers, and / or parts without departing from some embodiments of the present invention.

[0049] As mentioned above, in Extended Reality (XR) display applications, XR display devices resample different areas of the displayed image at different compression ratios based on the user's eye movement signals to improve the image resolution of key areas while simultaneously reducing the hardware computing power requirements of the XR display device. This dynamic gaze-point compression processing causes a dynamic deviation in the pixel position relationship between the original image and the displayed image. However, existing display compensation technologies generally lack the function of adjusting compensation values ​​in conjunction with gaze-point compression parameters, thus failing to achieve accurate statistics and compensation for XR display devices with gaze-point compression processing. Furthermore, considering the initial hardware display deviation and long-term display aging deviation of XR display devices, directly superimposing uniformity compensation for hardware display deviation and display aging deviation compensation in XR display devices would impose a huge data processing load on the XR display devices, making it impossible to simultaneously achieve high frame rate and high resolution XR displays.

[0050] To overcome the aforementioned deficiencies in the prior art, this invention provides a display compensation method, a display compensation system, and a computer storage medium. By using a combination of compensation coefficient α and compensation matrix to split and store compensation data, the bandwidth and data dimensionality of the compensation data are effectively reduced, thereby lowering the requirements for data storage, data transmission, and data processing of the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0051] In some non-limiting embodiments, the display compensation method provided in the first aspect of the present invention can be implemented via the display compensation system provided in the second aspect of the present invention. Please refer to [reference needed] for details. Figure 1 , Figure 1 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0052] exist Figure 1 In the illustrated embodiment, the display compensation system 10 provided in the second aspect of the present invention includes a memory 14 and a processor 15. The memory 14 includes, but is not limited to, the computer-readable storage medium provided in the third aspect of the present invention, on which computer instructions are stored. The processor 15 is connected to the memory 14 and configured to execute the computer instructions stored in the memory to implement the display compensation method provided in the first aspect of the present invention.

[0053] Furthermore, in Figure 1 In the embodiments shown, the above-described display compensation system may further include a display pipeline 11, a calibration system 12, and a display screen 13.

[0054] Specifically, the calibration system 12 is equipped with a shooting module 121, which is configured to acquire a first calibration image and transmit the first calibration image to the display screen 13 for display. The shooting module 121 acquires the first display image output by the display screen 13, and then compares the values ​​of each image pixel in the first calibration image and the first display image to determine the first compensation matrix corresponding to at least one screen pixel of the display screen 13 for each first element, and its corresponding first compensation parameter α.

[0055] The display pipeline 11 is equipped with a display compensation module 111. The display compensation module 111 is connected to the processor 15. Under the control of the processor 15, it can determine a second compensation matrix in which each second element corresponds to at least one screen pixel of the display screen 13 according to the first compensation matrix and the first compensation parameter α. Then, it compensates the original image according to the second compensation matrix to obtain a compensated image.

[0056] Furthermore, the aforementioned display compensation system may preferably include a gaze point compression module 112 and a gaze point decompression module 113. The gaze point compression module 112 acquires the user's eye movement signals and performs gaze point compression on the original image and / or the second compensation matrix based on these signals. The display compensation module 111 is configured after the gaze point compression module 112 and, under the control of the processor 15, compensates the compressed original image according to the compressed second compensation matrix to obtain a compressed compensation image. The gaze point decompression module 113 is configured after the display compensation module 111 and performs gaze point decompression on the compressed compensation image based on the eye movement signals to obtain a compensation image displayed on the display screen 13. By first performing gaze point compression on the original image and / or the second compensation matrix, then compressing the compressed original image according to the compressed second compensation matrix, and then performing gaze point decompression on the compressed compensation image, the present invention can significantly reduce the data processing volume of display compensation, thereby reducing the data storage requirements of the display compensation system and reducing the data transmission load of compensation data between different modules.

[0057] The working principle of the above-described display compensation system will be described below with reference to some embodiments of display compensation methods. Those skilled in the art will understand that these embodiments of display compensation methods are merely non-limiting implementations provided by the present invention, intended to clearly demonstrate the main concepts of the invention and provide specific solutions convenient for public implementation, rather than limiting all functions or all operating methods of the display compensation system. Similarly, this display compensation system is also merely a non-limiting implementation of the present invention and does not constitute a limitation on the executing entity or execution order of the steps in these display compensation methods.

[0058] Please refer to further information. Figure 2 , Figure 2 A schematic flowchart of a display compensation method provided according to some embodiments of the present invention is shown.

[0059] like Figure 2 As shown, in the process of determining the compensation matrix, the display compensation system 10 can first obtain the first compensation matrix and the first compensation parameter α via the display compensation module 111. Here, each first element in the first compensation matrix can correspond to at least one screen pixel of the display screen 13. The first compensation parameter α indicates the numerical relationship between each first element and the value of the corresponding screen pixel.

[0060] Specifically, regarding the uniformity compensation function for hardware display deviation, in the process of obtaining the first compensation matrix and the first compensation parameter α, the display compensation system can first acquire the first calibration image and transmit the first calibration image to the display screen 13 for display. Then, the imaging module 121 captures the first display image output by the display screen 13 and compares the values ​​of each image pixel in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0061] Please refer to further information. Figures 3A-3C , Figures 3A-3C Schematic diagrams of the first compensation matrix according to some embodiments of the present invention are shown respectively.

[0062] exist Figure 3A In the illustrated embodiment, each first element in the first compensation matrix can correspond to a screen pixel on the screen 13, and each screen pixel records its value at a preset grayscale (e.g., grayscale 255 in 8-bit precision). The first compensation parameter α corresponds to a lookup table LUT_0, which records the corresponding values ​​of each first element at at least one other grayscale (e.g., grayscale 192, 128, 64, etc. in 8-bit precision), indicating the numerical adjustment coefficient of each screen pixel at at least one other grayscale. Thus, the display compensation system can determine second compensation matrices for multiple grayscales based on the first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel on the display screen 13 at the corresponding grayscale based on the values ​​of each second element in the second compensation matrix. This reduces the data storage requirements of the display compensation system and reduces the data transmission load of compensation data between different modules.

[0063] exist Figure 3BIn the illustrated embodiment, each first element in the first compensation matrix can correspond to a screen pixel on the screen 13, and each element records the value difference between the screen pixels. The first compensation parameter α indicates the bias value between each first element and the value of the corresponding screen pixel. Thus, the display compensation system only needs to store small value difference data to determine the corresponding second compensation matrix based on the first compensation matrix and its corresponding first compensation parameter α, and to determine the value of at least one screen pixel on the display screen 13 based on the value of each second element in the second compensation matrix. This reduces the data storage requirements of the display compensation system and reduces the data transmission load of compensation data between different modules.

[0064] exist Figure 3C In the illustrated embodiment, the display compensation system may further store two first compensation matrices. Each first element in one first compensation matrix records a first gain value (gain1) of each screen pixel with respect to gain, while each first element in the other first compensation matrix records a first offset value (offset1) of each screen pixel with respect to offset. Correspondingly, the first compensation parameter α corresponding to each first compensation matrix can correspond to a lookup table (LUT_1) and a lookup table (LUT_2), which respectively record the corresponding values ​​of each first element with respect to gain or offset. Thus, the display compensation system can determine second compensation matrices with respect to gain and offset based on each first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel of the display screen 13 based on the values ​​of the second elements in these second compensation matrices, thereby reducing the data storage requirements of the display compensation system and reducing the data transmission load of compensation data between different modules.

[0065] Furthermore, in some embodiments, each first element in the first compensation matrix may correspond to multiple screen pixels in the screen 13, and each element records the value of a specific screen pixel. The first compensation parameter α indicates the value difference between each specific screen pixel and its corresponding non-specific screen pixel. Thus, the display compensation system only needs to store a small number of values ​​for specific screen pixels to determine the corresponding second compensation matrix based on the first compensation matrix and its corresponding first compensation parameter α, and to determine the value of at least one screen pixel in the display screen 13 based on the values ​​of each second element in the second compensation matrix. This reduces the data storage requirements of the display compensation system and reduces the data transmission load of compensation data between different modules.

[0066] Please refer to the reference. Figure 4A and Figure 4B , Figure 4A and Figure 4B Schematic diagrams of uniformity display compensation provided according to some embodiments of the present invention are shown respectively.

[0067] like Figure 4A and Figure 4B As shown, in the process of determining the second compensation matrix, the compensation system can first determine the first bias value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix by looking up the table according to the first compensation parameter α, as described above:

[0068]

[0069] Among them, g in For each of the first elements input, LUT_i() indicates the process of interpolating the compensation value according to the lookup table.

[0070] Subsequently, the display compensation system can establish a third compensation matrix based on the first resolution of the first compensation matrix (e.g., 960*960), and determine the value of each third element in the third compensation matrix according to the position of each third element and its corresponding first element's first offset value offset1 and / or first gain value gain1:

[0071] g out =g in ×gain1+offset1

[0072] Among them, g in For each value of the first element in the input, g out The values ​​of each third element in the output are given.

[0073] Subsequently, the display compensation system can upsample the first compensation matrix according to the second resolution of the display screen 13 (e.g., 1920*1920) to determine the value of each second element in the second compensation matrix of the second resolution (e.g., 1920*1920).

[0074] After that, such as Figure 2 As shown, the display compensation system can acquire the original image to be compensated and perform compensation correction on the original image according to the second compensation matrix to obtain the compensated image displayed on the display screen 13.

[0075] Specifically, such as Figure 4A and Figure 4BAs shown, during the uniformity compensation process, the display compensation system first acquires the user's eye movement signal, and then, via the aforementioned gaze point compression module 112, performs gaze point compression on the original image and the second compensation matrix based on the eye movement signal to obtain compressed image input data at a third resolution (e.g., 1296*1296) and a compressed second compensation matrix. Afterwards, the display compensation system, as described above, uses the second element of the gaze point-compressed second compensation matrix as the compensation value, first performs compensation correction on the gaze point-compressed original image via the display compensation module 111 to obtain a compressed compensation image, and then, via the gaze point decompression module 113, performs gaze point decompression on the compressed compensation image based on the eye movement signal to obtain the compensation image displayed on the display screen 13.

[0076] Please refer to the details. Figure 5 , Figure 5 A schematic diagram illustrating the gaze point compression and decompression principle provided according to some embodiments of the present invention is shown.

[0077] like Figure 5 As shown, during the gaze point compression process, the display compensation system first uses gaze point-based region division coordinates (x0, y0), (x1, y1), (x2, y2), and (x3, y3) to divide the original image and the second compensation matrix into multiple sub-regions with different levels of attention, and determines the compression ratio of each sub-region according to the level of attention. Here, the first sub-region where the gaze point is located can have the highest compression ratio (e.g., 1:1), the second sub-region near the gaze point can have a medium compression ratio (e.g., 1:2), and the third sub-region far from the gaze point can have the lowest compression ratio (e.g., 1:4). Then, the display compensation system can resample each sub-region in the original image and the second compensation matrix according to the compression ratio of each sub-region to obtain compressed image input data at a third resolution (e.g., 1296*1296) and a compressed second compensation matrix.

[0078] Correspondingly, during the gaze point decompression process, the display compensation system can also divide the compressed compensation image into multiple sub-regions with different attention levels according to the coordinates (x0,y0), (x1,y1), (x2,y2), and (x3,y3) of the above-mentioned region. Based on the compression ratio of each sub-region, the system can decompress each sub-region in the compressed compensation image (i.e., reverse resampling) to obtain a compensation image with a second resolution (e.g., 1920*1920).

[0079] In addition, please refer to Figure 6 . Figure 6 A schematic flowchart of uniformity display compensation provided according to some embodiments of the present invention is shown.

[0080] exist Figure 6 In the illustrated embodiment, before performing gaze point compression, the display compensation system may, preferably, acquire multiple second calibration images after acquiring the first calibration image, transmit each second calibration image to the display screen 13 for display, and capture each second display image output by the display screen 13 via the imaging module 121 configured in the calibration system 12. Then, the display compensation system can determine the second bias value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix based on the differences in pixel values ​​between the first calibration image and each of the second calibration images, and the differences in measured pixel values ​​between the first display image and each of the second display images.

[0081] Subsequently, during gaze point compression, the display compensation system determines the second offset value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix based on the values ​​of each pixel in the original image and the corresponding look-up table (LUT). Then, based on the second offset value offset2 and / or the second gain value gain2, it corrects the corresponding second elements in the second compensation matrix to determine the values ​​of each fourth element in the fourth compensation matrix. Here, the original image can be image data directly acquired by the display compensation system, or image data obtained by decompressing the gaze point-compressed input data. Afterward, the display compensation system performs gaze point compression on the fourth compensation matrix based on the eye movement signal to determine the gaze point-compressed second compensation matrix, and performs uniformity compensation on the input data as described above.

[0082] Those skilled in the art will understand that the above-described scheme of first upsampling the first compensation matrix to the second resolution of the display screen 13 to obtain the second compensation matrix of the second resolution, and then performing gaze point compression and uniformity compensation processing on the second compensation matrix and the original image, is only a non-limiting implementation provided by the present invention. It is intended to clearly demonstrate the main concept of the present invention and provide a specific solution that is easy for the public to implement, rather than to limit the scope of protection of the present invention.

[0083] Optionally, in other embodiments, the display compensation system can also directly divide the first compensation matrix into multiple sub-regions with different attention levels based on the user's eye movement signal, and resample each sub-region with different compression ratios to directly obtain the second compensation matrix with the second resolution. Then, based on the second compensation matrix, the original image after gaze point decompression is adjusted for compensation value and uniformity compensation is performed.

[0084] Please refer to the details. Figure 7 , Figure 7A schematic flowchart of uniformity compensation provided according to some embodiments of the present invention is shown.

[0085] like Figure 7 As shown, in determining the second compensation matrix, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element based on the first compensation parameter α, and then acquire the user's eye movement signal to partition the first compensation matrix. Afterwards, the display compensation system can determine the first compression ratio of each sub-region based on the user's eye movement signal, and determine the corresponding second compression ratio based on the first resolution of the first compensation matrix and the second resolution of the display screen. Then, based on the second compression ratio and the first compression ratio of each region, the third compression ratio of each region is determined. Here, the first sub-region where the gaze point is located can have the largest third compression ratio (e.g., 2:1), the second sub-region near the gaze point can have a medium third compression ratio (e.g., 2:3), and the third sub-region far from the gaze point can have the smallest third compression ratio (e.g., 1:2). Next, the display compensation system can upsample the first sub-region of interest to the user in the first compensation matrix according to the third compression ratio of each sub-region, and downsample the second and third sub-regions of interest to the user in the first compensation matrix to determine the fifth compensation matrix and at least one fifth element corresponding to each first element. Finally, the display compensation system can determine the value of each second element in the second compensation matrix according to each fifth element in the fifth compensation matrix and its corresponding first bias value offset1 and / or first gain value gain1.

[0086] Subsequently, during the compensation value adjustment process, the display compensation system can partition the original image compressed by the gaze point according to the user's eye movement signal, and determine the decompression ratio of each sub-region. Here, the first sub-region where the gaze point is located can have the smallest decompression ratio (e.g., 1:1), the second sub-region near the gaze point can have a medium decompression ratio (e.g., 2:1), and the third sub-region far from the gaze point can have the largest decompression ratio (e.g., 4:1). Then, the display compensation system can upsample the second and third sub-regions of interest to the user in the original image compressed by the gaze point according to the decompression ratio of each sub-region to obtain an original image of second resolution, and adjust the compensation value according to the second resolution original image and the second compensation matrix as described above.

[0087] Subsequently, during the uniformity compensation process, the display compensation system first performs gaze point compression on the original image based on the user's eye movement signals. Then, it uses the second compensation matrix to compensate and correct the gaze point-compressed original image to obtain a compressed compensated image. Finally, as described above, it performs gaze point decompression on the compressed compensated image based on the eye movement signals to obtain the compensated image displayed on the screen. In this way, the display compensation system does not need to restore each image pixel in each region to the pixel corresponding to the resolution of the display screen 13 to perform compensation value adjustment and uniformity compensation, thus further saving the data processing resources of the display compensation system.

[0088] Thus, by first generating a second compensation matrix based on the first compensation matrix and the calibrated first compensation parameter α, and then compensating and correcting the original image based on the second compensation matrix, the present invention can effectively eliminate the impact of uneven display on the native display screen 13, and reduce the bandwidth and data dimension of the compensation data, thereby reducing the data storage requirements of the display compensation system and the data transmission load of the compensation data between different modules. Furthermore, by performing synchronous gaze point compression based on eye movement signals on the original image to be compensated and the compensation value (i.e., each second element in the second compensation matrix), the present invention can more accurately achieve uniformity compensation for XR display devices with gaze point compression processing function.

[0089] Please refer to further information. Figure 8 , Figure 8 A schematic diagram of a combined display compensation process provided according to some embodiments of the present invention is shown.

[0090] exist Figure 8 In the embodiment shown, the display compensation system can also perform historical statistics on the temperature, current and other related parameters of the display screen 13 that has been used for a long time, and obtain the second compensation parameter β based on the statistical results.

[0091] Please refer to the details. Figure 9A and Figure 9B , Figure 9A and Figure 9B A schematic diagram of a display aging compensation process provided according to some embodiments of the present invention is shown.

[0092] like Figure 9A and Figure 9BAs shown, before performing combined compensation of uniformity compensation and display aging compensation, the display compensation system can first acquire multiple frames of the original image before display compensation or the compensated image after display compensation via the display compensation module 111, and perform historical statistics on their brightness to determine the current aging factor. The original image, the compensated image, and the current aging factor all have a third resolution after gaze compression (e.g., 1296*1296). Furthermore, the display compensation system can also perform historical statistics on the temperature of each pixel of the display screen 13 to determine the temperature aging factor, which has a second resolution of the display screen 22 (e.g., 1920*1920). Afterwards, the display compensation system can determine the aging compensation matrix and / or the second compensation parameter β for screen aging compensation based on the current aging factor and the temperature aging factor.

[0093] Please refer to the details. Figure 10 and Figure 11 . Figure 10 A schematic diagram of determining the aging compensation matrix is ​​shown according to some embodiments of the present invention. Figure 11 A schematic diagram of the updated aging compensation matrix and / or the second compensation parameter β provided according to some embodiments of the present invention is shown.

[0094] like Figure 10 As shown, in determining the current aging factor, the display compensation system can first acquire the display brightness value (DBV) data of the original image or the compensated image, and perform brightness conversion to determine the current factor of each image pixel in the original image or the compensated image. Then, the display compensation system can accumulate the current factor based on the actual usage time (i.e., statistical time) of the screen 13 to determine the current aging factor of each image pixel.

[0095] In addition, in the process of determining the temperature aging factor, the display compensation system can first determine the real-time temperature of each screen pixel of the display screen 13 via the screen temperature sensor, and then determine the temperature aging factor of each screen pixel according to the real-time temperature and the pre-calibrated temperature-aging relationship.

[0096] Subsequently, in determining the aging compensation matrix for screen aging compensation, the display compensation system can perform gaze-point decompression of the current aging factor based on the user's eye movement signals, or obtain the gaze-point decompressed second-resolution current aging factor by statistically analyzing the brightness of the original or compensated image. Then, through formula calculations or table lookups, the gaze-point decompressed current aging factor and the second-resolution temperature aging factor are fused to determine the comprehensive aging factor for the second resolution. Afterward, the display compensation system can downsample this comprehensive aging factor for the second resolution according to a preset fourth compression ratio to determine the aging compensation matrix for the third resolution.

[0097] Furthermore, in Figure 11 In the illustrated embodiment, the display compensation system may also preferably perform addition or multiplication operations on the aforementioned second compensation matrix and aging compensation matrix to determine a seventh compensation matrix for a stored grayscale level (e.g., 255 grayscale levels in 8-bit precision) and at least one eighth compensation matrix for non-stored grayscale levels (e.g., 192 grayscale levels, 128 grayscale levels, 64 grayscale levels, etc. in 8-bit precision). Then, the display compensation system can extract a second compensation parameter β for each non-stored grayscale level relative to the stored grayscale level based on the difference between each seventh element in the seventh compensation matrix and each eighth element in each eighth compensation matrix. Furthermore, the display compensation system can also perform an inverse operation on the seventh compensation matrix and / or the eighth compensation matrix based on the aforementioned first compensation parameter α to obtain an updated first compensation matrix for continued subsequent display compensation.

[0098] Please continue to refer to this. Figure 8 After obtaining the aging compensation matrix and / or the second compensation parameter β, the display compensation system 10 can first obtain the first compensation matrix and the first compensation parameter α of the first resolution (e.g., 960*960) as described above, and determine the second compensation matrix of the second resolution (e.g., 1920*1920) based on the first compensation matrix and the first compensation parameter α.

[0099] For example, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix based on the first compensation parameter α. Then, it can establish a third compensation matrix based on the first resolution of the first compensation matrix, and determine the value of each third element in the third compensation matrix based on the first offset value offset1 and / or the first gain value gain1 corresponding to each third element. Afterward, the display compensation system can upsample the third compensation matrix according to the second resolution of the display screen 13 to determine the value of each second element in the second compensation matrix at the second resolution.

[0100] For example, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix based on the first compensation parameter α, then acquire the user's eye movement signal to partition the first compensation matrix, and determine the first compression ratio of each sub-region. Furthermore, the display compensation system can determine the corresponding second compression ratio based on the first resolution of the first compensation matrix and the second resolution of the display screen 13, and then determine the third compression ratio of each sub-region based on the second compression ratio and the first compression ratio of each sub-region. Afterwards, the display compensation system can resample the first compensation matrix based on the third compression ratio to determine the fifth compensation matrix, and determine at least one fifth element corresponding to each first element. Then, based on each fifth element in the fifth compensation matrix and its corresponding first offset value offset1 and / or first gain value gain1, the value of each second element in the second compensation matrix is ​​determined.

[0101] After determining the compensation values ​​used for uniformity compensation (i.e., the values ​​of each second element in the second compensation matrix), the display compensation system can further correct the corresponding second elements in the second compensation matrix according to the aforementioned aging compensation matrix and / or the second compensation parameter β, so as to determine the values ​​of each sixth element in the sixth compensation matrix of the third resolution (e.g., 1296*1296). Then, the display compensation system can perform a combined compensation correction of uniformity compensation and display aging compensation on the original image according to the sixth compensation matrix, and then perform gaze decompression on the compensated image to obtain a compensated image displayed on the display screen 13 at the second resolution (e.g., 1920*1920), thereby further eliminating the effects of display aging deviation caused by long-term use of the display screen 13.

[0102] Specifically, in determining the values ​​of each sixth element in the sixth compensation matrix, the explicit compensation system can first... Figure 11 As shown, based on the aging compensation matrix and the second compensation matrix, the values ​​of each of the seventh elements in the seventh compensation matrix are determined. Then, based on the second compensation parameter β, the third bias value offset3 and / or the third gain value gain3 corresponding to each seventh element are determined respectively.

[0103] offset3 = offset1 × β(g) in )

[0104] β is the seventh element g in The function can also be each of the seventh elements g. in The lookup table LUT_3 is used to further save storage resources and transmission bandwidth.

[0105] Subsequently, the display compensation system can determine the values ​​of each sixth element in the sixth compensation matrix based on each seventh element in the seventh compensation matrix and its corresponding third bias value offset3 and / or third gain value gain3:

[0106] g out =g in ×gain3+offset3

[0107] Here, g in For each of the input seventh elements, g out This represents the value of each sixth element in the output.

[0108] Furthermore, in some embodiments, the display compensation system may preferably store a frame number threshold n for updating the aging compensation matrix and / or the second compensation parameter β. th After obtaining the aging compensation matrix and / or the second compensation parameter β, the display compensation system can continuously compensate each subsequent frame of the original image according to the aging compensation matrix and / or the second compensation parameter β, and continue to acquire subsequent original or compensated images. Then, in response to continuing to acquire a preset number of frames (n≥n... th The display compensation system can combine the original or compensated images of the preset number of frames to perform historical statistics, thereby updating the aging compensation matrix and / or the second compensation parameter β. Here, the preset number of frames can be one frame or multiple frames. Subsequently, in response to the update of the aging compensation matrix and / or the second compensation parameter β, the display compensation system can further modify the corresponding second elements in the second compensation matrix according to the updated aging compensation matrix and / or the second compensation parameter β, thereby updating the values ​​of the sixth elements in the sixth compensation matrix respectively, and performing compensation correction on each acquired original image frame according to the current sixth compensation matrix to obtain the compensated image displayed on the display screen 13.

[0109] Thus, by further employing the aging compensation matrix obtained from historical statistics and / or the second compensation parameter β to continuously correct each second element in the second compensation matrix, the present invention can simultaneously eliminate the uneven display of the native display screen 13 and the effects of display aging, while further reducing the bandwidth and data dimension of the compensation data. This reduces the requirements for data storage, data transmission, and data processing of the display compensation system, and also reduces the data transmission load of the compensation data between different modules. Furthermore, by performing synchronous gaze point compression based on eye movement signals on the original image to be compensated and the compensation value (i.e., each second element in the second compensation matrix), the present invention can more accurately achieve uniformity compensation and display aging compensation for XR display devices with gaze point compression processing function.

[0110] Those skilled in the art will understand that the above-described embodiment, which first determines the second compensation matrix based on a pre-calibrated first compensation parameter α, and then corrects the second compensation matrix based on historical statistical aging compensation matrix and / or the second compensation parameter β, to perform a combination of uniformity compensation and explicit aging compensation, is merely a non-limiting implementation provided by the present invention. It is intended to clearly demonstrate the main concept of the present invention and provide a specific solution that is easy for the public to implement, rather than to limit the scope of protection of the present invention.

[0111] Optionally, in other embodiments, the display compensation method, display compensation system and computer-readable storage medium provided by the present invention can also be used to perform display aging compensation for display aging deviations alone, so as to improve the user's visual comfort and the realism of the screen display image.

[0112] Please refer to the reference. Figure 12 and Figure 13 . Figure 12 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown. Figure 13 A schematic diagram of a display aging compensation process provided according to some embodiments of the present invention is shown.

[0113] exist Figure 12 In the embodiment shown, the display compensation system does not require a calibration system, but only includes a display pipeline 21, a display screen 22, a memory 23, and a processor 24.

[0114] Specifically, the memory 23 includes, but is not limited to, the computer-readable storage medium described in the third aspect of the present invention, on which computer instructions are stored. The processor 24 is connected to the memory 14 and is configured to execute the computer instructions stored in the memory to implement the display compensation method described in the first aspect of the present invention.

[0115] The display pipeline 21 is equipped with a display compensation module 211. The display compensation module 211 is connected to the processor 24. Under the control of the processor 24, it can determine an initial second compensation matrix based on the first compensation matrix, and modify the initial second compensation matrix by combining the aging compensation matrix and / or the second compensation parameter β indicating global compensation data, so as to determine a second compensation matrix in which each second element corresponds to at least one screen pixel of the display screen 22. Then, it compensates the original image according to the second compensation matrix to obtain a compensated image that eliminates display aging.

[0116] Thus, by first generating a second compensation matrix based on the first compensation matrix, the historically statistical aging compensation matrix, and / or the second compensation parameter β, and then compensating and correcting the original image based on the second compensation matrix, the present invention can effectively eliminate the effects of display aging on the display screen 22, and reduce the bandwidth and data dimensionality of the compensation data, thereby reducing the data storage requirements of the display compensation system and the data transmission load of the compensation data between different modules. Furthermore, by performing synchronous gaze point compression based on eye movement signals on the original image to be compensated and the compensation values ​​(i.e., each second element in the second compensation matrix), the present invention can more accurately achieve display aging compensation for XR display devices with gaze point compression processing function.

[0117] Furthermore, in some embodiments, the gaze compression module 212 is used to acquire the user's eye movement signals and perform gaze compression on the original image and / or the second compensation matrix based on the eye movement signals. The display compensation module 211 can be configured after the gaze compression module 212 and, under the control of the processor 24, can compensate the compressed original image according to the compressed second compensation matrix to obtain a compressed compensated image. The gaze decompression module 213 is configured after the display compensation module 211 and is used to perform gaze decompression on the compressed compensated image based on the eye movement signals to obtain a compensated image displayed on the display screen 22. Thus, by first performing gaze compression on the original image and / or the second compensation matrix, then compressing the compressed original image according to the compressed second compensation matrix, and then performing gaze decompression on the compressed compensated image, the present invention can significantly reduce the data processing volume of display compensation, thereby further reducing the data storage requirements of the display compensation system and reducing the data transmission load of compensation data between different modules.

[0118] Furthermore, those skilled in the art will understand that although the compensation parameter obtained based on historical statistics is referred to as the second compensation parameter β in the above-described embodiments of display aging compensation, those skilled in the art may also name it the first compensation parameter α when implementing display aging compensation independently.

[0119] In summary, the display compensation method, display compensation system, and computer-readable storage medium provided by the present invention can all effectively reduce the bandwidth and data dimensionality of the compensation data by splitting the storage of compensation data in the form of combining compensation coefficients and compensation matrices. This reduces the requirements for data storage, data transmission, and data processing of the display compensation system, and also reduces the data transmission load of compensation data between different modules.

[0120] Although the methods described above are illustrated and depicted as a series of actions for the sake of simplicity, it should be understood and appreciated that these methods are not limited by the order of the actions, as some actions may occur in a different order and / or concurrently with other actions from the illustrations and descriptions herein or not illustrated and described herein but which may be understood by those skilled in the art, according to one or more embodiments.

[0121] Those skilled in the art will understand that information, signals, and data can be represented using any of a variety of different techniques and arts. For example, the data, instructions, commands, information, signals, bits, symbols, and chips described throughout the above description can be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, light fields or optical particles, or any combination thereof.

[0122] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein can be implemented as electronic hardware, computer software, or a combination of both. To clearly illustrate this interchangeability between hardware and software, the various illustrative components, blocks, modules, circuits, and steps are described above in a generalized manner in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in different ways for each specific application, but such implementation decisions should not be construed as departing from the scope of the invention.

[0123] The prior description of this disclosure is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to this disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not intended to be limited to the examples and designs described herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A display compensation method, characterized in that, Includes the following steps: Obtain a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates the numerical relationship between the value of each first element and the value of the corresponding screen pixel. Based on the first compensation parameter α, determine the first bias value offset1 and / or the first gain value gain1 corresponding to each of the first elements respectively; A third compensation matrix is ​​established based on the first resolution of the first compensation matrix, and the value of each third element in the third compensation matrix is ​​determined based on the first offset value offset1 and / or the first gain value gain1 of the first element corresponding to each third element. Based on the second resolution of the display screen, the third compensation matrix is ​​upsampled to determine the value of each second element in the second compensation matrix of the second resolution, wherein each second element in the second compensation matrix corresponds to at least one screen pixel of the display screen. Obtain the original image to be compensated; and The original image is compensated and corrected according to the second compensation matrix to obtain a compensated image displayed on the display screen.

2. The display compensation method as described in claim 1, characterized in that, Each of the first elements records the value difference between each of the screen pixels, and the first compensation parameter α indicates the bias value between each of the first elements and the corresponding screen pixel value, and / or Each of the first elements records the value of a specific screen pixel, and the first compensation parameter α indicates the value difference between each specific screen pixel and its corresponding non-specific screen pixel, and / or Each of the first elements records the value of each screen pixel at a preset gray level, and the first compensation parameter α indicates the numerical adjustment coefficient of each screen pixel at at least one other gray level.

3. The display compensation method as described in claim 1, characterized in that, The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: Acquire the user's eye movement signals; Based on the eye movement signal, gaze point compression is performed on the original image and the second compensation matrix; The original image compressed by the gaze point is compensated and corrected using a second compensation matrix obtained through gaze point compression to obtain a compressed compensated image; and Based on the eye movement signal, the compressed compensation image is decompressed using a gaze point method to obtain a compensation image displayed on the screen.

4. The display compensation method as described in claim 3, characterized in that, The step of performing gaze point compression on the second compensation matrix based on the eye movement signal includes: Based on the values ​​of each pixel in the original image, determine the second bias value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix; Based on the second bias value offset2 and / or the second gain value gain2, the corresponding second elements in the second compensation matrix are corrected to determine the values ​​of the fourth elements in the fourth compensation matrix; and Based on the eye movement signal, the fourth compensation matrix is ​​subjected to gaze point compression to determine the second compensation matrix after gaze point compression.

5. The display compensation method as described in claim 1, characterized in that, It also includes the following steps: Obtain the first calibration image; The first calibration image is transmitted to the display screen for display, and the first display image output by the display screen is captured by the imaging module; as well as The values ​​of each pixel in the first calibration image and the first display image are compared to determine the first compensation matrix and the first compensation parameter α.

6. The display compensation method as described in claim 5, characterized in that, It also includes the following steps: Acquire multiple second calibration images; Each of the second calibration images is transmitted to the display screen for display, and the second display image output by the display screen is captured by the imaging module. as well as Based on the differences in pixel values ​​between the first calibration image and each of the second calibration images, and the differences in measured pixel values ​​between the first display image and each of the second display images, the second bias value offset2 and / or the second gain value gain2 corresponding to each of the second elements in the second compensation matrix are determined.

7. The display compensation method as described in claim 1, characterized in that, The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: Obtain a comprehensive aging factor indicating the aging condition of the screen; Based on the comprehensive aging factor, determine the aging compensation matrix and / or the second compensation parameter β for screen aging compensation; Based on the aging compensation matrix and / or the second compensation parameter β, the corresponding second elements in the second compensation matrix are modified to determine the values ​​of the sixth elements in the sixth compensation matrix; and The original image is compensated and corrected according to the sixth compensation matrix to obtain a compensated image displayed on the display screen.

8. The display compensation method as described in claim 7, characterized in that, The step of obtaining the comprehensive aging factor indicating the screen aging condition includes: The brightness of the original image or the compensated image is statistically analyzed to determine the current aging factor; The temperature of the display screen is measured to determine the temperature aging factor; and The comprehensive aging factor is determined based on the current aging factor and the temperature aging factor.

9. The display compensation method as described in claim 8, characterized in that, The step of statistically analyzing the brightness of the original image or the compensated image to determine the current aging factor includes: Based on the DBV data of the original image or the compensated image, determine the current factor of each pixel in the original image or the compensated image; and The current aging factor of each image pixel is determined by accumulating the current factor over statistical time.

10. The display compensation method as described in claim 8, characterized in that, The step of statistically analyzing the temperature of the display screen to determine the temperature aging factor includes: The real-time temperature of each pixel on the display screen is determined via a screen temperature sensor; and Based on the real-time temperature and the pre-calibrated temperature-aging relationship, the temperature aging factor of each screen pixel is determined.

11. The display compensation method as described in claim 8, characterized in that, The step of determining the comprehensive aging factor based on the current aging factor and the temperature aging factor includes: Obtain the current aging factor after decompression at the gaze point; and The current aging factor decompressed by the gaze point and the temperature aging factor of the screen resolution are fused together to determine the comprehensive aging factor of the screen resolution.

12. The display compensation method as described in claim 11, characterized in that, The step of determining the aging compensation matrix and / or the second compensation parameter β for screen aging compensation based on the comprehensive aging factor includes: Based on a preset fourth compression ratio, the comprehensive aging factor is downsampled to determine the aging compensation matrix; Based on the aging compensation matrix and the second compensation matrix, a seventh compensation matrix for storing gray levels and at least one eighth compensation matrix for not storing gray levels are determined; and The second compensation parameter β is determined based on the difference between each seventh element in the seventh compensation matrix and each eighth element in the eighth compensation matrix.

13. The display compensation method as described in claim 12, characterized in that, The steps for obtaining the first compensation matrix include: Based on the first compensation parameter α, the seventh compensation matrix and / or the eighth compensation matrix are inversely operated on to obtain the updated first compensation matrix.

14. The display compensation method as described in claim 12, characterized in that, The step of correcting the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β, so as to determine the value of each sixth element in the sixth compensation matrix, includes: Based on the aging compensation matrix and the second compensation matrix, determine the value of each of the seventh elements in the seventh compensation matrix; Based on the second compensation parameter β, determine the third bias value offset3 and / or the third gain value gain3 corresponding to each of the seventh elements; and Based on each of the seventh elements in the seventh compensation matrix and its corresponding third bias value offst3 and / or third gain value gain3, the values ​​of each of the sixth elements in the sixth compensation matrix are determined respectively.

15. The display compensation method as described in claim 7, characterized in that, The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen further includes: In response to the continued acquisition of a preset number of original or compensated images, historical statistics are performed in combination with the preset number of original or compensated images to update the aging compensation matrix and / or the second compensation parameter β; In response to the update of the aging compensation matrix and / or the second compensation parameter β, the corresponding second elements in the second compensation matrix are corrected according to the updated aging compensation matrix and / or the updated second compensation parameter β, so as to update the values ​​of the sixth elements in the sixth compensation matrix respectively; and In response to each acquired original image frame, the original image is compensated and corrected according to the current sixth compensation matrix to obtain a compensated image displayed on the display screen.

16. A display compensation method, characterized in that, Includes the following steps: Obtain a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates the numerical relationship between the value of each first element and the value of the corresponding screen pixel. Based on the first compensation parameter α, determine the first bias value offset1 and / or the first gain value gain1 corresponding to each of the first elements respectively; The user's eye-tracking signal is acquired to partition the first compensation matrix and determine the first compression ratio of each partitioned region. The corresponding second compression ratio is determined based on the first resolution of the first compensation matrix and the second resolution of the display screen; Based on the second compression ratio and the first compression ratio of each region, the third compression ratio of each region is determined respectively; The first compensation matrix is ​​sampled according to the third compression ratio to determine the fifth compensation matrix, and at least one fifth element corresponding to each of the first elements is determined. Based on each of the fifth elements in the fifth compensation matrix and their corresponding first offset value offset1 and / or first gain value gain1, the values ​​of each second element in the second compensation matrix are determined respectively, wherein each of the second elements in the second compensation matrix corresponds to at least one screen pixel of the display screen. Obtain the original image to be compensated; and The original image is compensated and corrected according to the second compensation matrix to obtain a compensated image displayed on the display screen.

17. The display compensation method as described in claim 16, characterized in that, The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: Based on the eye movement signals, gaze point compression is performed on the original image; The original image compressed by the gaze point is compensated and corrected using the second compensation matrix to obtain a compressed compensated image; and Based on the eye movement signal, the compressed compensation image is decompressed using a gaze point method to obtain a compensation image displayed on the screen.

18. A display compensation method, characterized in that, Includes the following steps: Obtain a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates the numerical relationship between the value of each first element and the value of the corresponding screen pixel. A second compensation matrix is ​​determined based on the first compensation matrix and the first compensation parameter α, wherein each second element in the second compensation matrix corresponds to at least one screen pixel of the display screen. Obtain the original image to be compensated; Obtain a comprehensive aging factor indicating the aging condition of the screen; Based on the preset fourth compression ratio, the comprehensive aging factor is downsampled to determine the aging compensation matrix for screen aging compensation. Based on the aging compensation matrix and the second compensation matrix, a seventh compensation matrix for storing gray levels and at least one eighth compensation matrix for not storing gray levels are determined. The second compensation parameter β for screen aging compensation is determined based on the difference between each seventh element in the seventh compensation matrix and each eighth element in the eighth compensation matrix. Based on the aging compensation matrix and / or the second compensation parameter β, the corresponding second elements in the second compensation matrix are modified to determine the values ​​of the sixth elements in the sixth compensation matrix; and The original image is compensated and corrected according to the sixth compensation matrix to obtain a compensated image displayed on the display screen.

19. A display compensation system, comprising display pipelines, wherein a display compensation module is configured, characterized in that, The display compensation module is configured to execute computer instructions to implement the display compensation method as described in any one of claims 1 to 18.

20. The display compensation system as described in claim 19, characterized in that, The display pipeline is also equipped with a gaze point compression module and a gaze point decompression module, wherein... The gaze point compression module is configured to: acquire the user's eye movement signal; and perform gaze point compression on the original image and / or the second compensation matrix based on the eye movement signal. The display compensation module is configured between the gaze point compression module and the gaze point decompression module, and is configured to: compensate and correct the original image after gaze point compression via a second compensation matrix to obtain a compressed compensated image. The gaze decompression module is configured to: perform gaze decompression on the compressed compensation image based on the eye movement signal to obtain a compensation image displayed on the display screen.

21. The display compensation system as described in claim 19, characterized in that, It also includes a calibration system, wherein the calibration system is equipped with a shooting module and is configured as follows: Obtain the first calibration image; The first calibration image is transmitted to the display screen for display, and the first display image output by the display screen is captured by the imaging module; and The values ​​of each pixel in the first calibration image and the first display image are compared to determine the first compensation matrix and the first compensation parameter α.

22. A computer-readable storage medium having computer instructions stored thereon, characterized in that, When the computer instructions are executed by the processor, the display compensation method as described in any one of claims 1 to 18 is implemented.

Images