Display compensation method, display compensation system and storage medium

Abstract

The invention provides a display compensation method, a display compensation system and a computer readable storage medium. The display compensation method comprises the following steps: acquiring a first compensation matrix and a first compensation parameter alpha; each first element in the first compensation matrix corresponds to at least one screen pixel point of the display screen. The first compensation parameter alpha indicates a numerical relationship between each first element and a value of a corresponding screen pixel point; and determining a second compensation matrix according to the first compensation matrix and the first compensation parameter alpha. Each second element in the second compensation matrix corresponds to at least one screen pixel point of the display screen; obtaining a to-be-compensated original image; and performing compensation correction on the original image according to the second compensation matrix to obtain a compensation image displayed on the display screen. According to the invention, the bandwidth and the data dimension of the compensation data can be reduced, so that the requirement on the data storage amount of the display compensation system is reduced.

Description

Technical Field

[0001] The present invention relates to the field of extended reality technology, and in particular to a display compensation method, a display compensation system, and a computer-readable storage medium. Background Art

[0002] Display compensation technology is widely used in various image display terminals to solve the problem of uneven brightness, color and / or contrast at different pixels of the screen image, thereby improving the user's visual comfort and the realism of the screen image.

[0003] In Extended Reality (XR) display applications, XR display devices will resample different areas of the screen image with different compression ratios based on the user's eye movement signals to improve the image resolution of key areas and reduce the requirements for the hardware computing power of the XR display device. This dynamic gaze point compression processing will cause the pixel position relationship between the original image and the screen image to dynamically deviate. However, existing display compensation technologies generally do not have the function of adjusting the compensation value in combination with the gaze point compression parameters, and therefore cannot achieve accurate statistics and compensation for XR display devices with gaze point compression processing functions.

[0004] In addition, considering the initial hardware display deviation of the XR display device and the display aging deviation after long-term use, if the uniformity compensation of the hardware display deviation and the display aging compensation of the display aging deviation are directly superimposed on the XR display device, it will cause a huge data processing load on the XR display device, resulting in the inability to achieve high frame rate and high resolution XR display at the same time.

[0005] In order to overcome the above-mentioned defects of the prior art, an improved display compensation method is urgently needed in the art, which is first used to reduce the bandwidth and data dimension of the compensation data, thereby reducing the requirements for data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules, and then preferably combining the gaze point compression parameters to adjust the compensation value to meet the display compensation requirements of XR display devices with gaze point compression processing functions. Summary of the invention

[0006] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or decisive elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0007] In order to overcome the above-mentioned defects in the prior art, the present invention provides a display compensation method, a display compensation system, and a computer storage medium, which can split and store compensation data in the form of combining compensation coefficients and compensation matrices, effectively reducing the bandwidth and data dimension of the compensation data, thereby reducing the requirements for data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules.

[0008] Specifically, the display compensation method provided according to the first aspect of the present invention includes the following steps: obtaining a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates the numerical relationship between each first element and the value of the corresponding screen pixel; determining a second compensation matrix according to the first compensation matrix and the first compensation parameter α, wherein each second element in the second compensation matrix corresponds to at least one screen pixel of the display screen; obtaining an original image to be compensated; and compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen. By combining the compensation coefficient and the compensation matrix to split and store the compensation data, the present invention can effectively reduce the bandwidth and data dimension of the compensation data, thereby reducing the requirements for the data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules.

[0009] Further, in some embodiments of the present invention, each of the first elements records the value difference between each of the screen pixel points, and the first compensation parameter α indicates the offset value between each of the first elements and the value of the corresponding screen pixel point. And / or, each of the first elements records the value of the corresponding specific screen pixel point, and the first compensation parameter α indicates the value difference between each of the specific screen pixel points and its corresponding non-specific screen pixel point. And / or, each of the first elements records the value of each of the screen pixel points at a preset grayscale, and the first compensation parameter α indicates the numerical adjustment coefficient of each of the screen pixel points at at least one other grayscale.

[0010] Further, in some embodiments of the present invention, the first compensation parameter α corresponds to a lookup table. The step of determining the second compensation matrix according to the first compensation matrix and the first compensation parameter α comprises: searching the lookup table corresponding to the first compensation parameter α according to the value and / or position of each of the first elements in the first compensation matrix to respectively determine the value and / or position of at least one second element corresponding to each of the first elements; and determining the second compensation matrix according to the value and position of each of the second elements.

[0011] Further, in some embodiments of the present invention, the step of determining the second compensation matrix based on the first compensation matrix and the first compensation parameter α includes: determining the first offset value offset1 and / or the first gain value gain1 corresponding to each of the first elements according to the first compensation parameter α; establishing a third compensation matrix according to the first resolution of the first compensation matrix, and determining the values ​​of each of the third elements in the third compensation matrix according to the first offset value offset1 and / or the first gain value gain1 of the first element corresponding to each of the third elements therein; and upsampling the third compensation matrix according to the second resolution of the display screen to determine the values ​​of each of the second elements in the second compensation matrix of the second resolution.

[0012] Further, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: obtaining the user's eye movement signal; performing gaze point compression on the original image and the second compensation matrix according to the eye movement signal; compensating and correcting the original image compressed by the gaze point via the second compensation matrix compressed by the gaze point to obtain a compressed compensated image; and performing gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen.

[0013] Furthermore, in some embodiments of the present invention, the step of performing gaze point compression on the second compensation matrix according to the eye movement signal includes: determining the second offset value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix according to the value of each image pixel in the original image; correcting the corresponding second elements in the second compensation matrix according to the second offset value offset2 and / or the second gain value gain2 to respectively determine the values ​​of each fourth element in the fourth compensation matrix; and performing gaze point compression on the fourth compensation matrix according to the eye movement signal to determine the second compensation matrix after the gaze point compression.

[0014] Further, in some embodiments of the present invention, the step of determining the second compensation matrix based on the first compensation matrix and the first compensation parameter α includes: determining the first offset value offset1 and / or the first gain value gain1 corresponding to each of the first elements according to the first compensation parameter α; obtaining the user's eye movement signal to partition the first compensation matrix, and determining the first compression ratio of each divided area respectively; determining the corresponding second compression ratio according to the first resolution of the first compensation matrix and the second resolution of the display screen; determining the third compression ratio of each of the areas according to the second compression ratio and the first compression ratio of each of the areas; sampling the first compensation matrix according to the third compression ratio to determine a fifth compensation matrix, and determining at least one fifth element corresponding to each of the first elements; and determining the value of each of the second elements in the second compensation matrix according to each of the fifth elements in the fifth compensation matrix and their corresponding first offset value offset1 and / or first gain value gain1.

[0015] Furthermore, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: performing gaze point compression on the original image according to the eye movement signal; performing gaze point compensation correction on the original image after the gaze point compression via the second compensation matrix to obtain a compressed compensated image; and performing gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen.

[0016] Furthermore, in some embodiments of the present invention, the display compensation method also includes the following steps: acquiring a first calibration image; transmitting the first calibration image to the display screen for display, and acquiring a first display image output by the display screen via a shooting module; and comparing the values ​​of each image pixel point in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0017] Furthermore, in some embodiments of the present invention, the display compensation method also includes the following steps: acquiring multiple second calibration images; transmitting each of the second calibration images to the display screen for display, and respectively capturing the second display images output by the display screen via the shooting module; and determining the second offset value offset2 and / or the second gain value gain2 corresponding to each of the second elements in the second compensation matrix based on the value difference between each image pixel point in the first calibration image and each of the second calibration images, and the measured value difference between each image pixel point in the first display image and each of the second display images.

[0018] Further, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen includes: obtaining a comprehensive aging factor indicating the aging condition of the screen; determining an aging compensation matrix and / or a second compensation parameter β for screen aging compensation according to the comprehensive aging factor; correcting each corresponding second element in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to respectively determine the values ​​of each sixth element in the sixth compensation matrix; and compensating and correcting the original image according to the sixth compensation matrix to obtain a compensated image displayed on the display screen.

[0019] Furthermore, in some embodiments of the present invention, the step of obtaining a comprehensive aging factor indicating the aging condition of the screen includes: counting the brightness of the original image or the compensated image to determine a current aging factor; counting the temperature of the display screen to determine a temperature aging factor; and determining the comprehensive aging factor based on the current aging factor and the temperature aging factor.

[0020] Furthermore, in some embodiments of the present invention, the step of counting the brightness of the original image or the compensated image to determine the current aging factor includes: determining the current factor of each image pixel of the original image or the compensated image based on DBV (Display Brightness Value) data of the original image or the compensated image, wherein the DBV data is used to indicate the display brightness level of the highest display grayscale of the screen in the current state; and accumulating the current factor according to the statistical time to determine the current aging factor of each image pixel.

[0021] Furthermore, in some embodiments of the present invention, the step of counting the temperature of the display screen to determine the temperature aging factor includes: determining the real-time temperature of each screen pixel of the display screen via a screen temperature sensor; and determining the temperature aging factor of each screen pixel based on the real-time temperature and a pre-calibrated temperature-aging relationship.

[0022] Furthermore, in some embodiments of the present invention, the step of determining the comprehensive aging factor based on the current aging factor and the temperature aging factor includes: obtaining the current aging factor decompressed through the gaze point; and fusing the current aging factor decompressed through the gaze point and the temperature aging factor of the screen resolution to determine the comprehensive aging factor of the screen resolution.

[0023] Further, in some embodiments of the present invention, the step of determining an aging compensation matrix and / or a second compensation parameter β for screen aging compensation based on the comprehensive aging factor includes: downsampling the comprehensive aging factor according to a preset fourth compression ratio to determine the aging compensation matrix; determining a seventh compensation matrix for storing grayscale and at least one eighth compensation matrix for non-storage grayscale based on the aging compensation matrix and the second compensation matrix; and determining the second compensation parameter β based on the difference between each seventh element in the seventh compensation matrix and each eighth element in the eighth compensation matrix.

[0024] Further, in some embodiments of the present invention, the step of acquiring the first compensation matrix includes: performing an inverse operation on the seventh compensation matrix and / or the eighth compensation matrix according to the first compensation parameter α to obtain an updated first compensation matrix.

[0025] Further, in some embodiments of the present invention, the step of correcting the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to respectively determine the values ​​of each sixth element in the sixth compensation matrix includes: determining the values ​​of each seventh element in the seventh compensation matrix according to the aging compensation matrix and the second compensation matrix; determining the third offset value offset3 and / or the third gain value gain3 corresponding to each seventh element according to the second compensation parameter β; and determining the values ​​of each sixth element in the sixth compensation matrix according to each seventh element in the seventh compensation matrix and its corresponding third offset value offset3 and / or third gain value gain3.

[0026] Further, in some embodiments of the present invention, the step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen further includes: in response to continuing to acquire a preset number of frames of original images or compensated images, performing historical statistics in combination with the preset number of frames of original images or compensated images to update the aging compensation matrix and / or the second compensation parameter β; in response to the update of the aging compensation matrix and / or the second compensation parameter β, correcting the corresponding second elements in the second compensation matrix according to the updated aging compensation matrix and / or the updated second compensation parameter β to respectively update the values ​​of the sixth elements in the sixth compensation matrix; and in response to each acquired frame of the original image, compensating and correcting the original image according to the current sixth compensation matrix to obtain a compensated image displayed on the display screen.

[0027] In addition, the above-mentioned display compensation system provided according to the second aspect of the present invention includes a display pipeline. A display compensation module is configured in the display pipeline. The display compensation module is configured to: obtain a first compensation matrix and a first compensation parameter α. Each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen. The first compensation parameter α indicates the numerical relationship between each first element and the value of each corresponding screen pixel; determine a second compensation matrix according to the first compensation matrix and the first compensation parameter α. Each second element in the second compensation matrix corresponds to each screen pixel of the display screen; obtain the original image to be compensated; and compensate and correct the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen.

[0028] Furthermore, in some embodiments of the present invention, the display pipeline is further configured with a gaze point compression module and a gaze point decompression module. The gaze point compression module is configured to: obtain the user's eye movement signal; and perform gaze point compression on the original image and / or the second compensation matrix according to the eye movement signal. The display compensation module is configured between the gaze point compression module and the gaze point decompression module, and is configured to: compensate and correct the original image compressed by the gaze point through the second compensation matrix compressed by the gaze point to obtain a compressed compensated image. The gaze point decompression module is configured to: perform gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen.

[0029] Furthermore, in some embodiments of the present invention, the display compensation system also includes a calibration system. The calibration system is configured with a shooting module and is configured to: obtain a first calibration image; transmit the first calibration image to the display screen for display, and collect the first display image output by the display screen via the shooting module; and compare the values ​​of each image pixel in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0030] In addition, the computer-readable storage medium provided according to the third aspect of the present invention stores computer instructions, which, when executed by a processor, implement the display compensation method provided by the first aspect of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.

[0032] Figure 1 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0033] Figure 2 A schematic flow chart of a display compensation method provided according to some embodiments of the present invention is shown.

[0034] Figure 3A to Figure 3C Schematic diagrams of a first compensation matrix according to some embodiments of the present invention are respectively shown.

[0035] Figure 4A and Figure 4B Schematic diagrams of the flow of uniform display compensation provided according to some embodiments of the present invention are respectively shown.

[0036] Figure 5 A schematic diagram showing the principles of gaze point compression and decompression provided according to some embodiments of the present invention is shown.

[0037] Figure 6 A schematic diagram of a process of uniform display compensation provided according to some embodiments of the present invention is shown.

[0038] Figure 7 A schematic diagram of a flow chart of determining a second compensation matrix according to some embodiments of the present invention is shown.

[0039] Figure 8 A schematic diagram of a process flow of combined display compensation provided according to some embodiments of the present invention is shown.

[0040] Fig.9A and Fig. 9B A schematic diagram of a flow chart of display aging compensation provided according to some embodiments of the present invention is shown.

[0041] Fig.10 A schematic diagram of determining an aging compensation matrix according to some embodiments of the present invention is shown.

[0042] Fig.11 A schematic diagram of updating an aging compensation matrix and / or a second compensation parameter β according to some embodiments of the present invention is shown.

[0043] Fig.12 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0044] Fig.13 A schematic diagram of a flow chart of display aging compensation provided according to some embodiments of the present invention is shown. DETAILED DESCRIPTION

[0045] The following specific embodiments illustrate the implementation of the present invention, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to this implementation. On the contrary, the purpose of introducing the invention in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, the following description will include many specific details. The present invention can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present invention, some specific details will be omitted in the description.

[0046] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0047] In addition, the terms "upper", "lower", "left", "right", "top", "bottom", "horizontal" and "vertical" used in the following description should be understood as the directions shown in the paragraph and the related drawings. Such relative terms are only used for the convenience of description and do not mean that the device described therein must be manufactured or operated in a specific direction, and therefore should not be understood as limiting the present invention.

[0048] It is understood that although the terms "first", "second", "third", etc. may be used herein to describe various components, regions, layers and / or parts, these components, regions, layers and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers and / or parts. Therefore, the first component, region, layer and / or part discussed below may be referred to as a second component, region, layer and / or part without departing from some embodiments of the present invention.

[0049] As mentioned above, in extended reality (Extended Reality, XR) display applications, XR display devices will resample different areas of the screen image with different compression ratios according to the user's eye movement signals to improve the image resolution of key areas and reduce the requirements for the hardware computing power of the XR display device. This dynamic gaze point compression processing will cause the pixel position relationship between the original image and the screen image to dynamically deviate. However, the existing display compensation technology generally does not have the function of adjusting the compensation value in combination with the gaze point compression parameter, and thus cannot achieve accurate statistics and compensation for XR display devices with gaze point compression processing functions. In addition, considering the initial hardware display deviation of the XR display device and the display aging deviation after long-term use, if the uniformity compensation of the hardware display deviation and the display aging compensation of the display aging deviation are directly superimposed in the XR display device, it will cause a huge data processing load on the XR display device, resulting in the inability to simultaneously achieve high frame rate and high resolution XR display.

[0050] In order to overcome the above-mentioned defects in the prior art, the present invention provides a display compensation method, a display compensation system, and a computer storage medium, which can split and store compensation data in the form of combining compensation coefficient α and compensation matrix, effectively reducing the bandwidth and data dimension of the compensation data, thereby reducing the requirements for data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules.

[0051] In some non-limiting embodiments, the display compensation method provided in the first aspect of the present invention may be implemented via the display compensation system provided in the second aspect of the present invention. Figure 1 , Figure 1 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown.

[0052] exist Figure 1 In the illustrated embodiment, the display compensation system 10 provided by the second aspect of the present invention is configured with a memory 14 and a processor 15. The memory 14 includes but is not limited to the computer-readable storage medium provided by the third aspect of the present invention, on which computer instructions are stored. The processor 15 is connected to the memory 14 and is configured to execute the computer instructions stored on the memory to implement the display compensation method provided by the first aspect of the present invention.

[0053] Further, in Figure 1 In the illustrated embodiment, the display compensation system may further include a display pipeline 11 , a calibration system 12 and a display screen 13 .

[0054] Specifically, the calibration system 12 is provided with a shooting module 121, and is configured to obtain a first calibration image, transmit the first calibration image to the display screen 13 for display, collect the first display image output by the display screen 13 via the shooting module 121, and then compare the first calibration image with the value of each image pixel in the first display image to determine a first compensation matrix in which each first element corresponds to at least one screen pixel of the display screen 13, and its corresponding first compensation parameter α.

[0055] The display pipeline 11 is provided with a display compensation module 111. The display compensation module 111 is connected to the processor 15, and under the control of the processor 15, according to the first compensation matrix and the first compensation parameter α, determines a second compensation matrix in which each second element corresponds to at least one screen pixel of the display screen 13, and then compensates the original image according to the second compensation matrix to obtain a compensated image.

[0056] Furthermore, the above display compensation system may also preferably include a gaze point compression module 112 and a gaze point decompression module 113. The gaze point compression module 112 is used to obtain the user's eye movement signal, and perform gaze point compression on the original image and / or the second compensation matrix according to the eye movement signal. The display compensation module 111 is configured after the gaze point compression module 112, and can compensate the compressed original image according to the compressed second compensation matrix under the control of the processor 15 to obtain a compressed compensated image. The gaze point decompression module 113 is configured after the display compensation module 111, and is used to perform gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen 13. By first performing gaze point compression on the original image and / or the second compensation matrix, then compensating the compressed original image according to the compressed second compensation matrix, and then performing gaze point decompression on the compressed compensated image, the present invention can greatly reduce the data processing amount of display compensation, thereby reducing the data storage amount requirement for the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0057] The working principle of the above-mentioned display compensation system will be described below in conjunction with some embodiments of the display compensation method. Those skilled in the art will understand that these embodiments of the display compensation method are only some non-limiting implementation methods provided by the present invention, which are intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit all functions or all working modes of the display compensation system. Similarly, the display compensation system is also only a non-limiting implementation method provided by the present invention, and does not constitute a limitation on the execution subject or execution order of each step in these display compensation methods.

[0058] Please refer to further Figure 2 , Figure 2 A schematic flow chart of a display compensation method provided according to some embodiments of the present invention is shown.

[0059] like Figure 2 As shown, in the process of determining the compensation matrix, the display compensation system 10 may first obtain the first compensation matrix and the first compensation parameter α via the display compensation module 111. Here, each first element in the first compensation matrix may correspond to at least one screen pixel of the display screen 13. The first compensation parameter α indicates the numerical relationship between each first element and the value of the corresponding screen pixel.

[0060] Specifically, for the uniformity compensation function of hardware display deviation, in the process of obtaining the first compensation matrix and the first compensation parameter α, the display compensation system can first obtain the first calibration image, and transmit the first calibration image to the display screen 13 for display, and then collect the first display image output by the display screen 13 through the shooting module 121, and compare the values ​​of each image pixel in the first calibration image and the first display image to determine the first compensation matrix and the first compensation parameter α.

[0061] Please refer to further Figure 3A to Figure 3C , Figure 3A to Figure 3C Schematic diagrams of a first compensation matrix according to some embodiments of the present invention are respectively shown.

[0062] exist Figure 3A In the illustrated embodiment, each first element in the first compensation matrix may correspond to a screen pixel point in the screen 13, and each screen pixel point may record the value of the preset grayscale (for example, 255 grayscale at 8-bit precision), and the first compensation parameter α corresponds to a lookup table LUT_0, which records the corresponding value of each first element at at least one other grayscale (for example, 192 grayscale, 128 grayscale, 64 grayscale, etc. at 8-bit precision), so as to indicate the numerical adjustment coefficient of each screen pixel point at at least one other grayscale. In this way, the display compensation system can determine the second compensation matrix at multiple grayscales according to the first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel point of the display screen 13 at the corresponding grayscale according to the value of each second element in the second compensation matrix, thereby reducing the data storage requirements of the display compensation system and reducing the data transmission load of the compensation data between different modules.

[0063] exist Figure 3BIn the illustrated embodiment, each first element in the first compensation matrix may correspond to a screen pixel point in the screen 13, and record the value difference between each screen pixel point, and the first compensation parameter α indicates the offset value between each first element and the value of the corresponding screen pixel point. In this way, the display compensation system only needs to store the value difference data with a smaller value, and can determine the corresponding second compensation matrix according to the first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel point of the corresponding display screen 13 according to the value of each second element in the second compensation matrix, thereby reducing the data storage requirements for the display compensation system and reducing the data transmission load of the compensation data between different modules.

[0064] exist Figure 3C In the embodiment shown, the display compensation system can also store two first compensation matrices, wherein each first element in one first compensation matrix records the first gain value gain1 of each screen pixel point with respect to gain (Gain), and each first element in the other first compensation matrix records the first offset value offset1 of each screen pixel point with respect to value deviation (Offset). Accordingly, the first compensation parameter α corresponding to each first compensation matrix can correspond to a lookup table LUT_1 and LUT_2, respectively, in which the corresponding values ​​of each first element with respect to gain (Gain) or value deviation (Offset) are recorded respectively. In this way, the display compensation system can determine the second compensation matrix with respect to gain (Gain) and value deviation (Offset) respectively according to each first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel point of the display screen 13 respectively according to the value of each second element in these second compensation matrices, thereby reducing the data storage requirements for the display compensation system and reducing the data transmission load of compensation data between different modules.

[0065] In addition, in some embodiments, each first element in the first compensation matrix may also correspond to a plurality of screen pixels in the screen 13, and record the values ​​of the corresponding specific screen pixels. The first compensation parameter α indicates the value difference between each specific screen pixel and its corresponding non-specific screen pixel. In this way, the display compensation system only needs to store the values ​​of a small number of specific screen pixels, and can determine the corresponding second compensation matrix according to the first compensation matrix and its corresponding first compensation parameter α, and determine the value of at least one screen pixel of the display screen 13 according to the values ​​of each second element in the second compensation matrix, thereby reducing the data storage requirements for the display compensation system and reducing the data transmission load of the compensation data between different modules.

[0066] Please refer to Figure 4A and Figure 4B , Figure 4A and Figure 4B Schematic diagrams of the flow of uniform display compensation provided according to some embodiments of the present invention are respectively shown.

[0067] like Figure 4A and Figure 4B As shown, in the process of determining the second compensation matrix, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix according to the first compensation parameter α as described above:

[0068]

[0069] Among them, g in The values ​​of the first elements of the inputs, LUT_i() indicates the process of interpolating the compensation values ​​according to the lookup table.

[0070] Afterwards, the display compensation system may establish a third compensation matrix according to the first resolution (e.g., 960*960) of the first compensation matrix, and determine the value of each third element in the third compensation matrix according to the position of each third element and the first offset value offset1 and / or the first gain value gain1 of the corresponding first element:

[0071] g out =g in ×gain1+offset1

[0072] Among them, g in is the value of each first element of the input, g out is the value of each third element of the output.

[0073] Afterwards, the display compensation system may upsample the first compensation matrix in a corresponding proportion according to the second resolution (eg 1920*1920) of the display screen 13 to determine the values ​​of each second element in the second compensation matrix of the second resolution (eg 1920*1920).

[0074] After that, if Figure 2 As shown, the display compensation system can obtain the original image to be compensated, and perform compensation correction on the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen 13.

[0075] Specifically, if Figure 4A and Figure 4BAs shown, in the process of uniformity compensation, the display compensation system can first obtain the user's eye movement signal, and then perform gaze point compression on the original image and the second compensation matrix according to the eye movement signal through the above-mentioned gaze point compression module 112 to obtain compressed image input data of the third resolution (for example: 1296*1296) and the compressed second compensation matrix. Afterwards, the display compensation system can use the second element in the second compensation matrix compressed by the gaze point as the compensation value as described above, first perform compensation correction on the original image compressed by the gaze point through the display compensation module 111 to obtain a compressed compensated image, and then perform gaze point decompression on the compressed compensated image according to the eye movement signal through the gaze point decompression module 113 to obtain a compensated image displayed on the display screen 13.

[0076] Please refer to Figure 5 , Figure 5 A schematic diagram showing the principles of gaze point compression and decompression provided according to some embodiments of the present invention is shown.

[0077] like Figure 5 As shown, in the process of gaze point compression, the display compensation system can first use the region division coordinates (x0, y0), (x1, y1), (x2, y2), (x3, y3) based on the gaze point to divide the original image and the second compensation matrix into multiple sub-regions with different attention levels, and determine the compression ratio of each sub-region according to the attention level. Here, the first sub-region where the gaze point is located can have the largest compression ratio (for example, 1:1), the second sub-region close to the gaze point can have a medium compression ratio (for example, 1:2), and the third sub-region far from the gaze point can have the smallest compression ratio (for example, 1:4). Afterwards, the display compensation system can resample the original image and each sub-region in the second compensation matrix according to the compression ratios of different sub-regions to obtain compressed image input data of the third resolution (for example, 1296*1296) and the compressed second compensation matrix.

[0078] Correspondingly, during the gaze point decompression process, the display compensation system can also divide the compressed compensated image into multiple sub-regions with different attention levels according to the above-mentioned area division coordinates (x0, y0), (x1, y1), (x2, y2), and (x3, y3), and decompress each sub-region in the compressed compensated image according to the compression ratio of each sub-region (i.e., reverse resampling) to obtain a compensated image with a second resolution (for example: 1920*1920).

[0079] In addition, please refer to Figure 6 . Figure 6 A schematic diagram of a process of uniform display compensation provided according to some embodiments of the present invention is shown.

[0080] exist Figure 6 In the illustrated embodiment, before performing gaze point compression, the display compensation system may also preferably obtain multiple second calibration images after obtaining the first calibration image, transmit each second calibration image to the display screen 13 for display, and respectively capture each second display image output by the display screen 13 via the camera module 121 configured in the calibration system 12. Afterwards, the display compensation system may determine the second offset value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix according to the value difference of each image pixel point in the first calibration image and each second calibration image, and the measured value difference of each image pixel point in the first display image and each second display image.

[0081] Then, in the process of gaze point compression, the display compensation system can determine the second offset value offset2 and / or the second gain value gain2 corresponding to each second element in the second compensation matrix according to the value of each image pixel in the original image and the corresponding look-up table (LUT), and then correct the corresponding second elements in the second compensation matrix according to the second offset value offset2 and / or the second gain value gain2 to respectively determine the value of each fourth element in the fourth compensation matrix. Here, the original image can be the image data directly obtained by the display compensation system, or it can be the image data obtained by performing gaze point decompression on the input data after gaze point compression. Then, the display compensation system can perform gaze point compression on the fourth compensation matrix according to the eye movement signal to determine the second compensation matrix after gaze point compression, and perform uniformity compensation on the input data as described above.

[0082] Those skilled in the art will appreciate that the above-mentioned scheme of first upsampling the first compensation matrix to the second resolution of the display screen 13 to obtain a second compensation matrix of the second resolution, and then performing gaze point compression and uniformity compensation processing on the second compensation matrix and the above-mentioned original image, is only a non-limiting implementation method provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide a specific scheme that is easy for the public to implement, rather than to limit the scope of protection of the present invention.

[0083] Optionally, in other embodiments, the display compensation system can also directly divide the first compensation matrix into multiple sub-areas with different attention levels according to the user's eye movement signal, and resample each sub-area with a different compression ratio to directly obtain a second compensation matrix with a second resolution, and then adjust the compensation value and perform uniformity compensation processing on the original image decompressed by the gaze point based on the second compensation matrix.

[0084] Please refer to Figure 7 , Figure 7A schematic diagram of a process of uniformity compensation provided according to some embodiments of the present invention is shown.

[0085] like Figure 7 As shown, in the process of determining the second compensation matrix, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element according to the above-mentioned first compensation parameter α, and then obtain the user's eye movement signal to partition the first compensation matrix. Afterwards, the display compensation system can determine the first compression ratio of each divided sub-area according to the user's eye movement signal, and determine the corresponding second compression ratio according to the first resolution of the first compensation matrix and the second resolution of the display screen, and then determine the third compression ratio of each area according to the second compression ratio and the first compression ratio of each area. Here, the first sub-area where the gaze point is located can have the largest third compression ratio (for example, 2:1), the second sub-area adjacent to the gaze point can have a medium third compression ratio (for example, 2:3), and the third sub-area far from the gaze point can have the smallest third compression ratio (for example, 1:2). Afterwards, the display compensation system can perform up-sampling processing on the first sub-region that the user pays attention to in the first compensation matrix according to the third compression ratio of each sub-region, and perform down-sampling processing on the second sub-region and the third sub-region that the user does not pay attention to in the first compensation matrix, so as to determine the fifth compensation matrix and at least one fifth element corresponding to each first element. Finally, the display compensation system can determine the values ​​of each second element in the second compensation matrix according to each fifth element in the fifth compensation matrix and its corresponding first offset value offset1 and / or first gain value gain1.

[0086] Afterwards, in the process of adjusting the compensation value, the display compensation system can partition the original image compressed by the gaze point according to the user's eye movement signal, and determine the decompression ratio of each divided sub-area. Here, the first sub-area where the gaze point is located can have the smallest decompression ratio (for example, 1:1), the second sub-area close to the gaze point can have a medium decompression ratio (for example, 2:1), and the third sub-area far from the gaze point can have the largest decompression ratio (for example, 4:1). Afterwards, the display compensation system can upsample the second sub-area and the third sub-area that the user is paying attention to in the original image compressed by the gaze point according to the decompression ratio of each sub-area to obtain the original image of the second resolution, and adjust the compensation value according to the original image of the second resolution and the second compensation matrix as described above.

[0087] Afterwards, in the process of uniformity compensation, the display compensation system can first perform gaze point compression on the original image according to the user's eye movement signal, and then compensate and correct the original image after gaze point compression through the second compensation matrix to obtain a compressed compensated image, and then perform gaze point decompression on the compressed compensated image according to the eye movement signal as described above to obtain a compensated image displayed on the display screen. In this way, the display compensation system does not need to restore each image pixel point in each area to the pixel corresponding to the resolution of the display screen 13, and can adjust the compensation value and perform uniformity compensation, thereby further saving data computing resources of the display compensation system.

[0088] In this way, by first generating a second compensation matrix according to the first compensation matrix and the calibrated first compensation parameter α, and then compensating and correcting the original image according to the second compensation matrix, the present invention can effectively eliminate the impact of the uneven display of the native display screen 13, and reduce the bandwidth and data dimension of the compensation data, so as to reduce the data storage requirements of the display compensation system and the data transmission load of the compensation data between different modules. Furthermore, by synchronously compressing the gaze point of the original image to be compensated and the compensation value (i.e., each second element in the second compensation matrix) based on the eye movement signal, the present invention can more accurately realize the uniformity compensation of the XR display device with the gaze point compression processing function.

[0089] Please refer to further Figure 8 , Figure 8 A schematic diagram of a process flow of combined display compensation provided according to some embodiments of the present invention is shown.

[0090] exist Figure 8 In the illustrated embodiment, the display compensation system may also perform historical statistics on the temperature, current and other related parameters of the display screen 13 that has been used for a long time, and obtain the second compensation parameter β based on the statistical results.

[0091] Please refer to Fig.9A and Fig. 9B , Fig.9A and Fig. 9B A schematic diagram of a flow chart of display aging compensation provided according to some embodiments of the present invention is shown.

[0092] like Fig.9A and Fig. 9BAs shown, before performing the combined compensation of uniformity compensation and display aging compensation, the display compensation system can first obtain multiple frames of original images before display compensation or compensated images after display compensation through the display compensation module 111, and perform historical statistics on their brightness to determine the current aging factor, wherein the original image, compensated image and current aging factor all have the third resolution after gaze point compression (for example: 1296*1296). In addition, the display compensation system can also perform historical statistics on the temperature of each pixel of the display screen 13 to determine the temperature aging factor, wherein the temperature aging factor has the second resolution of the display screen 22 (for example: 1920*1920). Afterwards, the display compensation system can determine the aging compensation matrix and / or the second compensation parameter β of the screen aging compensation based on the current aging factor and the temperature aging factor.

[0093] Please refer to Fig.10 and Fig.11 . Fig.10 A schematic diagram of determining an aging compensation matrix according to some embodiments of the present invention is shown. Fig.11 A schematic diagram of updating an aging compensation matrix and / or a second compensation parameter β according to some embodiments of the present invention is shown.

[0094] like Fig.10 As shown, in the process of determining the current aging factor, the display compensation system can first obtain the display brightness value (DBV) data of the original image or the compensated image, and perform brightness conversion on it to determine the current factor of each image pixel in the original image or the compensated image. Afterwards, the display compensation system can accumulate the current factor according to the actual use time (i.e., statistical time) of the screen 13 to determine the current aging factor of each image pixel.

[0095] In addition, in the process of determining the temperature aging factor, the display compensation system can first determine the real-time temperature of each screen pixel of the display screen 13 through the screen temperature sensor, and then determine the temperature aging factor of each screen pixel based on the real-time temperature and the pre-calibrated temperature-aging relationship.

[0096] Afterwards, in the process of determining the aging compensation matrix for screen aging compensation, the display compensation system can perform gaze point decompression on the current aging factor according to the user's eye movement signal, or obtain the current aging factor of the second resolution decompressed by the gaze point by counting the brightness of the original image or compensated image decompressed by the gaze point, and then fuse the current aging factor decompressed by the gaze point and the temperature aging factor of the second resolution by formula calculation or table lookup to determine the comprehensive aging factor of the second resolution. Afterwards, the display compensation system can downsample the comprehensive aging factor of the second resolution according to the preset fourth compression ratio to determine the aging compensation matrix of the third resolution.

[0097] Further, in Fig.11 In the illustrated embodiment, the display compensation system may also preferably perform addition or multiplication operations on the second compensation matrix and the aging compensation matrix to determine a seventh compensation matrix of a storage grayscale (e.g., 255 grayscales at 8-bit accuracy) and an eighth compensation matrix of at least one non-storage grayscale (e.g., 192 grayscales, 128 grayscales, 64 grayscales, etc. at 8-bit accuracy). Afterwards, the display compensation system may extract the second compensation parameter β of each non-storage grayscale compared to the storage grayscale based on the difference between each seventh element in the seventh compensation matrix and each eighth element in each eighth compensation matrix. In addition, the display compensation system may also perform an inverse operation on the seventh compensation matrix and / or the eighth compensation matrix based on the first compensation parameter α to obtain an updated first compensation matrix so as to continue subsequent display compensation.

[0098] Please continue to refer to Figure 8 After obtaining the aging compensation matrix and / or the second compensation parameter β, the display compensation system 10 can first obtain the first compensation matrix and the first compensation parameter α of the first resolution (for example: 960*960) as described above, and determine the second compensation matrix of the second resolution (for example: 1920*1920) based on the first compensation matrix and the first compensation parameter α.

[0099] For example, the display compensation system can first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix according to the first compensation parameter α, and then establish a third compensation matrix according to the first resolution of the first compensation matrix, and determine the value of each third element in the third compensation matrix according to the first offset value offset1 and / or the first gain value gain1 of the first element corresponding to each third element. After that, the display compensation system can upsample the third compensation matrix according to the second resolution of the display screen 13 to determine the value of each second element in the second compensation matrix of the second resolution.

[0100] For another example, the display compensation system may first determine the first offset value offset1 and / or the first gain value gain1 corresponding to each first element in the first compensation matrix according to the first compensation parameter α, and then obtain the user's eye movement signal to partition the first compensation matrix and determine the first compression ratio of each divided sub-region. In addition, the display compensation system may also determine the corresponding second compression ratio according to the first resolution of the first compensation matrix and the second resolution of the display screen 13, and then determine the third compression ratio of each sub-region according to the second compression ratio and the first compression ratio of each sub-region. After that, the display compensation system may resample the first compensation matrix according to the third compression ratio to determine the fifth compensation matrix, and determine at least one fifth element corresponding to each first element, so as to determine the value of each second element in the second compensation matrix according to each fifth element in the fifth compensation matrix and its corresponding first offset value offset1 and / or first gain value gain1.

[0101] After determining the compensation value for uniformity compensation (i.e., the value of each second element in the second compensation matrix), the display compensation system can further correct the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to respectively determine the value of each sixth element in the sixth compensation matrix of the third resolution (e.g., 1296*1296). After that, the display compensation system can perform a combined compensation correction of uniformity compensation and display aging compensation on the original image according to the sixth compensation matrix, and then perform gaze point decompression on the compensated image to obtain a compensated image of the second resolution (e.g., 1920*1920) displayed on the display screen 13, thereby further eliminating the influence of the display aging deviation caused by long-term use of the display screen 13.

[0102] Specifically, in the process of determining the values ​​of the sixth elements in the sixth compensation matrix, the display compensation system may first be as follows: Fig.11 As shown, according to the aging compensation matrix and the second compensation matrix, the value of each seventh element in the seventh compensation matrix is ​​determined, and then the third offset value offset3 and / or the third gain value gain3 corresponding to each seventh element is determined according to the second compensation parameter β, wherein,

[0103] offset3=offset1×β(g in )

[0104] β is the seventh element g in function, or each seventh element g in The lookup table LUT_3 is used to further save storage resources and transmission bandwidth.

[0105] Afterwards, the display compensation system may determine the values ​​of each sixth element in the sixth compensation matrix according to each seventh element in the seventh compensation matrix and its corresponding third offset value offset3 and / or third gain value gain3:

[0106] g out =g in ×gain3+offset3

[0107] Here, g in is the value of each seventh element of the input, g out is the value of each sixth element of the output.

[0108] Furthermore, in some embodiments, the display compensation system may preferably store a frame number threshold n for updating the aging compensation matrix and / or the second compensation parameter β. th After obtaining the aging compensation matrix and / or the second compensation parameter β, the display compensation system can continuously compensate each subsequent original image frame according to the aging compensation matrix and / or the second compensation parameter β, and continue to obtain subsequent original images or compensated images. th ), the display compensation system can combine the original image or compensated image of the preset frame number to perform historical statistics to update the aging compensation matrix and / or the second compensation parameter β. Here, the preset number of frames can be one frame or multiple frames. Thereafter, in response to the update of the aging compensation matrix and / or the second compensation parameter β, the display compensation system can further correct the corresponding second elements in the second compensation matrix according to the updated aging compensation matrix and / or the second compensation parameter β, so as to respectively update the values ​​of the sixth elements in the sixth compensation matrix, and perform compensation correction on each frame of the acquired original image according to the current sixth compensation matrix, so as to obtain a compensated image displayed on the display screen 13.

[0109] In this way, by further adopting the aging compensation matrix and / or the second compensation parameter β obtained by historical statistics to continuously correct each second element in the second compensation matrix, the present invention can simultaneously eliminate the uneven display of the native display screen 13 and the impact of display screen aging, while further reducing the bandwidth and data dimension of the compensation data, thereby reducing the requirements for the data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of the compensation data between different modules. Furthermore, by synchronously compressing the gaze point of the original image to be compensated and the compensation value (i.e., each second element in the second compensation matrix) based on the eye movement signal, the present invention can more accurately achieve uniformity compensation and display aging compensation for XR display devices with gaze point compression processing function.

[0110] Those skilled in the art will appreciate that the above-mentioned embodiment of first determining the second compensation matrix based on the pre-calibrated first compensation parameter α, and then correcting the second compensation matrix based on the historical statistical aging compensation matrix and / or the second compensation parameter β to perform a combined compensation of uniformity compensation and display aging compensation is only a non-limiting implementation method provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide a specific solution that is easy for the public to implement, but is not intended to limit the scope of protection of the present invention.

[0111] Optionally, in other embodiments, the display compensation method, display compensation system and computer-readable storage medium provided by the present invention can also be used to perform display aging compensation for display aging deviation alone to enhance the user's visual comfort and the realism of the displayed image.

[0112] Please refer to Fig.12 and Fig.13 . Fig.12 A schematic diagram of the architecture of a display compensation system provided according to some embodiments of the present invention is shown. Fig.13 A schematic diagram of a flow chart of display aging compensation provided according to some embodiments of the present invention is shown.

[0113] exist Fig.12 In the illustrated embodiment, the display compensation system does not need to be configured with a calibration system, but only includes a display pipeline 21 , a display screen 22 , a memory 23 and a processor 24 .

[0114] Specifically, the memory 23 includes but is not limited to the computer-readable storage medium provided in the third aspect of the present invention, on which computer instructions are stored. The processor 24 is connected to the memory 14 and is configured to execute the computer instructions stored in the memory to implement the display compensation method provided in the first aspect of the present invention.

[0115] The display pipeline 21 is provided with a display compensation module 211. The display compensation module 211 is connected to the processor 24, and can determine an initial second compensation matrix according to the first compensation matrix under the control of the processor 24, and correct the initial second compensation matrix in combination with the aging compensation matrix and / or the second compensation parameter β indicating the global compensation data to determine a second compensation matrix in which each second element corresponds to at least one screen pixel of the display screen 22, and then compensate the original image according to the second compensation matrix to obtain a compensated image that eliminates display aging.

[0116] In this way, by first generating a second compensation matrix based on the first compensation matrix, the historical statistical aging compensation matrix and / or the second compensation parameter β, and then compensating and correcting the original image based on the second compensation matrix, the present invention can effectively eliminate the impact of display aging of the display screen 22, and reduce the bandwidth and data dimension of the compensation data, so as to reduce the data storage requirements of the display compensation system and the data transmission load of the compensation data between different modules. Furthermore, by synchronously compressing the gaze point of the original image to be compensated and the compensation value (i.e., each second element in the second compensation matrix) based on the eye movement signal, the present invention can more accurately realize the display aging compensation of the XR display device with the gaze point compression processing function.

[0117] Furthermore, in some embodiments, the gaze point compression module 212 is used to obtain the user's eye movement signal, and perform gaze point compression on the original image and / or the second compensation matrix according to the eye movement signal. The display compensation module 211 can be configured after the gaze point compression module 212, and can compensate the compressed original image according to the compressed second compensation matrix under the control of the processor 24 to obtain a compressed compensated image. The gaze point decompression module 213 is configured after the display compensation module 211, and is used to perform gaze point decompression on the compressed compensated image according to the eye movement signal to obtain a compensated image displayed on the display screen 22. In this way, by first performing gaze point compression on the original image and / or the second compensation matrix, then compensating the compressed original image according to the compressed second compensation matrix, and then performing gaze point decompression on the compressed compensated image, the present invention can significantly reduce the data processing amount of display compensation, thereby further reducing the data storage amount requirement for the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0118] In addition, those skilled in the art may also understand that, although in the above-mentioned embodiment of display aging compensation, the compensation parameter obtained based on historical statistics is called the second compensation parameter β, those skilled in the art may also name it the first compensation parameter α when independently implementing display aging compensation.

[0119] In summary, the above-mentioned display compensation method, display compensation system and computer-readable storage medium provided by the present invention can split and store compensation data by combining compensation coefficients and compensation matrices, so as to effectively reduce the bandwidth and data dimension of the compensation data, thereby reducing the requirements for data storage, data transmission and data processing of the display compensation system, and reducing the data transmission load of compensation data between different modules.

[0120] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.

[0121] Those skilled in the art will appreciate that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips cited throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof.

[0122] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of the two. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps are generally described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. The technician may implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present invention.

[0123] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A display compensation method, characterized in that: The following steps are involved: Obtaining a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates a numerical relationship between each first element and a value of the corresponding screen pixel; Determine a second compensation matrix according to the first compensation matrix and the first compensation parameter α, wherein each second element in the second compensation matrix corresponds to at least one screen pixel of the display screen; acquiring an original image to be compensated; and The original image is compensated and corrected according to the second compensation matrix to obtain a compensated image displayed on the display screen.

2. The display compensation method according to claim 1, characterized in that: Each of the first elements records the value difference between each of the screen pixels, and the first compensation parameter α indicates the offset value between each of the first elements and the value of the corresponding screen pixel, and / or Each of the first elements records the value of the corresponding specific screen pixel point, the first compensation parameter α indicates the value difference between each of the specific screen pixel points and its corresponding non-specific screen pixel point, and / or Each of the first elements records the value of each of the screen pixels at a preset grayscale, and the first compensation parameter α indicates a numerical adjustment coefficient of each of the screen pixels at at least one other grayscale.

3. The display compensation method according to claim 2, characterized in that: The first compensation parameter α corresponds to a lookup table, and the step of determining the second compensation matrix according to the first compensation matrix and the first compensation parameter α comprises: According to the value and / or position of each of the first elements in the first compensation matrix, searching the lookup table corresponding to the first compensation parameter α to respectively determine the value and / or position of at least one second element corresponding to each of the first elements; and The second compensation matrix is ​​determined according to the value and position of each of the second elements.

4. The display compensation method according to claim 2, wherein: The step of determining the second compensation matrix according to the first compensation matrix and the first compensation parameter α comprises: According to the first compensation parameter α, respectively determine a first offset value offset1 and / or a first gain value gain1 corresponding to each of the first elements; Establishing a third compensation matrix according to the first resolution of the first compensation matrix, and determining the value of each third element in the third compensation matrix according to the first offset value offset1 and / or the first gain value gain1 of the first element corresponding to each third element; and The third compensation matrix is ​​up-sampled according to the second resolution of the display screen to determine the value of each second element in the second compensation matrix of the second resolution.

5. The display compensation method according to claim 3 or 4, characterized in that: The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen comprises: Obtain user's eye movement signals; Performing gaze point compression on the original image and the second compensation matrix according to the eye movement signal; Compensating and correcting the original image compressed by the gaze point through the second compensation matrix compressed by the gaze point to obtain a compressed compensated image; and The compressed compensation image is decompressed at the gaze point according to the eye movement signal to obtain a compensation image displayed on the display screen.

6. The display compensation method according to claim 5, characterized in that: The step of performing gaze point compression on the second compensation matrix according to the eye movement signal comprises: Determine, according to the value of each image pixel in the original image, a second offset value offset2 and / or a second gain value gain2 corresponding to each second element in the second compensation matrix; According to the second offset value offset2 and / or the second gain value gain2, correct the corresponding second elements in the second compensation matrix to respectively determine the values ​​of the fourth elements in the fourth compensation matrix; and The fourth compensation matrix is ​​subjected to gaze point compression according to the eye movement signal to determine a second compensation matrix subjected to the gaze point compression.

7. The display compensation method according to claim 2, characterized in that: The step of determining the second compensation matrix according to the first compensation matrix and the first compensation parameter α comprises: According to the first compensation parameter α, respectively determine a first offset value offset1 and / or a first gain value gain1 corresponding to each of the first elements; Acquire the user's eye movement signal to partition the first compensation matrix, and respectively determine a first compression ratio of each partitioned area; Determining a corresponding second compression ratio according to a first resolution of the first compensation matrix and a second resolution of the display screen; determining a third compression ratio for each of the regions according to the second compression ratio and the first compression ratio of each of the regions; performing sampling processing on the first compensation matrix according to the third compression ratio to determine a fifth compensation matrix, and determining at least one fifth element corresponding to each of the first elements; and According to each of the fifth elements in the fifth compensation matrix and its corresponding first offset value offset1 and / or first gain value gain1, the value of each of the second elements in the second compensation matrix is ​​determined respectively.

8. The display compensation method according to claim 7, characterized in that: The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen comprises: Performing gaze point compression on the original image according to the eye movement signal; By using the second compensation matrix, compensating and correcting the original image compressed by the gaze point to obtain a compressed compensated image; and The compressed compensation image is decompressed at the gaze point according to the eye movement signal to obtain a compensation image displayed on the display screen.

9. The display compensation method according to claim 1, characterized in that: The following steps are also included: Acquire a first calibration image; Transmitting the first calibration image to the display screen for display, and capturing a first display image output by the display screen via a camera module; as well as The first calibration image and the first display image are compared with each pixel value to determine the first compensation matrix and the first compensation parameter α.

10. The display compensation method according to claim 9, characterized in that: The following steps are also included: Acquire multiple second calibration images; Transmitting each of the second calibration images to the display screen for display, and collecting the second display images output by the display screen via the camera module; as well as According to the difference in values ​​of each image pixel point between the first calibration image and each of the second calibration images, and the difference in measured values ​​of each image pixel point between the first display image and each of the second display images, the second offset value offset2 and / or the second gain value gain2 corresponding to each of the second elements in the second compensation matrix are determined.

11. The display compensation method according to claim 1, 3, 4 or 7, characterized in that: The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen comprises: Get the comprehensive aging factor indicating the aging condition of the screen; Determining an aging compensation matrix and / or a second compensation parameter β for screen aging compensation according to the comprehensive aging factor; According to the aging compensation matrix and / or the second compensation parameter β, correct the corresponding second elements in the second compensation matrix to respectively determine the values ​​of the sixth elements in the sixth compensation matrix; and The original image is compensated and corrected according to the sixth compensation matrix to obtain a compensated image displayed on the display screen.

12. The display compensation method according to claim 11, characterized in that: The step of obtaining a comprehensive aging factor indicating screen aging conditions comprises: Counting the brightness of the original image or the compensated image to determine a current aging factor; Counting the temperature of the display screen to determine a temperature aging factor; and The comprehensive aging factor is determined according to the current aging factor and the temperature aging factor.

13. The display compensation method according to claim 12, wherein: The step of counting the brightness of the original image or the compensated image to determine the current aging factor comprises: Determining a current factor of each image pixel of the original image or the compensated image according to the DBV data of the original image or the compensated image; and The current factor is accumulated according to statistical time to determine the current aging factor of each pixel of the image.

14. The display compensation method according to claim 12, wherein: The step of counting the temperature of the display screen to determine the temperature aging factor comprises: Determining the real-time temperature of each screen pixel of the display screen via a screen temperature sensor; and According to the real-time temperature and the pre-calibrated temperature-aging relationship, the temperature aging factor of each screen pixel is determined respectively.

15. The display compensation method according to claim 12, wherein: The step of determining the comprehensive aging factor according to the current aging factor and the temperature aging factor comprises: Obtaining a current aging factor decompressed through a gaze point; and The current aging factor decompressed through the gaze point and the temperature aging factor of the screen resolution are fused to determine a comprehensive aging factor of the screen resolution.

16. The display compensation method according to claim 15, characterized in that: The step of determining an aging compensation matrix and / or a second compensation parameter β for screen aging compensation according to the comprehensive aging factor comprises: downsampling the comprehensive aging factor according to a preset fourth compression ratio to determine the aging compensation matrix; Determining a seventh compensation matrix for storage grayscale and at least one eighth compensation matrix for non-storage grayscale according to the aging compensation matrix and the second compensation matrix; and The second compensation parameter β is determined according to the difference between each seventh element in the seventh compensation matrix and each eighth element in the eighth compensation matrix.

17. The display compensation method according to claim 16, wherein: The step of obtaining the first compensation matrix comprises: According to the first compensation parameter α, an inverse operation is performed on the seventh compensation matrix and / or the eighth compensation matrix to obtain an updated first compensation matrix.

18. The display compensation method according to claim 16, wherein: The step of correcting the corresponding second elements in the second compensation matrix according to the aging compensation matrix and / or the second compensation parameter β to respectively determine the values ​​of the sixth elements in the sixth compensation matrix includes: Determining the value of each of the seventh elements in the seventh compensation matrix according to the aging compensation matrix and the second compensation matrix; According to the second compensation parameter β, respectively determine the third offset value offset3 and / or the third gain value gain3 corresponding to each of the seventh elements; and According to each of the seventh elements in the seventh compensation matrix and its corresponding third offset value offset3 and / or third gain value gain3, the values ​​of each of the sixth elements in the sixth compensation matrix are determined respectively.

19. The display compensation method according to claim 11, wherein: The step of compensating and correcting the original image according to the second compensation matrix to obtain a compensated image displayed on the display screen further includes: In response to continuously acquiring a preset number of frames of original images or compensated images, historical statistics are performed in combination with the preset number of frames of original images or compensated images to update the aging compensation matrix and / or the second compensation parameter β; In response to the updating of the aging compensation matrix and / or the second compensation parameter β, correcting the corresponding second elements in the second compensation matrix according to the updated aging compensation matrix and / or the updated second compensation parameter β, so as to update the values ​​of the sixth elements in the sixth compensation matrix respectively; and In response to each acquired original image frame, the original image is compensated and corrected according to the current sixth compensation matrix to obtain a compensated image displayed on the display screen.

20. A display compensation system, comprising a display pipeline, wherein a display compensation module is configured, characterized in that: The display compensation module is configured as follows: Obtaining a first compensation matrix and a first compensation parameter α, wherein each first element in the first compensation matrix corresponds to at least one screen pixel of the display screen, and the first compensation parameter α indicates a numerical relationship between each first element and the value of each corresponding screen pixel; Determine a second compensation matrix according to the first compensation matrix and the first compensation parameter α, wherein each second element in the second compensation matrix corresponds to each screen pixel point of the display screen; acquiring an original image to be compensated; and The original image is compensated and corrected according to the second compensation matrix to obtain a compensated image displayed on the display screen.

21. The display compensation system of claim 20, wherein: The display pipeline is also configured with a gaze point compression module and a gaze point decompression module, wherein: The gaze point compression module is configured to: obtain an eye movement signal of the user; and perform gaze point compression on the original image and / or the second compensation matrix according to the eye movement signal. The display compensation module is configured between the gaze point compression module and the gaze point decompression module, and is configured to: compensate and correct the original image compressed by the gaze point through the second compensation matrix compressed by the gaze point to obtain a compressed compensated image, The gaze point decompression module is configured to perform gaze point decompression on the compressed compensation image according to the eye movement signal to obtain a compensation image displayed on the display screen.

22. The display compensation system of claim 20, wherein: The system also includes a calibration system, wherein the calibration system is provided with a shooting module and is configured as follows: Acquire a first calibration image; transmitting the first calibration image to the display screen for display, and capturing a first display image output by the display screen via the camera module; and The first calibration image and the first display image are compared with each pixel value to determine the first compensation matrix and the first compensation parameter α.

23. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed by a processor, the display compensation method according to any one of claims 1 to 19 is implemented.

Images