Display compensation method and device and XR equipment

Abstract

The invention relates to the technical field of display, and discloses a display compensation method and device and XR equipment, and the method comprises the steps: obtaining brightness data corresponding to a display module and optical data corresponding to an optical system; determining first compensation data of the display module according to the brightness data, and determining second compensation data of the optical system according to the optical data; and compensating the to-be-displayed image based on the first compensation data and the second compensation data. Compared with the prior art that only the display module is improved, the display module can be improved through the first compensation data, the optical system is improved through the second compensation data, the final display effect of the to-be-displayed image on the XR equipment is improved, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of display technologies, and in particular, to a display compensation method, apparatus, and XR device. Background Art

[0002] At the current stage, virtual display technologies are booming. Silicon-based micro-displays combine semiconductor processes and organic light-emitting diode (OLED) display device processes, enabling higher pixel density (Pixels Per Inch, PPI), 4K and above resolutions, ultra-high brightness, and longer device lifetimes, showing significant advantages over traditional liquid crystal displays (LCDs) and active-matrix organic light-emitting diodes (AMOLEDs).

[0003] During the production process of silicon-based micro-display panels, there are still problems such as inaccurate control of equipment process parameters and efficiency differences in OLED emission, which lead to differences in pixel emission brightness and color of the display panel, manifested as various Mura phenomena perceptible to the human eye.

[0004] The existing common practice is to use the Demura algorithm to improve the overall display effect. However, the conventional Demura method only improves the brightness and chromaticity uniformity of the display panel of the display module, and the edge brightness attenuation of a common Pancake optical system can reach about 30%, which still leads to a poor display effect on the final XR device, and obvious Mura can be perceived by the human eye, affecting the user experience.

[0005] The above content is only used to assist in understanding the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0006] The main objective of the present invention is to provide a display compensation method, apparatus, and XR device, aiming to solve the technical problem in the prior art that only the brightness and chromaticity uniformity of the display module are improved by the conventional Demura method, and the influence brought by the optical system still leads to a poor display effect on the final XR device, affecting the user experience.

[0007] To achieve the above objective, the present invention provides a display compensation method, which is applied to an XR device with an optical system and a display module. The method includes the following steps:

[0008] Obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system;

[0009] Determine first compensation data for the display module according to the luminance data, and determine second compensation data for the optical system according to the optical data;

[0010] Compensate the image to be displayed based on the first compensation data and the second compensation data.

[0011] Optionally, the step of compensating the image to be displayed based on the first compensation data and the second compensation data includes:

[0012] Determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed;

[0013] Select module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels;

[0014] Select system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels;

[0015] Compensate the image to be displayed by the module compensation data and the system compensation data.

[0016] Optionally, the step of determining the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed further includes:

[0017] Obtain device data of the XR device, where the device data includes at least one of display luminance data, temperature data, and frequency data;

[0018] Compensate the image to be displayed by the device data, the module compensation data, and the system compensation data.

[0019] Optionally, the step of obtaining the luminance data corresponding to the display module and the optical data corresponding to the optical system includes:

[0020] Shoot the display interface of the XR device through a preset module shooting device to obtain the luminance data corresponding to the display module;

[0021] Shoot the display interface based on a preset system shooting device to obtain the optical data corresponding to the optical system.

[0022] Optionally, the step of shooting the display interface based on a preset system shooting device to obtain the optical data corresponding to the optical system includes:

[0023] Shoot the display interface based on a preset system shooting device to obtain a captured interface;

[0024] Divide the shooting interface according to a preset division area to obtain a divided interface;

[0025] Determine the optical data corresponding to the optical system based on each of the divided interfaces.

[0026] Optionally, the step of determining the first compensation data of the display module according to the brightness data includes:

[0027] Fit the brightness data to obtain an initial gamma curve;

[0028] Fit the initial gamma curve according to a preset fitting range to obtain a target gamma curve;

[0029] Determine the first compensation data of the display module based on the initial gamma curve and the target gamma curve.

[0030] Optionally, before the step of compensating the image to be displayed based on the first compensation data and the second compensation data, it further includes:

[0031] Verify the first compensation data and the second compensation data according to a preset verification method;

[0032] When the verification is successful, perform the operation of compensating the image to be displayed based on the first compensation data and the second compensation data.

[0033] In addition, to achieve the above object, the present invention also proposes a display compensation device, and the device includes: a data acquisition module, a compensation determination module, and a display compensation module;

[0034] The data acquisition module is used to acquire the brightness data corresponding to the display module and the optical data corresponding to the optical system;

[0035] The compensation determination module is used to determine the first compensation data of the display module according to the brightness data and determine the second compensation data of the optical system according to the optical data;

[0036] The display compensation module is used to compensate the image to be displayed based on the first compensation data and the second compensation data.

[0037] In addition, to achieve the above object, the present invention also proposes an XR device, and the XR device includes: an optical system, a display module, a processor, and a display driver chip;

[0038] Wherein, the display driver chip is respectively connected to the processor and the display module;

[0039] The processor is configured to obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system;

[0040] The processor is further configured to determine first compensation data for the display module according to the brightness data, and determine second compensation data for the optical system according to the optical data;

[0041] The display driver chip is configured to perform optical compensation on the image to be displayed based on the first compensation data and the second compensation data, and transmit the compensated image to be displayed to the display module;

[0042] The display module is configured to display the compensated image to be displayed through the optical system.

[0043] Optionally, the display driver chip includes: a brightness determination unit, a calculation unit, and a compensation unit;

[0044] Wherein, the calculation unit is respectively connected to the brightness determination unit, the calculation unit, and the processor, and the compensation unit is connected to the display module;

[0045] The brightness determination unit is configured to determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed;

[0046] The calculation unit is configured to select the module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels;

[0047] The calculation unit is further configured to select the system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels;

[0048] The compensation unit is further configured to perform optical compensation on the image to be displayed through the module compensation data and the system compensation data, and transmit the compensated image to be displayed to the display module.

[0049] Optionally, the brightness determination unit is further configured to obtain device data of the XR device, where the device data includes at least one of display brightness data, temperature data, and frequency data;

[0050] The compensation unit is further configured to perform optical compensation on the image to be displayed through the device data, the module compensation data, and the system compensation data.

[0051] The present invention provides a display compensation method, device and XR device. The method is applied to an XR device with an optical system and a display module. The method includes: obtaining brightness data corresponding to the display module and optical data corresponding to the optical system; determining first compensation data for the display module according to the brightness data, and determining second compensation data for the optical system according to the optical data; compensating the image to be displayed based on the first compensation data and the second compensation data. Since the present invention can first obtain the brightness data of the display module and the optical data of the optical system, determine the first compensation data for compensating the display module according to the brightness data, determine the second compensation data for compensating the optical system according to the optical data, and finally compensate the image to be displayed based on the first compensation data and the second compensation data. Compared with the existing method that only improves the display module, the present invention can improve the display module through the first compensation data and improve the optical system through the second compensation data, thereby improving the final display effect of the image to be displayed on the XR device and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a schematic flowchart of the first embodiment of the display compensation method of the present invention;

[0053] Figure 2 It is a processing flowchart of the XR device in the display compensation method of the present invention;

[0054] Figure 3 It is a schematic flowchart of the second embodiment of the display compensation method of the present invention;

[0055] Figure 4 It is a structural block diagram of the first embodiment of the XR device of the present invention;

[0056] Figure 5 It is a structural block diagram of the second embodiment of the XR device of the present invention;

[0057] Figure 6 It is a structural block diagram of the first embodiment of the display compensation device of the present invention.

[0058] The implementation, functional features and advantages of the object of the present invention will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0059] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0060] It should be noted that the method of this embodiment can be executed by an XR device. The above XR device can be an XR glasses or the like, and this embodiment does not limit this. The XR device in this embodiment may include a display module and an optical system. The display module may be a module that projects an image to be displayed in front of the user's eyes through the optical system, and may include a display screen and the like; the optical system is a system composed of a specific imaging optical path in the XR device. For example, it can be a pancake used in a Virtual Reality (VR) device or a waveguide for Augmented Reality (AR), etc., and this embodiment also does not limit this.

[0061] It can be understood that after the display module displays the image to be displayed, the optical system can project the image to be displayed in front of the user's eyes after optical processing, so that the user can see virtual reality or augmented reality content.

[0062] Even at the current stage, with the booming development of virtual display technology, silicon-based microdisplay combines semiconductor technology and Organic Light-Emitting Diode (OLED) display device technology, enabling higher Pixel Per Inch (PPI), 4K or higher resolution, ultra-high brightness, and longer device lifespan, showing great advantages over traditional Liquid Crystal Display (LCD) and Active-Matrix Organic Light-Emitting Diode (AMOLED).

[0063] During the production process of silicon-based microdisplay panels, there are still problems such as inaccurate control of equipment process parameters and efficiency differences in OLED emission, which lead to differences in pixel emission brightness and color of the display panel, manifested as various Mura phenomena that can be perceived by the human eye.

[0064] The existing common practice is to use the Demura algorithm to improve the overall display effect. However, the conventional Demura method only improves the brightness and chromaticity uniformity of the display panel of the display module, and the edge brightness attenuation of a common Pancake optical system can reach about 30%, which still leads to a poor display effect on the final XR device, and obvious Mura can be perceived by the human eye, affecting the user experience.

[0065] Therefore, to solve the above-mentioned defects, this embodiment provides a display compensation method, which is applied to an XR device with an optical system and a display module. By first obtaining the brightness data of the display module and the optical data of the optical system, determining the first compensation data for compensating the display module according to the brightness data, determining the second compensation data for compensating the optical system according to the optical data, and finally compensating the image to be displayed based on the first compensation data and the second compensation data. Compared with the existing method that only improves the display module, this embodiment can not only improve the display module through the first compensation data, but also improve the optical system through the second compensation data, thus enhancing the display effect of the image to be displayed on the XR device and improving the user experience.

[0066] For ease of understanding, the following specifically introduces the display compensation method provided by the embodiments of the present application in conjunction with Figures 1 to 3 the following content.

[0067] An embodiment of the present invention provides a display compensation method. Refer to Figure 1 , Figure 1 which is a schematic flowchart of the first embodiment of the display compensation method of the present invention. As Figure 1 shown, in this embodiment, the display compensation method includes the following steps:

[0068] Step S10: Obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system.

[0069] It should be noted that the method of this embodiment can be executed by an XR glasses with an optical system and a display module. Of course, it can also be executed by other XR devices with an optical system and a display module. This embodiment does not limit this. The following will illustrate this embodiment and the following embodiments with an XR device.

[0070] Before the above-mentioned XR device performs compensation, it can first obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system. Since different gray levels correspond to different display contents when the XR device displays, the brightness data and optical data corresponding to the XR device under a preset gray level can be obtained. The above-mentioned preset gray level can be any gray level. In this embodiment, 16 gray levels, 32 gray levels, 64 gray levels, 128 gray levels, 192 gray levels, and 224 gray levels are used for illustration.

[0071] The above-mentioned brightness data can be the brightness performance data corresponding to each sub-pixel when the display module displays, and can include data such as maximum brightness, average brightness, and backlight brightness; the above-mentioned optical data can be the optical performance data of the optical device when the optical system projects the display content onto the human eye, and can include data such as focal length, aperture, and field of view.

[0072] In order to obtain the above-mentioned brightness data and optical data, in this embodiment, the above-mentioned step S10 includes:

[0073] Step S11: Use a preset module photographing device to photograph the display interface of the XR device to obtain the brightness data corresponding to the display module;

[0074] Step S12: Based on a preset system photographing device, photograph the display interface to obtain the optical data corresponding to the optical system.

[0075] It should be noted that the above-mentioned preset module photographing device can be a photographing device for obtaining brightness data, such as a photometer, etc. In this embodiment, the display interface of the XR device can be photographed by the preset module photographing device in advance at 16 gray levels, 32 gray levels, 64 gray levels, 128 gray levels, 192 gray levels, and 224 gray levels to obtain the brightness data of all sub-pixels in the display module, and based on this brightness data, the initial compensation value of each sub-pixel at each preset gray level can be determined through the traditional Demura optical compensation method.

[0076] Then, the display interface of the XR device can be photographed by the above-mentioned preset system photographing device. At this time, the display interface can be the display interface compensated by the initial compensation value. The above-mentioned preset system photographing device can be a photographing device for obtaining optical data, and it can have a large field of view measurement ability to obtain macroscopic and whole-surface optical data of the entire field of view, such as a color camera equipped with an artificial eye lens, etc. Furthermore, in this embodiment, the display interface can also be photographed by the preset system photographing device at 16 gray levels, 32 gray levels, 64 gray levels, 128 gray levels, 192 gray levels, and 224 gray levels to obtain the optical data corresponding to all sub-pixels in the display module.

[0077] However, since the display screen is generally set as a rectangle, and an artificial eye lens is used, the picture photographed by the preset system photographing device may be circular. Therefore, the above-mentioned optical data can be the brightness data of the sub-pixels in the photographed picture.

[0078] Furthermore, considering that the uneven brightness and chromaticity caused by the light engine in the XR device are low-frequency and macroscopic, and at the same time, in order to reduce the data occupancy space, when obtaining the optical data, the photographed picture can be divided, and the brightness data can be determined according to the divided interface. The specific process is as follows:

[0079] The above-mentioned step S12 includes: Based on a preset system photographing device, photograph the display interface to obtain a photographed interface; divide the photographed interface according to a preset divided area to obtain a divided interface; determine the optical data corresponding to the optical system based on each divided interface.

[0080] It should be noted that the above-mentioned preset divided areas can be set by yourself according to the actual situation. In this embodiment, the shooting interface can be divided into 100*100 blocks as the above-mentioned divided interface. Among them, the division method can be an equal division method. However, considering that the deviation is greater the closer to the edge of the shooting interface, the division closer to the edge of the shooting interface can be made finer to improve the accuracy of subsequent optical data.

[0081] In specific implementation, under each preset gray level, the display interface of the XR device can be photographed by a preset module photographing device to obtain the brightness data corresponding to each sub-pixel under each preset gray level. The initial compensation value is determined according to the brightness data, and the image to be displayed is compensated by the initial compensation value; at the same time, the compensated display interface is photographed by a preset system photographing device, and the obtained shooting interface is divided, and the optical data corresponding to each divided interface is determined based on each divided interface.

[0082] After obtaining the brightness data and the optical data, they can both be stored in the XR device. In this embodiment, a non-volatile memory can be set in the XR device, and the brightness data and the optical data can be stored in the non-volatile memory, so that the subsequent XR device can directly perform compensation according to the data in the non-volatile memory.

[0083] Step S20: Determine the first compensation data of the display module according to the brightness data, and determine the second compensation data of the optical system according to the optical data.

[0084] It should be noted that after obtaining the brightness data, the above-mentioned XR device can be fitted through a specific module data processing algorithm, and the first compensation data for any gray level of any sub-pixel in the display module is determined based on the fitted data, where the first compensation data can be the above-mentioned initial compensation data.

[0085] As another implementation manner, the above-mentioned XR can also determine the first compensation data according to the brightness data after obtaining the optical data, and at the same time, the optical data can be calculated through a specific system data processing algorithm to obtain the second compensation data for any sub-pixel at any gray level. The above-mentioned module data processing algorithm and system data processing algorithm are not limited in this embodiment.

[0086] As another implementation, the above XR device can also directly receive the first compensation data and the second compensation data from the outside world. That is, after the preset module shooting device shoots the display interface, the first compensation data can be determined according to the obtained brightness data, and the first compensation data is transmitted to the non-volatile memory in the XR device. At this time, the XR device compensates the image to be displayed according to the first compensation data. After that, after the preset system shooting device shoots the display interface, the second compensation data can be determined according to the obtained optical data, and the second compensation data is transmitted to the non-volatile memory in the XR device.

[0087] Exemplarily, referring to Figure 2 , Figure 2 is the processing flowchart of the XR device in the display compensation method of the present invention. As shown in Figure 2 , the XR device can store the received first compensation data (i.e., DMR-A in Figure 2 ) and the second compensation data (i.e., DMR-B in Figure 2 ) into the non-volatile memory (i.e., Flash ROM in Figure 2 ).

[0088] At the same time, a display driver chip (i.e., DDIC in Figure 2 ) can also be set in the XR device. The DDIC can be used to drive the display screen to display. Then, during compensation, the DDIC can directly obtain DMR-A and DMR-B from the Flash ROM for compensation.

[0089] Furthermore, since the currently obtained first compensation data and second compensation data are both compensation data at each preset gray level (i.e., 16 gray levels, 32 gray levels, 64 gray levels, 128 gray levels, 192 gray levels, and 224 gray levels), in order to determine the compensation data at the remaining gray levels, the above XR device can also calculate the corresponding first compensation data at the remaining gray levels according to the first compensation data at each gray level and store them together in the Flash ROM. Similarly, the corresponding second compensation data at the remaining gray levels can be calculated according to the second compensation data at each preset gray level and stored together in the Flash ROM. The specific calculation process is not limited in this embodiment.

[0090] In a specific implementation, the above XR device can determine the first compensation data for the display module according to the brightness data, and determine the second compensation data for the diagnostic optical system according to the optical data.

[0091] Step S30: Compensate the image to be displayed based on the first compensation data and the second compensation data.

[0092] Continuing as in Figure 2As shown, when performing compensation, the XR device can obtain DMR-A and DMR-B from the Flash ROM through the DDIC and store them in the static memory in the DDIC (i.e., the Figure 2 SRAM therein) for internal operations of the DDIC, so as to implement compensation for the image to be displayed (i.e., the Figure 2 Input Image therein), obtain the compensated image to be displayed (i.e., the Figure 2 Output Image therein), and transmit the compensated image to be displayed to the display module. After receiving the compensated image to be displayed, the display module realizes display through the optical system together.

[0093] In this embodiment, the display interface of the XR device can be photographed by a preset module photographing device at each preset gray level in advance to obtain the brightness data corresponding to each sub-pixel at each preset gray level, and the initial compensation amount is determined based on the brightness data to compensate the image to be displayed; then the display interface is photographed by a preset system photographing device, and the obtained photographed interface is divided, and the optical data corresponding to each divided interface is determined based on each divided interface; the first compensation data for the display module is determined according to the brightness data, and the second compensation data for the diagnostic optical system is determined according to the optical data. After compensating the image to be displayed with the first compensation data and the second compensation data, it is displayed. Compared with the existing method that only improves the display module, this embodiment can take into account the brightness and chromaticity attenuation introduced by the optical engine through the second compensation data. It not only improves the display module through the first compensation data, but also improves the optical system through the second compensation data, enhancing the final display effect of the image to be displayed on the XR device, taking into account the brightness attenuation introduced by the optical system, and improving the user experience.

[0094] It should be emphasized that, due to the simulation and production of the optical system, it is often necessary to input parameters determined based on the display module, such as size, resolution, and the attenuation characteristics of brightness and chromaticity with angle, etc. Therefore, if direct compensation is performed on the XR device, effective resource integration of the two production systems of the display module and the optical system is required, which is difficult at the actual implementation level. However, when obtaining the second compensation amount in this embodiment, it is obtained based on photographing after compensating the display module, which can simplify the process and facilitate operation.

[0095] Refer to Figure 3 , Figure 3 which is a schematic flowchart of the second embodiment of the display compensation method of the present invention.

[0096] As Figure 3 shown, during actual compensation, since the compensation amounts corresponding to different gray levels are different, in this embodiment, the above step S30 includes:

[0097] Step S31: Determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed.

[0098] It should be noted that, continuing to refer to Figure 2 for illustration, as Figure 2 shown, a brightness determination unit (i.e., Figure 2 BC in

[0099] Step S32: Select the module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels.

[0100] Step S33: Select the system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels.

[0101] It should be understood that a calculation unit and a compensation unit may also be provided in the above DDIC; after determining the current gray level, BC can transmit the current gray level to the calculation unit, and the calculation unit can obtain the module compensation data for compensating the display module from DMR-A in the SRAM according to the current gray level, and at the same time can obtain the system compensation data for compensating the optical system from DMR-B in the SRAM.

[0102] Step S34: Compensate the image to be displayed by the module compensation data and the system compensation data.

[0103] In a specific implementation, after the calculation unit obtains the module compensation data and the system compensation data, it can determine the compensation amount corresponding to each sub-pixel to be compensated according to the module compensation data and the system compensation data, and transmit it to the compensation unit, and the compensation unit compensates each sub-pixel to be compensated according to each compensation amount.

[0104] Furthermore, considering that other factors need to be considered when determining the compensation amount, thus in this embodiment, the above step S34 includes:

[0105] Step S341: Obtain the device data of the XR device, where the device data includes at least one of display brightness data, temperature data, and frequency data;

[0106] Step S342: Compensate the image to be displayed by the device data, the module compensation data, and the system compensation data.

[0107] It can be understood that the above display brightness data (Display Brightness Value, DBV) can be the data corresponding to the brightness of the current display screen, and the brightness of the XR device display screen can be changed by adjusting the DBV; the above temperature data (i.e.,Figure 2 The medium temperature (Temp) can be the temperature inside or outside the XR device; the above frequency data can be the refresh rate of the XR device (i.e., Figure 2 medium FR).

[0108] Furthermore, when the above BC receives the image to be displayed, it can simultaneously obtain the display brightness data, temperature data, and frequency data of the XR device, and transmit the display brightness data, temperature data, frequency data, and the current gray level corresponding to each sub-pixel to be compensated to the calculation unit.

[0109] Continue to refer to Figure 2 In the Flash ROM, a look-up table corresponding to the display brightness data, temperature data, and frequency data (i.e., Figure 2 BC_LUT) can be stored, and can be preset and stored in the Flash ROM.

[0110] In actual use, the SRAM can obtain the BC_LUT in the Flash ROM. The calculation unit determines the compensation amount corresponding to each sub-pixel to be compensated according to the BC_LUT in the Flash ROM, in combination with the module compensation data and the system compensation data, and transmits it to the compensation unit. The compensation unit then compensates the image to be displayed based on the compensation amount, further improving the compensation effect.

[0111] Furthermore, when obtaining the first compensation data, this embodiment can be determined by fitting, that is, the step of determining the first compensation data of the display module according to the brightness data includes: fitting the brightness data to obtain an initial gamma curve; fitting the initial gamma curve according to a preset fitting range to obtain a target gamma curve; determining the first compensation data of the display module based on the initial gamma curve and the target gamma curve.

[0112] It should be noted that when the XR device receives the brightness data, the brightness data can be fitted through a preset module data processing algorithm to obtain an initial gamma curve, and a specific range (i.e., the above preset fitting range) is selected to fit and obtain a target gamma curve. Finally, the first compensation data of the display module is determined based on the initial gamma curve and the target gamma curve.

[0113] It should be emphasized that the above preset fitting range can be set according to the actual situation, and this embodiment does not limit it.

[0114] Further, considering that when both the first compensation data and the second compensation data in the XR device are received from the outside, in order to ensure the accuracy of the received data, this embodiment can verify the first compensation data and the second compensation data. The specific process is as follows: Before the above step S30, it further includes: verifying the first compensation data and the second compensation data according to a preset verification method; when the verification is successful, execute the step of compensating the image to be displayed based on the first compensation data and the second compensation data.

[0115] It can be understood that the above preset verification method can be a method for verifying data integrity, such as Cyclic Redundancy Check (CRC) or checksum mechanism, etc. Of course, other verification methods can also be used, and this embodiment does not limit this. At the same time, for the XR device to receive the first compensation data and the second compensation data, it can be implemented through the Serial Peripheral Interface (SPI) or the Mobile Industry Processor Interface (MIPI). Of course, other data transmission methods can also be used.

[0116] In actual use, this embodiment of the XR device can determine the compensation amount corresponding to each sub-pixel to be compensated by combining device data, module compensation data, and system compensation data, and transmit it to the compensation unit. The compensation unit then compensates the image to be displayed based on the compensation amount, further improving the compensation effect.

[0117] In addition, to achieve the above object, this embodiment also proposes an XR device. Refer to Figure 4 , Figure 4 which is the structural block diagram of the first embodiment of the XR device of the present invention.

[0118] As Figure 4 shown, the XR device includes: an optical system, a display module, a processor, and a display driver chip;

[0119] Among them, the display driver chip is respectively connected to the processor and the display module;

[0120] The processor is used to obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system;

[0121] The processor is also used to determine the first compensation data of the display module according to the brightness data, and determine the second compensation data of the optical system according to the optical data;

[0122] The display driving chip is used to perform optical compensation on the image to be displayed based on the first compensation data and the second compensation data, and transmit the compensated image to be displayed to the display module;

[0123] The display module is used to display the compensated image to be displayed through the optical system.

[0124] It should be noted that when obtaining the brightness data in this embodiment, it can be obtained by a preset module shooting device, and when obtaining the optical data, it can be obtained by a preset system shooting device. Furthermore, before the above-mentioned processor obtains the brightness data and the optical data, the display interface of the XR device can also be photographed by the preset module shooting device, and the obtained first photographed interface is transmitted to the processor. At the same time, the display interface is photographed based on the preset system shooting device, and the obtained second photographed interface is transmitted to the processor. After receiving the first photographed interface and the second photographed interface, the processor can obtain the brightness data corresponding to the display module according to the first photographed interface, and obtain the optical data corresponding to the optical system according to the second photographed interface.

[0125] As another implementation manner, the above-mentioned processor can also be set outside the XR device. The above-mentioned processor can be a processor in a computer. After the preset module shooting device and the preset system shooting device complete shooting, the first photographed interface and the second photographed interface can be transmitted to the computer. The processor in the computer can process and transmit the obtained brightness data and optical data to the non-volatile memory for storage.

[0126] It can be understood that when obtaining the optical data based on the second photographed interface, the above-mentioned processor can divide the second photographed interface. The specific process is as follows: divide the photographed interface (i.e., the above-mentioned second photographed interface) according to the preset divided area to obtain a divided interface; determine the optical data corresponding to the optical system based on each divided interface.

[0127] It should be understood that after the above-mentioned processor obtains the brightness data and the optical data, it can determine the first compensation data (i.e., DMR-A in Figure 2 and the second compensation data (i.e., DMR-B in Figure 2 ). At the same time, for the convenience of subsequent operation, a non-volatile memory (i.e., Flash ROM in Figure 2 ) can also be set in the above-mentioned XR device. After the above-mentioned processor obtains the first compensation data and the second compensation data, it can send the first compensation data and the second compensation data to the non-volatile memory for storage.

[0128] It should also be noted that when performing compensation, the above-mentioned display driving chip (i.e., Figure 2The DDIC can extract the first compensation data and the second compensation data from the non-volatile memory, and compensate the image to be displayed (i.e., Figure 2 the Input Image in) with the first compensation data and the second compensation data to obtain the compensated image to be displayed (i.e., Figure 2 the OutputImage in), and transmit the compensated image to be displayed to the display module. After receiving the compensated image to be displayed, the display module realizes the display through the optical system together.

[0129] In this embodiment, the display interface of the XR device can be photographed by a preset module photographing device at each preset gray level in advance to obtain the brightness data corresponding to each sub-pixel at each preset gray level, and the initial compensation amount is determined based on the brightness data to compensate the image to be displayed; then the display interface is photographed by a preset system photographing device, and the obtained photographed interface is divided, and the optical data corresponding to each divided interface is determined based on each divided interface; the first compensation data for the display module is determined according to the brightness data, and the second compensation data for the diagnostic optical system is determined according to the optical data, and the image to be displayed is compensated and then displayed through the first compensation data and the second compensation data. Compared with the existing method that only improves the display module, this embodiment can take into account the brightness and chromaticity attenuation introduced by the optical engine through the second compensation data, improve the display module through the first compensation data, and improve the optical system through the second compensation data, thus improving the final display effect of the image to be displayed on the XR device and enhancing the user experience.

[0130] Reference Figure 5 , Figure 5 is the structural block diagram of the second embodiment of the XR device of the present invention.

[0131] As Figure 5 shown, the display driving chip includes: a brightness determination unit, a calculation unit, and a compensation unit;

[0132] Among them, the calculation unit is respectively connected to the brightness determination unit, the calculation unit and the processor, and the compensation unit is connected to the display module;

[0133] The brightness determination unit is used to determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed;

[0134] The calculation unit is used to select the module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels;

[0135] The calculation unit is further used to select the system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels;

[0136] The compensation unit is further configured to optically compensate the image to be displayed by using the module compensation data and the system compensation data, and transmit the compensated image to be displayed to the display module.

[0137] It should be noted that the above display driver chip may further include a static memory (i.e., Figure 2 SRAM in

[0138] Figure 2 ). The display driver chip may extract the first compensation data and the second compensation data from the non-volatile memory to the static memory, and then extract the first compensation data and the second compensation data from the static memory for compensation.

[0139] Further, the brightness determination unit is further configured to obtain device data of the XR device, where the device data includes at least one of display brightness data, temperature data, and frequency data;

[0140] The compensation unit is further configured to optically compensate the image to be displayed by using the device data, the module compensation data, and the system compensation data.

[0141] Figure 2 It should be understood that the above brightness determination unit may further obtain at least one of the display brightness data (i.e., Figure 2 DVB in Figure 2 ), temperature data (i.e., Temp in

[0142] ), and frequency data (i.e., Figure 2 FR in ) of the XR device, and transmit them to the compensation unit through the calculation unit.

[0143] Further, the above-mentioned processor is further configured to fit the brightness data to obtain an initial gamma curve; fit the initial gamma curve according to a preset fitting range to obtain a target gamma curve; and determine first compensation data of the display module based on the initial gamma curve and the target gamma curve.

[0144] Further, the above-mentioned display driving chip is further configured to verify the first compensation data and the second compensation data according to a preset verification method; and when the verification is successful, perform the operation of compensating the image to be displayed based on the first compensation data and the second compensation data.

[0145] Other embodiments or specific implementation manners of the XR device of the present invention may refer to the above-mentioned method embodiments, which will not be elaborated herein.

[0146] Refer to Figure 6 , Figure 6 which is a structural block diagram of the first embodiment of the display compensation device of the present invention.

[0147] As Figure 6 shown, the display compensation device proposed in the embodiment of the present invention includes: a data acquisition module 601, a compensation determination module 602, and a display compensation module 603;

[0148] The data acquisition module 601 is configured to acquire brightness data corresponding to the display module and optical data corresponding to the optical system;

[0149] The compensation determination module 602 is configured to determine first compensation data of the display module according to the brightness data, and determine second compensation data of the optical system according to the optical data;

[0150] The display compensation module 603 is configured to compensate the image to be displayed based on the first compensation data and the second compensation data.

[0151] In this embodiment, the display interface of the XR device can be photographed by a preset module photographing device in advance at each preset gray level to obtain the brightness data corresponding to each sub-pixel at each preset gray level, and the initial compensation amount is determined based on the brightness data to compensate the image to be displayed; then the display interface is photographed by a preset system photographing device, and the obtained photographed interface is divided, and the optical data corresponding to each divided interface is determined based on each divided interface; the first compensation data for the display module is determined according to the brightness data, and the second compensation data for the diagnostic optical system is determined according to the optical data, and the image to be displayed is compensated and then displayed through the first compensation data and the second compensation data. Compared with the existing method that only improves the display module, this embodiment can take into account the brightness and chromaticity attenuation introduced by the optical engine through the second compensation data, improve the display module through the first compensation data, and improve the optical system through the second compensation data, thus improving the final display effect of the image to be displayed on the XR device and enhancing the user experience.

[0152] As an implementation manner, the data acquisition module 601 is further configured to photograph the display interface of the XR device by a preset module photographing device to obtain the brightness data corresponding to the display module; photograph the display interface by a preset system photographing device to obtain the optical data corresponding to the optical system.

[0153] As an implementation manner, the data acquisition module 601 is further configured to photograph the display interface by a preset system photographing device to obtain a photographed interface; divide the photographed interface according to a preset division area to obtain divided interfaces; determine the optical data corresponding to the optical system based on each divided interface.

[0154] Based on the first embodiment of the display compensation device of the present invention, a second embodiment of the display compensation device of the present invention is proposed.

[0155] In this embodiment, the compensation determination module 602 is further configured to determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed; select the module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each current gray level; select the system compensation data corresponding to each sub-pixel to be compensated from the second compensation data based on each current gray level; compensate the image to be displayed through the module compensation data and the system compensation data.

[0156] As an implementation manner, the compensation determination module 602 is further configured to obtain the device data of the XR device, where the device data includes at least one of display brightness data, temperature data, and frequency data; compensate the image to be displayed through the device data, the module compensation data, and the system compensation data.

[0157] As an implementation manner, the compensation determination module 602 is further configured to fit the luminance data to obtain an initial gamma curve; fit the initial gamma curve according to a preset fitting range to obtain a target gamma curve; and determine first compensation data of the display module based on the initial gamma curve and the target gamma curve.

[0158] As an implementation manner, the display compensation module 603 is further configured to verify the first compensation data and the second compensation data according to a preset verification method; and when the verification is successful, perform the operation of compensating the image to be displayed based on the first compensation data and the second compensation data.

[0159] Other embodiments or specific implementation manners of the display compensation device of the present invention may refer to the above method embodiments, and details are not described herein again.

[0160] It should be noted that, in this article, the terms "include", "comprise" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or system including a series of elements includes not only those elements but also other elements not expressly listed, or further includes elements inherent to such process, method, article or system. Without further limitation, an element defined by the phrase "including a..." does not exclude the presence of additional identical elements in the process, method, article or system including the element.

[0161] The serial numbers of the above embodiments of the present invention are only for description and do not represent the merits of the embodiments.

[0162] Through the description of the above implementation manners, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation manner. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as a read-only memory / random access memory, magnetic disk, optical disk), and includes several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0163] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the specification and drawings of the present invention, or directly or indirectly applied to other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A display compensation method, characterized in that, The method is applied to an XR device with an optical system and a display module, and the method includes the following steps: Obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system; Determine the first compensation data of the display module according to the brightness data, and determine the second compensation data of the optical system according to the optical data; Compensate the image to be displayed based on the first compensation data and the second compensation data.

2. The display compensation method according to claim 1, characterized in that, The step of compensating the image to be displayed based on the first compensation data and the second compensation data includes: Determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed; Select the module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels; Select the system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels; Compensate the image to be displayed by the module compensation data and the system compensation data.

3. The display compensation method according to claim 2, characterized in that, The step of determining the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed further includes: Obtain the device data of the XR device, where the device data includes at least one of display brightness data, temperature data, and frequency data; Compensate the image to be displayed by the device data, the module compensation data, and the system compensation data.

4. The display compensation method according to claim 1, characterized in that, The step of obtaining the brightness data corresponding to the display module and the optical data corresponding to the optical system includes: Shoot the display interface of the XR device through a preset module shooting device to obtain the brightness data corresponding to the display module; Based on a preset system shooting device, shoot the display interface to obtain the optical data corresponding to the optical system.

5. The display compensation method according to claim 4, characterized in that, The step of obtaining the optical data corresponding to the optical system by shooting the display interface based on a preset system shooting device includes: Based on a preset system shooting device, shoot the display interface to obtain a shooting interface; Divide the shooting interface according to a preset divided area to obtain a divided interface; Determine the optical data corresponding to the optical system based on each of the divided interfaces.

6. The display compensation method according to claim 4, characterized in that, The step of determining the first compensation data of the display module according to the brightness data includes: Perform fitting on the brightness data to obtain an initial gamma curve; Perform fitting on the initial gamma curve according to a preset fitting range to obtain a target gamma curve; Determine the first compensation data of the display module based on the initial gamma curve and the target gamma curve.

7. The display compensation method according to any one of claims 1 to 6, characterized in that, Before the step of compensating the image to be displayed based on the first compensation data and the second compensation data, it further includes: Verify the first compensation data and the second compensation data according to a preset verification method; When the verification is successful, execute the step of compensating the image to be displayed based on the first compensation data and the second compensation data.

8. A display compensation device, characterized in that, The display compensation device includes: a data acquisition module, a compensation determination module, and a display compensation module; The data acquisition module is used to obtain the brightness data corresponding to the display module and the optical data corresponding to the optical system; The compensation determination module is configured to determine first compensation data of the display module according to the luminance data, and determine second compensation data of the optical system according to the optical data; The display compensation module is configured to compensate the image to be displayed based on the first compensation data and the second compensation data.

9. An XR device, characterized in that, The XR device includes: an optical system, a display module, a processor, and a display driver chip; Wherein, the display driver chip is respectively connected to the processor and the display module; The processor is configured to obtain luminance data corresponding to the display module and optical data corresponding to the optical system; The processor is further configured to determine first compensation data of the display module according to the luminance data, and determine second compensation data of the optical system according to the optical data; The display driver chip is configured to perform optical compensation on the image to be displayed based on the first compensation data and the second compensation data, and transmit the compensated image to be displayed to the display module; The display module is configured to display the compensated image to be displayed through the optical system.

10. The XR device according to claim 9, wherein, The display driver chip includes: a luminance determination unit, a calculation unit, and a compensation unit; Wherein, the calculation unit is respectively connected to the luminance determination unit, the calculation unit, and the processor, and the compensation unit is connected to the display module; The luminance determination unit is configured to determine the current gray level corresponding to each sub-pixel to be compensated according to the image to be displayed; The calculation unit is configured to select module compensation data corresponding to each sub-pixel to be compensated from the first compensation data based on each of the current gray levels; The calculation unit is further configured to select system compensation data corresponding to each sub-pixel to be compensated from the second compensation data according to each of the current gray levels; The compensation unit is further configured to perform optical compensation on the image to be displayed through the module compensation data and the system compensation data, and transmit the compensated image to be displayed to the display module.

11. The XR device according to claim 10, wherein, The luminance determination unit is further configured to obtain device data of the XR device, and the device data includes at least one of display luminance data, temperature data, and frequency data; The compensation unit is further configured to perform optical compensation on the image to be displayed through the device data, the module compensation data, and the system compensation data.

Images