Display calibration method and display calibration device

Abstract

The embodiment of the invention discloses a display calibration method and a display calibration device, and relates to the field of image processing. The method is suitable for the augmented reality display device, the augmented reality display device comprises an acceleration processing unit and a display drive integration unit, and the method comprises the following steps: obtaining a to-be-processed image; performing low-frequency compensation on the to-be-processed image through the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image; performing high-frequency compensation on the low-frequency processing image through the display driving integration unit according to a preset high-frequency compensation coefficient to obtain a target image; and displaying the target image. According to the display calibration method, the calibration efficiency is higher, the image display effect after calibration is better, and the power consumption is lower.

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to a display calibration method and a display calibration device. Background Art

[0002] With the development of technology, display technology has also made great progress, and the demand for consumer electronics, including wearable electronic devices, is increasing day by day. Near-eye display is a display product that has gradually attracted people's attention in recent years. With the outbreak of the concept of the metaverse, emerging extended reality display devices such as augmented reality (AR), virtual reality (VR) and mixed reality (MR) based on near-eye display technology are increasingly appearing in industrial applications and ordinary life scenarios.

[0003] In AR and VR devices, the uniformity of display effects is very important, mainly manifested in: enhancing immersion. The core goal of AR and VR is to provide an immersive experience. The consistency of display effects can avoid visual incoherence and enhance the user's sense of immersion and reality; reducing interference: uneven display effects may cause image distortion or inconsistent colors, affecting the user's perceptual experience and the authenticity of the virtual environment; avoiding visual fatigue: uniform display effects help reduce visual fatigue and discomfort. Uneven display effects may cause the eyes to constantly adjust and adapt, increasing the burden on the eyes; maintaining image quality: in AR and VR devices, the consistency of display effects ensures that the combination of virtual objects and the real world is more accurate, avoiding unnecessary color differences or brightness differences in the image.

[0004] However, the calibration of the display effects of AR and VR devices is far from satisfactory. Compensation for flat displays cannot be directly applied to AR and VR displays. The reason is that AR and VR displays are virtual image displays, and an optical lens group (that is, an optical module) is added in front of the display of the device. As a result, when the original image enters the AR or VR device for display, the image will be very uneven due to the dark corners or vignetting of the optical system. Therefore, the calibration of AR and VR displays also needs to take this part into consideration. Therefore, when an image is input into an AR or VR device for display, the human eye will observe a large image distortion. This will also affect the quantitative evaluation of image uniformity. Summary of the invention

[0005] The embodiments of the present application provide a display calibration method, device, storage medium and electronic device, which can solve the above problems. The technical solution is as follows:

[0006] In a first aspect, an embodiment of the present application provides a display calibration method, the method being applicable to an extended reality display device, the extended reality display device comprising an acceleration processing unit and a display driver integration unit, the method comprising:

[0007] Get the image to be processed;

[0008] According to a preset low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image;

[0009] According to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on the low-frequency processed image to obtain a target image;

[0010] The target image is displayed.

[0011] In a second aspect, an embodiment of the present application provides a display calibration device, which is applicable to an extended reality display device, wherein the extended reality display device includes an acceleration processing unit and a display driver integration unit, and the device includes:

[0012] A first display calibration module, used for acquiring an image to be processed;

[0013] A second display calibration module, configured to perform low-frequency compensation on the image to be processed through the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image;

[0014] A third display calibration module, for obtaining a target image by performing high-frequency compensation on the low-frequency processed image according to a preset high-frequency compensation coefficient through the display driver integrated unit;

[0015] The fourth display calibration module is used to display the target image.

[0016] The beneficial effects brought about by the technical solutions provided by some embodiments of the present application include at least:

[0017] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0018] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 is a structural schematic diagram of an extended reality display device provided in an embodiment of the present application;

[0021] Figure 2 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0022] Figure 3A is a schematic diagram of an image to be processed provided in an embodiment of the present application;

[0023] Figure 3B is a schematic diagram of a target image provided in an embodiment of the present application;

[0024] Figure 4 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0025] Figure 5 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0026] Figure 6 is a schematic diagram of a first sample image provided in an embodiment of the present application;

[0027] Figure 7 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0028] Figure 8 is a schematic diagram of a monochrome image processed by local mean filtering provided in an embodiment of the present application;

[0029] Fig. 9 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0030] Fig.10 is a flow chart of a display calibration method provided in an embodiment of the present application;

[0031] Fig.11 is a structural schematic diagram of another display calibration device provided in an embodiment of the present application;

[0032] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0034] In the description of the present application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood in specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.

[0035] The present application is described in detail below with reference to specific embodiments.

[0036] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of this specification are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the features, information and data involved in this specification are all obtained with full authorization.

[0037] With the development of technology, display technology has also made great progress, and the demand for consumer electronics, including wearable electronic devices, is increasing day by day. Near-eye display is a display product that has gradually attracted people's attention in recent years. With the outbreak of the concept of the metaverse, emerging extended reality display devices such as augmented reality (AR), virtual reality (VR) and mixed reality (MR) based on near-eye display technology are increasingly appearing in industrial applications and ordinary life scenarios.

[0038] In AR and VR devices, the uniformity of display effects is very important, mainly manifested in: enhancing immersion. The core goal of AR and VR is to provide an immersive experience. The consistency of display effects can avoid visual incoherence and enhance the user's sense of immersion and reality; reducing interference: uneven display effects may cause image distortion or inconsistent colors, affecting the user's perceptual experience and the authenticity of the virtual environment; avoiding visual fatigue: uniform display effects help reduce visual fatigue and discomfort. Uneven display effects may cause the eyes to constantly adjust and adapt, increasing the burden on the eyes; maintaining image quality: in AR and VR devices, the consistency of display effects ensures that the combination of virtual objects and the real world is more accurate, avoiding unnecessary color differences or brightness differences in the image.

[0039] However, the calibration of the display effects for AR and VR devices is far from satisfactory. Compensation for flat displays cannot be directly applied to AR and VR displays. The reason is that AR and VR displays are virtual images, and an optical lens group (i.e., optical module) is added in front of the display of the device. As a result, when the original image enters the AR or VR device for display, the image will be very uneven due to the dark corners or vignetting of the optical system.

[0040] like Figure 1, which is a schematic diagram of the structure of an extended reality display device provided in this embodiment. An optical module 1011 is provided in the extended reality display device 101. The functions of the optical module 1011 include magnifying and focusing images, adjusting the field of view, reducing visual fatigue, and achieving stereoscopic vision. Especially for VR devices, the optical module 1011 also needs to support binocular independent imaging to achieve stereoscopic vision.

[0041] Therefore, the display calibration for AR and VR displays also needs to take this into account. When an image is input into an AR or VR device for display, the human eye will observe a large image distortion. This will also affect the quantitative evaluation of image uniformity.

[0042] In one embodiment, Figure 2 , which is a schematic diagram of a display calibration method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a display calibration device based on a von Neumann system. The method is applicable to an extended reality display device, which includes an acceleration processing unit and a display driver integration unit. The computer program can be integrated into an application or run as an independent tool application.

[0043] Specifically, the display calibration method includes:

[0044] S101: Obtain an image to be processed.

[0045] The method for the extended reality display device to obtain the image to be processed may be to collect the image and the sensor information through the image acquisition device provided by the extended reality display device, and further fuse the image and the sensor information to obtain the image to be processed. The image to be processed is used to obtain the target image after being processed by the extended reality display device, and then displayed in the form of a virtual image near the user's eye.

[0046] For example, VR devices usually have built-in high-definition cameras, which are used to capture the user's field of view information, including scenes, objects, etc. At the same time, VR devices are equipped with other sensors, such as gyroscopes, accelerometers and magnetometers, to obtain information such as the user's position, posture, acceleration and angular velocity. Furthermore, the sensor information is fused with the image captured by the camera. By fusing the image and sensor information, the VR device can more accurately construct and obtain the image to be processed for the user to experience the virtual environment.

[0047] In another embodiment, the method for the extended reality display device to obtain the image to be processed may also be to receive the image to be processed sent by other electronic devices. For example, the extended reality display device receives the image to be processed sent by other electronic devices through a communication connection with other electronic devices. In the present application, the method for the extended reality display device to obtain the image to be processed is not limited.

[0048] S102 . According to a preset low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image.

[0049] In addition to the central processing unit (CPU), the extended reality display device is also equipped with an accelerated processing unit (APU) or similar comprehensive acceleration hardware. The accelerated processing unit is used to efficiently handle complex image rendering, physical simulation, environmental interaction and other tasks. It can also be used to handle tasks such as video decoding, audio processing, image stabilization, etc., which are very important for providing an immersive XR experience.

[0050] Low-frequency compensation refers to enhancing or adjusting the low-frequency components of the image to be processed during the image processing process to improve the quality of the image to be processed. This compensation is especially important when processing scenes with a large dynamic range, because it can help improve the details and clarity of the image to be processed. The low-frequency signal is also the global signal, that is, the signal difference in the entire display screen. The accelerated processing unit APU is suitable for this kind of graphics generation calculation, and can perform low-frequency compensation on the image.

[0051] like Figure 3A , which is a schematic diagram of an image to be processed provided by an embodiment of the present application. The image to be processed 102 can be decomposed into a low-frequency part and a high-frequency part by frequency division processing, that is, including a low-frequency component and a high-frequency component. The frequency division processing of the image to be processed 102 can be implemented by a filter (such as a high-pass filter and a low-pass filter).

[0052] The low-frequency part is the part where the color changes slowly, that is, the part where the grayscale changes slowly, representing an area where the grayscale changes continuously and gradually. For the image 102 to be processed, the content within the edge is the low-frequency component, which is most of the information of the processed image 102, that is, the general appearance and content of the image 102 to be processed. Clipping generally refers to the percentage of the number of pixel saturation compensation in a certain area to the total number of pixels in the area reaching a certain ratio, so Clipping only occurs in the low-frequency part.

[0053] The high-frequency part is the area where the grayscale changes sharply. The sharper the change, the greater the grayscale difference between adjacent areas. It usually represents the edge and contour of the image 102 to be processed.

[0054] In other words, the low-frequency component corresponds to the slowly changing part of the image 102 to be processed (such as a large background area), while the high-frequency component corresponds to the rapidly changing part of the image 102 to be processed (such as edges and details).

[0055] The preset low-frequency compensation coefficient can be understood as a low-frequency compensation coefficient obtained in advance according to specific application requirements and the quality of the target image. The low-frequency compensation coefficient is set based on experimental data obtained through training, user preferences, or requirements of a specific scene. For example, in the pre-training stage, the low-frequency compensation coefficient to be trained in the acceleration processing unit is trained according to the quality difference between the image to be processed and the target image, and the low-frequency compensation coefficient is determined when the target image that meets the preset quality conditions is obtained.

[0056] Furthermore, the preset low-frequency compensation coefficient is used to adjust the low-frequency component in the image to be processed 102. This involves increasing the contrast, brightness or saturation of the low-frequency component. For example, in order to solve the problem of uneven brightness distribution of the image to be processed 102, the brightness distribution of the image to be processed 102 is adjusted according to the brightness compensation parameter included in the preset low-frequency compensation coefficient by using methods such as histogram equalization or histogram regulation.

[0057] S103 . Perform high-frequency compensation on the low-frequency processed image through the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image.

[0058] Display Driver Integrated Circuit (DDIC) is an integrated circuit used to drive and control display screens. It is mainly used in monitors, smart phones, tablet computers and other devices, responsible for converting the low-frequency compensated image signal output by the processor into an image that can be displayed on the display screen. Display driver integrated circuits are usually used to handle tasks related to display refresh rate, resolution and color depth.

[0059] The acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image. Further, the display driver integrated unit compensates for the high-frequency components in the low-frequency processed image. The purpose of high-frequency compensation is to enhance the high-frequency information in the image to be processed, that is, the details and edges of the image to be processed, so that the image to be processed looks clearer and sharper.

[0060] In this specification, the use of an accelerated processing unit for low-frequency compensation and a display driver unit for high-frequency compensation has lower power consumption than directly using a display driver integrated unit for low-frequency compensation and high-frequency compensation. This is because the original intention of the display driver integrated circuit design as a dedicated hardware is to ensure the display effect of the image, and it does not have the function of intelligently adjusting power consumption according to the content of the task. The accelerated processing unit integrates a variety of processing units (such as a central processing unit CPU and a processing unit GPU for image processing), and is designed specifically for performing complex computing tasks. Through programming, the accelerated processing unit can reasonably allocate resources when processing different image processing tasks, reduce unnecessary power consumption, and thus reduce the overall power consumption of the system.

[0061] Therefore, the acceleration processing unit is more efficient and consumes less power when processing more complex low-frequency compensation tasks than a single-function display driver integrated circuit when processing low-frequency compensation tasks. Therefore, the present application uses an acceleration processing unit to perform low-frequency compensation and performs high-frequency compensation through a display driver integrated circuit to display the image. Compared with directly using a display driver integrated circuit for low-frequency compensation and high-frequency compensation, the power consumption is lower and the calibration efficiency is higher.

[0062] Based on the above introduction to the functions of the acceleration processing unit and the display driver integrated unit, the present application can improve the quality of the calibrated image display by performing low-frequency compensation through the acceleration processing unit and high-frequency compensation through the display driver unit. This is because the processing process of high-frequency compensation for the image to be processed is simpler than the process of low-frequency compensation, does not require complex calculations, and can be completed through the display driver integrated unit. The hardware for high-frequency compensation is required to respond in real time and refresh quickly to display the image to be processed. The display driver unit is designed for high-speed data transmission and real-time display control, and can quickly respond and update the display of the image to be processed.

[0063] The low-frequency signal of the processed image involves more complex image processing algorithms, such as noise reduction, sharpening, color correction, etc. of the processed image through preset low-frequency compensation coefficients. And the low-frequency components in the image change slowly, which can allow longer processing time. Therefore, when using the acceleration processing unit to perform low-frequency compensation on the processed image, a more energy-saving resource allocation strategy can be adopted, and more accurate low-frequency compensation can be performed on the processed image, thereby improving the quality of the calibrated image display.

[0064] In this application, an accelerated processing unit is selected instead of other hardware for low-frequency compensation because most extended display devices are equipped with an accelerated processing unit, which can be used for compensation only through programming. However, other hardware installed on the extended display device does not have the image processing capability of the accelerated processing unit, and the introduction of hardware that can be used for low-frequency compensation will lead to problems such as high cost and disadvantageous promotion.

[0065] In summary, in the process of displaying images, the roles of the acceleration processing unit APU and the display driver integrated unit DDIC complement each other. The acceleration processing unit APU is responsible for graphics processing and calculation to generate images, while the display driver integrated unit DDIC is responsible for the specific implementation of transmitting these images to the display device and is responsible for ensuring the display effect and stability of the images. Therefore, they are both indispensable in electronic devices and each plays a key role.

[0066] The preset high-frequency compensation coefficient can be understood as a high-frequency compensation coefficient obtained in advance according to specific application requirements and the quality of the target image. The low-frequency compensation coefficient is set based on experimental data obtained through training, user preferences, or requirements of a specific scene. For example, in the pre-training stage, the high-frequency compensation coefficient to be trained in the display driver integrated unit is trained according to the quality difference between the image to be processed and the target image, and the high-frequency compensation coefficient is determined when the target image that meets the preset quality conditions is obtained.

[0067] In this embodiment, a high-pass filter can be used to perform high-frequency compensation on the low-frequency processed image based on a preset high-frequency compensation coefficient to enhance the high-frequency information corresponding to multiple high-frequency components in the low-frequency compensated image. There are many specific implementations of the high-pass filter, such as an ideal high-pass filter, a Butterworth high-pass filter, a Gaussian high-pass filter, etc. For example, the high-frequency compensation coefficient may include multiple high-frequency enhanced gain factors to control the intensity of the high-frequency compensation. The gain factor determines the degree to which a certain high-frequency component is amplified.

[0068] S104: Display the target image.

[0069] The acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image, and the display driver integrated unit further performs high-frequency compensation on the low-frequency processed image to obtain a target image. Figure 3B As shown, after low-frequency compensation and high-frequency compensation are performed on the processed image 103, the target image 103 is obtained. It can be seen that both the high-frequency component and the low-frequency component in the target image 103 are corrected. Finally, the target image is displayed through the augmented reality display device.

[0070] It is understandable that APUs are typically designed to handle specific types of image processing tasks, such as low-frequency compensation, and because the architecture and instruction set of APUs are optimized for these image processing tasks, they are able to complete their work more efficiently and with lower power consumption.

[0071] Since the display driver integrated unit is versatile, it can be responsible for other complex tasks related to the display device, such as interface, control and signal conversion. Therefore, handing over the low-frequency compensation task to the acceleration processing unit can allow the display driver integrated unit to only perform high-frequency compensation tasks, thereby improving overall efficiency and reducing power consumption.

[0072] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0073] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0074] In one embodiment, Figure 4 , which is a schematic diagram of a display calibration method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a display calibration device based on a von Neumann system. The method is applicable to an extended reality display device, which includes an acceleration processing unit and a display driver integration unit. The computer program can be integrated into an application or run as an independent tool application.

[0075] Specifically, the display calibration method includes:

[0076] S201: Acquire a sample image, and acquire brightness values ​​of a plurality of pixels included in the sample image.

[0077] The method of obtaining the sample image can be the same as the method of obtaining the image to be processed, which will not be repeated here. The sample image is composed of multiple pixels. The sample image is converted into a grayscale image, because each pixel value in the grayscale image directly corresponds to its brightness value. Further, each pixel of the sample image as a grayscale image is traversed, and the brightness value of each pixel is printed out.

[0078] S202: Perform frequency domain conversion processing on the brightness values ​​of multiple pixels included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixels included in the sample image.

[0079] In this embodiment, the sample image is subjected to frequency division processing based on the RGB color space domain to obtain high-frequency components and low-frequency components corresponding to the multiple pixels included in the sample image. Existing extended reality display devices are generally based on the RGB model, so this embodiment performs frequency division processing based on the RGB color space domain, without the need for color space conversion, which is convenient for hardware implementation, does not require additional hardware costs, is not prone to loss of color detail information, has high color accuracy, and the RGB color space is easy to understand.

[0080] In this embodiment, frequency domain conversion processing is performed on the brightness values ​​of multiple pixels included in the sample image, including Fourier transforming the sample image, thereby converting the sample image from the RGB color space domain to a frequency domain image, and further filtering the frequency domain image to obtain high-frequency components and low-frequency components corresponding to the multiple pixels included in the sample image.

[0081] Specifically, a Gaussian low-pass filter is used to filter the frequency domain image to obtain the low-frequency components corresponding to each pixel in the image to be processed, and a Gaussian high-pass filter is used to filter the frequency domain image to obtain the high-frequency components corresponding to each pixel in the image to be processed. Using a Gaussian filter for filtering can remove noise and detail information in the image to be processed, making the image to be processed smoother.

[0082] It should be noted that the frequency division processing is not limited to the RGB color space domain. For example, the sample image is first converted from the RGB color space domain to the HSV (Hue, Saturation, Value) space domain, and then further processed to obtain the low-frequency component and high-frequency component corresponding to the sample image. This method will increase the hardware cost, and the color accuracy is not as high as the RGB color space domain.

[0083] S203: Perform high-frequency compensation on the sample image according to the multiple high-frequency components corresponding to the sample image until a first sample image is obtained, and determine a high-frequency compensation coefficient

[0084] like Figure 5 As shown, a sample image 201 including a plurality of pixels is subjected to frequency domain conversion processing to obtain a sample image including a plurality of high-frequency components and a sample image including a plurality of low-frequency components. High-frequency compensation is performed on the sample image including a plurality of high-frequency components to obtain a first sample image 202, and a high-frequency compensation coefficient determined in the high-frequency compensation process is determined.

[0085] In this embodiment, the display driver integrated circuit performs high-frequency compensation on the multiple high-frequency components included in the sample image. The purpose of high-frequency compensation is to enhance the high-frequency information in the sample image, that is, the details and edge parts of the sample image, so that the first sample image 202 looks clearer and sharper. Figure 6 , which is a schematic diagram of a first sample image 202 obtained through high frequency compensation provided by this embodiment. The first sample image 202 is clearer and sharper than the sample image 201 .

[0086] S204 , performing low-frequency compensation on the sample image according to a plurality of low-frequency components corresponding to the sample image until a second sample image is obtained, and then determining a low-frequency compensation coefficient.

[0087] The sample image including multiple low-frequency components is subjected to low-frequency compensation to obtain the second sample image 203, and the low-frequency compensation coefficient required in the compensation process is determined. The low-frequency component corresponds to the slowly changing part (such as a large background area) in the sample image 201. In this embodiment, the sample image including multiple low-frequency components is subjected to low-frequency compensation by the acceleration processing unit, and the low-frequency component of the sample image 201 is enhanced or adjusted to improve the quality of the second sample image 203. This compensation is particularly important when processing scenes with a large dynamic range, because it can help improve the details and clarity of the image to be processed.

[0088] In this embodiment, a sample image including brightness values ​​corresponding to a plurality of pixel points is subjected to frequency domain conversion processing, so that high-frequency compensation and low-frequency compensation are respectively performed on the sample image as a frequency domain image to obtain a high-frequency compensation coefficient and a low-frequency compensation coefficient. The high-frequency compensation performed by the display driver integrated unit and the low-frequency compensation performed by the acceleration processing unit are performed independently to avoid interference, so that the accuracy of the high-frequency compensation coefficient and the low-frequency compensation coefficient can be improved, thereby improving the quality of the target image finally obtained.

[0089] S205: Obtain an image to be processed.

[0090] See the above S101, which will not be repeated here.

[0091] S206 , performing low-frequency compensation on the image to be processed by the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image.

[0092] See the above S102, which will not be described again here.

[0093] S207 . Perform high-frequency compensation on the low-frequency processed image through the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image.

[0094] See the above S103, which will not be described again here.

[0095] S208: Display the target image.

[0096] See the above S104, which will not be described again here.

[0097] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0098] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0099] In one embodiment, Figure 5 , which is a schematic diagram of a display calibration method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a display calibration device based on a von Neumann system. The extended reality display device includes an acceleration processing unit and a display driver integration unit. The computer program can be integrated into an application or run as an independent tool application.

[0100] Specifically, the display calibration method includes:

[0101] S301: Acquire a sample image, and acquire brightness values ​​of a plurality of pixels included in the sample image.

[0102] Refer to the above S201, which will not be repeated here.

[0103] S302: Perform frequency domain conversion processing on the brightness values ​​of multiple pixels included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixels included in the sample image.

[0104] Refer to the above S202, which will not be repeated here.

[0105] S303 , performing color extraction processing on the sample image based on the three optical primary colors to obtain three monochrome images corresponding to the sample image.

[0106] In order to perform color extraction processing on the sample image based on the three optical primary colors RGB, a monochrome image corresponding to the three channels of red, green and blue is obtained. In this embodiment, it can be implemented by image processing software or programming library (such as Python's Pillow or OpenCV), and this application does not limit the method of obtaining the three monochrome images corresponding to the sample image.

[0107] S304, performing high-frequency compensation on the monochrome image according to multiple high-frequency components corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, and determining a high-frequency compensation coefficient corresponding to the monochrome image;

[0108] The high-frequency compensation coefficients include high-frequency compensation coefficients corresponding to the three monochrome images respectively.

[0109] Specifically, the three monochrome images corresponding to the sample image include a sample image with only a red portion, a sample image with only a green portion, and a sample image with only a blue portion. When high-frequency compensation is performed on the sample image to obtain a first sample image with expected quality, the first sample image corresponds to a first sample image with only a red portion, a first sample image with only a green portion, and a first sample image with only a blue portion.

[0110] According to the high-frequency components respectively corresponding to the multiple pixels included in the sample image of only the red part, when the sample image of only the red part is subjected to high-frequency compensation until the first sample image of only the red part is obtained, the high-frequency compensation coefficient required in the high-frequency compensation process is determined, that is, the high-frequency compensation coefficient corresponding to the red image. According to the above steps, the high-frequency compensation coefficient corresponding to the green image and the high-frequency compensation coefficient corresponding to the blue image are obtained.

[0111] The high-frequency compensation coefficient set composed of the high-frequency compensation coefficients corresponding to the three monochrome images is the high-frequency compensation coefficient when high-frequency compensation is performed on the image to be processed. In this embodiment, by obtaining the high-frequency compensation coefficients corresponding to the three monochrome images in the RGB color space, the accuracy of the high-frequency compensation coefficients ultimately used for high-frequency compensation of the image to be processed can be improved, thereby improving the quality of the target image finally obtained.

[0112] In one embodiment, the specific steps of determining the high-frequency compensation coefficient of each monochrome image according to the three monochrome images corresponding to the sample images include: performing grayscale processing on the monochrome image at least twice to obtain at least two grayscale images corresponding to the monochrome image; performing local mean filtering on the monochrome image to obtain an actual brightness image corresponding to the monochrome image; determining a gamma curve between the at least two grayscale images and the actual brightness image, and an initial high-frequency compensation coefficient for high-frequency compensation of the monochrome image, according to multiple high-frequency components corresponding to the at least two grayscale images; performing high-frequency compensation on the monochrome image according to the initial high-frequency compensation coefficient corresponding to the monochrome image, and adjusting the initial high-frequency compensation coefficient corresponding to the monochrome image, until a first sample image corresponding to the monochrome image is obtained, and then determining the high-frequency compensation coefficient corresponding to the monochrome image.

[0113] The monochrome image is gray-scaled at least twice according to at least two grayscale thresholds to obtain at least two grayscale images corresponding to the monochrome image. For example, the preset grayscale threshold is the maximum fidelity point (Maximum Fidelity, MFP) of the monochrome image, and the maximum fidelity point MFP is the maximum grayscale value of the extended reality display device pushed forward by several grayscale points. Exemplarily, the maximum grayscale value of the extended reality display device is 255 grayscales, and the preset grayscale thresholds are 180 grayscales, 150 grayscales, 120 grayscales, and 90 grayscales, thereby obtaining 4 grayscale images corresponding to the monochrome image.

[0114] Furthermore, the monochrome image is processed by local mean filtering to obtain the actual brightness image corresponding to the monochrome image. Figure 8 As shown in the figure, a monochrome image 301 is being processed by local mean filtering provided by this embodiment. Each square in the figure represents a pixel of a 3X3 module. Therefore, the brightness values ​​of multiple pixels included in the monochrome image 301 after mean filtering are equal to the average of the surrounding 3x3 areas. For example, the value of pixel No. 5 is equal to the average of the brightness values ​​of pixels No. 1-9. After the monochrome image 301 is processed by the above mean filtering, the actual brightness image corresponding to the monochrome image 301 is obtained.

[0115] Further, according to the gamma curves between the above four grayscale images and the actual brightness image, and according to the gamma curves and the discrete grayscales, high-frequency compensation coefficients corresponding to the multiple grayscale images are generated. It can be understood that the above is the generation of high-frequency compensation coefficients corresponding to a certain monochrome image. In this embodiment, since the monochrome images include 3 images, the above steps are repeated at least 3 times to obtain the high-frequency compensation coefficients corresponding to each monochrome image, thereby obtaining the high-frequency compensation coefficients used for high-frequency compensation of the image to be processed.

[0116] For example, a smooth transition method is used to perform multiple high-frequency compensation processes on grayscale images with high-frequency components greater than or equal to 150 grayscales, and a linear compensation method is used to perform multiple high-frequency compensation processes on grayscale images with high-frequency components less than 150 grayscales, so as to adjust the initial high-frequency compensation coefficient corresponding to the monochrome image. When a first sample image corresponding to a monochrome image with expected quality is obtained, the initial high-frequency compensation coefficient is adjusted to the high-frequency compensation coefficient.

[0117] In one embodiment, after obtaining the high-frequency compensation coefficient, the display driver integrated unit is driven to perform high-frequency compensation on another sample image to obtain a target sample image corresponding to the sample image. Further, the target sample image is subjected to Fourier transform to determine whether the performance of the high-frequency component in the spectrum diagram corresponding to the target sample image is weak, thereby determining whether the compensation and repair effect of the multiple high-frequency components corresponding to the sample image meets expectations. When it is determined that the compensation and repair effect of the multiple high-frequency components corresponding to the sample image does not meet expectations, the multiple parameter values ​​included in the high-frequency compensation coefficient can be adjusted until the high-frequency compensation coefficient for high-frequency compensation of the image to be processed is finally obtained. In this embodiment, by adjusting the high-frequency compensation coefficient multiple times, the display effect of the target image obtained according to the high-frequency compensation coefficient in the actual production process can be improved.

[0118] S305 , performing low-frequency compensation on the sample image according to multiple low-frequency components corresponding to the sample image until a second sample image is obtained, and then determining a low-frequency compensation coefficient.

[0119] See the above S204, which will not be described again here.

[0120] S306: Obtain an image to be processed.

[0121] See the above S101, which will not be repeated here.

[0122] S307 , performing low-frequency compensation on the image to be processed by the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image.

[0123] See the above S102, which will not be described again here.

[0124] S308 . Perform high-frequency compensation on the low-frequency processed image through the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image.

[0125] See the above S103, which will not be described again here.

[0126] S309: Display the target image.

[0127] See the above S104, which will not be described again here.

[0128] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0129] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0130] In one embodiment, Figure 7 , which is a schematic diagram of a display calibration method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a display calibration device based on a von Neumann system. The extended reality display device includes an acceleration processing unit and a display driver integration unit. The computer program can be integrated into an application or run as an independent tool application.

[0131] Specifically, the display calibration method includes:

[0132] S401: Acquire a sample image, and acquire brightness values ​​of a plurality of pixels included in the sample image.

[0133] Refer to the above S201, which will not be repeated here.

[0134] S402: Perform frequency domain conversion processing on the brightness values ​​of multiple pixels included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixels included in the sample image.

[0135] Refer to the above S202, which will not be repeated here.

[0136] S403 , performing high-frequency compensation on the sample image according to a plurality of high-frequency components corresponding to the sample image until a first sample image is obtained, and then determining a high-frequency compensation coefficient.

[0137] Refer to the above S203 and will not be repeated here.

[0138] S404: Perform reduction processing on the sample image to obtain a reduced sample image.

[0139] The sample image is binned or scaled. For example, the sample image includes a plurality of pixels, and according to the reduction parameters such as 2x2, 3x3, or 4x4, the plurality of pixels are combined and the average is taken as 1 pixel, thereby obtaining a reduced sample image. In other words, the number of pixels included in the reduced sample image is less than the number of pixels included in the sample image. In this embodiment, by reducing the sample image and obtaining the low-frequency compensation coefficient according to the reduced sample image, the efficiency of the acceleration processing unit in performing low-frequency compensation on the reduced sample image can be improved, and the amount of calculation can be effectively reduced.

[0140] S405 , performing low-frequency compensation on the reduced sample image according to multiple low-frequency components corresponding to the reduced sample image until a second sample image is obtained, and then determining a low-frequency compensation coefficient.

[0141] Low-frequency compensation is performed on a reduced sample image including a plurality of low-frequency components to obtain a second sample image, and a low-frequency compensation coefficient required in the compensation process is determined. The low-frequency component corresponds to a slowly changing portion (such as a large background area) in the reduced sample image. In this embodiment, low-frequency compensation is performed on the reduced sample image including a plurality of low-frequency components by an acceleration processing unit, and the low-frequency components of the sample image are enhanced or adjusted to improve the quality of the second sample image. This compensation is particularly important when processing scenes with a large dynamic range, because it can help improve the details and clarity of the image to be processed.

[0142] In one embodiment, the specific steps of performing low-frequency compensation on the reduced sample image include: normalizing the reduced sample image according to the low-frequency components of the pixel points located at the center of the reduced sample image to obtain low-frequency compensation parameters corresponding to the multiple pixel points included in the reduced sample image; and obtaining low-frequency compensation parameters according to the low-frequency compensation parameters corresponding to the multiple pixel points included in the reduced sample image.

[0143] The low-frequency component of the central pixel of the reduced sample image is extracted, and this low-frequency component represents the low-frequency characteristics of the central area of ​​the reduced sample image. The reduced sample image is further normalized according to the low-frequency component of the central pixel, and each pixel included in the reduced sample image is calculated and compared with the central pixel to obtain the low-frequency compensation parameters corresponding to each pixel. It can be understood that if the sample image is reduced using 2x2 parameters during the reduction process, the same low-frequency compensation coefficient is used for each 2x2 pixel in the sample image.

[0144] S406: Obtain an image to be processed.

[0145] See the above S101, which will not be repeated here.

[0146] S407 . According to a preset low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image.

[0147] See the above S102, which will not be described again here.

[0148] S408 . Perform high-frequency compensation on the low-frequency processed image through the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image.

[0149] See the above S103, which will not be described again here.

[0150] S409: Display the target image.

[0151] See the above S104, which will not be described again here.

[0152] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0153] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0154] In one embodiment, Fig.10 , which is a schematic diagram of a display calibration method provided by an embodiment of the present application, which can be implemented by a computer program and can be run on a display calibration device based on a von Neumann system. The extended reality display device includes an acceleration processing unit and a display driver integration unit. The computer program can be integrated into an application or run as an independent tool application.

[0155] Specifically, the display calibration method includes:

[0156] S501: Obtain an image to be processed.

[0157] See S101 above, which will not be repeated here.

[0158] S502 : Perform reduction processing on the image to be processed according to the reduction parameter associated with the preset low-frequency compensation coefficient to obtain a reduced image to be processed.

[0159] When obtaining the low-frequency compensation coefficient, the sample image is binned or scaled. For example, the sample image includes multiple pixels, and according to the reduction parameter of 2x2, the multiple pixels are merged and the average is taken as 1 pixel, thereby obtaining a reduced sample image. Therefore, the preset low-frequency compensation coefficient is associated with the reduction parameter. When low-frequency compensation is performed on the image to be processed during the production process, the image to be processed is reduced according to the reduction parameter. For example, in this embodiment, every 4 pixels in the image to be processed are merged into 1 pixel according to the reduction parameter of 2x2, thereby obtaining a reduced image to be processed.

[0160] S503 , performing low-frequency compensation on the reduced image to be processed by an acceleration processing unit according to the low-frequency compensation coefficient to obtain a low-frequency processed image.

[0161] The low-frequency compensation coefficient is associated with the reduction parameter. For example, when the image to be processed is reduced using the 2x2 parameter during the reduction process, the same low-frequency compensation coefficient is used for each 2x2 pixel point in the image to be processed. Based on the above principle, low-frequency compensation is performed on the reduced image to be processed. In this embodiment, low-frequency compensation is performed after the image to be processed is reduced, which can improve the efficiency of the acceleration processing unit in performing low-frequency compensation on the image to be processed and effectively reduce the amount of calculation.

[0162] S504 , according to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on a plurality of pixel points included in the low-frequency processed image to obtain a target image.

[0163] In this embodiment, the image to be processed is reduced according to the reduction parameter, and low-frequency compensation is performed on multiple pixels included in the reduced image to be processed, that is, low-frequency compensation is performed in a module composed of multiple pixels in the image to be processed by using the same low-frequency compensation coefficient, thereby obtaining a low-frequency processed image. According to the multiple pixels included in the low-frequency processed image, high-frequency compensation is performed by using the high-frequency compensation coefficient and the display driver integrated circuit.

[0164] The high-frequency compensation coefficient is composed of the high-frequency compensation coefficients corresponding to the three monochrome images under the three optical primary colors. Therefore, when high-frequency compensation is performed on the low-frequency processed image, high-frequency compensation is performed on the red part, blue part and green part corresponding to each pixel point in the high-frequency compensation coefficient, thereby improving the accuracy of high-frequency compensation.

[0165] S505: Display the target image.

[0166] See the above S104, which will not be repeated here.

[0167] In one embodiment, a target image is photographed by a photographic device to obtain a captured image corresponding to the target image; based on the display effect of the captured image, it is determined whether the low-frequency compensation and high-frequency compensation of the target image meet expectations; when it is determined that the low-frequency compensation and / or high-frequency compensation of the target image do not meet expectations, the high-frequency compensation coefficient and / or the low-frequency compensation coefficient are adjusted to obtain an adjusted high-frequency compensation coefficient and / or an adjusted low-frequency compensation coefficient; based on the adjusted high-frequency compensation coefficient and / or the adjusted low-frequency compensation coefficient, high-frequency compensation and / or low-frequency compensation are performed on the target image through a display driver integrated unit to obtain an adjusted target image; and the adjusted target image is displayed.

[0168] The photographic device can be understood as a device that can photograph the target image displayed as a virtual image by the augmented reality display device, and is used to obtain a photographed image corresponding to the target image after photographing the target image. By performing Fourier transform on the photographed sample image, it is determined whether the performance of the high-frequency component and the low-frequency component in the spectrum diagram corresponding to the photographed image meets expectations. For example, the image to be processed is photographed by a photographic device to obtain a photographed image to be processed, and the photographed image to be processed and the photographed image corresponding to the target image are compared, and the multiple high-frequency components and the multiple low-frequency components corresponding to the two images are compared, so as to determine whether the compensation and restoration effect of the target image meets expectations.

[0169] When it is determined that the low-frequency compensation of the target image does not meet expectations, the low-frequency compensation coefficient is adjusted to obtain an adjusted low-frequency compensation coefficient, and the target image is subjected to low-frequency compensation through the display driver integrated unit according to the adjusted low-frequency compensation coefficient to obtain an adjusted target image. Alternatively, when it is determined that the high-frequency compensation of the target image does not meet expectations, the high-frequency compensation coefficient is adjusted to obtain an adjusted high-frequency compensation coefficient, and the target image is subjected to high-frequency compensation through the display driver integrated unit according to the adjusted high-frequency compensation coefficient to obtain an adjusted target image. The adjusted target image is displayed through an extended reality device, and the display effect of the adjusted target image is clearer and closer to reality than the display effect of the target image.

[0170] In this embodiment, the image captured by the photographic device is used to determine whether the display adjustment effect of the target image reaches the expected value, thereby quantifying the display adjustment process of the target image. Compared with visual adjustment, the method of shooting by the photographic device can effectively improve the accuracy of high-frequency compensation and low-frequency compensation for the image to be processed.

[0171] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0172] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0173] The following are device embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0174] See also Fig.11 , which shows a schematic diagram of the structure of a display calibration device provided by an exemplary embodiment of the present application. The display calibration device can be implemented as all or part of the device through software, hardware, or a combination of both. The extended reality display device includes an acceleration processing unit and a display driver integration unit. The display calibration device includes a first display calibration module 601, a first display calibration module 602, a first display calibration module 603, and a first display calibration module 604.

[0175] A first display calibration module 601, used to obtain an image to be processed;

[0176] A second display calibration module 602, configured to perform low-frequency compensation on the image to be processed through the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image;

[0177] A third display calibration module 603, for obtaining a target image by performing high-frequency compensation on the low-frequency processed image according to a preset high-frequency compensation coefficient through the display driver integrated unit;

[0178] The fourth display calibration module 604 is configured to display the target image.

[0179] In one embodiment, the display calibration device further includes:

[0180] A first sample calibration module, used to obtain a sample image and obtain brightness values ​​of a plurality of pixel points included in the sample image;

[0181] A second sample calibration module is used to perform frequency domain conversion processing on the brightness values ​​of multiple pixels included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixels included in the sample image;

[0182] A third sample calibration module, configured to perform high-frequency compensation on the sample image according to a plurality of high-frequency components corresponding to the sample image until a first sample image is obtained, and determine the high-frequency compensation coefficient;

[0183] The fourth sample calibration module is used to perform low-frequency compensation on the sample image according to a plurality of low-frequency components corresponding to the sample image until a second sample image is obtained, and then determine the low-frequency compensation coefficient.

[0184] In one embodiment, the third sample calibration module comprises:

[0185] A color extraction unit, configured to perform color extraction processing on the sample image based on three optical primary colors to obtain three monochrome images corresponding to the sample image;

[0186] A monochrome compensation unit is used to perform high-frequency compensation on the monochrome image according to multiple high-frequency components corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, and then determine the high-frequency compensation coefficient corresponding to the monochrome image; wherein the high-frequency compensation coefficient includes high-frequency compensation coefficients corresponding to the three monochrome images respectively.

[0187] In one embodiment, the monochrome compensation unit comprises:

[0188] A first compensation subunit, configured to perform grayscale processing on the monochrome image at least twice to obtain at least two grayscale images corresponding to the monochrome image;

[0189] A second compensation subunit is used to perform local mean filtering on the monochrome image to obtain an actual brightness image corresponding to the monochrome image;

[0190] A third compensation subunit is used to determine the gamma curves between the at least two grayscale images and the actual brightness image, and an initial high-frequency compensation coefficient for high-frequency compensation of the monochrome image according to the multiple high-frequency components respectively corresponding to the at least two grayscale images;

[0191] The fourth compensation subunit is used to perform high-frequency compensation on the monochrome image according to the initial high-frequency compensation coefficient corresponding to the monochrome image, and adjust the initial high-frequency compensation coefficient corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, and then determine the high-frequency compensation coefficient corresponding to the monochrome image.

[0192] In one embodiment, the fourth sample calibration module comprises:

[0193] An image reduction unit, used for reducing the sample image to obtain a reduced sample image;

[0194] The reduction compensation unit is used to perform low-frequency compensation on the reduced sample image according to a plurality of low-frequency components corresponding to the reduced sample image until a second sample image is obtained, and then determine the low-frequency compensation coefficient.

[0195] In one embodiment, the shrinkage compensation unit includes:

[0196] a fifth compensation subunit, configured to perform normalization processing on the reduced sample image according to a low-frequency component of a pixel located at the center of the reduced sample image, and obtain low-frequency compensation parameters respectively corresponding to a plurality of pixel points included in the reduced sample image;

[0197] The sixth compensation subunit is used to obtain the low-frequency compensation parameter according to the low-frequency compensation parameters respectively corresponding to the multiple pixel points included in the reduced sample image.

[0198] In one embodiment, the second display calibration module 602 includes:

[0199] A first display calibration unit, configured to perform a reduction process on the image to be processed according to a reduction parameter associated with a preset low-frequency compensation coefficient to obtain a reduced image to be processed;

[0200] The second display calibration unit is used to perform low-frequency compensation on the reduced image to be processed through the acceleration processing unit according to the low-frequency compensation coefficient to obtain a low-frequency processed image.

[0201] In one embodiment, the second display calibration module 603 includes:

[0202] The third display calibration unit is used to perform high-frequency compensation on a plurality of pixel points included in the low-frequency processed image through the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image.

[0203] In one embodiment, the display calibration device further includes:

[0204] a calibration and adjustment module, configured to photograph the target image by a photographic device to obtain a photographed image corresponding to the target image;

[0205] A second calibration adjustment module, used to determine whether the low-frequency compensation and high-frequency compensation of the target image meet expectations according to the display effect of the captured image;

[0206] A third calibration adjustment module is used to adjust the high frequency compensation coefficient and / or the low frequency compensation coefficient when it is determined that the low frequency compensation and / or the high frequency compensation of the target image does not meet the expectation, so as to obtain an adjusted high frequency compensation coefficient and / or an adjusted low frequency compensation coefficient;

[0207] a fourth calibration adjustment module, configured to perform high frequency compensation and / or low frequency compensation on the target image through the display driver integrated unit according to the adjusted high frequency compensation coefficient and / or the adjusted low frequency compensation coefficient, so as to obtain an adjusted target image;

[0208] The fifth calibration adjustment module is used to display the adjustment target image.

[0209] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0210] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0211] It should be noted that the display calibration device provided in the above embodiment only uses the division of the above functional modules as an example when executing the display calibration method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display calibration device provided in the above embodiment and the display calibration method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0212] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0213] The present application also provides a computer storage medium, which can store multiple instructions, and the instructions are suitable for being loaded and executed by a processor as described above. Figure 1 - Fig.10 The display calibration method of the embodiment shown in the figure can be specifically executed by referring to Figure 1 - Fig.10 The specific description of the illustrated embodiment will not be repeated here.

[0214] The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor as described above. Figure 1 - Fig.10 The display calibration method of the embodiment shown in the figure can be specifically executed by referring to Figure 1 - Fig.10 The specific description of the illustrated embodiment will not be repeated here.

[0215] See also Fig.12 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.12 As shown, the electronic device 700 may include: at least one processor 701 , at least one network interface 704 , a user interface 703 , a memory 705 , at least one communication bus 702 , an acceleration processing unit 706 and a display driver integration unit 707 .

[0216] The communication bus 702 is used to realize the connection and communication between these components.

[0217] The user interface 703 may include a display screen (Display) and a camera (Camera), and the optional user interface 703 may also include a standard wired interface and a wireless interface.

[0218] The network interface 704 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0219] Among them, the processor 701 may include one or more processing cores. The processor 701 uses various interfaces and lines to connect the various parts of the entire server 700, and executes the instructions, programs, code sets or instruction sets stored in the memory 705, and calls the data stored in the memory 705, and executes various functions and processes data of the server 700 through the acceleration processing unit 706 and the display driver integration unit 707. Optionally, the processor 701 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 701 can integrate one or more combinations of processors (Central Processing Unit, CPU), image processors (Graphics Processing Unit, GPU) and modems. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 701, and it can be implemented by a single chip.

[0220] Among them, the memory 705 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 705 includes a non-transitory computer-readable storage medium. The memory 705 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 705 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned method embodiments, etc.; the data storage area may store data involved in the above-mentioned method embodiments, etc. The memory 705 may optionally be at least one storage device located away from the aforementioned processor 701. As Fig.12 As shown, the memory 705 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a display calibration application.

[0221] exist Fig.12In the electronic device 700 shown, the user interface 703 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 701 can be used to call the display calibration application stored in the memory 705 and specifically execute:

[0222] Get the image to be processed;

[0223] According to a preset low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image;

[0224] According to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on the low-frequency processed image to obtain a target image;

[0225] The target image is displayed.

[0226] In one embodiment, before the processor 701 performs the low-frequency compensation on the image to be processed by the acceleration processing unit according to the preset low-frequency compensation coefficient to obtain the low-frequency processed image, it further performs:

[0227] Acquire a sample image, and acquire brightness values ​​of a plurality of pixel points included in the sample image;

[0228] Performing frequency domain conversion processing on the brightness values ​​of the multiple pixel points included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixel points included in the sample image;

[0229] According to a plurality of high-frequency components corresponding to the sample image, high-frequency compensation is performed on the sample image until a first sample image is obtained, and then the high-frequency compensation coefficient is determined;

[0230] The low-frequency compensation coefficient is determined when low-frequency compensation is performed on the sample image according to a plurality of low-frequency components corresponding to the sample image to obtain a second sample image.

[0231] In one embodiment, the processor 701 performs the high-frequency compensation on the sample image according to the multiple high-frequency components included in the sample image until the first sample image is obtained, and determines the high-frequency compensation coefficient, specifically performing:

[0232] Performing color extraction processing on the sample image based on the three optical primary colors to obtain three monochrome images corresponding to the sample image;

[0233] When high-frequency compensation is performed on the monochrome image according to multiple high-frequency components corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, a high-frequency compensation coefficient corresponding to the monochrome image is determined; wherein the high-frequency compensation coefficient includes high-frequency compensation coefficients corresponding to the three monochrome images respectively.

[0234] In one embodiment, the processor 701 performs the high-frequency compensation on the monochrome image according to the multiple high-frequency components corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, and determines the high-frequency compensation coefficient corresponding to the monochrome image, specifically performing:

[0235] Performing grayscale processing on the monochrome image at least twice to obtain at least two grayscale images corresponding to the monochrome image;

[0236] Performing local mean filtering on the monochrome image to obtain an actual brightness image corresponding to the monochrome image;

[0237] Determining, according to a plurality of high-frequency components respectively corresponding to the at least two grayscale images, gamma curves between the at least two grayscale images and the actual brightness image, and an initial high-frequency compensation coefficient for performing high-frequency compensation on the monochrome image;

[0238] High frequency compensation is performed on the monochrome image according to the initial high frequency compensation coefficient corresponding to the monochrome image, and the initial high frequency compensation coefficient corresponding to the monochrome image is adjusted until a first sample image corresponding to the monochrome image is obtained, and the high frequency compensation coefficient corresponding to the monochrome image is determined.

[0239] In one embodiment, the processor 701 performs the low-frequency compensation on the sample image according to the multiple low-frequency components corresponding to the sample image until the second sample image is obtained, and determines the low-frequency compensation coefficient, specifically performing:

[0240] Performing a reduction process on the sample image to obtain a reduced sample image;

[0241] According to a plurality of low-frequency components corresponding to the reduced sample image, when low-frequency compensation is performed on the reduced sample image to obtain a second sample image, the low-frequency compensation coefficient is determined.

[0242] In one embodiment, the processor 701 performs the low-frequency compensation on the reduced sample image according to the multiple low-frequency components included in the reduced sample image until the second sample image is obtained, and determines the low-frequency compensation coefficient, specifically performing:

[0243] According to the low-frequency components of the pixel points located at the center of the reduced sample image, the reduced sample image is normalized to obtain low-frequency compensation parameters respectively corresponding to the plurality of pixel points included in the reduced sample image;

[0244] The low-frequency compensation parameter is obtained according to the low-frequency compensation parameters respectively corresponding to a plurality of pixel points included in the reduced sample image.

[0245] In one embodiment, the processor 701 performs the low-frequency compensation on the image to be processed by the acceleration processing unit according to the preset low-frequency compensation coefficient to obtain a low-frequency processed image, specifically performing:

[0246] According to the reduction parameter associated with the preset low-frequency compensation coefficient, the image to be processed is reduced to obtain a reduced image to be processed;

[0247] According to the low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the reduced image to be processed to obtain a low-frequency processed image.

[0248] In one embodiment, the processor 701 performs the high-frequency compensation on the low-frequency processed image according to the preset high-frequency compensation coefficient through the display driver integrated unit to obtain the target image, specifically performing:

[0249] According to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on a plurality of pixel points included in the low-frequency processed image to obtain a target image.

[0250] In one embodiment, after the processor 701 executes the displaying of the target image, the processor 701 further executes:

[0251] photographing the target image by a photographing device to obtain a photographed image corresponding to the target image;

[0252] Determining whether the low-frequency compensation and the high-frequency compensation of the target image meet expectations according to the display effect of the captured image;

[0253] When it is determined that the low-frequency compensation and / or the high-frequency compensation for the target image does not meet the expectation, adjusting the high-frequency compensation coefficient and / or the low-frequency compensation coefficient to obtain an adjusted high-frequency compensation coefficient and / or an adjusted low-frequency compensation coefficient;

[0254] According to the adjusted high-frequency compensation coefficient and / or the adjusted low-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation and / or low-frequency compensation on the target image to obtain an adjusted target image;

[0255] The adjustment target image is displayed.

[0256] In the present application, an extended reality display device obtains an image to be processed, performs low-frequency compensation on the image to be processed through an acceleration processing unit in the extended reality display device according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image, and further performs high-frequency compensation on the low-frequency processed image through a display driver integrated unit in the extended reality display device according to a preset high-frequency compensation coefficient to obtain a target image, and displays the target image on a display device of the extended reality display device.

[0257] In other words, the present application targets the low-frequency non-uniformity and high-frequency non-uniformity that occur when the image to be processed is displayed on an extended reality device. The application uses an acceleration processing unit to perform low-frequency compensation according to a low-frequency compensation coefficient. After the low-frequency compensation is completed for the image to be processed, the display driver integrated unit performs high-frequency compensation on the image to be processed that only includes high-frequency components according to high-frequency compensation parameters to obtain the final target image for display. The present application simultaneously solves the problems of low-frequency non-uniformity and high-frequency non-uniformity of image display. Compared with directly using the display driver integrated unit to perform high-frequency compensation and low-frequency compensation for the image to be processed, the display calibration method of the present application has higher calibration efficiency, better image display effect after calibration, and lower power consumption.

[0258] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0259] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0260] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A display calibration method, characterized in that: The method is applicable to an extended reality display device, wherein the extended reality display device includes an acceleration processing unit and a display driver integration unit, and the method includes: Get the image to be processed; According to a preset low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the image to be processed to obtain a low-frequency processed image; According to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on the low-frequency processed image to obtain a target image; The target image is displayed.

2. The display calibration method according to claim 1, characterized in that: Before the low-frequency compensation is performed on the image to be processed by the acceleration processing unit according to the preset low-frequency compensation coefficient to obtain the low-frequency processed image, the method further includes: Acquire a sample image, and acquire brightness values ​​of a plurality of pixel points included in the sample image; Performing frequency domain conversion processing on the brightness values ​​of the multiple pixel points included in the sample image to obtain high-frequency components and low-frequency components respectively corresponding to the multiple pixel points included in the sample image; According to a plurality of high-frequency components corresponding to the sample image, high-frequency compensation is performed on the sample image until a first sample image is obtained, and then the high-frequency compensation coefficient is determined; The low-frequency compensation coefficient is determined when low-frequency compensation is performed on the sample image according to a plurality of low-frequency components corresponding to the sample image to obtain a second sample image.

3. The display calibration method according to claim 2, characterized in that: The step of performing high-frequency compensation on the sample image to obtain a first sample image according to the plurality of high-frequency components included in the sample image and determining the high-frequency compensation coefficient comprises: Performing color extraction processing on the sample image based on the three optical primary colors to obtain three monochrome images corresponding to the sample image; According to multiple high-frequency components corresponding to the monochrome image, when high-frequency compensation is performed on the monochrome image until a first sample image corresponding to the monochrome image is obtained, a high-frequency compensation coefficient corresponding to the monochrome image is determined; wherein the high-frequency compensation coefficient includes high-frequency compensation coefficients corresponding to the three monochrome images respectively.

4. The display calibration method according to claim 3, characterized in that: The step of performing high-frequency compensation on the monochrome image according to the plurality of high-frequency components corresponding to the monochrome image until a first sample image corresponding to the monochrome image is obtained, and determining a high-frequency compensation coefficient corresponding to the monochrome image, comprises: Performing grayscale processing on the monochrome image at least twice to obtain at least two grayscale images corresponding to the monochrome image; Performing local mean filtering on the monochrome image to obtain an actual brightness image corresponding to the monochrome image; Determining, according to a plurality of high-frequency components respectively corresponding to the at least two grayscale images, gamma curves between the at least two grayscale images and the actual brightness image, and an initial high-frequency compensation coefficient for high-frequency compensation of the monochrome image; High frequency compensation is performed on the monochrome image according to the initial high frequency compensation coefficient corresponding to the monochrome image, and the initial high frequency compensation coefficient corresponding to the monochrome image is adjusted until a first sample image corresponding to the monochrome image is obtained, and the high frequency compensation coefficient corresponding to the monochrome image is determined.

5. The display calibration method according to claim 2, characterized in that: The step of performing low-frequency compensation on the sample image according to the plurality of low-frequency components corresponding to the sample image until a second sample image is obtained and determining the low-frequency compensation coefficient comprises: Performing a reduction process on the sample image to obtain a reduced sample image; According to a plurality of low-frequency components corresponding to the reduced sample image, when low-frequency compensation is performed on the reduced sample image to obtain a second sample image, the low-frequency compensation coefficient is determined.

6. The display calibration method according to claim 5, characterized in that: The step of performing low-frequency compensation on the reduced sample image to obtain a second sample image according to the plurality of low-frequency components included in the reduced sample image, and determining the low-frequency compensation coefficient comprises: According to the low-frequency components of the pixel points located at the center of the reduced sample image, the reduced sample image is normalized to obtain low-frequency compensation parameters respectively corresponding to the plurality of pixel points included in the reduced sample image; The low-frequency compensation parameter is obtained according to the low-frequency compensation parameters respectively corresponding to a plurality of pixel points included in the reduced sample image.

7. The display calibration method according to claim 1, characterized in that: The step of performing low-frequency compensation on the image to be processed by the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image includes: According to the reduction parameter associated with the preset low-frequency compensation coefficient, the image to be processed is reduced to obtain a reduced image to be processed; According to the low-frequency compensation coefficient, the acceleration processing unit performs low-frequency compensation on the reduced image to be processed to obtain a low-frequency processed image.

8. The display calibration method according to claim 1, characterized in that: The step of performing high-frequency compensation on the low-frequency processed image by the display driver integrated unit according to a preset high-frequency compensation coefficient to obtain a target image includes: According to a preset high-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation on a plurality of pixel points included in the low-frequency processed image to obtain a target image.

9. The display calibration method according to claim 1, characterized in that: After displaying the target image, the method further comprises: photographing the target image by a photographing device to obtain a photographed image corresponding to the target image; Determining whether the low-frequency compensation and the high-frequency compensation of the target image meet expectations according to the display effect of the captured image; When it is determined that the low-frequency compensation and / or the high-frequency compensation for the target image does not meet the expectation, adjusting the high-frequency compensation coefficient and / or the low-frequency compensation coefficient to obtain an adjusted high-frequency compensation coefficient and / or an adjusted low-frequency compensation coefficient; According to the adjusted high-frequency compensation coefficient and / or the adjusted low-frequency compensation coefficient, the display driver integrated unit performs high-frequency compensation and / or low-frequency compensation on the target image to obtain an adjusted target image; The adjustment target image is displayed.

10. A display calibration device, characterized in that: The device is applicable to an extended reality display device, wherein the extended reality display device comprises an acceleration processing unit and a display driver integrated unit, and the device comprises: A first display calibration module, used for acquiring an image to be processed; A second display calibration module, configured to perform low-frequency compensation on the image to be processed through the acceleration processing unit according to a preset low-frequency compensation coefficient to obtain a low-frequency processed image; A third display calibration module, for obtaining a target image by performing high-frequency compensation on the low-frequency processed image according to a preset high-frequency compensation coefficient through the display driver integrated unit; The fourth display calibration module is used to display the target image.

Images