Image quality improvement method and device, near-to-eye display equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses an image quality improvement method and device, near-to-eye display equipment and a computer readable storage medium. The method comprises the following steps: determining compensation information of a first display image; and controlling the near-to-eye display device to display a second display image according to the compensation information, wherein the second display image is the first display image after the image quality is improved. According to the image quality improvement method provided by the embodiment of the invention, the display image of the first display content can be compensated according to the compensation information of the first display content, so that the image quality is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of extended reality display technology, and specifically to a method and apparatus for improving image quality, a near-eye display device, and a computer-readable storage medium. Background Art

[0002] Extended Reality (XR) technology enables users to interact with both the virtual and real worlds by overlaying virtual objects, images, videos, or other digital content onto the real world. Wearable XR near-eye display devices, such as smart glasses, are considered the optimal vehicle for the implementation of "XR + AI" technology, integrating a wide range of functional applications such as communication, music, photography, navigation, translation, and health monitoring.

[0003] In the prior art, near-eye display devices generate images through display devices. After magnification and pupil dilation by the optical system, the images can be properly magnified and focused in the human eye, thereby achieving the effect of close viewing.

[0004] However, existing near-eye display devices have uneven light transmission in their optical systems, resulting in chromatic aberration and color deviation in images entering the human eye. This is especially true for optical waveguide products, where the color deviation is even more severe due to design and process issues. Summary of the Invention

[0005] The embodiments of the present application provide a method and apparatus for improving image quality, a near-eye display device, and a computer-readable storage medium, which can compensate the display screen of the first display content according to the compensation information of the first display content to achieve image quality improvement.

[0006] In a first aspect, an embodiment of the present application provides a method for improving image quality, which is applied to a near-eye display device. The method includes:

[0007] determining compensation information for the first display image;

[0008] controlling the near-eye display device to display a second display image according to the compensation information;

[0009] The second display image is the first display image with improved image quality.

[0010] Optionally, in some embodiments of the present application, before determining the compensation information of the first display image, the method further includes:

[0011] Controlling the virtual display screen of the near-eye display device to display a compensation picture;

[0012] Determining compensation pixel information of the compensation picture;

[0013] A compensation function is determined according to the compensated pixel information, wherein the compensation function is used to calculate the compensation information.

[0014] Optionally, in some embodiments of the present application, the compensation pixel information includes information of a plurality of pixels and information of a compensation target corresponding one-to-one to each pixel in the plurality of pixels;

[0015] The determining the compensation function according to the compensated pixel information includes:

[0016] The compensation function is determined according to information of the plurality of pixels and information of the plurality of compensation targets.

[0017] Optionally, in some embodiments of the present application, determining compensation information of the first display image includes:

[0018] determining first pixel information of the first display image;

[0019] The first pixel information is compensated using the compensation function to determine the compensation information.

[0020] Optionally, in some embodiments of the present application, the first pixel information includes first brightness information and first chrominance information;

[0021] The compensating the first pixel information by using the compensation function to determine the compensation information includes:

[0022] Calculating the first brightness information using the compensation function to determine target brightness information;

[0023] Calculating the first chromaticity information using the compensation function to determine target chromaticity information;

[0024] The compensation information is determined according to the target brightness information and the target chromaticity information.

[0025] Optionally, in some embodiments of the present application, controlling the near-eye display device to display a second display image according to the compensation information includes:

[0026] Controlling the near-eye display device to display the brightness value corresponding to the target brightness information according to the compensation information,

[0027] And display the chromaticity value corresponding to the target chromaticity information.

[0028] Optionally, in some embodiments of the present application, before controlling the virtual display screen of the near-eye display device to display a compensation picture, the method further includes:

[0029] Acquire a test picture, and determine that the test picture is the compensation picture;

[0030] Alternatively, the shooting module of the near-eye display device is controlled to shoot a real picture, and the real picture is determined to be the compensation picture.

[0031] In a second aspect, an embodiment of the present application further provides an image quality enhancement device, which is applied to a near-eye display device. The device includes:

[0032] a processing module, configured to determine compensation information of the first display image;

[0033] The processing module is further configured to control the near-eye display device to display a second display image according to the compensation information;

[0034] The second display image is the first display image with improved image quality.

[0035] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0036] Controlling the virtual display screen of the near-eye display device to display a compensation picture;

[0037] Determining compensation pixel information of the compensation picture;

[0038] A compensation function is determined according to the compensated pixel information, wherein the compensation function is used to calculate the compensation information.

[0039] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0040] The compensation function is determined according to information of the plurality of pixels and information of the plurality of compensation targets.

[0041] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0042] determining first pixel information of the first display image;

[0043] The first pixel information is compensated using the compensation function to determine the compensation information.

[0044] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0045] Calculating the first brightness information using the compensation function to determine target brightness information;

[0046] Calculating the first chromaticity information using the compensation function to determine target chromaticity information;

[0047] The compensation information is determined according to the target brightness information and the target chromaticity information.

[0048] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0049] Controlling the near-eye display device to display the brightness value corresponding to the target brightness information according to the compensation information,

[0050] And display the chromaticity value corresponding to the target chromaticity information.

[0051] Optionally, in some embodiments of the present application, the processing module is further configured to:

[0052] Acquire a test picture, and determine that the test picture is the compensation picture;

[0053] Alternatively, the shooting module of the near-eye display device is controlled to shoot a real picture, and the real picture is determined to be the compensation picture.

[0054] In a third aspect, an embodiment of the present application further provides a near-eye display device, which includes a memory, a processor, and a computer program stored in the memory and runnable on the processor. When the computer program is executed by the processor, the steps in the above-mentioned image quality improvement method are implemented.

[0055] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned image quality enhancement method are implemented.

[0056] In a fifth aspect, embodiments of the present application further provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in the embodiments of the present application.

[0057] In summary, the embodiments of the present application adopt a technical solution of determining compensation information for a first display image; controlling the near-eye display device to display a second display image according to the compensation information; wherein the second display image is the first display image with improved image quality. According to the compensation information of the first display content, the display screen of the first display content is compensated, thereby achieving the technical effect of improving the image quality of the near-eye display device without adding new hardware. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in this application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0059] Figure 1 Schematic diagram of a scenario of the image quality improvement method provided in an embodiment of the present application;

[0060] Figure 2 1 is a flow chart of the method for improving image quality performed by the near-eye display device provided in an embodiment of the present application;

[0061] Figure 3 is an architecture diagram of an image quality improvement system corresponding to the image quality improvement method provided in an embodiment of the present application;

[0062] Figure 4 Schematic diagram of the principle of the image quality improvement method provided in the embodiment of the present application;

[0063] Figure 5 is a structural diagram of the image quality improvement device provided in an embodiment of the present application;

[0064] Figure 6 It is a structural schematic diagram of the near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making any creative efforts shall fall within the scope of protection of the present invention.

[0066] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the above features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0067] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to make and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art will recognize that the invention can be practiced without these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0068] First, let’s explain the terms involved in this application:

[0069] Extended Reality: Extended Reality (XR) is a technology that creates an enhanced perceptual environment by combining virtual information with real-world scenes.

[0070] Near-eye display devices: These devices are used to integrate virtual content with the real world to provide an enhanced visual experience. These devices are typically head-mounted displays (HMDs), smart glasses, or other forms of wearable devices.

[0071] The present invention provides a method and apparatus for enhancing image quality, a near-eye display device, and a computer-readable storage medium. Specifically, the present invention provides an apparatus for enhancing image quality applicable to the method for enhancing image quality, the apparatus comprising a near-eye display device and a computing processing module of the near-eye display device.

[0072] In the existing technology, with the rapid development and increasing maturity of extended reality display technology, the support of extended reality display and artificial intelligence large models has enabled near-eye display devices to have rich and colorful functional applications. More and more wearable near-eye display devices (such as VR headsets, AR glasses, etc.) have been launched on the market. One of the important functions is to generate images through display devices and enable users to interact with the virtual and real world.

[0073] However, existing near-eye display devices such as wearable smart glasses generate images through display devices. During the process of magnification and pupil expansion by the optical system, there is a problem of uneven light transmission by the optical system, resulting in color aberration and color deviation in the image entering the human eye.

[0074] Therefore, when displaying images, existing near-eye display devices cannot accurately display the color and brightness corresponding to the content to be displayed, cannot meet the needs of users, and thus affect the user experience.

[0075] The present invention provides a method and apparatus for enhancing image quality, a near-eye display device, and a computer-readable storage medium. The method employs a technical solution that determines compensation information for a first display image and controls the near-eye display device to display a second display image based on the compensation information; the second display image is the first display image after image quality enhancement.

[0076] In summary, the image quality improvement method in the embodiment of the present application can compensate the display screen of the first display content according to the compensation information of the first display content, thereby achieving the technical effect of improving the image quality of the near-eye display device without adding new hardware.

[0077] It should be noted that the order of description of the following embodiments does not limit the priority order of the embodiments.

[0078] See also Figure 1 , Figure 1This is a schematic diagram of a scenario of the image quality enhancement method provided in an embodiment of the present application. The image quality enhancement system may include a near-eye display device 100 and a computing and processing module 200. The near-eye display device 100 and the computing and processing module 200 may be connected to each other in any manner, including but not limited to signal communication via electronic circuits, communication via wireless signals, and wireless signals may be computer network communications using the TCP / IP Protocol Suite (TCP / IP) or the User Datagram Protocol (UDP). The near-eye display device 100 may receive control signals from a remote control or a control panel. The near-eye display device 100 may also receive instruction information sent by the computing and processing module 200. The near-eye display device 100 may perform corresponding operations according to the corresponding instruction information, such as the image quality enhancement method in the present application.

[0079] In the embodiment of the present application, the near-eye display device 100 includes but is not limited to a head-mounted display (HMD), smart glasses (Smart Glasses) or other forms of wearable devices.

[0080] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or less near-eye display devices as shown in, e.g. Figure 1 Only one near-eye display device is shown, and the specific details are not limited here.

[0081] In addition, if Figure 1 As shown, the computing and processing module 200 may include any hardware device capable of processing data and sending instructions, such as a CPU or single-chip microcomputer, embedded in the near-eye display device 100, and the specific details are not limited here. The computing and processing module 200 may also be any hardware device capable of processing data and sending instructions, such as a CPU or single-chip microcomputer, embedded in other wearable devices such as mobile phones, bracelets, iPads, and wristbands, and the specific details are not limited here.

[0082] It should be noted that Figure 1 The scenario diagram of the image quality enhancement system shown is only an example. The image quality enhancement system and scenario described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the image quality enhancement system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0083] For details, please refer to Figure 2 , Figure 2 : is a flow chart of the method for improving image quality performed by the near-eye display device provided in an embodiment of the present application, wherein the specific execution process of the method for improving image quality performed by the near-eye display device is as follows:

[0084] S201: Determine compensation information of a first display image.

[0085] In the embodiment of the present application, the first display content is the picture to be displayed on the virtual display screen of the near-eye display device, and the compensation information is used to adjust the brightness and chromaticity of the first display content.

[0086] In the embodiment of this application, Figure 3 As shown in the structural diagram of the near-eye display device, the near-eye display device mainly includes: a micro-projection module, an optical waveguide module, a near-eye detection module and a computing and processing module (also called a processor or processing module).

[0087] Optionally, the micro-projection module consists of a micro-display screen and a projection lens. The micro-display screen receives signals output by the main control chip in the glasses' computing and processing module, displays the corresponding information, and forms an image through the projection lens as the display input of the optical waveguide module. The micro-display screen can be a micro-LED screen, micro-OLED screen, LCOS, DLP, LBS, etc.

[0088] Optionally, the optical waveguide module receives light from the micro-projection module and redirects it to the user wearing the glasses, allowing the user to view a virtual magnified display image. The optical waveguide module can be a surface relief optical waveguide, a volume holographic optical waveguide, or an array optical waveguide.

[0089] Optionally, the near-eye detection module includes a near-eye detection camera and a near-eye detection lens. The near-eye detection camera imaging chip can be a CMOS or CCD. The near-eye detection module can also be a sensor module that detects the position, posture, and state of the user's eyes to implement functions such as eye tracking, eye position detection, and eye closure detection, thereby providing a more intelligent and interactive user experience.

[0090] In an embodiment of the present application, the near-eye detection module is mainly used before the near-eye display device is officially used. The compensation target can be calibrated based on the data collected by the near-eye detection module during the experiment to generate a more accurate compensation function, so that when the near-eye display device is officially used, a display image with better picture quality can be generated.

[0091] Optionally, the computing and processing module may include high-performance computer hardware, algorithm software, automation control software, etc.

[0092] In the embodiment of this application, Figure 4 The schematic diagram of the principle of the image quality enhancement method shown in the figure shows that in the prior art, after the AP outputs image data, it directly outputs the display image based on the grayscale value without undergoing image quality enhancement, resulting in inconsistent brightness values ​​for each pixel in the displayed image. In the embodiment of the present application, compensation data (which can be obtained through a compensation function or a compensation lookup table (LUT)) is loaded based on the grayscale value, so that the brightness and chromaticity values ​​of each pixel in the output display image (second display image) are consistent, thereby achieving the effect of image quality enhancement.

[0093] It should be noted that Figure 4 The rectangular array shown in the figure represents the pixel array of the display, G represents the grayscale value, and L represents the brightness value. Assume that the AP-side grayscale data G11 = G12 = ... = G1n = ... = Gnn. Without image quality enhancement, L11 ≠ L12 ≠ L1N ≠ ... ≠ Ln1 ≠ Lnn. After image quality enhancement through the embodiment of the present application, L′11 = L′12 = L′1n = ... = L′n1 = L′nn.

[0094] It should also be noted that in a near-eye display system, the AP refers to the computing processing module that manages and controls the entire system, that is, the computing processing module 200 mentioned above, which can also be called a control box or host. It is a central device connected to a near-eye display device (such as a head-mounted display or smart glasses) and is responsible for processing and presenting images, audio, and other data. The AP plays an important role in the near-eye display system and can provide the following functions:

[0095] Data processing: The AP receives data from computing devices (such as computers and smartphones) or the cloud and processes it to generate images and content suitable for near-eye display.

[0096] Image presentation: The AP transmits processed images and videos to the near-eye display device for real-time display in the user's field of view. It is responsible for converting high-resolution images into visual scenes and providing appropriate display controls such as brightness, contrast, and correction.

[0097] Connection Management: The AP establishes a wireless or wired connection with the near-eye display device and handles tasks such as communication protocols, data transmission, and device pairing. It is also responsible for communicating with other devices such as sensors, handles, or external controllers.

[0098] Sensor integration: The AP may integrate various sensors, such as gyroscopes, accelerometers, and magnetometers, to provide more accurate head tracking and position tracking capabilities.

[0099] User interface: The AP usually has a user interface, through which operations such as settings, parameter adjustment, and mode switching can be performed to meet user needs and preferences.

[0100] In the embodiment of the present application, after the AP determines the content to be displayed, it is also necessary to determine compensation information of the content to be displayed so that the content to be displayed can be displayed according to the compensation information.

[0101] Before determining the compensation information of the content to be displayed, optionally, the image quality improvement method provided in the embodiment of the present application also includes: controlling the virtual display screen of the near-eye display device to display the compensation picture; determining the compensation pixel information of the compensation picture; and determining the compensation function based on the compensation pixel information.

[0102] In the embodiment of the present application, the compensation function is used to calculate the compensation information.

[0103] In an embodiment of the present application, before controlling the virtual display screen of the near-eye display device to display the compensation picture, it also includes: obtaining a test picture and determining that the test picture is the compensation picture; or controlling the shooting module of the near-eye display device to shoot the real picture and determining that the real picture is the compensation picture.

[0104] Optionally, a display image on a virtual display screen of a near-eye display device is obtained, which display image may be an image used for testing or any image displayed by the near-eye display device during use; and compensation pixel information of the display image is determined based on a compensation image displayed based on the obtained image.

[0105] It should be noted that the compensation pixel information includes information of multiple pixels and information of compensation targets corresponding to each pixel in the multiple pixels. The information of the multiple pixels mainly includes: brightness information of each pixel and chromaticity information of each pixel.

[0106] Optionally, a compensation function is determined according to the brightness information and chromaticity information in the acquired compensated pixel information and a compensation target.

[0107] As an optional embodiment, a high-resolution near-eye detection system is used to capture the display image of the optical waveguide near-eye display system and collect pixel-level brightness, chromaticity and other information.

[0108] It should be noted that pixel-level brightness, chromaticity, and other information refers to the brightness and color information of each pixel in the display system. Brightness indicates the brightness or darkness of a pixel and is usually expressed as a grayscale value or luminance value, with larger values ​​indicating higher brightness and smaller values ​​indicating lower brightness. Chromaticity represents the color attribute of a pixel and is usually expressed using color models such as RGB (red, green, blue) or CMYK (cyan, magenta, yellow, black). The brightness and chromaticity information of each pixel determines the brightness and color of the image or text displayed on the display.

[0109] Optionally, the image quality improvement method provided in the embodiment of the present application further includes: determining a compensation function according to information of multiple pixel points and information of multiple compensation targets.

[0110] In an embodiment of the present application, the compensation pixel information includes information of multiple pixel points and information of a compensation target corresponding one-to-one to each pixel point in the multiple pixel points. The compensation function is determined based on the chromaticity and brightness of each pixel point in the information of the multiple pixel points, as well as the chromaticity target and brightness target of each pixel point.

[0111] Optionally, according to a display quality improvement target, ie, a compensation target, the collected pixel-level display information may be algorithmically processed to generate a compensation value for each display pixel, thereby determining a compensation function.

[0112] As an optional embodiment, the compensation values ​​of all pixels in the display area may be further processed to obtain optimized compensation values, thereby outputting a compensation lookup table LUT or compensation function of the near-eye display system.

[0113] In an embodiment of the present application, the compensation function or compensation lookup table LUT is stored in the near-eye display device. For example, the compensation data LUT or compensation function can be compressed and stored in the AP end of the smart glasses or the Flash of the display driver IC.

[0114] As an optional embodiment, the compensation function or the compensation lookup table LUT may also be stored in a device or server capable of communicating with the near-eye display device.

[0115] Optionally, the image quality improvement method provided in the embodiment of the present application further includes: determining first pixel information of the first display image; and performing compensation processing on the first pixel information using a compensation function to determine compensation information.

[0116] It should be noted that the first pixel information includes first brightness information and first chromaticity information.

[0117] In an embodiment of the present application, the first pixel information of the first display content corresponding to the first display image is determined by the AP end, mainly including the chromaticity information and brightness information of each pixel point, and the chromaticity information and brightness information of each pixel point are compensated according to the compensation function to obtain compensation information.

[0118] Optionally, the image quality improvement method provided in the embodiment of the present application also includes: calculating the first brightness information through a compensation function to determine the target brightness information; calculating the first chromaticity information through a compensation function to determine the target chromaticity information; and determining the compensation information based on the target brightness information and the target chromaticity information.

[0119] In the embodiment of the present application, the chromaticity information of each pixel is calculated according to the compensation function to obtain a target chromaticity value. At the same time, the luminance information of each pixel is calculated according to the compensation function to obtain a target luminance value. The target chromaticity value and the target luminance value are thus used as compensation information.

[0120] S202: Control the near-eye display device to display a second display image according to the compensation information.

[0121] In the embodiment of the present application, when the smart glasses are working, they decompress the data and perform real-time compensation through the main control chip SoC or the display driver IC.

[0122] Optionally, the image quality improvement method provided in the embodiment of the present application further includes: controlling the near-eye display device to display the brightness value corresponding to the target brightness information and the chromaticity value corresponding to the target chromaticity information according to the compensation information.

[0123] In an embodiment of the present application, the AP side obtains compensation information based on calculation, adjusts the display screen of the first display content to the brightness value corresponding to the target brightness information, and adjusts the display screen of the first display content to the chromaticity value corresponding to the target chromaticity information, obtains the second display image, and displays it on the virtual display screen, thereby realizing picture compensation. After the compensation is completed, the picture quality is improved.

[0124] Through the embodiments of the present application, a technical solution is adopted to determine compensation information for a first display image; control a near-eye display device to display a second display image according to the compensation information; wherein the second display image is the first display image with improved image quality. According to the compensation information of the first display content, the display screen of the first display content is compensated, thereby achieving the technical effect of improving the image quality of the near-eye display device without adding new hardware.

[0125] To facilitate better implementation of the image quality enhancement method of this application, this application also provides an image quality enhancement device based on the above image quality enhancement method. The meanings of the terms are the same as those in the above image quality enhancement method, and the specific implementation details can be referred to the description in the method embodiment.

[0126] See also Figure 5 , Figure 5 : is a structural diagram of an image quality enhancement device provided in an embodiment of the present application, wherein the image quality enhancement device 500 is applied to a near-eye display device, and can be specifically as follows:

[0127] Processing module 501, used to determine content to be displayed and determine compensation information for the content to be displayed, the compensation information being used to adjust the brightness and chromaticity of the content to be displayed;

[0128] The processing module 501 is further configured to control the near-eye display device to display the content to be displayed according to the compensation information.

[0129] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0130] Obtaining a display image on a virtual display screen of a near-eye display device;

[0131] Determining first pixel information of a display image;

[0132] A compensation function is determined according to the first pixel information, wherein the compensation function is used to calculate and obtain compensation information.

[0133] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0134] A compensation function is determined according to information of a plurality of pixels and information of a plurality of compensation targets.

[0135] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0136] Determining second pixel information of content to be displayed;

[0137] The second pixel information is compensated using a compensation function to determine compensation information.

[0138] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0139] Calculate the brightness information through the compensation function to determine the target brightness information;

[0140] Calculate the chromaticity information through the compensation function to determine the target chromaticity information;

[0141] Compensation information is determined based on the target luminance information and the target chromaticity information.

[0142] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0143] According to the compensation information, the near-eye display device is controlled to adjust the display screen of the content to be displayed to the brightness value corresponding to the target brightness information, and to adjust the display screen of the content to be displayed to the chromaticity value corresponding to the target chromaticity information.

[0144] Optionally, in some embodiments of the present application, the processing module 501 is further configured to:

[0145] Acquire a test picture, and determine that the test picture is the compensation picture;

[0146] Alternatively, the shooting module of the near-eye display device is controlled to shoot a real picture, and the real picture is determined to be the compensation picture.

[0147] In the embodiment of the present application, the processing module 501 first determines the content to be displayed and determines compensation information for the content to be displayed. The compensation information is used to adjust the brightness and chromaticity of the content to be displayed. Then, the processing module 501 controls the near-eye display device to display the content to be displayed according to the compensation information.

[0148] Among them, the embodiment of the present application determines the compensation information of the first display image; controls the near-eye display device to display the second display image according to the compensation information; wherein the second display image is a technical solution of the first display image with improved image quality, and compensates the display screen of the first display content according to the compensation information of the first display content, thereby achieving the technical effect of improving the image quality of the near-eye display device without adding new hardware.

[0149] In addition, the present application also provides a near-eye display device, such as Figure 6 As shown, it shows a schematic structural diagram of the near-eye display device involved in this application, specifically:

[0150] The near-eye display device may include components such as a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, and an input unit 604. It will be understood by those skilled in the art that Figure 6 The structure of the near-eye display device shown in the figure does not constitute a limitation on the near-eye display device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0151] The processor 601 is the control center of the near-eye display device. It uses various interfaces and lines to connect the various parts of the entire near-eye display device. By running or executing software programs and / or modules stored in the memory 602 and calling data stored in the memory 602, it performs various functions of the near-eye display device and processes data, thereby monitoring the near-eye display device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0152] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created based on the use of the near-eye display device. In addition, the memory 602 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602. When the specific electronic device is a wearable optical see-through smart glasses, in addition to the above structure, it also includes at least a glasses body frame, an optical display component, an electronic circuit component, sensors, etc. The sensors built into the glasses include a heart rate monitor, a blood glucose meter, a microphone, a camera, and / or an eye tracker.

[0153] The near-eye display device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 603 can also include one or more DC or AC power supplies, a recharging system, a power supply device debugging circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0154] The near-eye display device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0155] Although not shown, the near-eye display device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the near-eye display device loads the executable files corresponding to one or more application processes into the memory 602 according to the following instructions, and the processor 601 runs the application stored in the memory 602, thereby implementing the steps of any of the image quality enhancement methods provided in the embodiments of the present application.

[0156] The embodiment of the present application determines compensation information for a first display image; controls a near-eye display device to display a second display image according to the compensation information; wherein the second display image is a technical solution of the first display image with improved image quality, and compensates the display screen of the first display content according to the compensation information of the first display content, thereby achieving the technical effect of improving the image quality of the near-eye display device without adding new hardware.

[0157] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0158] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0159] To this end, the present application provides a computer-readable storage medium, on which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any one of the image quality enhancement methods provided in the present application.

[0160] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0161] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0162] Since the instructions stored in the computer-readable storage medium can execute the steps in any image quality enhancement method provided in this application, the beneficial effects that can be achieved by any image quality enhancement method provided in this application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0163] The above is a detailed introduction to the image quality enhancement method, device, near-eye display device and computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A method for improving image quality, characterized in that: Applied to a near-eye display device, the method comprises: determining compensation information of the first display image; controlling the near-eye display device to display a second display image according to the compensation information; The second display image is the first display image with improved image quality.

2. The method according to claim 1, characterized in that Before determining the compensation information of the first display image, the method further includes: Controlling the virtual display screen of the near-eye display device to display a compensation picture; Determining compensation pixel information of the compensation picture; A compensation function is determined according to the compensated pixel information, wherein the compensation function is used to calculate and obtain the compensation information.

3. The method according to claim 2, characterized in that The compensation pixel information includes information of a plurality of pixels and information of a compensation target corresponding to each pixel in the plurality of pixels; The determining the compensation function according to the compensation pixel information comprises: The compensation function is determined according to the information of the multiple pixel points and the information of the multiple compensation targets.

4. The method according to claim 3, characterized in that The determining of compensation information of the first display image includes: Determining first pixel information of the first display image; The first pixel information is compensated by using the compensation function to determine the compensation information.

5. The method according to claim 4, characterized in that The first pixel information includes first brightness information and first chromaticity information; The compensating the first pixel information by using the compensation function to determine the compensation information includes: Calculating the first brightness information by using the compensation function to determine target brightness information; Calculating the first chromaticity information by using the compensation function to determine target chromaticity information; The compensation information is determined according to the target brightness information and the target chromaticity information.

6. The method according to claim 5, characterized in that The controlling the near-eye display device to display a second display image according to the compensation information includes: Controlling the near-eye display device to display the brightness value corresponding to the target brightness information according to the compensation information, And display the chromaticity value corresponding to the target chromaticity information.

7. The method according to claim 3, characterized in that Before controlling the virtual display screen of the near-eye display device to display a compensation picture, the method further includes: Acquire a test picture, and determine that the test picture is the compensation picture; Alternatively, a shooting module of the near-eye display device is controlled to shoot a real picture, and the real picture is determined to be the compensation picture.

8. A device for improving image quality, characterized in that: Applied to a near-eye display device, the device comprises: A processing module, used to determine compensation information of the first display image; The processing module is further used to control the near-eye display device to display a second display image according to the compensation information; The second display image is the first display image with improved image quality.

9. A near-eye display device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the image quality enhancement method as described in any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the image quality improvement method according to any one of claims 1 to 7 are implemented.

Images