Image display method and image display apparatus

Abstract

The application provides an image display method and an image display device, which are beneficial to improving the uniformity of an image displayed by a diffractive light waveguide, thereby improving user experience. The method is applied to a device including a light engine and a diffractive light waveguide, and includes: obtaining uniformity data of a first image obtained by the diffractive light waveguide; determining to-be-compensated data of the light engine according to the uniformity data; adjusting the brightness distribution of a light source in the light engine based on the to-be-compensated data; and displaying a second image by the adjusted light engine and the diffractive light waveguide.

Description

Technical Field

[0001] This application relates to the field of augmented reality, and more particularly to an image display method and an image display device. Background Technology

[0002] Augmented reality (AR) technology combines virtual and real environments, overlaying objects from both environments onto the same screen in real time, thus enabling interaction between the two environments. An AR headset is a wearable device that implements AR technology and is worn on the head for display. AR headsets typically take the form of glasses or a helmet, displaying images in front of the user's eyes and enhancing their sense of reality.

[0003] The display portion of an AR headset includes a light engine and a diffractive waveguide. The light engine comprises a light source, a lens assembly, a display screen, and a lens. For example, the light source may include a light-emitting diode (LED) or a laser diode (LD); the display screen may include a liquid crystal on silicon (LCOS) display or a digital light processing (DLP) display. The display works as follows: light emitted from the light source is transmitted through the lens assembly to the display screen for imaging. The image formed on the display screen serves as the image source. The light emitted from the display screen is modulated through the lens to exit the pupil, then enters the diffractive waveguide. Finally, the pupil is expanded by the diffractive waveguide to display a virtual image. Therefore, the virtual image displayed by the AR headset enters the user's eye, achieving near-eye display.

[0004] The core component of the aforementioned diffractive waveguide is the diffraction grating, which can split the incident light into several diffraction orders and disperse it. Since the wavelengths of different colors of incident light are different, the diffraction angles are also different. Therefore, when different colors of incident light are transmitted in the diffractive waveguide, they will have different transmission angles and different paths, resulting in poor image uniformity and affecting the user experience. Summary of the Invention

[0005] This application provides an image display method and an image display device, which are beneficial to improving the uniformity of images displayed through diffractive waveguides, thereby improving the user experience.

[0006] In a first aspect, an image display method is provided, applied to a device including an optical engine and a diffractive waveguide, the method comprising: obtaining uniformity data of a first image obtained through the diffractive waveguide; determining compensation data of the optical engine based on the uniformity data; adjusting the brightness distribution of a light source in the optical engine based on the compensation data; and displaying a second image through the adjusted optical engine and the diffractive waveguide.

[0007] The image display method of this application improves the uniformity of the image displayed by the diffractive waveguide by adjusting the brightness distribution of the light source in the light engine, thereby enhancing the user experience.

[0008] Since the light source can include an LED array light source or an LD light source, this embodiment can adjust the brightness distribution of the LED array light source or the brightness distribution of the LD light source.

[0009] It should be understood that, in the embodiments of this application, image uniformity includes both brightness uniformity and color uniformity. Brightness and color are related; changes in brightness will also cause changes in color. Therefore, by adjusting the brightness distribution of the light source in the optical engine, the embodiments of this application effectively adjust the brightness and color uniformity of the image presented by the optical engine, thereby making the uniformity of the image output by the optical engine and the image output by the diffracted waveguide complementary, ultimately presenting an image with higher uniformity.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, obtaining uniformity data of the first image obtained through the diffractive waveguide includes: testing the uniformity of the first image corresponding to multiple regions to obtain multiple uniformity sub-data; and determining the uniformity data based on the multiple uniformity sub-data and the weights of the multiple regions.

[0011] The image display method of this application embodiment, through region division, determines the uniformity data of a first image based on the uniformity sub-data corresponding to multiple divided regions and the weights of these regions. Based on this uniformity data, it determines the data to be compensated, and then adjusts the brightness distribution of the light source in the optical engine. Finally, it displays a second image through the optical engine and the diffractive waveguide. The method of this application embodiment can take into account all areas where the human eye may be located, thereby improving the uniformity of the images displayed in different regions viewed by different users, or in different regions viewed by the same user at different times, thus enhancing the user experience.

[0012] Since the human eye is movable, the same user's eye can be at different positions within the eyebox at different times, and different users' eyes will also be at different positions within the eyebox relative to the same device. Therefore, the multiple regions mentioned above in this application embodiment can include regions obtained by dividing the eyebox. In different regions, the human eye will see a first image with different uniformity. This application embodiment uses uniformity sub-data to represent the uniformity of the first image in different regions.

[0013] In this embodiment, multiple regions each have their own weights. Some regions may have the same weight, while others may have different weights; this embodiment does not limit this. Optionally, the uniformity data of the first image can be obtained by weighted summation of the uniformity sub-data corresponding to multiple regions.

[0014] In one possible implementation, considering that the proportion of the population in the middle region is relatively high, while the proportion in the edge region is relatively low, the middle region has the highest weight, and the edge region has the lowest weight. This is more in line with reality and helps to obtain more accurate uniformity data.

[0015] In conjunction with the first aspect, in some implementations of the first aspect, before obtaining the uniformity data of the first image obtained through the diffractive waveguide, the method further includes: determining a target region based on eye-tracking technology; obtaining the uniformity data of the first image obtained through the diffractive waveguide includes: acquiring uniformity sub-data of the first image corresponding to the target region; and determining the uniformity sub-data of the first image corresponding to the target region as the uniformity data.

[0016] The image display method of this application embodiment uses eye-tracking technology to track the position of a user's eyes in real time, obtains uniformity data of a first image based on the eye position, and then adjusts the brightness distribution of the light source in the light engine in real time. A second image is then displayed through the light engine and diffractive waveguide. This method can flexibly adapt to different users. Based on the current user's eye position, it determines the uniformity of the image in the target area corresponding to the current user's eye position, and then compensates for the uniformity of the image in the target area, providing a better user experience.

[0017] In conjunction with the first aspect, in some implementations of the first aspect, obtaining the uniformity sub-data of the first image corresponding to the target region includes: selecting the uniformity sub-data of the first image corresponding to the target region from multiple uniformity sub-data of the first image corresponding to multiple regions, wherein the multiple regions include the target region.

[0018] Before determining the target area, the image display device has tested the uniformity of the first image corresponding to multiple areas, obtained multiple uniformity sub-data, and saved these multiple uniformity sub-data. In this case, after the image display device determines the target area, it can directly select the uniformity sub-data corresponding to the target area from the multiple uniformity sub-data corresponding to the multiple areas, shortening the image display latency and improving the image display efficiency.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, before determining the compensation data of the optical engine based on the uniformity data, the method further includes: obtaining the brightness value of the environment in which the device is located; determining the compensation data of the optical engine based on the uniformity data includes: determining the compensation data based on the uniformity data and the brightness value.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, adjusting the brightness distribution of the light source in the light engine based on the data to be compensated includes: determining a target current value based on the data to be compensated; and adjusting the brightness distribution of the light source based on the target current value.

[0021] It should be understood that since a larger current value results in a brighter light source and a smaller current value results in a dimmer light source, the embodiments of this application can adjust the brightness distribution of the light source in the light engine based on the target current value determined by the data to be compensated.

[0022] For example, if the light source is an LED array light source, and different LEDs in the LED array light source have different brightness, then the image display device can first determine the relationship between these different brightnesses and current values, then determine the brightness required for each LED in the LED array, and convert the brightness required for each LED into the current value required for each LED, which is the target current value mentioned above.

[0023] Secondly, an image display apparatus is provided for performing the method in any possible implementation of the first aspect described above. Specifically, the apparatus includes a module for performing the method in any possible implementation of the first aspect described above.

[0024] Thirdly, another image display device is provided, including a processor coupled to a memory for executing instructions in the memory to implement the methods in any of the possible implementations of the first aspect described above. Optionally, the device also includes a memory. Optionally, the device also includes a communication interface, to which the processor is coupled.

[0025] In one implementation, the image display device is an AR head-mounted display device. When the image display device is an AR head-mounted display device, the communication interface can be a transceiver, or an input / output interface.

[0026] In another implementation, the image display device is a chip configured in the AR headset. When the image display device is a chip configured in the AR headset, the communication interface can be an input / output interface.

[0027] Fourthly, a processor is provided, comprising: an input circuit, an output circuit, and a processing circuit. The processing circuit is used to receive signals through the input circuit and transmit signals through the output circuit, causing the processor to execute the method in any possible implementation of the first aspect described above.

[0028] In specific implementation, the processor can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, gate circuit, flip-flop, and various logic circuits. The input signal received by the input circuit can be received and input by, for example, but not limited to, a receiver, and the signal output by the output circuit can be output to, for example, but not limited to, a transmitter and transmitted by the transmitter. Furthermore, the input circuit and the output circuit can be the same circuit, which is used as the input circuit and the output circuit at different times. This application does not limit the specific implementation of the processor and various circuits.

[0029] Fifthly, a processing apparatus is provided, including a processor and a memory. The processor is used to read instructions stored in the memory and to receive signals via a receiver and transmit signals via a transmitter to execute the method in any of the possible implementations of the first aspect described above.

[0030] Optionally, there may be one or more processors and one or more memories.

[0031] Alternatively, the memory can be integrated with the processor, or the memory can be set up separately from the processor.

[0032] In specific implementation, the memory can be a non-transitory memory, such as read-only memory (ROM), which can be integrated with the processor on the same chip or set on different chips. The embodiments of this application do not limit the type of memory or the way the memory and processor are set.

[0033] It should be understood that the relevant data interaction process, such as sending indication information, can be the process of outputting indication information from the processor, and receiving capability information can be the process of the processor receiving input capability information. Specifically, the processed output data can be output to the transmitter, and the input data received by the processor can come from the receiver. Here, the transmitter and receiver can be collectively referred to as a transceiver.

[0034] The processing device in the fifth aspect above can be a chip. The processor can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor that reads software code stored in memory. The memory can be integrated into the processor or located outside the processor and exist independently.

[0035] In a sixth aspect, a computer program product is provided, comprising: a computer program (also referred to as code or instructions) that, when executed, causes a computer to perform the method in any of the possible implementations of the first aspect described above.

[0036] In a seventh aspect, a computer-readable storage medium is provided that stores a computer program (also referred to as code or instructions) that, when executed on a computer, causes the computer to perform the methods in any of the possible implementations of the first aspect described above. Attached Figure Description

[0037] Figure 1 This is a schematic diagram illustrating the principle of image display;

[0038] Figure 2 This is a schematic flowchart of an image display method provided in an embodiment of this application;

[0039] Figure 3 This is a schematic diagram of image uniformity corresponding to an image display method provided in an embodiment of this application;

[0040] Figure 4 This is a schematic flowchart illustrating another image display method provided in an embodiment of this application;

[0041] Figure 5 This is a schematic diagram of the weight distribution of multiple regions provided in an embodiment of this application;

[0042] Figure 6 This is a schematic flowchart illustrating another image display method provided in the embodiments of this application;

[0043] Figure 7 This is a schematic flowchart of another image display method provided in an embodiment of this application;

[0044] Figure 8 This is a schematic block diagram of an image display device provided in an embodiment of this application;

[0045] Figure 9 This is a schematic block diagram of another image display device provided in the embodiments of this application;

[0046] Figure 10This is a schematic block diagram of another image display device provided in the embodiments of this application. Detailed Implementation

[0047] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0048] To facilitate understanding, the relevant terms used in the embodiments of this application will be introduced first.

[0049] 1. Diffractive waveguide

[0050] An optical waveguide is a medium that guides light waves to propagate; it is also called a dielectric optical waveguide.

[0051] A diffractive waveguide is an optical waveguide that includes a diffraction grating. It utilizes the diffraction properties of light and the total internal reflection properties of the waveguide medium to transmit imaging beams. Diffractive waveguides are mainly divided into two types: surface relief grating waveguides manufactured using photolithography and holographic volume grating waveguides manufactured based on holographic interference technology.

[0052] A diffraction grating is the core component of a diffraction waveguide. A diffraction grating is an optical element with a periodic structure. This period can be highs and lows embossed on the material surface, or "bright and dark interference fringes" formed by holographic exposure within the material. The function of a diffraction grating is to induce periodic changes in the refractive index within the material. This period is typically at the micro-nano scale, on the order of magnitude of visible light wavelengths (400-700 nm), thus effectively affecting light.

[0053] 2. Light Engine

[0054] A light engine can include components such as a light source, a lens assembly, a display screen, and a lens. Light emitted from the light source is transmitted through the lens assembly to the display screen for imaging. The image formed on the display screen serves as the image source; that is, the display screen is the image plane of the light source. Because the display screen is the image plane of the light source, the brightness distribution of the image formed on the display screen corresponds one-to-one with the brightness distribution of the light source.

[0055] The light source may include LED light sources, LD light sources, or other types of light sources; the display screen may include LCOS display screens, DLP display screens, or other types of display screens, and this application does not limit them.

[0056] Taking an LED light source as an example, an LED light source can include multiple LEDs, i.e., an LED array. Therefore, an LED light source can also be called an LED array light source. The LED array can be of any size, such as a 5×8 rectangle or a 5×5 square; this application does not limit this. The aforementioned LED array can be located on an LED substrate, forming an LED module together with the LED substrate. The LED module can also include a diffuser and a brightness enhancement film (BEF) to reduce the divergence angle of the LED array.

[0057] 3. Image display

[0058] Image display can be achieved through an optical engine and a diffractive waveguide. Specifically, light emitted from a light source can be transmitted to a display screen for imaging through a lens group, then modulated by a lens to exit the pupil, and then input into a diffractive waveguide. After diffraction and total internal reflection, the light is transmitted to a diffraction grating to generate pupil expansion, and finally output from the diffractive waveguide to display the image.

[0059] In simple terms, the optical engine can be understood as a projector, and the diffractive waveguide can be understood as responsible for transmitting the projected image to the viewer's eyes. It should be understood that the diffractive waveguide does not enlarge or reduce the image during transmission.

[0060] 4. Image uniformity

[0061] Image uniformity refers to the degree of difference between pixels in different locations on a display screen. Uniformity can be measured by parameters such as brightness and color. Brightness, also known as luminance, represents the lightness or darkness of a color. Brightness and color are related; changes in brightness will also cause changes in color.

[0062] 5. Eye box

[0063] The eye box, in the context of AR headsets, refers to the cone-shaped area between the display of the AR headset and the eyeball. It is also the area where the displayed content is clearest. Beyond this area, problems such as color rendering errors, incomplete display of content, or even no content may occur.

[0064] 6. Eye tracking technology

[0065] Eye-tracking technology tracks the movement of the eyes by measuring the position of the eye's gaze point or the movement of the eyes relative to the head. Specifically, image processing techniques can be used to locate the pupil position, obtain the coordinates of the pupil center, and algorithms can be used to calculate the eye's gaze point, thereby tracking the eye's movement trajectory.

[0066] For example, a pupil-corneal reflection tracking method can be used. An eye camera is used to capture an image of the eye, and then the image is processed to obtain the center position of the pupil. The corneal reflection point is then used as the base point for the relative position of the eye camera and the human eye. Based on the pupil center position obtained from the image processing, the gaze vector coordinates of the human eye can be obtained, thereby determining the gaze point of the human eye and tracking the movement trajectory of the human eye.

[0067] Figure 1 This is a schematic diagram illustrating the principle of image display. Figure 1 It includes a light engine 101, a diffractive waveguide 102, and a human eye 106. The diffractive waveguide 102 includes an input grating 103, a diffraction grating 104, and an output grating 105.

[0068] The light emitted by the light source in the aforementioned light engine 101 is imaged by the display screen, modulated by the lens at the exit pupil, and then enters the diffraction waveguide 102. The input grating 103 is responsible for receiving the light signal and transmitting it to the diffraction grating 104 by total internal reflection. The diffraction grating 104 is used to dilate the received light signal and then transmit it to the output grating 105 by total internal reflection. The output grating 105 outputs the light signal and projects it onto the human eye 106 for image formation.

[0069] It should be understood that the aforementioned pupil expansion refers to converting a low-field-of-view input light signal into a high-field-of-view output light signal, including horizontal and vertical pupil expansion. The field of view (FOV) can be measured using the visible angle, specifically the angle between the edge of the display and the line connecting the edge to the viewer's eye. The FOV can include both horizontal and vertical FOVs.

[0070] exist Figure 1 In this process, the diffraction grating 104 expands the pupil of the incident light, splitting it into several diffraction orders and dispersing it. It should be understood that diffraction gratings can include one-dimensional and two-dimensional gratings. To avoid ghosting and stray light, diffraction gratings generally have only one diffraction order, including positive and negative 1. For example, the diffraction order of a one-dimensional grating can be +1 or -1; the diffraction order of a two-dimensional grating can include (-1,1), (-1,-1), (1,1), (1,-1), (1,0), (-1,0), (0,-1), (0,1).

[0071] After the diffraction grating 104 divides the incident light into several diffraction orders, the light of each diffraction order can continue to propagate in different directions within the diffraction waveguide 102. The main function of the diffraction grating 104 in this dimension is to change the propagation direction of the incident light. Specifically, by adjusting parameters such as the refractive index of the material, the shape of the grating, its thickness, and its duty cycle, the diffraction efficiency of the incident light at a certain diffraction order (i.e., a certain direction) can be optimized to the highest level, ensuring that most of the light propagates primarily along this direction after diffraction, thereby reducing light loss in other diffraction directions.

[0072] To address the dispersion issue, the diffraction grating 104 can generate different diffraction angles for incident light of different wavelengths; the longer the wavelength, the larger the diffraction angle. For example, the incident light includes red, green, and blue light. Since the wavelength of red light > the wavelength of green light > the wavelength of blue light, the diffraction angle of red light > the diffraction angle of green light > the diffraction angle of blue light. Because the diffraction angles of the incident light differ, the path length traversed by the incident light for each total internal reflection also differs. Therefore, the number of total internal reflections for red light < the number of total internal reflections for green light < the number of total internal reflections for blue light. Based on these differences, the image displayed by the diffraction waveguide 102 after the incident light, including red, green, and blue light, ultimately passes through the red light waveguide 102 will exhibit uneven brightness and color.

[0073] Therefore, when incident light of different colors propagates within a diffractive waveguide, it will exhibit different propagation angles and paths, resulting in poor image uniformity and consequently affecting the user experience.

[0074] In view of this, this application provides an image display method that, by adjusting the brightness distribution of the light source in the light engine, compensates for the brightness of the image displayed by the diffractive waveguide, thereby improving the uniformity of the image displayed by the diffractive waveguide and thus enhancing the user experience.

[0075] It should be understood that the image display method of this application embodiment can be applied to image display devices including optical engines and diffractive waveguides, such as AR helmets, AR glasses, mobile phones, tablets, computers, vehicle head-up displays (HUDs), AR smart interactive devices, and smart glasses, etc., and this application embodiment does not limit it in this regard.

[0076] Before introducing the image display method and image display device provided in the embodiments of this application, the following points should be made first.

[0077] First, in the embodiments shown below, the terms and English abbreviations, such as uniformity data, uniformity sub-data, compensation data, etc., are merely exemplary examples given for ease of description and should not constitute any limitation on this application. This application does not preclude the possibility of defining other terms that can achieve the same or similar functions in existing or future agreements.

[0078] Second, in the embodiments shown below, the first, second, and various numerical designations are merely distinctions for descriptive convenience and are not intended to limit the scope of the embodiments of this application. For example, distinguishing different images, distinguishing different regions, etc.

[0079] Third, "at least one" means one or more, while "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0080] The image display method and image display device provided in this application will now be described in detail with reference to the accompanying drawings.

[0081] Figure 2 This is a schematic flowchart illustrating an image display method 200 provided in an embodiment of this application. The method 200 can be executed by an image display device and includes the following steps:

[0082] S201, Obtain uniformity data of the first image obtained through the diffractive waveguide. It should be understood that the first image can be an image output solely through the diffractive waveguide. Because incident light of different colors will have different transmission angles and different paths when propagating within the diffractive waveguide, the uniformity of the first image is poor.

[0083] S202, Based on the uniformity data, determine the data to be compensated for the light engine.

[0084] S203, Based on the data to be compensated, adjust the brightness distribution of the light source in the light engine. Since the light source may include an LED array light source or an LD light source, this embodiment can adjust the brightness distribution of either the LED array light source or the LD light source.

[0085] Since the aforementioned data to be compensated is determined based on the uniformity data of the first image, and the uniformity data of the first image reflects the uniformity of the image displayed by the diffractive waveguide, the data to be compensated can compensate for the uniformity of the image displayed by the diffractive waveguide.

[0086] S204, a second image is displayed using the adjusted light source and diffractive waveguide. It should be understood that this second image is displayed after brightness compensation of the diffractive waveguide. Due to the brightness compensation, the second image has higher uniformity compared to the first image.

[0087] The image display method of this application improves the uniformity of the image displayed by the diffractive waveguide by adjusting the brightness distribution of the light source in the light engine, thereby enhancing the user experience.

[0088] It should be understood that, in the embodiments of this application, image uniformity includes both brightness uniformity and color uniformity. Brightness and color are related; changes in brightness will also cause changes in color. Therefore, by adjusting the brightness distribution of the light source in the optical engine, the embodiments of this application effectively adjust the brightness and color uniformity of the image presented by the optical engine, thereby making the uniformity of the image output by the optical engine and the image output by the diffracted waveguide complementary, ultimately presenting an image with higher uniformity.

[0089] The following is combined with Figure 3 The principles of the embodiments of this application will be explained.

[0090] Figure 3 This is a schematic diagram of the image uniformity corresponding to the above method 200, wherein the image obtained through the diffraction waveguide is image 1 (equivalent to the first image mentioned above), the image imaged by the optical engine is image 2, and the image displayed by the diffraction waveguide and the optical engine is image 3 (equivalent to the second image mentioned above). Figure 3 In the diagram, images 1, 2, and 3 are each divided into 4×4 regions, each with its own brightness value, thus showcasing the brightness distribution of the image. The brightness distributions of images 1, 2, and 3 can be represented as follows: Figure 3 As shown by the lines, different line patterns represent different brightness values. Figure 3 It can be seen that the brightness distribution of image 1 is uneven, the brightness distribution of image 2 is uneven, while the brightness distribution of image 3, obtained by superimposing image 1 and image 2, is uniform. In this example, image 1 is divided into a 4×4 region, and image 2 is also divided into a 4×4 region, with a one-to-one correspondence between the regions of image 1 and image 2.

[0091] As an optional embodiment, the uniformity data of the first image obtained by the diffraction waveguide can be obtained in a variety of different ways, that is, S201 can be implemented in a variety of different ways. Two possible implementation methods are described below.

[0092] In the first possible implementation, such as Figure 4As shown, the above S201 may include the following steps:

[0093] S401, test the uniformity of the first image corresponding to multiple regions to obtain multiple uniformity sub-data.

[0094] S402, determine the uniformity data of the first image based on multiple uniformity sub-data and the weights of multiple regions.

[0095] Since the human eye is movable, the same user's eye can be at different positions within the eyebox at different times, and different users' eyes will also be at different positions within the eyebox relative to the same device. Therefore, the multiple regions mentioned above in this application embodiment can include regions obtained by dividing the eyebox. In different regions, the human eye will see a first image with different uniformity. This application embodiment uses uniformity sub-data to represent the uniformity of the first image in different regions.

[0096] In the embodiments of this application, multiple regions each have their own weights. Some regions may have the same weight, while others may have different weights. This embodiment of the application does not limit this.

[0097] In one possible implementation, considering that the proportion of the population in the middle region is relatively high, while the proportion in the edge region is relatively low, the middle region has the highest weight, and the edge region has the lowest weight. This is more in line with reality and helps to obtain more accurate uniformity data.

[0098] For example, such as Figure 5 As shown, the human eye box can be divided into 3×5 regions, resulting in 15 regions: region 1, region 2, ..., region 15. The human eye can be positioned in any of these 15 regions. The aforementioned uniformity sub-data includes 15 uniformity sub-data corresponding to these 15 regions. Region 8 has a weight of A, regions 3, 7, 9, and 13 have a weight of B, regions 2, 4, 6, 10, 12, and 14 have a weight of C, and regions 1, 5, 11, and 15 have a weight of D. A through D represent the weights from highest to lowest. A represents the highest weight, followed by B and C, with D representing the lowest weight. For example, A could be set to 60%, the sum of the weights of regions with weight B to 30% (B = 7.5%), the sum of the weights of regions with weight C to 20% (C = 3.3%), and the sum of the weights of regions with weight D to 10% (D = 2.5%). However, this embodiment does not limit this.

[0099] Optionally, the uniformity data of the first image can be obtained by weighted summation of the uniformity sub-data corresponding to multiple regions.

[0100] In the example above, the uniformity data of the first image can be the sum of the uniformity sub-data corresponding to region 1 * 10%, the uniformity sub-data corresponding to region 2 * 3.3%, ..., and the uniformity sub-data corresponding to region 15 * 2.5%.

[0101] The image display method of this application embodiment, through region division, determines the uniformity data of a first image based on the uniformity sub-data corresponding to multiple divided regions and the weights of these regions. Based on this uniformity data, it determines the data to be compensated, and then adjusts the brightness distribution of the light source in the optical engine. Finally, it displays a second image through the optical engine and the diffractive waveguide. The method of this application embodiment can take into account all areas where the human eye may be located, thereby improving the uniformity of the images displayed in different regions viewed by different users, or in different regions viewed by the same user at different times, thus enhancing the user experience.

[0102] In the second possible implementation, such as Figure 6 As shown, the above S201 may include the following steps:

[0103] S601 determines the target area based on eye-tracking technology.

[0104] S602, Obtain the uniformity sub-data of the first image corresponding to the target region.

[0105] S603, the uniformity sub-data of the first image corresponding to the target region is determined as the uniformity data of the first image.

[0106] Specifically, the image display device can first determine the relative position of the pupil of the eye using eye-tracking technology, and then determine the point of gaze of the human eye. The area where the point of gaze of the human eye is located is the aforementioned target area. In the embodiments of this application, the uniformity sub-data of the first image corresponding to the target area is the uniformity data of the first image.

[0107] The image display method of this application embodiment uses eye-tracking technology to track the position of a user's eyes in real time, obtains uniformity data of a first image based on the eye position, and then adjusts the brightness distribution of the light source in the light engine in real time. A second image is then displayed through the light engine and diffractive waveguide. This method can flexibly adapt to different users. Based on the current user's eye position, it determines the uniformity of the image in the target area corresponding to the current user's eye position, and then compensates for the uniformity of the image in the target area, providing a better user experience.

[0108] As an optional embodiment, the embodiments of this application can obtain the uniformity sub-data of the first image corresponding to the target region in a variety of different ways, and the embodiments of this application do not limit this.

[0109] Method 1: After the target area is determined using eye-tracking technology in the image display device, the image display device can measure the uniformity sub-data of the first image corresponding to the target area in real time.

[0110] Method 2: After the image display device uses eye-tracking technology to determine the target area, the image display device can select the uniformity sub-data of the first image corresponding to the target area from multiple uniformity sub-data of the first image corresponding to multiple areas, wherein the multiple areas include the target area.

[0111] It should be understood that before determining the target area, the image display device has already executed the above-described S401, tested the uniformity of the first image corresponding to multiple areas, obtained multiple uniformity sub-data, and saved the multiple uniformity sub-data. In this case, after the image display device determines the target area, it can directly select the uniformity sub-data corresponding to the target area from the multiple uniformity sub-data corresponding to the multiple areas.

[0112] For example, in Figure 5 In the image display device, the target area can be determined as region 7 based on eye-tracking technology. Then, the image display device can select the uniformity sub-data corresponding to region 7 from the 15 uniformity sub-data corresponding to the 15 regions, and determine the uniformity sub-data corresponding to region 7 as the uniformity data of the first image.

[0113] Comparing the two possible methods above, we can conclude that Method 1 does not require pre-measuring the uniformity of multiple regions of the image or saving multiple uniformity sub-data, which helps save device power consumption and memory; while Method 2 does not require measuring the uniformity of the image in the target region after the target region has been determined, which shortens the image display latency and improves the efficiency of image display.

[0114] As an optional embodiment, before determining the data to be compensated for the light engine based on the uniformity data (i.e., S202), the method 200 further includes: obtaining the brightness value of the environment in which the image display device is located. Determining the data to be compensated for the light engine based on the uniformity data includes: determining the data to be compensated based on the uniformity data and brightness value of the first image.

[0115] For example, the image display device can use an ambient light sensor to test the brightness value of the current environment. If the uniformity data of the first image is 20 nits and the brightness value of the environment in which the image display device is located is 100 nits, then the data to be compensated can be 100 divided by 20, which equals 5.

[0116] As an optional embodiment, the above-mentioned adjustment of the brightness distribution of the light source in the light engine based on the data to be compensated, i.e., S203 includes: determining the target current value based on the data to be compensated; and adjusting the brightness distribution of the light source according to the target current value.

[0117] It should be understood that since a larger current value results in a brighter light source and a smaller current value results in a dimmer light source, the embodiments of this application can adjust the brightness distribution of the light source in the light engine based on the target current value determined by the data to be compensated.

[0118] For example, if the light source is an LED array light source, and different LEDs in the LED array light source have different brightness, then the image display device can first determine the relationship between these different brightnesses and current values, then determine the brightness required for each LED in the LED array, and convert the brightness required for each LED into the current value required for each LED, which is the target current value mentioned above.

[0119] To better understand the image display method proposed in this application, the following will be combined with... Figure 7 The method for displaying images according to the embodiments of this application will be described in detail.

[0120] Figure 7 A schematic flowchart of another image display method 700 proposed in this application is shown. This method can be performed by an image display device and may include the following steps:

[0121] S701, the first image is obtained through the diffraction waveguide.

[0122] S702, test the uniformity of the first image corresponding to multiple regions to obtain multiple uniformity sub-data.

[0123] Optionally, S703 uses eye-tracking technology to determine the target region from multiple regions.

[0124] S704, determine the uniformity data of the first image.

[0125] It should be understood that S704 includes two possible implementations.

[0126] In a first possible implementation, the image display device may execute S703 and then S704, that is, the image display device determines the target area and determines the uniformity sub-data of the first image corresponding to the target area as the uniformity data of the first image.

[0127] In the second possible implementation, the image display device may skip S703 and directly execute S704 after executing S702. That is, the image display device can determine the uniformity data of the first image based on the uniformity sub-data of the first image corresponding to multiple regions and the weights of the multiple regions.

[0128] S705 obtains the brightness value of the environment in which the image display device is located.

[0129] S706, Based on the uniformity data of the first image and the obtained brightness value, determine the compensation data of the light engine.

[0130] S707 determines the target current value based on the compensation data of the aforementioned optical engine.

[0131] S708, based on the target current value, adjusts the brightness distribution of the light source of the light engine.

[0132] S709 displays a second image using an adjusted optical engine and diffractive waveguide.

[0133] Optionally, in the first possible implementation described above, where the uniformity data of the first image is the uniformity data of the first image corresponding to the target area determined by the image display device using eye-tracking technology, the method 700 may further include: S710, determining whether the second image achieves the expected effect.

[0134] Specifically, the image display device can test the uniformity of the second image to obtain uniformity data. Then, based on this uniformity data and the brightness of the environment in which the image display device is located, it can determine whether the uniformity of the second image meets the expected standard. If the uniformity of the second image meets the expected standard, the current process ends, and the second image is output to the user. If the uniformity of the second image does not meet the expected standard, steps S703 to S710 are repeated until the expected standard is achieved.

[0135] It should be understood that S701, S702, and S704–S709 constitute an image display method. This method, through region division, determines the uniformity data of a first image based on the uniformity sub-data corresponding to multiple regions and the weights of these regions. Based on this uniformity data, it determines the data to be compensated, and then adjusts the brightness distribution of the light source in the light engine. The second image is then displayed through the light engine and the diffraction waveguide. This method considers all possible areas where the human eye may be positioned, thus improving the uniformity of the displayed image in different regions viewed by different users, or in different regions viewed by the same user at different times, thereby enhancing the user experience.

[0136] S701–S710 represent another image display method. This method uses eye-tracking technology to track the user's eye position in real time, obtains the uniformity data of the first image based on the eye position, and then adjusts the brightness distribution of the light source in the light engine in real time. The second image is then displayed through the light engine and diffractive waveguide, and the uniformity of the second image is checked to see if it meets the expected standard. If not, this method is repeated until the expected standard is achieved. This method can flexibly adapt to different users. Based on the current user's eye position, it determines the uniformity of the image in the target area corresponding to the current user's eye position, then compensates for the uniformity of the image in the target area, and detects the compensation result until the expected standard is achieved, thus providing a good user experience.

[0137] It should be understood that the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0138] The above text combines Figures 2 to 7 The image display method according to the embodiments of this application is described in detail below, in conjunction with Figures 8 to 10 The image display apparatus according to embodiments of this application is described in detail.

[0139] Figure 8 An image display device 800 according to an embodiment of this application is shown. The device 800 includes a processing unit 810 and a display unit 820. The display unit 820 includes a light engine and a diffractive waveguide.

[0140] The processing unit 810 is configured to: obtain uniformity data of a first image obtained based on the optical engine and the diffractive waveguide; determine the data to be compensated for the optical engine based on the uniformity data; and adjust the brightness distribution of the light source in the optical engine based on the data to be compensated. The display unit 820 is configured to: display a second image based on the adjusted light source and the diffractive waveguide.

[0141] Optionally, the processing unit 820 is specifically used to: test the uniformity of the first image corresponding to multiple regions to obtain multiple uniformity sub-data; and determine uniformity data based on the multiple uniformity sub-data and the weights of the multiple regions.

[0142] Optionally, the processing unit 820 is further configured to: determine a target region based on eye-tracking technology; acquire uniformity sub-data of a first image corresponding to the target region; and determine the uniformity sub-data of the first image corresponding to the target region as uniform data.

[0143] Optionally, the processing unit 820 is specifically configured to: select uniformity sub-data of the first image corresponding to the target region from multiple uniformity sub-data of the first image corresponding to multiple regions, wherein the multiple regions include the target region.

[0144] Optionally, the processing unit 820 is further configured to: obtain the brightness value of the environment in which the device is located; and determine the data to be compensated based on the uniformity data and the brightness value.

[0145] Optionally, the processing unit 820 is specifically used to: determine the target current value based on the data to be compensated; and adjust the brightness distribution of the light source based on the target current value.

[0146] It should be understood that the device 800 here is embodied in the form of a functional module. The term "unit" here can refer to an application-specific integrated circuit (ASIC), electronic circuitry, a processor (e.g., a shared processor, a proprietary processor, or a group processor, etc.) and memory for executing one or more software or firmware programs, integrated logic circuitry, and / or other suitable components supporting the described functions. In an alternative example, those skilled in the art will understand that the device 800 may specifically be the image display device in the above embodiments, or the functions of the image display device in the above embodiments may be integrated into the device 800. The device 800 may be used to execute the various processes and / or steps corresponding to the image display device in the above method embodiments; to avoid repetition, these will not be described again here.

[0147] The aforementioned device 800 has the function of implementing the corresponding steps performed by the image display device in the above method; the above function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above function.

[0148] In the embodiments of this application, Figure 8 The device 800 in the text can also be a chip or a chip system, such as a system on chip (SoC).

[0149] Figure 9 Another image display device 900 provided in an embodiment of this application is shown. The device 900 includes a processor 910, a light engine 920, and a diffractive waveguide 930. The processor 910 is configured to: obtain uniformity data of a first image obtained based on the light engine 920 and the diffractive waveguide 930; determine, based on the uniformity data, data to be compensated for in the light engine 920; and adjust the brightness distribution of the light source in the light engine 920 based on the data to be compensated. The light engine 920 and the diffractive waveguide 930 are configured to: display a second image based on the adjusted light source.

[0150] It should be understood that the device 900 may specifically be the image display device in the above embodiments, or the functions of the image display device in the above embodiments may be integrated into the device 900. The device 900 may be used to execute the various steps and / or processes corresponding to the image display device in the above method embodiments.

[0151] Furthermore, the aforementioned light engine may include a light source and a display screen. Figure 10 This application illustrates another image display device 1000 provided in an embodiment of the present application. The device 1000 includes a memory 1010, a processor 1020, a controller 1030, a driver 1040, a light source 1050, a display screen 1060, and a diffractive waveguide 1070.

[0152] The aforementioned devices can be connected via internal pathways. Memory 1010 stores data (e.g., uniformity data of the first image) and instructions. Processor 1020 executes the instructions stored in memory 1010, performing preprocessing operations. Specifically, based on the uniformity data of the first image, it determines the compensation data for light source 1050, and then controls driver 1040 via controller 1030 to adjust the brightness distribution of light source 1050. The light emitted by the adjusted light source 1050 can be transmitted to display screen 1060 for imaging, and then enters the human eye via diffraction waveguide 1070. In this embodiment, the image seen by the user is the second image displayed by the adjusted light source and diffraction waveguide. Related details can be found in the description of the above method embodiments, and will not be repeated here.

[0153] It should be understood that the device 1000 may be specifically the image display device in the above embodiments, or the functions of the image display device in the above embodiments may be integrated into the device 1000. The device 1000 may be used to execute the various steps and / or processes corresponding to the image display device in the above method embodiments.

[0154] Optionally, the aforementioned memory may include read-only memory and random access memory, and provide instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information. The processor can be used to execute instructions stored in the memory, and when the processor executes the instructions, the processor can perform the various steps and / or processes corresponding to the image display device in the above method embodiments.

[0155] It should be understood that, in the embodiments of this application, the processor can be a central processing unit (CPU), or it can be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. The controller described above can be a microcontroller unit (MCU).

[0156] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be directly manifested as execution by a hardware processor, or as a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor executes the instructions in the memory, combining them with its hardware to complete the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0157] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0158] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0159] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0160] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0161] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0162] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0163] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An image display method, characterized in that, Applied to a device including an optical engine and a diffractive waveguide, the method includes: The uniformity of a first image corresponding to multiple regions within a test window of the human eye is obtained to acquire multiple uniformity sub-data of the first image; wherein, the multiple regions include a target region, and the first image is obtained through the diffractive waveguide device; The target area is determined based on eye-tracking technology; Obtain the uniformity sub-data corresponding to the target region and use it as the uniformity data; Based on the uniformity data, the data to be compensated for by the optical engine is determined; Based on the data to be compensated, determine the target current value; Based on the target current value, adjust the brightness distribution of the light source in the light engine; A second image is displayed using the adjusted optical engine and the diffractive waveguide.

2. The method as described in claim 1, characterized in that, The steps for obtaining the uniformity sub-data corresponding to the target region include: From multiple uniformity sub-data of the first image corresponding to multiple regions, select the uniformity sub-data of the first image corresponding to the target region.

3. The method as described in claim 1 or 2, characterized in that, Before determining the compensation data for the optical engine based on the uniformity data, the method further includes: Obtain the brightness value of the environment in which the device is located; The step of determining the compensation data for the optical engine based on the uniformity data includes: The data to be compensated is determined based on the uniformity data and the brightness value.

4. An image display device, characterized in that, include: Processor, optical engine, and diffractive waveguide; The processor is configured to: test the uniformity of a first image corresponding to multiple regions within a human eye window, obtaining multiple uniformity sub-data of the first image; wherein the multiple regions include a target region, and the first image is obtained through the diffractive waveguide device; determine the target region using eye-tracking technology, and determine the uniformity sub-data of the first image corresponding to the target region as uniformity data; determine the data to be compensated for by the optical engine based on the uniformity data, determine a target current value based on the data to be compensated, and adjust the brightness distribution of the light source in the optical engine based on the target current value; the uniformity data is determined based on the uniformity sub-data of at least one region within the human eye window; The optical engine and the diffractive waveguide are used to display a second image based on the adjusted light source.

5. The apparatus as described in claim 4, characterized in that, The processor is specifically used for: From multiple uniformity sub-data of the first image corresponding to multiple regions, select the uniformity sub-data of the first image corresponding to the target region, wherein the multiple regions include the target region.

6. The apparatus as described in claim 4 or 5, characterized in that, The processor is also used for: Obtain the brightness value of the environment in which the device is located; The data to be compensated is determined based on the uniformity data and the brightness value.

7. An image display device, characterized in that, include: A processor coupled to a memory for storing a computer program, which, when invoked by the processor, causes the apparatus to perform the method as described in any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that, Used to store a computer program, the computer program including instructions for implementing the method as described in any one of claims 1 to 3.

9. A computer program product, said computer program product comprising computer program code, characterized in that, When the computer program code is run on a computer, it causes the computer to implement the method as described in any one of claims 1 to 3.

Images