Image display method and device, image display equipment and storage medium

Abstract

The invention discloses an image display method and device, image display equipment and a storage medium. According to the high dynamic range HDR display technology, higher brightness can be displayed, so that the highlight part in the picture is brighter and more real. And particularly, when the content is watched in a bright environment, the visibility and definition of the image are remarkably improved by higher brightness. In the application, the spatial light modulator is divided into a plurality of areas, the light source light emitted by the light source is guided by the spatial light scanner to illuminate the spatial light modulator according to each area, the brightness is independently adjusted according to the requirement of the display image corresponding to each area, very bright and very dark details can be displayed at the same time, and a fine light control capability is achieved; therefore, the contrast and dark detail representation are improved.

Description

Technical Field

[0001] This application relates to the field of image display, and specifically to an image display method, apparatus, device, and storage medium. Background Technology

[0002] High Dynamic Range (HDR) display technology delivers higher brightness, making highlights in images more vivid and realistic. Especially when viewing content in bright environments, the increased brightness significantly improves image visibility and clarity. HDR technology enhances the contrast between bright and dark areas, creating a more layered image. In projection displays, enhanced contrast makes images deeper, more three-dimensional, and richer in detail. HDR technology supports a wider color gamut, displaying more and richer colors. For displays, wide color gamut support results in richer and more realistic color reproduction, especially noticeable in scenes with complex colors. HDR technology better renders details in images, particularly in bright and dark areas. HDR content can display more detail and texture that might be lost or compressed in standard Dynamic Range (SDR) display systems.

[0003] However, existing image display devices face challenges in achieving native HDR, primarily due to the following reasons: In existing LCD, LCoS, and DLP image display devices, the backlight is uniformly distributed, making it impossible to independently adjust brightness in different areas. Consequently, the contrast between bright and dark areas in the same image cannot be optimized simultaneously. Low light efficiency: To improve overall brightness, non-zoned backlight projection systems typically require higher-power light sources; however, this does not effectively improve image contrast and detail, but instead increases energy consumption and heat generation. Energy waste: In non-zoned backlight projection systems, a significant amount of light energy cannot be effectively utilized, especially when displaying details in dark areas, requiring the maintenance of high-brightness backlighting, resulting in low light efficiency. Summary of the Invention

[0004] This application provides an image display method, apparatus, device, and storage medium that can improve contrast and dark detail.

[0005] In a first aspect, this application provides an image display method applicable to an image display device. The image display device includes a light source, a spatial light scanner, and a spatial light modulator. The spatial light modulator includes multiple modulation regions. The image display method includes:

[0006] Based on the image to be displayed, determine the modulation control signal corresponding to each modulation region in the spatial light modulator, and the scanning control signal corresponding to the spatial light scanner;

[0007] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into different modulation areas at different time periods for illumination.

[0008] According to the modulation control signal, each modulation region is controlled to be in the corresponding modulation state so as to modulate the incident light source and obtain the modulated light corresponding to each modulation region;

[0009] The modulated light corresponding to each modulation region is projected to obtain the displayed image.

[0010] In some embodiments,

[0011] Based on the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into different modulation areas at different times for illumination, including:

[0012] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into the target modulation region for illumination during the time period t; the target modulation region can be any one of multiple modulation regions.

[0013] Based on the modulation control signal, each modulation region is controlled to be in its corresponding modulation state to modulate the incident light source, resulting in modulated light for each modulation region, including:

[0014] In the target modulation state, the target modulation region modulates the incident light source during the time interval t, resulting in the modulated light corresponding to the target modulation region; the target modulation region is controlled by the corresponding modulation control signal during the time interval t-1, thus being in the target modulation state.

[0015] In some embodiments, the target modulation region includes a plurality of scanning modules, and the target scanning module is any one of the plurality of scanning modules;

[0016] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into the target modulation region for illumination during the time period t, including:

[0017] The scanning control signal includes the target illumination duration and target deflection angle corresponding to the target scanning module;

[0018] The spatial light scanner is controlled to deflect the target at the deflection angle, so as to guide the light emitted from the light source to enter the target scanning module at the target time and illuminate the target scanning module for the target illumination duration; the target time is any time within the time period t.

[0019] In some embodiments, the image to be displayed includes a target display area corresponding to a target modulation area among multiple modulation areas, the target display area includes a display unit corresponding to each of multiple scanning modules, the scanning control signal includes the illumination duration corresponding to each scanning module, and the scanning control signal corresponding to the spatial light scanner is determined based on the image to be displayed, including:

[0020] Based on the grayscale values ​​of the pixels in the target display area, determine the brightness information of each unit to be displayed;

[0021] Based on the brightness information of each unit to be displayed, the illumination duration corresponding to each scanning module is determined.

[0022] In some embodiments, the brightness information of the unit to be displayed indicates whether the unit to be displayed is a bright area or a dark area. Based on the brightness information of each unit to be displayed, the illumination duration corresponding to each scanning module is determined, including:

[0023] The time required to illuminate the target modulation area by the light emitted from the spatial light scanner guides the target modulation area.

[0024] Determine the number of bright areas in the target display area indicated by the brightness information of the display unit;

[0025] The illumination duration for each scanning module is determined based on the number of bright areas and the target duration.

[0026] In some embodiments, the illumination duration corresponding to each scanning module is determined based on the number of bright areas and the target duration, including:

[0027] Each brightness information indicates the illumination duration of the scanning module corresponding to the display unit in the bright area, which is determined based on the target duration and the number of bright areas;

[0028] The illumination duration of the scanning module corresponding to each display unit whose brightness information indicates a dark area is zero.

[0029] In some embodiments, the brightness information of the unit to be displayed indicates whether the unit to be displayed is a bright area or a dark area;

[0030] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into the target modulation region for illumination during the time period t, including:

[0031] During the time period t, the spatial light scanner is controlled to deflect by a preset angle each time so as to guide the light emitted from the light source into each scanning module.

[0032] If the unit to be displayed corresponding to the current scanning module is a bright area, the light emitted from the guide light source will enter the current scanning module and illuminate the current scanning module for a preset illumination time.

[0033] If the unit to be displayed corresponding to the current scanning module is a dark area, the light source will not emit light.

[0034] In some embodiments, determining the scanning control signal corresponding to the spatial light scanner based on the image to be displayed includes:

[0035] Based on the brightness information of each area to be displayed in the image to be displayed, the areas to be displayed and the modulation areas are matched one-to-one.

[0036] Based on the display time of a frame corresponding to the image to be displayed and the brightness information of each area to be displayed, the illumination duration corresponding to each modulation area is determined; the scanning control signal includes the illumination duration corresponding to each modulation area.

[0037] In some embodiments, the spatial light modulator includes M*N modulation units, each modulation region includes multiple scanning modules, and each scanning module includes m*n modulation units, where m is less than or equal to M and n is less than or equal to N;

[0038] During the display time of one frame corresponding to the image to be displayed, the spatial light scanner deflects M / m times in the first direction and N / n times in the second direction;

[0039] The first direction is orthogonal to the second direction; and / or, each modulation region is an area that can be illuminated by the spatial light scanner deflecting M / m in the first direction; and / or, the time required for the light emitted by the spatial light scanner to illuminate each modulation region is the ratio of one frame display time to the number of modulation regions.

[0040] Secondly, this application provides an image display device, which includes a light source, a spatial light scanner, a spatial light modulator, and a display lens. The spatial light modulator includes multiple modulation regions, including:

[0041] The light source is used to emit light from the light source, which then enters the spatial light scanner.

[0042] A spatial light scanner includes a reflective surface and a driver. The driver is used to drive the reflective surface to deflect light from the source at different times to illuminate different modulation regions of the spatial light modulator.

[0043] A spatial light modulator, in which each modulation region modulates the incident light source to obtain the modulated light corresponding to each modulation region, which is then incident into the display lens;

[0044] The display lens is used to project the modulated light corresponding to each modulation area to obtain a display image.

[0045] In some embodiments, the target modulation region is any one of a plurality of modulation regions;

[0046] The target modulation region is in the target modulation state during the (t-1)th time period;

[0047] The reflective surface deflects during the time interval t to guide the light emitted from the light source into the target modulation area for illumination;

[0048] The target modulation region modulates the incident light source during time period t to obtain the corresponding modulated light.

[0049] In some embodiments, the target modulation region in the plurality of modulation regions includes a plurality of scanning modules, and the target scanning module is any one of the plurality of scanning modules;

[0050] The reflective surface deflects the target scanning module by the corresponding deflection angle to guide the light emitted from the light source into the target scanning module and illuminate the target scanning module for the corresponding illumination duration.

[0051] In some embodiments, the image display device is used to display an image to be displayed, the image to be displayed including a plurality of display areas corresponding one-to-one with a plurality of modulation areas; the target display area corresponding to the target modulation area among the plurality of display areas includes a display unit corresponding one-to-one with a plurality of scanning modules;

[0052] The illumination duration for each scanning module is determined based on the brightness information of each unit to be displayed.

[0053] The brightness information of each unit to be displayed is determined based on the grayscale value of the pixels in the target display area.

[0054] In some embodiments,

[0055] The brightness information of the display unit indicates whether the display unit is a bright area or a dark area;

[0056] The illumination duration for each scanning module is determined based on the number of bright areas and the target duration.

[0057] The target duration is the time required for the light emitted from the light source guided by the reflective surface to illuminate the target modulation area; the number of bright areas is the number of display units in the target display area whose brightness information indicates the number of bright areas.

[0058] In some embodiments,

[0059] Each brightness information indicates the illumination duration of the scanning module corresponding to the display unit in the bright area, which is determined based on the target duration and the number of bright areas;

[0060] The illumination duration of the scanning module corresponding to each display unit whose brightness information indicates a dark area is zero.

[0061] In some embodiments, the brightness information of the unit to be displayed indicates whether the unit to be displayed is a bright area or a dark area;

[0062] The reflective surface deflects at a preset angle each time to guide the light emitted from the light source into each scanning module;

[0063] If the unit to be displayed corresponding to the current scanning module is a bright area, the light emitted from the guide light source will enter the current scanning module and illuminate the current scanning module for a preset illumination time.

[0064] If the unit to be displayed corresponding to the current scanning module is a dark area, the light source is turned off and no light is emitted.

[0065] In some embodiments,

[0066] The reflective surface deflects according to the illumination duration corresponding to each modulation area;

[0067] The illumination duration corresponding to each modulation region is determined based on the brightness information of each region to be displayed in the image to be displayed and the display time of one frame of the image to be displayed; the brightness information of each region to be displayed is determined based on the grayscale value of the pixels in the image to be displayed.

[0068] In some embodiments, the spatial light modulator includes M*N modulation units, each modulation region includes multiple scanning modules, and each scanning module includes m*n modulation units, where m is less than or equal to M and n is less than or equal to N; the driver has rotational degrees of freedom in the first direction and the second direction respectively.

[0069] During the display time of one frame corresponding to the image to be displayed, the driver drives the reflective surface to deflect M / m times in the first direction and N / n times in the second direction;

[0070] The first direction is orthogonal to the second direction; and / or, each modulation region is an area that can be illuminated by the reflective surface deflecting M / m times in the first direction; and / or, the time required for the light emitted by the light source guided by the reflective surface to illuminate each modulation region is the ratio of one frame display time to the number of areas to be displayed or modulation regions.

[0071] Thirdly, this application also provides an image display device suitable for image display equipment, including a light source, a spatial light scanner, and a spatial light modulator, wherein the spatial light modulator includes multiple modulation regions, wherein:

[0072] The processing unit is used to determine the modulation control signal corresponding to each modulation region in the spatial light modulator and the scanning control signal corresponding to the spatial light scanner based on the image to be displayed.

[0073] The scanning unit is used to control the deflection of the spatial light scanner according to the scanning control signal, so as to guide the light emitted from the light source into different modulation areas at different time periods for illumination.

[0074] The modulation unit is used to control each modulation region to be in the corresponding modulation state according to the modulation control signal, so as to modulate the incident light source and obtain the modulated light corresponding to each modulation region.

[0075] The projection unit is used to project the modulated light corresponding to each modulation area to obtain the display image.

[0076] Fourthly, this application also provides a computer-readable storage medium storing a plurality of instructions adapted for loading by a processor to perform the steps in any of the image display methods provided in this application.

[0077] In this application, the spatial light modulator is divided into multiple regions. The light emitted from the light source is guided by the spatial light scanner to illuminate the spatial light modulator according to each region. The brightness is adjusted independently according to the display image requirements of each region, which can simultaneously display very bright and very dark details, and has fine light control capabilities; thereby improving contrast and dark detail performance. Attached Figure Description

[0078] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0079] Figure 1 This is a flowchart illustrating the image display method provided in this application;

[0080] Figure 2 This is a schematic diagram of the projection optical engine provided in this application;

[0081] Figure 3 This is a schematic diagram of the structure of the image display device provided in this application. Detailed Implementation

[0082] The technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0083] This application provides an image display method, apparatus, image display device, and storage medium.

[0084] The following sections provide detailed descriptions of each example. It should be noted that the sequence numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

[0085] In this embodiment, this application provides an image display method applicable to an image display device. The image display device includes a light source, a spatial light scanner, and a spatial light modulator. The spatial light modulator includes multiple modulation regions. The image display method includes:

[0086] S110: Based on the image to be displayed, determine the modulation control signal corresponding to each modulation region in the spatial light modulator, and the scanning control signal corresponding to the spatial light scanner.

[0087] The image to be displayed can be any frame from a video file, a photograph, or the image display interface of an application software in an image display device. The modulation control signal and scanning control signal are not limited; for example, they can be voltage or current signals.

[0088] In some embodiments, the spatial light modulator includes M*N modulation units, each modulation region includes multiple scanning modules, and each scanning module includes m*n modulation units, where m is less than or equal to M and n is less than or equal to N. During one frame of display time corresponding to the image to be displayed, the spatial light scanner deflects M / m times in a first direction and N / n times in a second direction; the first direction and the second direction are orthogonal; and / or, each modulation region is an area that can be illuminated by the spatial light scanner deflecting M / m times in the first direction. Optionally, the modulation units can correspond one-to-one with pixels in the displayed image. For example, the spatial light modulator is a DMD, the modulation units are micromirrors, the spatial light modulator is a liquid crystal panel, and the modulation units can be liquid crystal molecules.

[0089] In some embodiments, the image to be displayed includes a target display area corresponding to a target modulation area among multiple modulation areas, the target display area includes a display unit corresponding to each of multiple scanning modules, and the scanning control signal includes the illumination duration corresponding to each scanning module. The scanning control signal corresponding to the spatial light scanner is determined based on the image to be displayed, and may include, but is not limited to:

[0090] S10: Determine the brightness information of each display unit based on the grayscale values ​​of the pixels in the target display area. For example, the average grayscale value of the pixels in the display unit or the average grayscale value of the pixels along the central axis and diagonal can be calculated, and the brightness information can be determined based on the average value. The brightness information can indicate whether the display unit is a bright area or a dark area, or it can indicate the brightness level, etc.

[0091] S20: Determine the illumination duration for each scanning module based on the brightness information of each unit to be displayed.

[0092] Optionally, the brightness information of the unit to be displayed indicates whether the unit to be displayed is a bright area or a dark area; the target duration required for the light emitted by the light source guided by the spatial light scanner to illuminate the target modulation area can be obtained; Optionally, the duration required for the light emitted by the light source guided by the spatial light scanner to illuminate each modulation area is the ratio of one frame display time to the number of modulation areas, that is, the target duration can be equal to the ratio of one frame display time to the number of modulation areas.

[0093] The number of bright areas in the display unit whose brightness information indicates a bright area is then determined. Based on the number of bright areas and the target duration, the illumination duration corresponding to each scanning module is determined. For example, the illumination duration of the scanning module corresponding to each display unit whose brightness information indicates a bright area can be determined based on the target duration and the number of bright areas; such as the ratio of the target duration to the number of bright areas, or the longer illumination duration for bright areas in the middle of the image to be displayed, and the shorter illumination duration for the edge areas. It is understood that this embodiment does not consider the duration required for spatial light scanner deflection in its description, which needs to be considered in practical applications. The illumination duration of the scanning module corresponding to each display unit whose brightness information indicates a dark area is zero, or it can be less than a certain small value. This involves redistributing the light from one or more dark areas of the image to be displayed to one or more bright areas, making one or more bright areas brighter than one or more dark areas, improving the detail of bright and dark areas in the displayed image, and improving the utilization efficiency of the illumination light, thereby displaying the image under high dynamic range (HDR).

[0094] Optionally, the brightness information of the unit to be displayed can also indicate the brightness level of the unit to be displayed, for example, there can be 10 or 20 levels; the illumination duration corresponding to each scanning module is determined according to the brightness level; for example, the higher the brightness level, the longer the illumination duration of the corresponding modulation area, and the lower the brightness level, the shorter the illumination duration of the corresponding modulation area. If the brightness information is level 0, the corresponding illumination duration can be zero.

[0095] In some embodiments, determining the scanning control signal corresponding to the spatial light scanner based on the image to be displayed includes:

[0096] The process involves determining a one-to-one correspondence between each displayable area and a modulation area based on the brightness information of each area in the image to be displayed; determining the illumination duration for each modulation area based on the display time of a frame corresponding to the image to be displayed and the brightness information of each displayable area; and including the illumination duration for each modulation area in the scan control signal. The brightness information of the displayable area can indicate whether the displayable area is a bright or dark area, or it can indicate the brightness level, etc.

[0097] As can be seen from the above, this solution does not require target light field deduction and holographic calculation, has low computing power requirements, does not require complex algorithms, and runs quickly.

[0098] S120: According to the scanning control signal, control the deflection of the spatial light scanner to guide the light emitted from the light source into different modulation areas at different time periods for illumination.

[0099] The spatial light scanner can include a reflective surface and a driver. The driver deflects the reflective surface to guide light from the source into different modulation regions of the spatial light modulator at different times for illumination. It employs a pure reflection principle for zoned modulation, applicable to both single-wavelength and continuous-spectrum light sources in the visible light band. This avoids the need for optimization of spatial light modulators for single wavelengths and the color break risk and optimization compensation issues caused by diffraction angle deviations of different wavelengths. Furthermore, the pure reflection principle for zoned modulation is independent of the polarization characteristics of light waves, resulting in high light utilization and improved overall system light efficiency.

[0100] Optionally, the reflective surface can be a mirror, which is a metal or inorganic dielectric film high-reflectivity mirror. The material has low intrinsic light absorption, high reflectivity, and strong heat resistance, and can withstand better light density, making it more suitable for high-brightness laser projection systems.

[0101] In some embodiments, according to a scanning control signal, the spatial light scanner is controlled to deflect so as to guide the light emitted from the light source into different modulation regions at different times for illumination, including:

[0102] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into the target modulation region for illumination during the time period t; the target modulation region can be any one of multiple modulation regions.

[0103] Optionally, the target modulation region includes multiple scanning modules, and the target scanning module is any one of the multiple scanning modules; according to the scanning control signal, the spatial light scanner is controlled to deflect so as to guide the light emitted by the light source into the target modulation region for illumination during the time period t, including:

[0104] The scanning control signal includes the target illumination duration and target deflection angle corresponding to the target scanning module; it controls the spatial light scanner to deflect the target deflection angle to guide the light emitted from the light source into the target scanning module at the target time and illuminate the target scanning module for the target illumination duration; the target time is any time within the time period t. That is, when the modulation unit is in the OFF state, the reflective surface will not reflect the light source into the output light path, resulting in energy waste. Furthermore, it can convert the light from areas that do not need illumination (dark areas) into equivalent illumination time for the areas that need illumination (bright areas), greatly reducing energy waste and improving the brightness of the bright field image. It can project arbitrary zone patterns according to the brightness information of the image to be displayed, greatly improving the precision of zone illumination and significantly enhancing the final display effect.

[0105] Optionally, the brightness information of the unit to be displayed indicates whether the unit is a bright area or a dark area; according to the scanning control signal, the spatial light scanner is controlled to deflect so as to guide the light emitted from the light source into the target modulation area for illumination during the time period t, including:

[0106] Within time period t, the spatial light scanner deflects at a preset angle each time to guide the light emitted from the light source into each scanning module. If the unit to be displayed corresponding to the current scanning module is a bright area, the light emitted from the light source is directed into the current scanning module and illuminates it for a preset illumination duration. If the unit to be displayed corresponding to the current scanning module is a dark area, the light source does not emit light. The preset angle and preset illumination duration are not limited and can be customized according to actual application requirements. Depending on the content of the image to be displayed, when the projection trajectory of the spatial light scanner passes through a zone that does not require illumination (i.e., the dark area of ​​the image display), the light source is turned off to reduce energy waste and heat generation. Since the modulation unit in this area is not illuminated, the dark areas of the final displayed image appear deep black, significantly improving contrast.

[0107] In some embodiments, according to a scanning control signal, the spatial light scanner is controlled to deflect to guide the light emitted from the light source into different modulation regions at different time periods for illumination, including:

[0108] The scanning control signal includes the illumination duration and deflection angle corresponding to each modulation region; it controls the spatial light scanner to deflect the corresponding angle to guide the light emitted from the light source into the target modulation region at the target time and illuminate the target modulation region for the corresponding illumination duration. Optionally, the spatial light modulator can guide the light source to illuminate the entire modulation region at once; alternatively, within the modulation region, the spatial light modulator can guide the light source to illuminate one scanning module at a time, with the illumination duration being consistent for each scanning module.

[0109] S130: According to the modulation control signal, control each modulation region to be in the corresponding modulation state so as to modulate the incident light source and obtain the modulated light corresponding to each modulation region.

[0110] In some embodiments, the target modulation region in the target modulation state modulates the incident light source during the time period t to obtain the modulated light corresponding to the target modulation region; the target modulation region is controlled by the corresponding modulation control signal during the time period t-1, thus being in the target modulation state. The target modulation state indicates the state of each modulation unit in the target modulation region; taking liquid crystal as an example, liquid crystal molecules can switch between ON and OFF states in multiple levels to achieve multi-level transmittance / reflectance (i.e., grayscale) modulation. The target modulation state can refer to whether each liquid crystal molecule in the target modulation region is ON, OFF, or in an intermediate state. That is, after the spatial light modulator loads data (modulation control signal) for M*n pixels, the light scanner turns on and completes the illumination of the region during the corresponding time period; this can save the time of displaying one frame of image, thereby increasing the frame rate and improving the image quality.

[0111] In some embodiments, the optical scanner can be turned on and complete the illumination after the spatial light modulator has responded to all modulation control signals.

[0112] S140: Project the modulated light corresponding to each modulation region to obtain the display image.

[0113] Optionally, a display lens can be used to project the modulated light corresponding to each modulation area to obtain a display image. The display image can be displayed on a projection screen.

[0114] As can be seen from the above, this application can divide the spatial light modulator into multiple regions. The light emitted from the light source, guided by the spatial light scanner, illuminates the spatial light modulator according to each region. The brightness is independently adjusted according to the display image requirements of each region, allowing for the simultaneous display of both very bright and very dark details, demonstrating precise light control capabilities. This improves contrast and shadow detail performance. In other words, the image display method of this application effectively utilizes the light source to achieve high-quality HDR display while reducing overall energy consumption.

[0115] To better implement the above methods, this application also provides an image display device. Specifically, this image display device can be integrated into an image display equipment, such as a projector, smart TV, laser TV, mobile phone, tablet computer, smart Bluetooth device, laptop computer, desktop computer, or other similar devices.

[0116] For example, in this embodiment, the method of this application will be described in detail by taking the image display device specifically integrated into the projection device as an example.

[0117] An image display device, suitable for projection equipment, includes a light source, a spatial light scanner, and a spatial light modulator, wherein the spatial light modulator includes multiple modulation regions, wherein:

[0118] The processing unit is used to determine the modulation control signal corresponding to each modulation region in the spatial light modulator and the scanning control signal corresponding to the spatial light scanner based on the image to be displayed.

[0119] The scanning unit is used to control the deflection of the spatial light scanner according to the scanning control signal, so as to guide the light emitted from the light source into different modulation areas at different time periods for illumination.

[0120] The modulation unit is used to control each modulation region to be in the corresponding modulation state according to the modulation control signal, so as to modulate the incident light source and obtain the modulated light corresponding to each modulation region.

[0121] The projection unit is used to project the modulated light corresponding to each modulation area to obtain the display image.

[0122] For detailed implementation methods, please refer to the image display method described above, which will not be repeated here.

[0123] In practice, each of the above units can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units, please refer to the previous method embodiments, which will not be repeated here.

[0124] As can be seen from the above, the image display device of this embodiment can divide the spatial light modulator into multiple regions. The light emitted from the light source is guided by the spatial light scanner to illuminate the spatial light modulator according to each region. The brightness is adjusted independently according to the display image requirements of each region. It can display very bright and very dark details at the same time and has fine light control capabilities, thereby improving contrast and dark detail performance.

[0125] This application also provides an image display device. In this embodiment, a projection device will be used as an example for detailed description. For example, such as... Figure 3 As shown, it illustrates a schematic diagram of the projection device involved in this application.

[0126] In some embodiments, the projection device may include an image processor 201 and a projection optical engine 202. Wherein:

[0127] The image processor 201 can be a microcontroller, a dedicated image processing chip, etc. The microcontroller can be an ARM chip, a microcontroller unit (MCU), etc.; the dedicated image processing chip can be an image signal processor (ISP), a graphics processing unit (GPU), an embedded neural network processing unit (NPU), etc. The image processor 201 can be used for video decoding, image quality processing, etc.

[0128] like Figure 2 As shown, the projection optical engine 202 may include a spatial light scanner, a spatial light modulator, a light source, and a display lens. The light source may be a laser light source or an LED light source, etc.; the spatial light modulator may be a digital micromirror device (DMD), a liquid crystal display (LCD), or a liquid crystal on silicon (LCOS), etc.; the driving chip corresponds to the spatial light modulator, for example, the digital micromirror device may be driven by a digital light processing (DLP) element. The projection optical engine 202 is used to project the image to be displayed into a display image.

[0129] Optionally, the spatial light scanner can be a high-speed scanning micromirror based on MEMS technology, comprising a reflective surface and actuators with rotational degrees of freedom in orthogonal directions; the actuators can be based on piezoelectric, electromagnetic, electrothermal, or electrostatic driving principles.

[0130] Optionally, relay optical elements can be set between the light source and the spatial light scanner, between the spatial light scanner and the spatial light modulator, and between the spatial light modulator and the display lens. These relay optical elements can be focusing lenses, collimating lenses, etc.

[0131] In some embodiments, the spatial light modulator includes a plurality of modulation regions, wherein:

[0132] The light source is used to emit light from the light source, which then enters the spatial light scanner.

[0133] A spatial light scanner includes a reflective surface and a driver. The driver is used to drive the reflective surface to deflect light from the source at different times to illuminate different modulation regions of the spatial light modulator.

[0134] A spatial light modulator, in which each modulation region modulates the incident light source to obtain the modulated light corresponding to each modulation region, which is then incident into the display lens;

[0135] The display lens is used to project the modulated light corresponding to each modulation area to obtain a display image.

[0136] The image processor processes the image to be displayed, determining the modulation control signal corresponding to each modulation region in the spatial light modulator and the scanning control signal corresponding to the spatial light scanner. The image processor sends the scanning control signal to the driver corresponding to the spatial light scanner; the driver responds to the scanning control signal and controls the deflection of the reflective surface. The image processor also sends the modulation control signal to the driver chip corresponding to the spatial light scanner; the driver chip responds to the modulation control signal and controls the modulation unit in the spatial light modulator to be in the corresponding modulation state.

[0137] In some embodiments, the target modulation region is any one of a plurality of modulation regions;

[0138] The target modulation region is in the target modulation state during the (t-1)th time period;

[0139] The reflective surface deflects during the time interval t to guide the light emitted from the light source into the target modulation area for illumination;

[0140] The target modulation region modulates the incident light source during time period t to obtain the corresponding modulated light.

[0141] In some embodiments, the target modulation region in the plurality of modulation regions includes a plurality of scanning modules, and the target scanning module is any one of the plurality of scanning modules;

[0142] The reflective surface deflects the target scanning module by the corresponding deflection angle to guide the light emitted from the light source into the target scanning module and illuminate the target scanning module for the corresponding illumination duration.

[0143] In some embodiments, the image display device is used to display an image to be displayed, the image to be displayed including a plurality of display areas corresponding one-to-one with a plurality of modulation areas; the target display area corresponding to the target modulation area among the plurality of display areas includes a display unit corresponding one-to-one with a plurality of scanning modules;

[0144] The illumination duration for each scanning module is determined based on the brightness information of each unit to be displayed.

[0145] The brightness information of each unit to be displayed is determined based on the grayscale value of the pixels in the target display area.

[0146] In some embodiments,

[0147] The brightness information of the display unit indicates whether the display unit is a bright area or a dark area;

[0148] The illumination duration for each scanning module is determined based on the number of bright areas and the target duration.

[0149] The target duration is the time required for the light emitted from the light source guided by the reflective surface to illuminate the target modulation area; the number of bright areas is the number of display units in the target display area whose brightness information indicates the number of bright areas.

[0150] In some embodiments,

[0151] Each brightness information indicates the illumination duration of the scanning module corresponding to the display unit in the bright area, which is determined based on the target duration and the number of bright areas;

[0152] The illumination duration of the scanning module corresponding to each display unit whose brightness information indicates a dark area is zero.

[0153] In some embodiments, the brightness information of the unit to be displayed indicates whether the unit to be displayed is a bright area or a dark area;

[0154] The reflective surface deflects at a preset angle each time to guide the light emitted from the light source into each scanning module;

[0155] If the unit to be displayed corresponding to the current scanning module is a bright area, the light emitted from the guide light source will enter the current scanning module and illuminate the current scanning module for a preset illumination time.

[0156] If the unit to be displayed corresponding to the current scanning module is a dark area, the light source is turned off and no light is emitted.

[0157] In some embodiments,

[0158] The reflective surface deflects according to the illumination duration corresponding to each modulation area;

[0159] The illumination duration corresponding to each modulation region is determined based on the brightness information of each region to be displayed in the image to be displayed and the display time of one frame of the image to be displayed; the brightness information of each region to be displayed is determined based on the grayscale value of the pixels in the image to be displayed.

[0160] In some embodiments, the spatial light modulator includes M*N modulation units, each modulation region includes multiple scanning modules, and each scanning module includes m*n modulation units, where m is less than or equal to M and n is less than or equal to N; the driver has rotational degrees of freedom in the first direction and the second direction respectively.

[0161] During the display time of one frame corresponding to the image to be displayed, the driver drives the reflective surface to deflect M / m times in the first direction and N / n times in the second direction;

[0162] The first direction is orthogonal to the second direction; and / or, each modulation region is an area that can be illuminated by the reflective surface deflecting M / m times in the first direction; and / or, the time required for the light emitted by the light source guided by the reflective surface to illuminate each modulation region is the ratio of one frame display time to the number of areas to be displayed or modulation regions.

[0163] The specific implementation method can be found in the description of the image display method above, and will not be repeated here.

[0164] In some embodiments, the image projection device further includes a central controller 203 with one or more processing cores. The central controller may be a CPU, ARM, MCU, or other controller. The central controller 203 is the control center of the projection device, connecting various parts of the entire projection device through various interfaces and lines. It can run or execute software programs and / or operating systems stored in the memory 204, and call data stored in the memory 204.

[0165] In some embodiments, the projection device further includes a memory 204, an input module 205, a communication module 206, a power supply 207, and other components of one or more computer-readable storage media. Those skilled in the art will understand that... Figure 2 The projection device structure shown does not constitute a limitation on the projection device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0166] The memory 204 can be used to store software programs and operating systems. The central controller 203 executes various functional applications and data processing by running the software programs and operating systems stored in the memory 204. The memory 204 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the projection device, etc. In addition, the memory 204 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 204 may also include a memory controller to provide the central controller 203 with access to the memory 204.

[0167] The projection device may also include an input module 205, which can be used to receive input digital or character information, and generate remote control, keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0168] The projection device may also include a communication module 206. In some embodiments, the communication module 206 may include a wireless module, through which the projection device can perform short-range wireless transmission, thereby providing users with wireless broadband internet access. For example, the communication module 206 can be used to help users access streaming media.

[0169] The projection device also includes a power supply 207 that supplies power to the various components. In some embodiments, the power supply 207 can be logically connected to the central controller 203 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 207 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0170] As can be seen from the above, the projection device provided in this embodiment divides the spatial light modulator into multiple regions. The light emitted from the light source is guided by the spatial light scanner to illuminate the spatial light modulator according to each region. The brightness is adjusted independently according to the display image requirements of each region, which can simultaneously display very bright and very dark details, and has fine light control capabilities; thereby improving contrast and dark detail performance.

[0171] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0172] Therefore, this application provides a computer-readable storage medium storing a plurality of instructions that can be loaded by a processor to execute the steps in any of the image display methods provided in this application. For example, the instructions can execute the following steps:

[0173] Based on the image to be displayed, determine the modulation control signal corresponding to each modulation region in the spatial light modulator, and the scanning control signal corresponding to the spatial light scanner;

[0174] According to the scanning control signal, the spatial light scanner is deflected to guide the light emitted from the light source into different modulation areas at different time periods for illumination.

[0175] According to the modulation control signal, each modulation region is controlled to be in the corresponding modulation state so as to modulate the incident light source and obtain the modulated light corresponding to each modulation region;

[0176] The modulated light corresponding to each modulation region is projected to obtain the displayed image.

[0177] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0178] According to one aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the image display method provided in the above embodiments.

[0179] Since the instructions stored in the storage medium can execute the steps of any of the image display methods provided in this application, the beneficial effects that any of the image display methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0180] The foregoing has provided a detailed description of an image display method, apparatus, device, and computer-readable storage medium. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An image display method characterized by, The application relates to an image display method and device. According to the image to be displayed, modulation control signals corresponding to each modulation region in the spatial light modulator and scanning control signals corresponding to the spatial light scanner are determined. According to the scanning control signals, the spatial light scanner is controlled to deflect so as to guide light source light emitted by the light source to enter different modulation regions for illumination at different time periods. According to the modulation control signals, each modulation region is controlled to be in a corresponding modulation state so as to modulate the entered light source light, thereby obtaining modulated light corresponding to each modulation region. The modulated light corresponding to each modulation region is projected, thereby obtaining a display image.

2. The image display method according to claim 1, wherein According to the scanning control signals, the spatial light scanner is controlled to deflect so as to guide light source light emitted by the light source to enter different modulation regions for illumination at different time periods. According to the scanning control signals, the spatial light scanner is controlled to deflect so as to guide light source light emitted by the light source to enter different modulation regions for illumination at different time periods. According to the modulation control signals, each modulation region is controlled to be in a corresponding modulation state so as to modulate the entered light source light, thereby obtaining modulated light corresponding to each modulation region. The target modulation region includes a plurality of scanning modules, and a target scanning module is any one of the plurality of scanning modules.

3. The image display method according to claim 2, characterized by, According to the scanning control signals, the spatial light scanner is controlled to deflect so as to guide light source light emitted by the light source to enter different modulation regions for illumination at different time periods. The scanning control signals include a target illumination time length and a target deflection angle corresponding to the target scanning module. The spatial light scanner is controlled to deflect by the target deflection angle so as to guide light source light emitted by the light source to enter the target scanning module at a target time and irradiate the target scanning module for the target illumination time length; the target time is any time within the tth time period. The image to be displayed includes a target display region corresponding to a target modulation region in the plurality of modulation regions, the target display region includes a to-be-displayed unit corresponding to each scanning module in one-to-one correspondence, and the scanning control signals include an illumination time length corresponding to each scanning module.

4. The image display method according to claim 1, characterized by, According to the gray value of a pixel in the target display region, the brightness information of each to-be-displayed unit is determined. ​ According to the brightness information of each of the to-be-displayed units, a corresponding illumination time length of each scanning module is determined.

5. The image display method according to claim 4, wherein The brightness information of the to-be-displayed unit indicates that the to-be-displayed unit is a bright area or a dark area, and the corresponding illumination time length of each scanning module is determined according to the brightness information of each of the to-be-displayed units, including: Obtaining a target time length required for the spatial light scanner to guide the light source light emitted by the light source to illuminate the target modulation region; Determining the number of bright areas of the to-be-displayed units in the target display region whose brightness information indicates bright areas; According to the number of bright areas and the target time length, the corresponding illumination time length of each scanning module is determined.

6. The image display method according to claim 5, wherein According to the number of bright areas and the target time length, the corresponding illumination time length of each scanning module is determined, including: The illumination time length of the scanning module corresponding to each to-be-displayed unit whose brightness information indicates a bright area is determined according to the target time length and the number of bright areas; The illumination time length of the scanning module corresponding to each to-be-displayed unit whose brightness information indicates a dark area is zero.

7. The image display method according to claim 4, wherein The brightness information of the to-be-displayed unit indicates that the to-be-displayed unit is a bright area or a dark area; According to the scanning control signal, the spatial light scanner is controlled to deflect to guide the light source light emitted by the light source to enter the target modulation region for illumination in the tth time period, including: In the tth time period, the spatial light scanner is controlled to deflect by a preset angle each time to be able to guide the light source light emitted by the light source to enter each scanning module; If the to-be-displayed unit corresponding to the current scanning module is a bright area, the light source light emitted by the light source is guided to enter the current scanning module and irradiate the current scanning module for a preset illumination time length; If the to-be-displayed unit corresponding to the current scanning module is a dark area, the light source does not emit light source light.

8. The image display method of claim 1, wherein The scanning control signal corresponding to the spatial light scanner is determined according to the to-be-displayed image, including: The brightness information of each to-be-displayed region in the to-be-displayed image is determined, and each to-be-displayed region corresponds to a modulation region one by one; According to a frame display time corresponding to the to-be-displayed image and the brightness information of each to-be-displayed region, the illumination time length corresponding to each modulation region is determined; and the scanning control signal includes the illumination time length corresponding to each modulation region.

9. The image display method of claim 1, wherein The spatial light modulator includes M*N modulation units, each modulation region includes a plurality of scanning modules, each scanning module includes m*n modulation units, m is less than or equal to M, and n is less than or equal to N; In the frame display time corresponding to the to-be-displayed image, the spatial light scanner deflects M / m times in a first direction and N / n times in a second direction; The first direction is orthogonal to the second direction; and / or each modulation region is a region that can be illuminated by the spatial light scanner deflecting M / m times in the first direction; And / or the time length required for the spatial light scanner to guide the light source light emitted by the light source to illuminate each modulation region is a ratio of the frame display time and the number of modulation regions.

10. An image display system characterized by comprising: The image display device includes a light source, a spatial light scanner, a spatial light modulator, and a display lens, and the spatial light modulator includes a plurality of modulation regions, including: The light source is configured to emit light source light, and the light source light is incident on the spatial light scanner; The spatial light scanner comprises a reflecting surface and a driver, and the driver is configured to drive the reflecting surface to deflect to guide the light source light to be incident on different modulation regions of the spatial light modulator at different time periods to be illuminated; The spatial light modulator is configured to modulate the incident light source light in each modulation region to obtain modulated light corresponding to each modulation region, and then the modulated light is incident on the display lens; The display lens is configured to project the modulated light corresponding to each modulation region to obtain a display image.

11. The image display device according to claim 10, wherein The target modulation region is any one of the plurality of modulation regions; The target modulation region is in a target modulation state in a t-1 time period; The reflecting surface deflects in the t time period to guide the light source light emitted by the light source to be incident on the target modulation region to be illuminated; The target modulation region modulates the incident light source light in the t time period to obtain corresponding modulated light.

12. The image display apparatus according to claim 10, wherein The target modulation region in the plurality of modulation regions comprises a plurality of scanning modules, and a target scanning module is any one of the plurality of scanning modules; The reflecting surface deflects by a deflection angle corresponding to the target scanning module to guide the light source light emitted by the light source to be incident on the target scanning module and irradiate the target scanning module for a corresponding illumination time length.

13. The image display apparatus according to claim 11, wherein The image display device is configured to display a to-be-displayed image, and the to-be-displayed image comprises a plurality of to-be-displayed regions corresponding to the plurality of modulation regions in a one-to-one manner; a target display region corresponding to the target modulation region in the plurality of to-be-displayed regions comprises a to-be-displayed unit corresponding to the plurality of scanning modules in a one-to-one manner; The illumination time length corresponding to each scanning module is determined according to brightness information of each to-be-displayed unit; The brightness information of each to-be-displayed unit is determined according to a gray value of a pixel in the target display region.

14. The image display device of claim 13, wherein The brightness information of the to-be-displayed unit indicates that the to-be-displayed unit is a bright region or a dark region; The illumination time length corresponding to each scanning module is determined according to a number of bright regions and a target time length; The target time length is a time length required for the reflecting surface to guide the light source light emitted by the light source to illuminate the target modulation region; and the number of bright regions is a number of to-be-displayed units in the target display region whose brightness information indicates a bright region.

15. The image display device of claim 14, wherein The illumination time length of the scanning module corresponding to each to-be-displayed unit whose brightness information indicates a bright region is determined according to the target time length and the number of bright regions; The illumination time length of the scanning module corresponding to each to-be-displayed unit whose brightness information indicates a dark region is zero.

16. The image display apparatus according to claim 13, wherein The brightness information of the to-be-displayed unit indicates that the to-be-displayed unit is a bright region or a dark region; The reflecting surface deflects by a preset angle each time to be able to guide the light source light emitted by the light source to be incident on each scanning module; If a to-be-displayed unit corresponding to a current scanning module is a bright region, the light source light emitted by the light source is guided to be incident on the current scanning module and irradiate the current scanning module for a preset illumination time length; If the to-be-displayed unit corresponding to the current scanning module is a dark area, the light source is turned off, and no light source light is emitted.

17. The image display device of claim 10, wherein, the reflecting surface deflects according to an illumination time length corresponding to each modulation region; the illumination time length corresponding to each modulation region is determined according to brightness information of each to-be-displayed region in the to-be-displayed image and a frame display time corresponding to the to-be-displayed image; and the brightness information of each to-be-displayed region is determined according to a gray value of a pixel in the to-be-displayed image.

18. The image display device of claim 10, wherein, the spatial light modulator includes M*N modulation units, each modulation region includes a plurality of scanning modules, and each scanning module includes m*n modulation units, where m is less than or equal to M, and n is less than or equal to N; the driver has rotational degrees of freedom in the first direction and the second direction, respectively; within the frame display time corresponding to the to-be-displayed image, the driver drives the reflecting surface to deflect M / m times in the first direction and N / n times in the second direction; the first direction is orthogonal to the second direction; and / or each modulation region is a region that can be illuminated by the reflecting surface deflecting M / m times in the first direction; and / or the time length required for the reflecting surface to guide the light source light emitted by the light source to illuminate each modulation region is a ratio of the frame display time to the number of to-be-displayed regions or modulation regions.

19. An image display device, characterized by comprising: The application is suitable for an image display device, which includes a light source, a spatial light scanner, and a spatial light modulator including a plurality of modulation regions, wherein: a processing unit is configured to determine, according to a to-be-displayed image, a modulation control signal corresponding to each modulation region in the spatial light modulator and a scanning control signal corresponding to the spatial light scanner; a scanning unit is configured to control the spatial light scanner to deflect according to the scanning control signal, so as to guide light source light emitted by the light source to enter different modulation regions for illumination at different time periods; a modulation unit is configured to control each modulation region to be in a corresponding modulation state according to the modulation control signal, so as to modulate the entered light source light and obtain modulated light corresponding to each modulation region; a projection unit is configured to project the modulated light corresponding to each modulation region, and obtain a display image.

20. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a plurality of instructions, which are suitable for being loaded by a processor to execute the steps in the image display method of any one of claims 1-9.

Images