Projection Image Display Method, Device, Equipment and Storage Medium

Abstract

The present invention discloses a projection image display method, apparatus, device and storage medium, relating to the field of projection technology. The method includes: dividing a high dynamic range image to be displayed into a global image and a local image, controlling a spatial light modulator to form a first light for displaying a first color sub-image in the global image in a first sub-period of a first illumination period, and controlling the spatial light modulator to form a second light for displaying a first color sub-image in the local image in a second sub-period of the first illumination period. The present invention can achieve HDR display through a single spatial light modulator, and has simple timing control.

Description

Technical Field

[0001] The present invention relates to the field of projection technology, and particularly to a projection image display method, apparatus, device, and storage medium. Background Art

[0002] High Dynamic Range Imaging (HDRI or HDR for short) is a set of technologies used to achieve a larger exposure dynamic range (i.e., a larger difference between light and dark) than ordinary digital image technologies. The purpose of high dynamic range imaging is to correctly represent the luminance range as large as from direct sunlight to the darkest shadow in the real world. Since the HDR technology can display more details in bright and dark parts, the displayed image is closer to what the human eye sees. With the development of projection technology, the HDR technology has been widely applied to projection devices to optimize the display effect of projection devices. Summary of the Invention

[0003] In current projection devices, in order to achieve HDR display, usually a high dynamic range image to be displayed is divided into a standard part (global image) and a detail part (local image), and then two spatial light modulators (such as digital micromirror devices DMD) are used to modulate the standard part (global image) and the detail part (local image) respectively, which has a high cost and requires coordinating two spatial light modulators, and the control is complex. In view of this, the present invention provides a projection image display method, apparatus, device, and storage medium to achieve HDR display based on one spatial light modulator.

[0004] In a first aspect, the present invention provides a projection image display method, including:

[0005] Dividing a high dynamic range image to be displayed into a global image and a local image;

[0006] Controlling a spatial light modulator to form a first light for displaying a first color sub-image in the global image in a first sub-period of a first illumination period, and controlling the spatial light modulator to form a second light for displaying a first color sub-image in the local image in a second sub-period of the first illumination period, where the first sub-period and the second sub-period are two different sub-periods in the first illumination period.

[0007] In a second aspect, the present invention provides a projection image display apparatus, including an image display module, and the image display module is configured to perform the following steps:

[0008] Dividing a high dynamic range image to be displayed into a global image and a local image;

[0009] During a first sub-period of a first illumination period, control the spatial light modulator to form a first light for displaying a first color sub-image in the global image, and during a second sub-period of the first illumination period, control the spatial light modulator to form a second light for displaying a first color sub-image in the local image, where the first sub-period and the second sub-period are two different sub-periods in the first illumination period.

[0010] In a possible implementation, the image display module is further configured to perform the following steps:

[0011] Adjust the time ratios of the first sub-period and the second sub-period in the first illumination period according to the ratios of the global image and the local image in the high-dynamic-range image to be displayed.

[0012] In a possible implementation, the image display module is further configured to perform the following steps:

[0013] During a third sub-period of a second illumination period, control the spatial light modulator to form a third light for displaying a second color sub-image in the global image, and during a fourth sub-period of the second illumination period, control the spatial light modulator to form a fourth light for displaying a second color sub-image in the local image, where the third sub-period and the fourth sub-period are two different sub-periods in the second illumination period, and the second illumination period is a different period from the first illumination period.

[0014] In a possible implementation, the image display module is further configured to perform the following steps:

[0015] During a fifth sub-period of a third illumination period, control the spatial light modulator to form a fifth light for displaying a third color sub-image in the global image, and during a sixth sub-period of the third illumination period, control the spatial light modulator to form a sixth light for displaying a third color sub-image in the local image, where the fifth sub-period and the sixth sub-period are two different sub-periods in the third illumination period, and the third illumination period is a different period from the second illumination period and the first illumination period.

[0016] In a possible implementation, the image display module is further configured to perform the following steps:

[0017] Determine whether the brightness display range of the projection device exceeds the standard range;

[0018] If the brightness display range of the projection device exceeds or is equal to the standard range, perform the step of dividing the high-dynamic-range image to be displayed into a global image and a local image.

[0019] In a possible implementation, the image display module is further configured to perform the following steps:

[0020] Determine whether the maximum refresh rate supported by the projection device is greater than twice the original image frame rate;

[0021] If the maximum refresh rate supported by the projection device is greater than or equal to twice the original image frame rate, perform the step of dividing the high-dynamic range image to be displayed into a global image and a local image.

[0022] In a possible implementation, the image display module is further configured to perform the following steps:

[0023] Determine whether the maximum refresh rate supported by the projection device is greater than twice the original image frame rate. If it is less, perform frame dropping processing; if it is greater than or equal, keep the original image frame rate unchanged for image display.

[0024] In a possible implementation, the image display module is further configured to perform the following steps:

[0025] Perform tone mapping on the global image and the local image respectively.

[0026] In a possible implementation, the performing tone mapping on the global image and the local image respectively includes:

[0027] Obtain the current brightness level of the projection device;

[0028] Perform tone mapping on the global image and the local image respectively according to the brightness level.

[0029] In a third aspect, the present invention provides a projection device, including:

[0030] A light source device for emitting a light beam;

[0031] A spatial light modulator located on the light-emitting side of the light source device, and the spatial light modulator is configured to modulate incident light into image light;

[0032] A projection lens located on the light-emitting side of the spatial light modulator, and the projection lens is configured to image the light emitted by the spatial light modulator;

[0033] A processor connected to the spatial light modulator. The processor is configured to divide a high-dynamic range image to be displayed into a global image and a local image; control the spatial light modulator to form a first light for displaying a first color sub-image in the global image in a first sub-period of a first illumination period, and control the spatial light modulator to form a second light for displaying a first color sub-image in the local image in a second sub-period of the first illumination period, where the first sub-period and the second sub-period are two different sub-periods in the first illumination period.

[0034] In a fourth aspect, the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory, where the processor executes the computer program to implement the method described in the first aspect.

[0035] In a fifth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the first aspect is implemented.

[0036] In a sixth aspect, the present invention provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in an electronic device, the processor in the electronic device executes the method described in the first aspect.

[0037] It should be noted that the device described in the second aspect, the projection device described in the third aspect, the electronic device described in the fourth aspect, the storage medium described in the fifth aspect, and the computer program product described in the sixth aspect are used to execute the method provided in the first aspect above. Therefore, the same beneficial effects as the method described in the first aspect can be achieved, and the present invention will not elaborate on them one by one.

[0038] The present invention divides the high-dynamic range image to be displayed into a global image and a local image. In the first sub-period of the first illumination period, the spatial light modulator is controlled to form a first light for displaying the first color sub-image in the global image. In the second sub-period of the first illumination period, the spatial light modulator is controlled to form a second light for displaying the first color sub-image in the local image. HDR display can be achieved through one spatial light modulator, and the timing control is simple. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a schematic diagram of the functional modules of a projection device provided by an embodiment of the present invention;

[0040] Figure 2 It is a schematic diagram of the structure of a projection device provided by an embodiment of the present invention;

[0041] Figure 3 It is a schematic diagram of a projection image display method provided by an embodiment of the present invention;

[0042] Figure 4 It is a schematic diagram of the timing control of the light source of a projection device provided by an embodiment of the present invention;

[0043] Figure 5 It is a schematic diagram of the timing control of the light source of a projection device in the prior art;

[0044] Figures 6-7A schematic diagram of the image input sequence provided by an embodiment of the present invention;

[0045] Figure 8 Another schematic diagram of the projection image display method provided by an embodiment of the present invention;

[0046] Figure 9 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Detailed implementation manners

[0047] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. Although the disclosed content in the present invention is introduced according to one or several exemplary examples, it should be understood that each aspect of these disclosed contents can also constitute a complete technical solution alone. Without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0048] In order to thoroughly understand the present invention, a detailed description will be provided below to explain the technical solutions of the present invention. The preferred embodiments of the present invention are described in detail as follows. However, in addition to these detailed descriptions, the present invention can also have other implementation manners.

[0049] Figure 1 A schematic diagram of the functional modules of a projection device provided by an embodiment of the present invention. As Figure 1 shown, the projection device includes an image processor 101 and a projection optical engine 102. Among them:

[0050] The image processor 101 can be a microcontroller, a dedicated image processing chip, etc. The microcontroller can be an ARM chip, a microcontroller unit (MCU), etc.; the dedicated image processing chip can be an image signal processor (ISP), a graphics processing unit (GPU), an embedded neural network processor (NPU), etc. The image processor 101 can be used for video decoding, picture quality processing, etc.

[0051] The projection optical engine 102 can include a driving chip, a spatial light modulator 204 (refer to Figure 2) and light sources, etc. Among them, the light source can include a laser light source, an LED light source, etc.; the spatial light modulator 204 can be a digital micromirror device (Digtial Micromirror Devices, DMD), a liquid crystal device (Liquid Crystal Display, LCD), a liquid crystal on silicon device (Liquid Crystal on Silicon, LCOS), etc.; the driving chip corresponds to the spatial light modulator 204. For example, a digital micromirror device can be driven by a digital light processing element (Digital Light Processing, DLP). The projection optical machine 102 is used to project the image to be projected into a projection screen.

[0052] In some embodiments, the projection device further includes a central controller 103 with one or more processing cores, and the central controller can be a controller such as a CPU, ARM, or MCU. The central controller 103 is the control center of the projection device. It uses various interfaces and lines to connect all parts of the projection device, and can run or execute software programs and / or operating systems stored in the storage module 104, and call data stored in the storage module 104. Optionally, the image processor 101 and the central controller 103 can be integrated into one processor.

[0053] In some embodiments, the projection device further includes components such as a storage module 104 with one or more computer-readable storage media, an input module 105, a communication module 106, and a power supply 107. Those skilled in the art can understand that Figure 1 the projection device structure shown does not limit the projection device, and it can include more or fewer components than shown, or combine certain components, or have different component arrangements. Among them:

[0054] The storage module 104 can be used to store software programs and operating systems. The central controller 103 executes various functional applications and data processing by running the software programs and operating systems stored in the storage module 104. The storage module 104 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the projection device. In addition, the storage module 104 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices. Correspondingly, the storage module 104 can also include a memory controller to provide the central controller 103 with access to the storage module 104.

[0055] The projection device may further include an input module 105, which can be used to receive input digital or character information, and generate remote control, keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0056] The projection device may further include a communication module 106. In some embodiments, the communication module 106 may include a wireless module. The projection device can perform short-distance wireless transmission through the wireless module of the communication module 106, thereby providing users with wireless broadband Internet access. For example, the communication module 106 can be used to help users access streaming media, etc.

[0057] The projection device further includes a power supply 107 for powering each component. In some embodiments, the power supply 107 can be logically connected to the central controller 103 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 107 may further include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power status indicator.

[0058] Figure 2 It is a schematic structural diagram of a projection device provided by an embodiment of the present invention. As Figure 2 shown, the projection device includes a light source device 201, an optical system 202, and an imaging system 203. Among them, the light source device 201 includes one or more light sources and optical elements for collimating and combining the light of the light sources; the light beam emitted by the light source device 201 is irradiated onto the spatial light modulator 204 through the optical system 202, and the spatial light modulator 204 modulates its incident light into image light, and the image light is imaged onto a projection object such as a screen through the imaging system 203. The imaging system 203 is generally a lens system, such as a projection lens.

[0059] In addition, the projection device may further include a light source control module (not shown in the figure). The light source control module can control the actions of one or more light sources in the light source device 201, so that the light source device 201 emits light in a specified wavelength band required for generating an image. Further, the light source device 201, the optical system 202, and the imaging system 203 can all be included in the projection optical engine 102 (refer to Figure 1 ).

[0060] The projection image display method provided by the embodiment of the present invention can be realized by running or executing software programs and / or operating systems stored in the storage module 104 through the central controller 103, or can be realized by the image processor 101 executing corresponding instructions. The projection image display method provided by the embodiment of the present invention includes the following contents:

[0061] S1001. Divide the high-dynamic range image to be displayed into a global image and a local image.

[0062] As Figure 3 shown, first obtain the HDR original image, that is, the high-dynamic range image to be displayed, and then perform image division on the obtained HDR original image, dividing the HDR original image into a standard part (global image) and a detail part (local image).

[0063] S1002. Control the spatial light modulator to form a first light for displaying the first color sub-image in the global image during a first sub-period in the first illumination period, and control the spatial light modulator to form a second light for displaying the first color sub-image in the local image during a second sub-period in the first illumination period, where the first sub-period and the second sub-period are two different sub-periods in the first illumination period.

[0064] Specifically, the spatial light modulator can be controlled by a driving chip, as Figure 3 shown. In an embodiment of the present invention, the spatial light modulator can be a Digital Micromirror Devices (DMD), a Liquid Crystal Display (LCD), a Liquid Crystal on Silicon (LCOS), etc., and the driving chip corresponds to the spatial light modulator. Hereinafter, taking the spatial light modulator as a DMD and the driving chip as a DLP as an example for specific introduction.

[0065] In DLP projection technology, the light source can emit R (red), G (green), and B (blue) three-color lights in sequence (or, B (blue), Y (yellow) two-color lights; or, R (red), G (green), B (blue), Y (yellow) and other more colors). The lights of various colors are projected onto the DMD chip. After receiving the control signal from the DLP control system, the DMD chip reflects the lights of different colors to the projection lens, and then forms an image on the projection screen. Among them, the DMD chip includes a lot of micromirrors, and one micromirror corresponds to one pixel. A rotating device is provided below each micromirror. Under the control of the digital driving signal output by the DLP control system, the micromirror can flip between the ON state and the OFF state. When the micromirror is in the ON state, the incident light is reflected to the projection lens to form image light; when the micromirror is in the OFF state, the incident light is reflected to the area outside the projection lens to form non-image light. The DLP control system controls the number of times (total duration) that the corresponding micromirror is in the ON state according to the gray scale value of each pixel in the image frame data, and the number of times (total duration) that each micromirror is in the ON state determines the brightness of the corresponding pixel on the projection screen.

[0066] Figure 4 Schematic diagram of timing control of a light source of a projection device provided by an embodiment of the present invention. As Figure 4 shown, the illumination period of the red light source includes two sub-periods R1 and R2, the illumination period of the green light source includes two sub-periods G1 and G2, and the illumination period of the blue light source includes two sub-periods B1 and B2.

[0067] In the R1 period, the DLP control system controls the DMD chip to form image light for displaying the red sub-image in the global image, so as to form the red sub-image in the global image on the projection screen; in the R2 period, the DLP control system controls the DMD chip to form image light for displaying the red sub-image in the local image, so as to form the red sub-image in the local image on the projection screen.

[0068] In the G1 period, the DLP control system controls the DMD chip to form image light for displaying the green sub-image in the global image, so as to form the green sub-image in the global image on the projection screen; in the G2 period, the DLP control system controls the DMD chip to form image light for displaying the green sub-image in the local image, so as to form the green sub-image in the local image on the projection screen.

[0069] In the B1 period, the DLP control system controls the DMD chip to form image light for displaying the blue sub-image in the global image, so as to form the blue sub-image in the global image on the projection screen; in the B2 period, the DLP control system controls the DMD chip to form image light for displaying the blue sub-image in the local image, so as to form the blue sub-image in the local image on the projection screen, thereby performing time mixing using the visual inertia of the human eye to achieve color image display.

[0070] Figure 5 Schematic diagram of timing control of a light source of a projection device in the prior art. As Figure 5As shown, in the dual-DMD projection device, during the illumination period R11 of the first red light source, the first DMD chip is controlled to form image light for displaying the red sub-image in the global image, so as to form the red sub-image in the global image on the projection screen; during the illumination period G11 of the first green light source, the first DMD chip is controlled to form image light for displaying the green sub-image in the global image, so as to form the green sub-image in the global image on the projection screen; during the illumination period B11 of the first blue light source, the first DMD chip is controlled to form image light for displaying the blue sub-image in the global image, so as to form the blue sub-image in the global image on the projection screen; during the illumination period R12 of the second red light source, the second DMD chip is controlled to form image light for displaying the red sub-image in the local image, so as to form the red sub-image in the local image on the projection screen; during the illumination period G12 of the second green light source, the second DMD chip is controlled to form image light for displaying the green sub-image in the local image, so as to form the green sub-image in the local image on the projection screen; during the illumination period B12 of the second blue light source, the second DMD chip is controlled to form image light for displaying the blue sub-image in the local image, so as to form the blue sub-image in the local image on the projection screen, thereby performing temporal color mixing by utilizing the visual inertia of the human eye to achieve color image display.

[0071] Compared with the timing control for implementing HDR display based on two DMD chips in the prior art, the timing control in the embodiments of the present invention is simple and can be achieved by changing the control of the DMD chip, avoiding the disadvantage of the large control difficulty that both the existing timing and the control of the DMD chip need to be changed.

[0072] It should be noted that the order of the sub-periods for the global image and the local image in the illumination period of each color can be interchanged, and the order of the illumination periods of each color can also be interchanged. The embodiments of the present invention do not limit this.

[0073] In some embodiments, the time ratios of the two sub-periods in each illumination period can also be adjusted according to the proportions of the global image and the local image in the HDR original image. Taking the illumination period of the red light source as an example, for example, in an HDR original image, the global image accounts for 40% and the local image accounts for 60%, then the time ratio corresponding to R1 and R2 is 2:3, which can make the image display effect better. Optionally, the two sub-periods in the illumination period of each color are two consecutive periods.

[0074] In some embodiments, after the HDR raw image is divided, the global image and the local image can be tone-mapped separately to map the global image and the local image into images that can be displayed by the projection device. The DLP control system controls the DMD chip according to the mapped images. The specific method of tone mapping is a prior art and will not be introduced in detail in the embodiments of the present invention. In the embodiments of the present invention, image division is performed first, and then the global image and the local image are tone-mapped separately, so that the adjustable brightness range is increased and the image display effect is better.

[0075] Further, the current brightness level of the projection device can be obtained first, and then the global image and the local image are tone-mapped according to the brightness level. Different brightness levels correspond to different brightness ranges. The brightness level can be a system evenly divided setting level, a division level selected by the user, or a brightness level set according to hardware parameters. If it is for selection, the process includes:

[0076] The user selects the first mode in the menu options. Exemplarily, the modes include a high-brightness mode, a color mode, and an eye protection mode;

[0077] The brightness levels corresponding to the high-brightness mode, the color mode, and the eye protection mode are high, medium, and low in sequence.

[0078] Tone mapping in combination with the brightness level of the projection device further improves the image display effect, and in combination with the user side, it is displayed according to the mode selected by the user, improving the user experience.

[0079] In some embodiments, it is also possible to judge the maximum refresh rate supported by the projection device and the frame rate of the raw image. If the maximum refresh rate supported by the projection device is less than twice the frame rate of the raw image, frame dropping processing is performed, as Figure 6 shown; if the maximum refresh rate supported by the projection device is greater than or equal to twice the frame rate of the raw image, the frame rate of the raw image remains unchanged for image display, as Figure 7 shown.

[0080] Figure 8 This is a schematic diagram of another projection image display method provided by the embodiments of the present invention. As Figure 8 shown, the projection image display method includes the following:

[0081] S2001. Obtain the HDR raw image.

[0082] S2002. Judge whether the maximum refresh rate supported by the projection device is greater than twice the frame rate of the raw image.

[0083] If the maximum refresh rate supported by the projection device is less than twice the original image frame rate, the driver chip is instructed to control the spatial light modulator to form image light; if the maximum refresh rate supported by the projection device is greater than or equal to twice the original image frame rate, step S2003 is executed.

[0084] S2003. Determine whether the brightness display range of the projection device exceeds the standard range.

[0085] If the brightness display range of the projection device is less than the standard range, the driver chip is instructed to control the spatial light modulator to form image light; if the brightness display range of the projection device exceeds or is equal to the standard range, step S2004 is executed.

[0086] S2004. Divide the HDR original image into a global image and a local image, and perform tone mapping on the global image and the local image respectively, map the global image and the local image into images that can be displayed by the projection device, and instruct the driver chip to control the spatial light modulator to form image light according to the mapped image information.

[0087] The method for the driver chip to control the spatial light modulator to form image light can refer to step S1002 and will not be elaborated here.

[0088] It should be noted that the order of the above steps S2002 and S2003 can be interchanged, and only one of step S2002 and step S2003 can be included. The embodiments of the present invention do not limit this. The embodiments of the present invention comprehensively consider the hardware parameters of the projection device, combine the refresh rate and the brightness display range, and achieve multiple levels of brightness range; if the refresh rate supported by the projection device is four times the original image frame rate, then the original brightness can be divided into three different levels of brightness images outside the global area, improving the image display effect.

[0089] The embodiments of the present invention also provide a projection image display device, including an image display module, and the image display module is used to execute the following steps: divide the high-dynamic-range image to be displayed into a global image and a local image; control the spatial light modulator to form first light for displaying the first color sub-image in the global image in the first sub-period of the first illumination period, and control the spatial light modulator to form second light for displaying the first color sub-image in the local image in the second sub-period of the first illumination period, where the first sub-period and the second sub-period are two different sub-periods in the first illumination period.

[0090] In an alternative example, those skilled in the art can understand that the above device can be specifically integrated into an electronic device, which can be a terminal, a server, or other devices. Among them, the terminal can be a projector, a smart TV, a laser TV, a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a desktop computer, etc.; the server can be a single server or a server cluster composed of multiple servers. In some embodiments, the server can also be implemented in the form of a terminal. In some embodiments, the device can also be integrated into multiple electronic devices. For example, the projection image display device can be integrated into the terminal and the server, and the projection image display method of the present invention can be jointly implemented by the terminal and the server. The device can be used to execute each process and / or step of the above method. To avoid repetition, it will not be elaborated here.

[0091] It should be understood that the device here is embodied in the form of functional modules. The term "module" here can refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor, or a group of processors, etc.) for executing one or more software or firmware programs, and a memory, a combined logic circuit, and / or other suitable components that support the described functions. The above device has the function of implementing the corresponding steps in the above method; the above function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In the embodiments of the present invention, the device can also be a chip or a chip system, for example: a system on chip (SoC). The present invention is not limited thereto.

[0092] Embodiments of the present invention also provide an electronic device, Figure 9 which is a schematic structural diagram of the electronic device provided by the embodiments of the present invention. As Figure 9 shown, the device 300 includes a processor 301, a memory 302, and a communication interface 303. Among them, the processor 301, the memory 302, and the communication interface 303 communicate with each other through a bus 304. The memory 302 stores instructions executable by the processor 301, and the instructions are loaded and executed by the processor 301 to control the communication interface 303 to send signals and / or receive signals.

[0093] It should be understood that the device 300 may specifically be the projection device in the above embodiments, or the functions of the projection device in the above embodiments may be integrated in the device 300, and the device 300 may be used to execute each step and / or process corresponding to the projection device in the above embodiments. Optionally, the memory 302 may include a read-only memory and a random access memory, and provide instructions and data to the processor 301. A part of the memory 302 may further include a non-volatile random access memory. For example, the memory 302 may further store information about the device type. The processor 301 may be used to execute the instructions stored in the memory 302, and when the processor 301 executes the instructions, the processor 301 may execute each corresponding step and / or process in the above method embodiments.

[0094] It should be understood that in the embodiments of the present invention, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0095] In the implementation process, each step of the above method may be completed by the integrated logic circuit in the hardware of the processor or the instructions in the form of software. The steps of the method disclosed in combination with the embodiments of the present invention may be directly embodied as being executed by the hardware processor, or executed by a combination of the hardware and software modules in the processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor executes the instructions in the memory and combines its hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.

[0096] The above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that contains one or more collections of available media. The available medium can be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state drive.

[0097] It should be understood that in various embodiments of the present invention, the order numbers of the above processes do not indicate the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention. The modules described as separate components may or may not be physically separated. The components shown as modules may or may not be physical modules, that is, they may be located in one place, or distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present invention.

[0098] In several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there can be other division methods. For example, one module or component can be divided into multiple modules or components, or multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the couplings or direct couplings or communication connections shown or discussed with each other can be indirect couplings or communication connections through some interfaces, devices, or modules, and can be in electrical, mechanical, or other forms.

[0099] Those of ordinary skill in the art can realize that the modules and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the present invention.

[0100] As described above, it is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A projection image display method, characterized in that, Including: Dividing the high dynamic range image to be displayed into a global image and a local image; Controlling a spatial light modulator to form first light for displaying a first color sub-image in the global image during a first sub-period in a first illumination period, and controlling the spatial light modulator to form second light for displaying a first color sub-image in the local image during a second sub-period in the first illumination period, wherein the first sub-period and the second sub-period are two different sub-periods in the first illumination period; Controlling a spatial light modulator to form third light for displaying a second color sub-image in the global image during a third sub-period in a second illumination period, and controlling the spatial light modulator to form fourth light for displaying a second color sub-image in the local image during a fourth sub-period in the second illumination period, wherein the third sub-period and the fourth sub-period are two different sub-periods in the second illumination period, and the second illumination period is a different period from the first illumination period; Controlling a spatial light modulator to form fifth light for displaying a third color sub-image in the global image during a fifth sub-period in a third illumination period, and controlling the spatial light modulator to form sixth light for displaying a third color sub-image in the local image during a sixth sub-period in the third illumination period, wherein the fifth sub-period and the sixth sub-period are two different sub-periods in the third illumination period, and the third illumination period is a different period from the second illumination period and the first illumination period; Wherein, the spatial light modulators all adopt the same digital micromirror device.

2. The projection image display method according to claim 1, wherein Further including: Adjusting the time ratio of the first sub-period and the second sub-period in the first illumination period according to the ratio of the global image and the local image in the high dynamic range image to be displayed.

3. A projection image display method according to claim 1, characterized in that Further including: Judging whether the brightness display range of the projection device exceeds the standard range; If the brightness display range of the projection device exceeds or is equal to the standard range, performing the step of dividing the high dynamic range image to be displayed into a global image and a local image.

4. A projection image display method according to claim 1, characterized in that Further including: Judging whether the maximum refresh rate supported by the projection device is greater than twice the original image frame rate; If the maximum refresh rate supported by the projection device is greater than or equal to twice the original image frame rate, performing the step of dividing the high dynamic range image to be displayed into a global image and a local image.

5. A projection image display method according to claim 1, wherein Further including: Judging whether the maximum refresh rate supported by the projection device is greater than twice the original image frame rate. If it is less, frame dropping processing is performed; If it is greater than or equal to, the original image frame rate is kept unchanged for image display.

6. A projection image display method according to claim 1, characterized in that, Further including: Performing tone mapping on the global image and the local image respectively.

7. A projection image display method according to claim 6, wherein The performing tone mapping on the global image and the local image respectively includes: Obtaining the current brightness level of the projection device; Performing tone mapping on the global image and the local image respectively according to the brightness level.

8. A projection image display device, characterized in that, Including an image display module, and the image display module is used to perform the following steps: Dividing the high dynamic range image to be displayed into a global image and a local image; During a first sub-period of a first illumination period, control the spatial light modulator to form a first light for displaying a first color sub-image in the global image. During a second sub-period of the first illumination period, control the spatial light modulator to form a second light for displaying a first color sub-image in the local image. Here, the first sub-period and the second sub-period are two different sub-periods within the first illumination period. During a third sub-period of a second illumination period, control the spatial light modulator to form a third light for displaying a second color sub-image in the global image. During a fourth sub-period of the second illumination period, control the spatial light modulator to form a fourth light for displaying a second color sub-image in the local image. Here, the third sub-period and the fourth sub-period are two different sub-periods within the second illumination period, and the second illumination period is a different period from the first illumination period. During a fifth sub-period of a third illumination period, control the spatial light modulator to form a fifth light for displaying a third color sub-image in the global image. During a sixth sub-period of the third illumination period, control the spatial light modulator to form a sixth light for displaying a third color sub-image in the local image. Here, the fifth sub-period and the sixth sub-period are two different sub-periods within the third illumination period, and the third illumination period is a different period from the second illumination period and the first illumination period. Among them, the same digital micromirror device is used for all the spatial light modulators.

9. A projection device, characterized in that, Comprising: A light source device for emitting a light beam; A spatial light modulator located on the light-emitting side of the light source device, and the spatial light modulator is used to modulate incident light into image light; A projection lens located on the light-emitting side of the spatial light modulator, and the projection lens is used to image the light emitted by the spatial light modulator; A processor, connected to the spatial light modulator, is configured to divide a high-dynamic-range image to be displayed into a global image and a local image; control the spatial light modulator to form a first light for displaying a first color sub-image of the global image during a first sub-period in a first illumination period, and control the spatial light modulator to form a second light for displaying a first color sub-image of the local image during a second sub-period in the first illumination period, wherein the first sub-period and the second sub-period are two different sub-periods in the first illumination period; control the spatial light modulator to form a third light for displaying a second color sub-image of the global image during a third sub-period in a second illumination period, and control the spatial light modulator to form a fourth light for displaying a second color sub-image of the local image during a fourth sub-period in the second illumination period, wherein the third sub-period and the fourth sub-period are two different sub-periods in the second illumination period, and the second illumination period is different from the first illumination period; control the spatial light modulator to form a fifth light for displaying a third color sub-image of the global image during a fifth sub-period in a third illumination period, and control the spatial light modulator to form a sixth light for displaying a third color sub-image of the local image during a sixth sub-period in the third illumination period, wherein the fifth sub-period and the sixth sub-period are two different sub-periods in the third illumination period, and the third illumination period is different from the second illumination period and the first illumination period; wherein the spatial light modulator uses the same digital micromirror device.

10. An electronic device, comprising a memory, a processor, and a computer program stored on the memory, characterized in that, The processor executes the computer program to implement the method according to any one of claims 1-7.

11. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method according to any one of claims 1-7.

Images