Signal processing method and device of projection device, projection device and storage medium

Abstract

The application provides a signal processing method and device of a projection device, the projection device comprising at least a light source, a first spatial light modulator and a second spatial light modulator, the first spatial light modulator and the second spatial light modulator being arranged in sequence on an emergent light path of the light source; the method comprising: obtaining a data source generated according to image data to be displayed from a server; obtaining a light source control signal, a first control signal and a second control signal according to the data source; sending the control signals to the light source, the first control signal to the first spatial light modulator and the second control signal to the second spatial light modulator, and controlling the light source, the first spatial light modulator and the second spatial light modulator according to the control signals, the first control signal and the second control signal respectively. The signal processing method provided by the application simplifies the local calculation amount of the projection device and reduces the requirement for the calculation performance of the projection device.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of optical display technology, in particular to a signal processing method and device of a projection device, the projection device and a storage medium. BACKGROUND

[0002] The contrast ratio of the current single spatial light modulator projection display technology is about several hundred to one to twelve thousand to one, which is far lower than the brightness resolution of the human eye. Therefore, the brightness of the projection display picture is not bright enough in the bright place, and the brightness cannot be reduced in the dark place, so that the picture level perceived by people is poor, and a large amount of details are lost. The purpose of the high dynamic range (High-Dynamic Range, HDR) projection system is to improve the brightness range of the display, so that the bright and dark parts of the picture can display rich gray scale information, thereby greatly improving the picture effect and the audience's viewing experience.

[0003] One technical solution of the projection system to realize HDR display is a series of double spatial light modulators, that is, by adding another spatial light modulator after the first spatial light modulator, the high contrast ratio of the product of the two can be realized. No matter which type of spatial light modulator is selected, when realizing HDR display, the first spatial light modulator is used to pre-modulate the distribution of the light source light field irradiated onto the second spatial light modulator. The modulation amount of each pixel of the second spatial light modulator is calculated according to the source image and the light intensity at the pixel point, so the light source light field distribution needs to be accurately calculated. If real-time calculation is performed, the calculation ability and memory capacity of the device will have high requirements. SUMMARY

[0004] The present application provides a signal processing method and device of a projection device, a projection device and a storage medium to solve the above technical problems.

[0005] The present application achieves the above-mentioned purposes by the following technical solutions.

[0006] In a first aspect, the embodiments of the present application provide a signal processing method of a projection device, the projection device comprising at least a light source, a first spatial light modulator, and a second spatial light modulator, the first spatial light modulator and the second spatial light modulator being arranged in sequence on an exit light path of the light source, the method comprising: obtaining a data source generated according to image data to be displayed from a server; the data source being generated by splitting each frame of image content in the image data into a light source luminance signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packing the light source luminance signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal; obtaining a light source control signal, a first control signal, and a second control signal according to the data source; sending the light source control signal to the light source, so that the light source emits light source light according to the light source control signal; sending the first control signal to the first spatial light modulator, so that the first spatial light modulator pre-modulates the light source light according to the first control signal to form a continuous light field; and sending the second control signal to the second spatial light modulator, so that the second spatial light modulator modulates the continuous light field according to the second control signal to form an image light field.

[0007] In a second aspect, the embodiments of the present application also provide a signal processing device of a projection device, the projection device comprising at least a light source, a first spatial light modulator, and a second spatial light modulator, the first spatial light modulator and the second spatial light modulator being arranged in sequence on an exit light path of the light source; the signal processing device comprising: a receiving unit configured to obtain a data source generated according to image data to be displayed; the data source being generated by splitting each frame of image content in the image data into a light source luminance signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packing the light source luminance signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal; a processing unit configured to obtain a light source control signal, a first control signal, and a second control signal according to the data source; and a sending unit configured to send the light source control signal to the light source, so that the light source emits light source light according to the light source control signal; send the first control signal to the first spatial light modulator, so that the first spatial light modulator pre-modulates the light source light according to the first control signal to form a continuous light field; and send the second control signal to the second spatial light modulator, so that the second spatial light modulator modulates the continuous light field according to the second control signal to form an image light field.

[0008] In a third aspect, the embodiments of the present application provide a projection device, comprising at least a light source, a first spatial light modulator, a second spatial light modulator, and a signal processing module, the first spatial light modulator and the second spatial light modulator are arranged in sequence on an exit light path of the light source, the signal processing module is signal-connected with the light source, the first spatial light modulator, and the second spatial light modulator, and the signal processing module is configured to: acquire a data source generated according to image data to be displayed; generate the data source by splitting each frame of image content in the image data into a light source luminance signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packing the light source luminance signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal; acquire a light source control signal, a first control signal, and a second control signal according to the data source; send the light source control signal to the light source, so that the light source emits light source light according to the light source control signal; send the first control signal to the first spatial light modulator, so that the first spatial light modulator pre-modulates the light source light according to the first control signal to form a continuous light field; and send the second control signal to the second spatial light modulator, so that the second spatial light modulator modulates the continuous light field according to the second control signal to form an image light field.

[0009] In a fourth aspect, the embodiments of the present application further provide a computer-readable storage medium, which stores computer program instructions, and the computer program instructions can be invoked by a processor to execute the method of the first aspect.

[0010] The projection device signal processing method, device, projection device, and storage medium provided by the present application are characterized in that the data source is generated by splitting each frame of image content in the image data into a light source luminance signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packing the light source luminance signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal, that is, the projection device receives a data source that has been re-plate, rather than original image data, so that the projection device only needs to analyze the data source to acquire a light source control signal, a first control signal, and a second control signal, thereby simplifying the local computing amount of the projection device and reducing the requirement for the computing performance of the projection device. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the following embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0012] Figure 1 The module schematic diagram of the projection device provided by the embodiments of the present application is shown in the figure.

[0013] Figure 2 A flowchart of a signal processing method of a projection device according to an embodiment of the present application.

[0014] Figure 3 Another schematic diagram of a module of a projection device according to an embodiment of the present application.

[0015] Figure 4 A schematic diagram of a module of a projection device according to another embodiment of the present application.

[0016] Figure 5 A schematic diagram of a module of a projection device according to another embodiment of the present application. Figure 4 A schematic diagram of data arrangement of a data source in the embodiment shown.

[0017] Figure 6 A schematic diagram of a module of a projection device according to another embodiment of the present application.

[0018] Figure 7 A schematic diagram of data arrangement of a data source in the embodiment shown. Figure 1 A schematic diagram of data arrangement of a data source in the embodiment shown.

[0019] Figure 8 A flowchart of a signal processing method according to another embodiment of the present application.

[0020] Figure 9 A schematic diagram of delay adjustment of different control signals in the embodiment shown. Figure 4 A schematic diagram of delay adjustment of different control signals in the embodiment shown.

[0021] Figure 10 A schematic diagram of a signal processing device of a projection device according to an embodiment of the present application.

[0022] Figure 11 A schematic diagram of a computer readable storage medium having program codes executable by a processor according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to make the personnel in the technical field better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by the personnel in the art without making creative efforts are within the scope of protection of the present application.

[0024] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. In order to better understand the signal processing method provided by the embodiments of the present application, a projection device provided by the embodiments of the present application will be described first, and the above signal processing method is applicable to the projection device.

[0025] Please refer to Figure 1 The embodiments of the present application provide a projection device 100, which at least comprises a light source 110, a first spatial light modulator 120, a second spatial light modulator 130, a light diffusion device 140 and a lens imaging system 150. The first spatial light modulator 120 is a pre-modulation spatial light modulator, and the second spatial light modulator 130 is a main modulation spatial light modulator. The first spatial light modulator 120, the second spatial light modulator 130, the light diffusion device 140 and the lens imaging system 150 are sequentially arranged on an outgoing light path of the light source 110.

[0026] The light source 110 can be a xenon lamp or a laser diode (Laser Diode) or a light emitting diode (Light Emitting Diode). In the embodiments, the laser diode can be selected as the light source 110. The light source 110 emits uniform light source light to the first spatial light modulator 120. The first spatial light modulator 120 pre-modulates the light source light. The pre-modulated light beam is diffused by the light field of the light diffusion device 140 and then irradiates the second spatial light modulator 130 to form a continuous light field with intensity distribution. The second spatial light modulator 130 modulates the continuous light field with intensity distribution at the pixel level to generate an image light field. Each pixel generates the required brightness of a source image. The image light field passes through the lens imaging system 150 and projects an HDR image.

[0027] The first spatial light modulator 120 and the second spatial light modulator 130 can be a digital micromirror device (Digtial Micromirror Devices, DMD), a liquid crystal display (Liquid Crystal Display, LCD) or a liquid crystal on silicon (Liquid Crystal on Silicon, LCoS) and the like. Since the reliability of DMD is higher than that of liquid crystal, a high-brightness projection system usually selects DMD. The embodiments of the present application take the first spatial light modulator 120 and the second spatial light modulator 130 as DMD as an example for description.

[0028] Projection device 100 also includes a signal processing module 160, which is signal-connected to light source 110, first spatial light modulator 120, and second spatial light modulator 130. Signal processing module 160 can be an FPGA (Field Programmable Gate Array) chip or a chip capable of performing equivalent signal processing functions. FPGA chips offer high-speed data transmission and processing capabilities, high integration, and low cost, making them suitable for large-scale production.

[0029] Please also refer to Figures 1-2 The present application also provides a signal processing method for the projection device 100 , which may specifically include steps S100 to S300 .

[0030] Step S100: Obtain a data source generated based on the image data to be displayed from the server; the data source is generated by splitting the image content of each frame in the image data into a light source brightness signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packaging the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal.

[0031] Each frame of image content in the image data is split by the server 500 into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal are packaged to generate a data source. The projection device 100 establishes a signal connection with the server 500 through the signal processing module 160, and then can obtain the data source from the server 500. In some embodiments, the split can be based on the to-be-displayed information of each frame of image and the optical transmission matrix of the entire optical system, combined with a phase recovery algorithm, etc., to calculate the control current corresponding to the light source as the light source brightness signal, to calculate the pre-modulation signal on the first spatial light modulator as the first spatial light modulator modulation signal, and to calculate the modulation signal on the second spatial light modulator as the second spatial light modulator modulation signal. The server 500 can be a cloud server or a physical server, which usually runs with large memory and fast computing speed, and can provide powerful computing capability. The to-be-displayed image data can be video data. Specifically, the to-be-displayed image data can be a film master, and the data amount of the film master is large. If the film master is directly sent to the projection device 100 for real-time calculation and display, the computing capability and memory capacity of the projection device 100 are required to be high. In step S100, the projection device 100 does not obtain the original image data, but generates a data source according to the image data. The data source is generated by splitting each frame of image content in the image data and then re-packaging, which is equivalent to generating a new edition by re-editing the image data. The entire calculation process of generating the data source according to the image data generates a new edition by re-editing the image data on a device with computing capability such as a server, and then sends the data source to the projection device 100.

[0032] Step S200: obtaining a light source control signal, a first control signal and a second control signal according to the data source.

[0033] The data source is generated by packaging the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal. The packaging process is a data encapsulation process. After the data encapsulation of the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal, the data source in the form of a data packet is formed.

[0034] The data source is usually additionally attached with a target address, a local address, and some bytes for error correction, and when the security and reliability are higher, encryption processing is also performed, and the like. The data source after data encapsulation can reliably and accurately send the data source to the projection device 100, and efficiently utilize the transmission resource. After the projection device 100 acquires the data packet of the data source, there is a data decapsulation process, which disassembles the data source and processes the information in the data source, and acquires the light source control signal, the first control signal and the second control signal according to the data source.

[0035] The data decapsulation process is the inverse process of the data encapsulation process, and the data decapsulation process and the calculation amount of acquiring the light source control signal, the first control signal and the second control signal from the decapsulated data are much smaller than the calculation amount of splitting each frame of image content in the image data into the light source control signal, the first control signal and the second control signal, thereby greatly simplifying the local calculation amount of the projection device 100.

[0036] Step S300: sending the light source control signal to the light source 110 to make the light source 110 emit light source light according to the light source control signal; sending the first control signal to the first spatial light modulator 120 to make the first spatial light modulator 120 pre-modulate the light source light according to the first control signal to form a continuous light field; and sending the second control signal to the second spatial light modulator 130 to make the second spatial light modulator 130 modulate the continuous light field according to the second control signal to form an image light field.

[0037] The light source control signal contains the brightness information of the light source light emitted by the light source 110, and the brightness of the light source light emitted by the light source 110 can be adjusted according to the light source control signal. The first control signal contains the control information of the micro-mirror array on the first spatial light modulator 120, and the first spatial light modulator 120 controls each pixel in the micro-mirror array to switch to the ON state (open state) or the OFF state (off state) according to the first control signal, and the gray scale modulation is performed through the percentage of ON state / OFF state pixels, that is, the half-tone pattern is used for gray scale modulation. After the light field diffusion of the light diffusion device 140, the half-tone pattern forms a continuous light field with intensity distribution, and the second spatial light modulator 130 forms an image light field after pixel-level modulation of the continuous light field with intensity distribution. The image light field passes through the lens imaging system 105, and projects the HDR image.

[0038] The first control signal can be determined according to the light source control signal, that is, the control information of the micro-mirror array on the first spatial light modulator 120 can be determined according to the brightness of the light source. The second control signal can be determined according to the light source control signal and the first control signal, that is, the control information of the micro-mirror array on the second spatial light modulator 130 can be determined according to the brightness of the light source and the gray scale of the halftone pattern. The signal processing method of the projection device 100 provided in the embodiments of the present application is that the data source is obtained by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and then packaging the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal to generate. That is, the projection device receives a data source that has been re-imaged, rather than the original image data, so that the projection device only needs to unpack and analyze the data source to obtain the light source control signal, the first control signal and the second control signal, thereby simplifying the local computing amount of the projection device 100 and reducing the requirement for the computing performance of the projection device 100.

[0039] Referring to Figure 4 In an embodiment, the projection device 100 can further include a third spatial light modulator, a fourth spatial light modulator, an nth spatial light modulator and other spatial light modulators. The third spatial light modulator, the fourth spatial light modulator and the nth spatial light modulator cooperate with the first spatial light modulator 120 and the second spatial light modulator 130 to modulate the light source light emitted by the light source 110. Correspondingly, the server 500 splits each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal, a second spatial light modulator modulation signal, a third spatial light modulator modulation signal and an nth spatial light modulator modulation signal, and then packages the light source brightness signal, the first spatial light modulator modulation signal, the second spatial light modulator modulation signal, the third spatial light modulator modulation signal and the nth spatial light modulator modulation signal to generate a data source. The signal processing module 160 obtains the data source, obtains a light source control signal, a first control signal, a second control signal, a third control signal and an nth control signal from the data source, and then sends the light source control signal, the first control signal, the second control signal, the third control signal and the nth control signal to the light source 110 and each spatial light modulator, respectively.

[0040] Referring to Figure 4 and Figure 5In an embodiment, the data source is generated by packing the light source brightness signal corresponding to the image content of each frame of image data, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal according to a set data stream. The set data stream is the arrangement order of the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal in each frame of image. By packing the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal according to the set data stream to generate the data source, the data source can be reliably and accurately sent to the projection device 100, and the transmission resource can be efficiently utilized. In the packing process, the modulation signals corresponding to different spatial light modulators can be interleaved, which is equivalent to packing by using an encryption algorithm, so as to protect the data source from being stolen and read by non-persons.

[0041] In an embodiment, the step S200 can specifically include:

[0042] Step S201: receiving the data source.

[0043] The projection device 100 establishes a signal connection with the server 500 through the signal processing module 160, and receives the data source through the signal processing module 160.

[0044] Step S202: obtaining a light source control signal according to the light source brightness signal, obtaining a first control signal according to the first spatial light modulator modulation signal, and obtaining a second control signal according to the second spatial light modulator modulation signal.

[0045] The light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal are packed according to the set data stream to generate the data source. The light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal can be sequentially arranged or interleaved arranged. After receiving the data source, the signal processing module 160 obtains the content related to the light source, i.e. the light source brightness signal, from the data source, and generates the light source control signal meeting the data requirement of the projection device 100 after analyzing the light source brightness signal and sends the light source control signal to the light source. Similarly, the signal processing module 160 also obtains the content related to the first spatial light modulator, i.e. the first spatial light modulator modulation signal, from the data source, and generates the first control signal meeting the data requirement of the projection device 100 after analyzing the first spatial light modulator modulation signal and sends the first control signal to the first spatial light modulator. Similarly, the signal processing module 160 also obtains the content related to the second spatial light modulator, i.e. the second spatial light modulator modulation signal, from the data source, and generates the second control signal meeting the data requirement of the projection device 100 after analyzing the second spatial light modulator modulation signal and sends the second control signal to the second spatial light modulator.

[0046] AsFigure 5 As shown, as an implementation method, the light source brightness signal, the first spatial light modulator modulation signal, the second spatial light modulator modulation signal, ... the nth spatial light modulator modulation signal corresponding to the content of each frame of the image are packaged in the order of the first frame light source brightness signal, the first frame first spatial light modulator modulation signal, the first frame second spatial light modulator modulation signal, ... the first frame nth spatial light modulator modulation signal, the second frame light source brightness signal, the second frame first spatial light modulator modulation signal, the second frame second spatial light modulator modulation signal, ... the second frame nth spatial light modulator modulation signal...

[0047] The server 500 can send the complete data source to the signal processing module 160. After receiving the complete data source, the signal processing module 160 parses the data source to obtain a light source control signal and send it to the light source, obtain a first control signal and send it to the first spatial light modulator, obtain a second control signal and send it to the second spatial light modulator, ... obtain an nth control signal and send it to the nth spatial light modulator.

[0048] As another embodiment, the light source brightness signal, the first spatial light modulator modulation signal, the second spatial light modulator modulation signal, ... the nth spatial light modulator modulation signal corresponding to the content of each frame of image can be arranged in the order of the first frame light source brightness signal, the second frame light source brightness signal, ... the nth frame light source brightness signal, the first frame first spatial light modulator modulation signal, the second frame first spatial light modulator modulation signal, ... the nth frame first spatial light modulator modulation signal, the first frame second spatial light modulator modulation signal, the second frame second spatial light modulator modulation signal, ... the nth frame second spatial light modulator modulation signal...

[0049] Similarly, the server 500 can send the complete data source to the signal processing module 160. After receiving the complete data source, the signal processing module 160 parses the data source to obtain a light source control signal to send to the light source, obtain a first control signal to send to the first spatial light modulator, obtain a second control signal to send to the second spatial light modulator,... obtain the nth control signal to send to the nth spatial light modulator.

[0050] As another embodiment, the light source brightness signal, the first spatial light modulator modulation signal, the second spatial light modulator modulation signal, ... the nth spatial light modulator modulation signal corresponding to the content of each frame of the image can be arranged in the order of the light source brightness signal of the first 1 / 2 subframe of the first frame, the first spatial light modulator modulation signal of the first 1 / 2 subframe of the first frame, the second spatial light modulator modulation signal of the first 1 / 2 subframe of the first frame, ... the light source brightness signal of the second 1 / 2 subframe of the first frame, the first spatial light modulator modulation signal of the second 1 / 2 subframe of the first frame...

[0051] Similarly, the server 500 can send the complete data source to the signal processing module 160, and the signal processing module 160 parses the data source after receiving the complete data source to obtain the light source control signal sent to the light source, the first control signal sent to the first spatial light modulator, the second control signal sent to the second spatial light modulator, and the nth control signal sent to the nth spatial light modulator.

[0052] In an embodiment, the data source is generated by packing the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal in a video format conforming to the resolution of the final projection picture.

[0053] The resolution of the final projection picture is the resolution of the final projection device 100 to be achieved. For example, if the final resolution to be achieved by the projection device 100 is 2160*3840 (4K), the data source is packed in a video format of 2160*3840 (4K). The packing process is equivalent to format conversion to generate a data source in a video format conforming to the resolution requirement, so that the data source is compatible with the resolution to be achieved by the final projection device 100.

[0054] In the embodiment, the resolution of the first spatial light modulator 120 is less than the resolution of the second spatial light modulator 130, and the resolution of the second spatial light modulator 130 is less than the resolution of the final projection device 100 to be achieved. As an example, please refer to Figure 7 , the final resolution to be achieved by the projection device 100 is 2160*3840, and the resolution of the first spatial light modulator 120 can be 1280*800, and the resolution of the second spatial light modulator 130 can be 2048*1080.

[0055] In the embodiment, in the process of packing the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal in a video format conforming to the resolution of the final projection picture, data compression can be performed to reduce the amount of data. Alternatively, non-zero video data of the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal is not compressed, and the blank is compressed. Alternatively, data compression is not performed in the process of packing the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal to generate a non-compressed data source. Thus, the amount of data can be reduced, the data processing speed can be improved, the data processing efficiency can be improved, real-time imaging can be achieved, and a data source with a higher resolution can be provided under the premise of meeting the data processing requirement.

[0056] Still please refer to Figure 6In one embodiment, the light source control signal is determined according to the maximum brightness of each frame of image content in the image data and the light recycling gain.

[0057] Specifically, the light source control signal is used to control the current of the light source 110, and the brightness of the light source light emitted by the light source 110 is adjusted by adjusting the current, and the gain of the projection device 100 is improved by light recycling. For example, when the brightness of the light source light emitted by the light source 110 is 200 when the projection device 100 does not recycle the light through the light recycling assembly, the current of the light source 110 needs to be turned on to 200 / 255*I0, where 255 is the maximum gray signal corresponding to the full brightness field, and I0 is the current value corresponding to the maximum gray signal. Assuming that the light recycling gain of the projection device 100 is 10%, when the brightness of the light source light emitted by the light source 110 is 200, the current of the light source 110 only needs to be turned on to (200 / 250)*I0*(1-10%), so that the light emitting power of the light source 110 can be appropriately reduced to achieve energy saving under the same display effect.

[0058] In the embodiment, the projection device can further include a light path processing system disposed on a light path between the light source 110 and the first spatial light modulator 120, and used to shape the light beam emitted by the light source 110 to form uniform light source light irradiated to the first spatial light modulator 120. When the first spatial light modulator 120 is a DMD, the first spatial light modulator 120 includes a plurality of first micro-mirrors used to selectively switch between ON state and OFF state to complete the modulation of the light source light. The projection device 100 can further include a first light path recycling assembly disposed on a light path between the first micro-mirror and the light path processing system, and used to guide the light beam to the light path processing system. The light path processing system can re-irradiate the light beam to the first spatial light modulator 120, so as to achieve the purpose of reusing the light source light that is originally not used, and realize the light recycling gain.

[0059] Further, when the second spatial light modulator 130 is a DMD, the second spatial light modulator 130 includes a plurality of second micro-mirrors used to selectively switch between ON state and OFF state to complete the modulation of the continuous light field. The projection device 100 can further include a second light path recycling assembly disposed on a light path between the second micro-mirror and the light path processing system, and used to guide the light beam to the light path processing system for recycling, and further improve the utilization rate of the light source 110 of the projection device 100. The first light path recycling assembly and the second light path recycling assembly can be composed of one or more refractive prisms and mirrors, which are not specifically limited here.

[0060] When the projection device 100 includes the first light path recycling assembly, assuming that the gain of the first light path recycling assembly is 10%, when the light source 110 emits light source light with a brightness of 200, the light source control signal is (200 / 250)*I0*(1-10%), which can appropriately reduce the light emitting power of the light source 110, thereby playing a role in saving energy. When the projection device 100 includes the first light path recycling assembly and the second light path recycling assembly, assuming that the gain of the first light path recycling assembly and the second light path recycling assembly is 10%, when the light source 110 emits light with a maximum brightness of 200, the light source control signal is (200 / 250)*I0*(1-(10%+10%*10%), which further enhances the energy saving effect.

[0061] Of course, in some embodiments, the projection device 100 can also not achieve light recycling gain through light recycling. Alternatively, in the presence of light recycling gain, the current of the light source 110 is not reduced, so that the display brightness of the final projection picture is higher.

[0062] In an embodiment, step S300 can specifically include:

[0063] The first control signal reaches the first spatial light modulator 120 at the same time as the light source light irradiates the first spatial light modulator 120, and the second control signal reaches the second spatial light modulator 130 at the same time as the continuous light field irradiates the second spatial light modulator 130.

[0064] The first spatial light modulator 120 starts light modulation at the same time as the first control signal reaches, and the first control signal reaches the first spatial light modulator 120 at the same time as the light source light irradiates the first spatial light modulator 120, that is, the first spatial light modulator 120 synchronously starts light modulation at the same time as the light source light irradiates the first spatial light modulator 120, ensuring that the light source light and the first control signal are synchronized to reach the first spatial light modulator 120, avoiding the influence of device delay on the light modulation process, for example, after the light source light irradiates the first spatial light modulator 120, the first control signal has not yet reached the first spatial light modulator 120, resulting in that the first spatial light modulator 120 cannot timely modulate the light source light.

[0065] Similarly, the second spatial light modulator 130 starts light modulation at the same time as the second control signal reaches, and the second control signal reaches the second spatial light modulator 130 at the same time as the continuous light field irradiates the second spatial light modulator 130, that is, the second spatial light modulator 130 synchronously starts light modulation at the same time as the continuous light field irradiates the second spatial light modulator 130, ensuring that the continuous light field and the second control signal are synchronized to reach the second spatial light modulator 130. Please refer to Figure 8 In an embodiment, step S300 can specifically include step S301 and step S302.

[0066] Step S301 : obtaining a signal sending sequence and a time interval according to a delay condition of the projection device 100 .

[0067] The transmission sequence and time interval refer to the order in which the light source control signal, the first control signal, and the second control signal are transmitted from the signal processing module 160, as well as the time intervals between them. Delays in the projection device 100 include delays caused by light propagation within the projection device, as well as delays caused by the time difference between the light source control signal, the first control signal, and the second control signal being transmitted from the signal processing module 160 and reaching their respective destinations.

[0068] Step S302: sending the light source control signal, the first control signal and the second control signal to the light source 110, the first spatial light modulator 120 and the second spatial light modulator 130 respectively according to the sending order and time interval.

[0069] For example, see Figure 9 According to the delay of the projection device 100, it is determined that the signal processing module 160 first sends a light source control signal to the light source 110, and then after an interval t1, the signal processing module 160 sends a first control signal to the first spatial light modulator 120, and after an interval t2, the signal processing module 160 sends a second control signal to the second spatial light modulator 130, so that the first control signal reaches the first spatial light modulator 120 at the same time when the light from the light source irradiates the first spatial light modulator 120, and the second control signal reaches the second spatial light modulator 130 at the same time when the continuous light field irradiates the second spatial light modulator 130.

[0070] See also Figure 1 and Figure 10 The present application also provides a signal processing device 200 for a projection device 100. The projection device 100 includes at least a light source 110, a first spatial light modulator 120, and a second spatial light modulator 130. The first spatial light modulator 120 and the second spatial light modulator 130 are sequentially arranged on the output light path of the light source 110.

[0071] The signal processing device 200 includes a receiving unit 201, a processing unit 202 and a sending unit 203. The processing unit 202 is signal-connected to the receiving unit 201, the sending unit 203 is signal-connected to the processing unit 202, and the sending unit 203 is signal-connected to the light source 110, the first spatial light modulator 120 and the second spatial light modulator 130.

[0072] The receiving unit 201 is configured to obtain a data source generated according to image data to be displayed from a server; the data source is generated by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and then packing the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal; the processing unit 202 is configured to obtain a light source control signal, a first control signal and a second control signal according to the data source; the sending unit 203 is configured to send the light source control signal to the light source 110, so that the light source 110 emits light source light according to the light source control signal; send the first control signal to the first spatial light modulator 120, so that the first spatial light modulator 120 modulates the light source light according to the first control signal to form a continuous light field; and send the second control signal to the second spatial light modulator 130, so that the second spatial light modulator 130 modulates the continuous light field according to the second control signal to form an image light field.

[0073] In an embodiment, the data source is generated by packing the light source control signal, the first control signal and the second control signal corresponding to each frame of image content in the image data according to a set data stream.

[0074] In an embodiment, the receiving unit 201 is configured to receive the data source, obtain the light source control signal according to the light source brightness signal, obtain the first control signal according to the first spatial light modulator modulation signal, and obtain the second control signal according to the second spatial light modulator modulation signal.

[0075] In an embodiment, the light source control signal is determined according to the highest brightness of each frame of image content in the image data and a light recycling gain.

[0076] In an embodiment, the data source is generated by packing the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal according to a video format conforming to the resolution of the final projection picture.

[0077] In an embodiment, the first control signal reaches the first spatial light modulator 120 at the same time when the light source light irradiates the first spatial light modulator 120, and the second control signal reaches the second spatial light modulator 130 at the same time when the continuous light field irradiates the second spatial light modulator 130.

[0078] In an embodiment, the sending unit 203 is further configured to obtain a signal sending order and a time interval according to the delay condition of the projection device 100; and the sending unit 203 is further configured to send the light source control signal, the first control signal and the second control signal to the light source 110, the first spatial light modulator 120 and the second spatial light modulator 130 respectively according to the sending order and the time interval.

[0079] It should be noted that the embodiments of the signal processing device 200 in the present application correspond to the signal processing method embodiments of the aforementioned projection device 100, the specific implementation principles of each unit in the signal processing device 200 are similar to the principles in the signal processing method embodiments of the aforementioned projection device 100, and the specific contents in the signal processing device 200 embodiments can be referred to the modulation method embodiments of the projection device 100, and will not be repeated in the signal processing device 200 embodiments.

[0080] Please continue to refer to Figure 1 The present application also provides a projection device 100, which comprises at least a light source 110, a first spatial light modulator 120, a second spatial light modulator 130 and a signal processing module 160. The first spatial light modulator 120 and the second spatial light modulator 130 are arranged in sequence on the light path of the light source 110. The signal processing module 160 is signal connected with the light source 110, the first spatial light modulator 120 and the second spatial light modulator 130. The signal processing module 160 is used for: obtaining a data source generated according to image data to be displayed from a server; the data source is generated by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and then packing the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal; obtaining a light source control signal, a first control signal and a second control signal according to the data source; sending the light source control signal to the light source 110, so that the light source 110 emits light source light according to the light source control signal; sending the first control signal to the first spatial light modulator 120, so that the first spatial light modulator 120 modulates the light source light according to the first control signal to form a continuous light field; and sending the second control signal to the second spatial light modulator 130, so that the second spatial light modulator 130 modulates the continuous light field according to the second control signal to form an image light field.

[0081] In an embodiment, the data source is generated by packing the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal according to a set data stream.

[0082] In an embodiment, the signal processing module 160 is used for receiving the data source, obtaining the light source control signal according to the light source brightness signal, obtaining the first control signal according to the first spatial light modulator modulation signal, and obtaining the second control signal according to the second spatial light modulator modulation signal.

[0083] In an embodiment, the light source control signal is determined according to the highest brightness of each frame of image content in the image data and the light recycling gain.

[0084] In an embodiment, the data source generates the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal by packing them in a video format conforming to the resolution of the final projection picture.

[0085] In an embodiment, the first control signal reaches the first spatial light modulator 120 at the same time as the light source light irradiates the first spatial light modulator 120, and the second control signal reaches the second spatial light modulator 130 at the same time as the continuous light field irradiates the second spatial light modulator 130.

[0086] In an embodiment, the signal processing module 160 is further configured to obtain the signal sending sequence and the time interval according to the delay of the projection device, and to send the light source control signal, the first control signal and the second control signal to the light source 110, the first spatial light modulator 120 and the second spatial light modulator 130 respectively according to the sending sequence and the time interval.

[0087] In the embodiment, the signal processing module 160 can be a FPGA (Field Programmable Gate Array) chip or a chip having the same signal processing function. The FPGA chip has high-speed data transmission and processing performance, high integration and low cost, and is conducive to mass production.

[0088] Referring to Figure 11 The application further provides a computer readable storage medium 300, which stores computer program instructions. The computer program instructions can be called by a processor to execute each step of the above signal processing method.

[0089] The computer readable storage medium 300 can be an electronic storage such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk or a ROM. Alternatively, the computer readable storage medium 300 includes a non-transitory computer readable storage medium. The computer readable storage medium 300 has a storage space for program codes 310 for executing any method step of the above modulation method. These program codes 310 can be read from or written into one or more computer program products. The program codes 310 can be compressed in a suitable form.

[0090] In addition, the terms "first", "second", and the like are used only to distinguish descriptions, and cannot be understood as specifically or particularly indicating or specifying a certain structure. The description of the terms "some embodiments", "other embodiments", and the like means that the specific features, structures, materials or characteristics described in connection with the embodiments or examples are contained in at least one embodiment or example of the present application. In the present application, the illustrative description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any appropriate manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine the different embodiments or examples described in the present application and the features of the different embodiments or examples without contradiction.

[0091] The above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A signal processing method of a projection device, characterized by, The projection device at least includes a light source, a first spatial light modulator, and a second spatial light modulator, the first spatial light modulator and the second spatial light modulator are sequentially arranged on an outgoing light path of the light source, and the method comprises: obtaining a data source generated according to image data to be displayed from a server; the data source is generated by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal, and a second spatial light modulator modulation signal, and then packaging the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal; obtaining a light source control signal, a first control signal, and a second control signal according to the data source; sending the light source control signal to the light source to make the light source emit light source light according to the light source control signal, sending the first control signal to the first spatial light modulator to make the first spatial light modulator pre-modulate the light source light according to the first control signal to form a continuous light field, and sending the second control signal to the second spatial light modulator to make the second spatial light modulator modulate the continuous light field according to the second control signal to form an image light field.

2. The method of claim 1, wherein, The data source is generated by packaging the light source brightness signal, the first spatial light modulator modulation signal, and the second spatial light modulator modulation signal corresponding to each frame of image content in the image data according to a set data stream.

3. The method of claim 1, wherein, The obtaining of the light source control signal, the first control signal, and the second control signal according to the data source comprises: receiving the data source; obtaining the light source control signal according to the light source brightness signal, obtaining the first control signal according to the first spatial light modulator modulation signal, and obtaining the second control signal according to the second spatial light modulator modulation signal.

4. The method of claim 1, wherein, The light source control signal is determined according to the highest brightness of each frame of image content in the image data and a light recycling gain.

5. The method of claim 1, wherein, The data source is generated by packaging the light source control signal, the first control signal, and the second control signal according to a video format conforming to the resolution of a final projection picture.

6. The method according to any one of claims 1 to 5, characterized in that, The sending of the light source control signal to the light source to make the light source emit light source light according to the light source control signal, the sending of the first control signal to the first spatial light modulator to make the first spatial light modulator pre-modulate the light source light according to the first control signal to form a continuous light field, and the sending of the second control signal to the second spatial light modulator to make the second spatial light modulator modulate the continuous light field according to the second control signal to form an image light field comprise: The first control signal reaches the first spatial light modulator at the same time when the light source light irradiates the first spatial light modulator, and the second control signal reaches the second spatial light modulator at the same time when the continuous light field irradiates the second spatial light modulator. ​ 7. The method of claim 6, wherein, The sending the light source control signal to the light source, so that the light source emits light source light according to the light source control signal; sending the first control signal to the first spatial light modulator, so that the first spatial light modulator pre-modulates the light source light according to the first control signal to form a continuous light field; sending the second control signal to the second spatial light modulator, so that the second spatial light modulator modulates the continuous light field according to the second control signal to form an image light field, further comprising: According to the delay of the projection device, the signal sending order and the time interval are obtained; The light source control signal, the first control signal and the second control signal are sent to the light source, the first spatial light modulator and the second spatial light modulator respectively according to the sending order and the time interval. The projection device comprises a light source, a first spatial light modulator and a second spatial light modulator, and the first spatial light modulator and the second spatial light modulator are arranged in sequence on the light path of the light source; 8. A signal processing apparatus of a projection apparatus, characterized by comprising: The signal processing device comprises: The receiving unit is used to obtain a data source generated according to image data to be displayed; the data source is generated by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and then packaging the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal; The processing unit is used to obtain a light source control signal, a first control signal and a second control signal according to the data source; The sending unit is used to send the light source control signal to the light source, so that the light source emits light source light according to the light source control signal; send the first control signal to the first spatial light modulator, so that the first spatial light modulator pre-modulates the light source light according to the first control signal to form a continuous light field; send the second control signal to the second spatial light modulator, so that the second spatial light modulator modulates the continuous light field according to the second control signal to form an image light field. The projection device comprises a light source, a first spatial light modulator, a second spatial light modulator and a signal processing module, the first spatial light modulator and the second spatial light modulator are arranged in sequence on the light path of the light source, and the signal processing module is signal connected with the light source, the first spatial light modulator and the second spatial light modulator; the signal processing module is used for:

9. A projection apparatus, characterized by comprising: Obtaining a data source generated according to image data to be displayed; The data source is generated by splitting each frame of image content in the image data into a light source brightness signal, a first spatial light modulator modulation signal and a second spatial light modulator modulation signal, and then packaging the light source brightness signal, the first spatial light modulator modulation signal and the second spatial light modulator modulation signal; According to the data source, a light source control signal, a first control signal and a second control signal are obtained; ​ sending the light source control signal to the light source to cause the light source to emit light source light according to the light source control signal; sending the first control signal to the first spatial light modulator to cause the first spatial light modulator to pre-modulate the light source light according to the first control signal to form a continuous light field; sending the second control signal to the second spatial light modulator to cause the second spatial light modulator to modulate the continuous light field according to the second control signal to form an image light field.

10. The projection apparatus according to claim 9, wherein, The signal processing module is an FPGA chip.

11. A computer readable storage medium, characterized in that, The computer readable storage medium stores computer program instructions, and the computer program instructions can be called and executed by the processor to execute the method in any one of claims 1-7.

Images