Lighting equipment, projector equipment

The lighting and projector devices achieve high brightness and reduced size by using a single phase modulator to simultaneously modulate multiple wavelength bands, addressing the challenges of brightness and cost in existing technologies.

JP7948307B2Active Publication Date: 2026-11-11SONY GROUP CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024502965
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-02-24
Filing Date
2023-02-03
Publication Date
2026-11-11
Estimated Expiration
2043-02-03

AI Technical Summary

Technical Problem

Existing image display technologies face challenges in achieving high brightness without increasing the size and cost of the optical system, particularly when using time-division multiplexing for spatial light modulation of different colors, which reduces brightness, or providing separate spatial light modulators for each color, which increases complexity and cost.

Method used

A lighting and projector device that uses a single phase modulator to simultaneously perform spatial light phase modulation on multiple wavelength bands, allowing for simultaneous spatial light phase modulation in different areas of the modulator, eliminating the need for time-division multiplexing and reducing the number of components, thereby enhancing brightness while minimizing system size and cost.

Benefits of technology

The solution improves brightness and reduces the size and cost of the optical system by allowing simultaneous spatial light phase modulation across different wavelength bands, ensuring high light utilization efficiency and contrast without the need for multiple modulators.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007948307000010
    Figure 0007948307000010
  • Figure 0007948307000011
    Figure 0007948307000011
  • Figure 0007948307000012
    Figure 0007948307000012
Patent Text Reader

Abstract

When performing spatial light phase modulation of a plurality of beams of light having differing wavelength bands so as to obtain a reproduced image in each wavelength band, the present invention realizes an improvement in the brightness of the reproduced image while achieving reductions in the size and cost of the optical system. A lighting device according to the present technology comprises: a light-emitting unit which emits a plurality of beams of light having differing wavelength bands; a phase modulator which performs spatial light phase modulation of incident light from the light-emitting unit and in which the beams of light having differing wavelength bands are incident from the light-emitting unit on respective phase modulation areas that are areas dividing a phase modulation surface where the spatial light phase modulation is performed; and a control unit which executes the spatial light phase modulation simultaneously in the phase modulation areas in a state in which the light having a wavelength band corresponding to the respective phase modulation area is incident thereon.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This technology relates to lighting devices and projector devices, and more particularly to lighting devices and projector devices that generate a reconstructed image having a desired light intensity distribution by applying spatial light phase modulation to incident light from a light-emitting unit. [Background technology]

[0002] In recent years, technologies to enhance the dynamic range have been proposed in the field of image display devices, with the HDR (High Dynamic Range) standard attracting particular attention. The HDR standard is designed to expand the gradation expression in low-luminance areas and achieve high peak brightness.

[0003] Patent Document 1, described below, discloses a technology that uses a laser light source and a spatial light phase modulator (hereinafter referred to as "phase modulator") for modulating the phase of light to steer the light beam emitted from the laser light source to match the image signal, thereby generating projector illumination light that matches the brightness distribution of the image by focusing the light from dark objects onto bright objects. The invention proposes a method for realizing images with a wide dynamic range by injecting this illumination light into a spatial light intensity modulator (hereinafter referred to as "intensity modulator") such as a DMD (Digital Micro Mirror Device). As described above, the method of injecting illumination light generated by a phase modulator into an intensity modulator can be said to aim for a similar effect to, for example, area-divided driving of the backlight in an LCD television (television receiver).

[0004] When performing full-color HDR display using a phase modulator, it is possible to use three phase modulators for R, G, and B, or to use a single phase modulator and perform time-division driving for each color. Patent Document 2, listed below, discloses a technique for performing RGB spatial light modulation using time-division multiplexing. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Special Publication No. 2018-532152 [Patent Document 2] Japanese Patent Publication No. 2021-26195 [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] However, when spatial light modulation for each color is performed using time-division multiplexing, it is necessary to time-division multiplex the light of each color into the spatial light modulator for each frame period. This shortens the emission period of each color of light, leading to a decrease in brightness. On the other hand, if a separate spatial light modulator is provided for each color, it is possible to avoid the brightness reduction that occurs in the case of time-division driving. However, providing a separate spatial light modulator for each color leads to an increase in the number of components, which contributes to the larger size and increased cost of the optical system.

[0007] This technology was developed in light of the above circumstances, and aims to improve the brightness of the reconstructed image when obtaining reconstructed images for each wavelength band by spatially phase modulating multiple lights of different wavelength bands, while miniaturizing the optical system and reducing costs. [Means for solving the problem]

[0008] The lighting device according to this technology comprises: a light-emitting unit that emits multiple lights of different wavelength bands; a phase modulator that performs spatial light phase modulation with respect to the incident light from the light-emitting unit, wherein light of different wavelength bands is incident from the light-emitting unit to each phase modulation area, which is an area that divides the phase modulation plane on which the spatial light phase modulation is performed; and a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of the wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas. Here, "simultaneous" does not mean that the execution periods of spatial light phase modulation in each phase modulation area are exactly the same, but rather that there is at least a period in which spatial light phase modulation is being performed in all phase modulation areas. In other words, as long as this condition is met, it is permissible for the start and end timings of spatial light phase modulation to differ between one phase modulation area and another. According to the above configuration, for example, when obtaining a reconstructed image by combining images of light with different wavelength bands, such as R light, G light, and B light, on a predetermined reconstructed surface, it becomes unnecessary to time-resolved spatial light phase modulation of the light in each wavelength band.

[0009] Furthermore, the projector device relating to this technology comprises: a light-emitting unit that emits multiple lights of different wavelength bands; a phase modulator that performs spatial light phase modulation on incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit on each phase modulation area, which is an area that divides the phase modulation surface on which the spatial light phase modulation is performed; an intensity modulator that performs spatial light intensity modulation on the light incident through the phase modulator; a projection lens that projects the light whose spatial light intensity modulation has been performed by the intensity modulator onto the projection surface; and a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas when light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas. Such a projector device can also provide the same functions and effects as the lighting device described in the above-described embodiment. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an example configuration of a lighting device as the first embodiment. [Figure 2] This is an explanatory diagram of the principle of image reconstruction using spatial optical phase modulation. [Figure 3] This is an explanatory diagram illustrating an example of area division of the phase modulation surface. [Figure 4] This figure shows the output image of the regenerated image for each area in the embodiment. [Figure 5] This is an explanatory diagram of the coordinate system for the phase-modulatable region and domain on the phase modulation surface, and the coordinate system for the irradiation region on the intensity modulation surface. [Figure 6] This is a diagram schematically illustrating the relationship between the phase distribution across the entire phase-modulatable region and the intensity distribution realized by said phase distribution in the irradiation region. [Figure 7] This is a diagram schematically illustrating the relationship between the phase distribution of a domain and the intensity distribution realized by said phase distribution in the irradiation region. [Figure 8] This is an explanatory diagram for the addition of a lens component to a scaled phase distribution. [Figure 9] This is an explanatory diagram of a control method as the first embodiment for generating a full-color reproduced image. [Figure 10] This is a diagram for explaining a configuration example of a control unit included in the illumination device as the first embodiment. [Figure 11] This is an explanatory diagram of color balance adjustment in the embodiment. [Figure 12] This is a diagram showing a configuration example of a projector device as the second embodiment. [Figure 13] This is an explanatory diagram of a control method for image reproduction in the second embodiment. [Figure 14] This is a diagram for explaining a configuration example of a control unit included in the projector device as the second embodiment. [Figure 15] This is a diagram illustrating, for each of the R, G, and B colors, an example of the relationship between the drive signal value of a phase modulator and the phase modulation amount. [Figure 16] This is an explanatory diagram of drive signal value compression processing. [Figure 17] This is a diagram for explaining a configuration example of a control unit included in the projector device as the third embodiment. [Figure 18] This is a conceptual diagram of a reproduced image in which color mixing has occurred. [Figure 19] This is an explanatory diagram of the luminance priority mode and the color mixing suppression mode. [Figure 20] This is a diagram for explaining a configuration example of a control unit included in the projector device as the fourth embodiment. [Figure 21] This diagram schematically shows the relationship between the zeroth-order light of a phase modulator and the reconstructed image when images of each wavelength band are superimposed on the same region centered on the optical axis in the reconstructed surface. [Figure 22] This is an explanatory diagram of the offset method for the reconstructed image as the fifth embodiment. [Figure 23] This is an explanatory diagram of spatial optical phase modulation used to offset the illumination area of ​​the reconstructed image. [Figure 24] This figure shows an example configuration of a projector device as the fifth embodiment. [Figure 25] This is an explanatory diagram illustrating another example of the offset method for reconstructed images. [Figure 26] This is an explanatory diagram showing a modified example of the fifth embodiment. [Figure 27] This figure shows an example of the configuration of a projector device as a modified example of the fifth embodiment. [Figure 28] This figure shows the behavior of the luminous flux in each wavelength band when the optical axis of the incident light to the phase modulator is misaligned. [Figure 29] This is a diagram illustrating an example of the configuration of a control unit included in a projector device as a sixth embodiment. [Figure 30] This is an explanatory diagram of the image shifting process in the image shifting section. [Figure 31] This is an explanatory diagram illustrating an example of a test projection image. [Figure 32] This figure illustrates a test projection image projected onto the projection surface when there is a misalignment of the optical axis of the incident light. [Figure 33] This is an explanatory diagram of the phase modulation pattern shifting process for canceling optical axis misalignment. [Figure 34] This figure illustrates an example of the configuration of a control unit included in a projector device as a modified example of the sixth embodiment. [Figure 35] This figure shows an example of random noise occurring in the reproduced image, and an example of a projected image with noise caused by this random noise. [Figure 36] This figure shows an example configuration of a projector device as the seventh embodiment. [Figure 37] This is an explanatory diagram illustrating the effect of defocusing the reconstructed image. [Modes for carrying out the invention]

[0011] The embodiments of this technology will be described below in the following order with reference to the attached drawings. <1. First Embodiment> (1-1. Overview of the Lighting System Configuration) (1-2. Regarding Phase Modulation) (1-3. Control method and control unit configuration as the first embodiment) (1-4. Regarding color balance adjustment) <2. Second Embodiment> <3. Third Embodiment> <4. Fourth Embodiment> <5. Fifth Embodiment> <6. Sixth Embodiment> <7. Seventh Embodiment> <8. Variation> <9. Summary of Embodiments> <10. This Technology>

[0012] <1. First Embodiment> (1-1. Overview of the Lighting System Configuration) Figure 1 is a diagram showing an example configuration of lighting device 1 as one embodiment of the lighting device according to this technology. As shown in the figure, the illumination device 1 comprises a light-emitting unit 2 that emits multiple lights of different wavelength bands, a phase modulator 3 that performs spatial light phase modulation with respect to the incident light from the light-emitting unit 2, and a control unit 4 that controls the light emission of the light-emitting unit 2 and the drive of the phase modulator 3. It also includes multiple collimation lenses 5 (5r, 5g, 5b), a first dichroic mirror 6, a second dichroic mirror 7, a first mirror M1, a second mirror M2, and a projection lens 8.

[0013] In this lighting device 1, a reflective liquid crystal panel is used as the phase modulator 3. The phase modulator 3 is configured to reproduce a desired image (light intensity distribution) on a predetermined reproduction surface Sp by performing spatial light phase modulation on the incident light from the light-emitting unit 2.

[0014] For confirmation, let's now explain the principle of image reconstruction by spatial optical phase modulation, referring to Figure 2. Figure 2 schematically shows the relationship between each light ray incident on the phase modulation surface Sm of the phase modulator 3, the wavefront of the phase distribution in the phase modulator 3, each light ray after phase modulation, and the light intensity distribution formed on the regeneration surface Sp by each light ray after phase modulation. First, as a premise, the wavefront of the phase distribution in phase modulator 3 draws a smooth curve as shown in the figure by using the Freeform method. Due to spatial optical phase modulation in phase modulator 3, each incident light ray is refracted so as to propagate in the direction of the normal to the wavefront of the phase distribution. This refraction creates areas on the regeneration surface Sp where the light density is high and areas where the light density is low, thereby forming an optical intensity distribution on the regeneration surface Sp. Based on this principle, it is possible to reproduce a desired image on the regeneration surface Sp by setting a phase distribution pattern in the phase modulator 3.

[0015] While image reconstruction can also be performed using spatial light intensity modulation instead of spatial light phase modulation, spatial light intensity modulation involves blocking or attenuating a portion of the incident light using devices such as DMDs (Digital Micro Mirror Devices) or liquid crystal panels. This results in low light utilization efficiency and makes it difficult to achieve high contrast. By performing image reconstruction using spatial light phase modulation as described above, the light from dark objects that would otherwise be blocked or attenuated can be focused onto bright objects, thereby improving light utilization efficiency and enabling higher contrast (expanding the dynamic range).

[0016] In Figure 1, the light-emitting unit 2 functions as a light source for the light incident on the phase modulator 3. In this example, the light-emitting unit 2 has three light-emitting elements 2r, 2g, and 2b, each configured to emit light of a different color. Light-emitting element 2r emits R (red) light, light-emitting element 2g emits G (green) light, and light-emitting element 2b emits B (blue) light. In this example, semiconductor lasers are used as the light-emitting elements 2r, 2g, and 2b. In this diagram, the luminous beams of R light, G light, and B light are represented by dotted lines, dashed lines, and solid lines, respectively. Although this example illustrates a configuration with one each of the light-emitting elements 2r, 2g, and 2b, the light-emitting unit 2 can also be configured to have two or more of each of the light-emitting elements 2r, 2g, and 2b.

[0017] As shown in the figure, the R light emitted from the light-emitting element 2r is incident on the surface of the first dichroic mirror 6 via the collimation lens 5r, and the G light emitted from the light-emitting element 2g is incident on the back surface of the first dichroic mirror 6 via the collimation lens 5g. The first dichroic mirror 6 has the property of transmitting red light and reflecting green light. That is, red light incident from the light-emitting element 2r through the collimation lens 5r is transmitted through the first dichroic mirror 6, and green light incident from the light-emitting element 2g through the collimation lens 5g is reflected from the back surface of the first dichroic mirror 6. As shown in the figure, the red light transmitted through the first dichroic mirror 6 and the green light reflected from the back surface of the first dichroic mirror 6 are incident on the front surface of the second dichroic mirror 7.

[0018] Light B emitted from the light-emitting element 2b is incident on the back surface of the second dichroic mirror 7 via the collimation lens 5b. The second dichroic mirror 7 has the property of reflecting R and G light and transmitting B light. Therefore, R and G light incident from the first dichroic mirror 6 are reflected by the surface of the second dichroic mirror 7, and B light incident from the light-emitting element 2b via the collimation lens 5b is transmitted through the second dichroic mirror 7.

[0019] In the illumination device 1, R light, G light, and B light are emitted from the surface of the second dichroic mirror 7 such that their respective beams are parallel. Furthermore, in the illumination device 1, the R light, G light, and B light emitted from the surface of the second dichroic mirror 7 in this manner are incident on different areas on the phase modulation surface Sm of the phase modulator 3.

[0020] Figure 3 is an explanatory diagram illustrating an example of area division of the phase modulation plane Sm. In this example, corresponding to the handling of three types of light with different wavelength bands—R light, G light, and B light—the phase modulation plane Sm is divided into three areas (phase modulation areas) Ar. These three areas Ar are denoted as the first area Ar1, the second area Ar2, and the third area Ar3. In this example, the effective pixel area of ​​the phase modulator 3 as a liquid crystal panel, that is, the area in which spatial light phase modulation with respect to incident light is possible (hereinafter referred to as the "phase modulation-capable area"), is rectangular in shape, and the division of area Ar is carried out by dividing the phase modulation-capable area into three equal parts in the longitudinal direction. The surface onto which the R, G, and B light from the second dichroic mirror 7 enters is defined as the surface of the phase modulator 3. The area Ar located furthest to the left when facing this surface is designated as the first area Ar1, the area Ar to its right is designated as the second area Ar2, and the area Ar further to the right is designated as the third area Ar3. As shown in the diagram, in this example, G light is incident on the first area Ar1, B light on the second area Ar2, and R light on the third area Ar3. Figure 3 shows an example in which two light-emitting elements 2r, 2g, and 2b are each provided in the light-emitting section 2, and two beams of light of the corresponding color are incident on each area Ar.

[0021] As can be seen by referring to Figure 1, in the illumination device 1, the optical system is designed so that the R light, G light, and B light emitted from the surface of the second dichroic mirror 7 are arranged in parallel without overlapping. Furthermore, in this case, the optical system is designed so that the arrangement of the R light, G light, and B light incident on the phase modulator 3 is such that G light is incident on the first area Ar1, B light on the second area Ar2, and R light on the third area Ar3, as described above.

[0022] In this process, when forming a full-color reconstructed image on a predetermined reconstruction surface Sp using red, green, and blue light, spatial light phase modulation is performed in the first area Ar1, the second area Ar2, and the third area Ar3, based on the corresponding color input images. However, if only spatial light phase modulation is performed in each area Ar to reproduce the light intensity distribution corresponding to the input image, the light beams of each color will be output in parallel from the phase modulator 3, causing the images of each color to illuminate different regions on the reconstruction surface Sp. This makes it impossible to obtain a proper full-color reconstructed image.

[0023] Figure 4 shows the image output for each area Ar. To obtain a proper full-color reproduced image, the images of each color should be superimposed on the same region on the reproduction surface Sp, as shown in Figures 4A to 4C, to prevent crosstalk in the spatial direction. To achieve this, spatial optical phase modulation is performed in each area Ar so that lens components are provided to change the direction of emission, shape, and size of the light beam from each area Ar (compared to the light beam before incidence into each area Ar). Further details regarding the spatial optical phase modulation to be performed in each area Ar, including this lens component, will be explained separately.

[0024] In Figure 1, the R, G, and B light, which have undergone spatial light phase modulation in their respective corresponding areas Ar of the phase modulator 3, are reflected by the first mirror M1 and then by the second mirror M2. In this example, the regeneration surface Sp is set as the position between the second mirror M2 and the projection lens 8 in the optical path from the light-emitting unit 2. The images of each color generated by the spatial light phase modulation in each area Ar of the phase modulator 3 are superimposed on this regeneration surface Sp to form a full-color regeneration image.

[0025] In the illumination device 1, the regenerated image formed on the regeneration surface Sp is projected onto a predetermined projection surface, such as the surface of the screen Sc, by the projection lens 8.

[0026] (1-2. Regarding Phase Modulation) Here, we will explain, with reference to Figures 5 to 8, the method for deriving a phase modulation pattern for reconstructing a desired light intensity distribution on the regeneration surface Sp, including the lens components mentioned above. First, the Freeform method is a known technique for determining the phase distribution necessary to reconstruct a target light intensity distribution. The Freeform method is a general term for techniques that determine the phase distribution necessary to reconstruct a desired image based on optical optics. The following describes a method for determining the phase distribution for each area Ar based on this Freeform method. Note that the following explanation uses the concept of "domain Dm," which corresponds to the concept of "area Ar."

[0027] As shown in Figure 5, for the sake of explanation, we define the coordinate system (x,y) in the phase-modulation region of the phase-modulation plane Sm, the coordinate system (x',y') in the domain Dm of the phase-modulation plane, and the coordinate system (ux,uy) in the irradiation region (the region where the reconstructed image is irradiated) of the reconstruction plane Sp. We also define the positional shift amount of domain Dm relative to the phase-modulation region as (Δx,Δy), and the area reduction ratio of domain Dm relative to the phase-modulation region as r (r>2). Furthermore, let f be the distance between the phase-modulation plane Sm and the reconstruction plane Sp.

[0028] The phase distribution P, which creates a one-to-one correspondence between the light ray from the entire phase-modulation region to the irradiation region, is determined using the Freeform method. The refraction effect on a light ray incident on a point (x,y)=(x1,y1) in the phase-modulation region, as determined by the phase distribution P, is the gradient vector of the phase distribution P at that point (x,y)=(x1,y1).

number

number

number

[0029] We will call the phase distribution to be applied to domain Dm "P'". As shown in Figures 6 and 7, let "I" be the intensity distribution realized in the irradiated area by the phase distribution P refracting light rays incident on the entire phase-modulation region, and let "I'" be the intensity distribution realized in the irradiated area by the phase distribution P' refracting light rays incident on domain Dm. The condition that the phase distribution P' must satisfy is that intensity distribution I and intensity distribution I' are the same.

[0030] Here, as shown in Figure 7, let A' be any point on the domain Dm, and let its coordinates be (x',y')=(s x ,s y Let ) be the case. Also, let B' be the point where the ray, which has been refracted by the phase distribution P' at point A', penetrates the regeneration surface Sp. Furthermore, as shown in Figure 6, the coordinates (x,y) = (r·s) for point A'. x ,r·s y Let point A be a point on the phase-modulation region that corresponds to the given relationship, and let point B be the point where the ray, which has been refracted by the phase distribution P at point A, penetrates the regeneration surface Sp.

[0031] To make intensity distribution I and intensity distribution I' coincide, we need to define the phase distribution P' such that points B and B' coincide. If a phase distribution P' that satisfies this condition exists, then, as explained in [Equation 2], the product of the gradient vector of the phase distribution P' at point A' and the distance f will coincide with the in-plane displacement between point B and point A', but the coordinates of point B can be determined using the expression on the left side of [Equation 3].

number

number

number

[0032] Here, since point A' is any point on domain Dm, in [Equation 6] (s x ,s y By rewriting ) as (x',y'), we obtain the following conditional expression [Equation 7].

number

[0033] The first term in the above [Equation 10] represents a component obtained by scaling the phase distribution P with a reduction magnification r in both the spatial direction and the phase direction, and the second and third terms represent lens components determined by the position of the domain Dm. Therefore, to calculate the phase distribution P' of each divided area Ar, first, the phase distribution P obtained by the Freeform method is scaled in the spatial direction and the phase direction, and a lens component corresponding to the position of each domain Dm is added to the scaled phase distribution, which may be assigned as the phase distribution P' of each domain Dm. By doing in this way, it is possible to reproduce each light intensity distribution in the same region on the reproduction surface Sp without shifting the position of the reproduced image from each domain Dm.

[0034] Hereafter, the phase distribution P obtained for the entire phase-modulation-possible region of an image of a certain color will be referred to as the "basic phase distribution Dpr". Furthermore, the phase distribution obtained by applying spatial and phase scaling to this basic phase distribution Dpr according to the size of the domain Dm will be referred to as the "area basic phase distribution Dpa". In this embodiment, where the first area Ar1 corresponds to the G image, the second area Ar2 to the B image, and the third area Ar3 to the R image, the area base phase distribution Dpa is determined for each of these G, B, and R images.

[0035] Scaling of the fundamental phase distribution Dpr is performed using a scaling factor of "ard / arr," where "arr" is the area of ​​the entire phase-modulation region and "ard" is the area of ​​the domain Dm.

[0036] Figure 8 is an explanatory diagram regarding the addition of lens components. Here, we illustrate the domain Dm as follows: Domain Dm-1 (corresponding to the second area Ar2), located in the center of Domain Dm; and Domains Dm-2 (corresponding to the first area Ar1) and Dm-3 (corresponding to the third area Ar3), located to the left and right of Domain Dm-1, respectively. In the figure, the phase distribution shown as lens component Dpl-1 is the phase distribution of the lens component corresponding to the position of Domain Dm-1, and lens components Dpl-2 and Dpl-3 are the phase distributions of the lens components corresponding to the positions of Domains Dm-2 and Dm-3, respectively. Furthermore, the area base phase distributions Dpa1, Dpa2, and Dpa3 represent the area base phase distributions Dpa obtained corresponding to Domains Dm-1, Dm-2, and Dm-3, respectively.

[0037] As shown in the figure, the phase distribution Dpd-1 to be set for domain Dm-1 is obtained by adding the lens component Dpl-1 to the area base phase distribution Dpa1. Similarly, the phase distribution Dpd-2 to be set for domain Dm-2 is obtained by adding the lens component Dpl-2 to the area base phase distribution Dpa2, and the phase distribution Dpd-3 to be set for domain Dm-3 is obtained by adding the lens component Dpl-3 to the area base phase distribution Dpa3. This allows each of the domains Dm-1, Dm-2, and Dm-3 to regenerate their respective target light intensity distributions in the same region on the regeneration surface Sp.

[0038] Hereafter, the phase distribution obtained by adding the lens component Dpl corresponding to each domain Dm to the area base phase distribution Dpa as described above will be collectively referred to as the "area phase distribution Dpd".

[0039] (1-3. Control method and control unit configuration as the first embodiment) Based on the above explanation, the control method for image reproduction as the first embodiment and the configuration of the control unit 4 for realizing the control method will be described below.

[0040] Figure 9 is an explanatory diagram of a control method as a first embodiment for generating a full-color reconstructed image. In the figure, the "red light source," "green light source," and "blue light source" schematically represent the light emission operation of the light-emitting elements 2r, 2g, and 2b, respectively. Furthermore, the "red region," "green region," and "blue region" in the figure schematically represent the phase modulation execution modes in the third area Ar3, first area Ar1, and second area Ar2 of the phase modulator 3, respectively.

[0041] In this embodiment, as shown in Figure 3, light of the wavelength band corresponding to each area Ar of the phase modulator 3 is incident, and during each frame period, each area Ar simultaneously performs spatial light phase modulation with respect to the incident light. To clarify, the frame duration referred to here means the frame duration of the image to be reproduced by the reconstructed image, i.e., the target image in image reconstruction. When performing full-color image reconstruction, the R image, G image, and B image are input as the target image. Each area Ar performs spatial optical phase modulation according to the area phase distribution Dpd calculated based on the input image of the corresponding color, so that the images of each color are superimposed in the same region on the reconstruction surface Sp, and a full-color reconstructed image can be obtained.

[0042] As described above, by having each area Ar simultaneously perform spatial light phase modulation for incident light of each color during each frame period, it becomes unnecessary to time-divisionally inject light of each color into the phase modulator 3 during each frame period. As shown in the figure, in this embodiment, light of each color is emitted simultaneously during each frame period.

[0043] In this way, it becomes unnecessary to time-divisionally inject light of each color into the phase modulator 3, thereby increasing the amount of light emitted for each color during each frame period, and improving the brightness of the reproduced image. Furthermore, according to the configuration of the lighting device 1 shown in Figure 1, there is no need to provide a phase modulator 3 for each color, thus preventing an increase in the size and cost of the optical system. Therefore, according to this embodiment, it is possible to improve the brightness of the reproduced image while miniaturizing the optical system and reducing costs.

[0044] Here, the term "simultaneous" is used in the above explanation, but "simultaneous" here does not mean that the execution periods of spatial optical phase modulation in each area Ar (phase modulation area) are exactly the same. Rather, it means that at least there is a period in which spatial optical phase modulation is being performed in all phase modulation areas. In other words, as long as this condition is met, it is permissible for at least one of the start timing or end timing of spatial optical phase modulation to differ between one phase modulation area and another. Furthermore, this concept of "simultaneity" also applies to the emission of light in each wavelength band in the light-emitting unit 2.

[0045] Figure 10 is an explanatory diagram of the configuration of the control unit 4 shown in Figure 1. In addition, Figure 10 shows an example of the internal configuration of the control unit 4, along with the light-emitting unit 2 and phase modulator 3 shown in Figure 1. As shown in the figure, the control unit 4 includes a light emission control unit 40, a plurality of phase pattern calculation units 41 as phase pattern calculation units 41r, 41g, and 41b, a plurality of phase-drive value conversion units 42 as phase-drive value conversion units 42r, 42g, and 42b, and a drive unit 43.

[0046] The light emission control unit 40 controls the light emission operation of the light-emitting elements 2r, 2g, and 2b of the light-emitting unit 2. Specifically, it performs ON / OFF control (light emission / non-light emission control) for each of these light-emitting elements 2r, 2g, and 2b.

[0047] Each phase pattern calculation unit 41 calculates the area phase distribution Dpd for the corresponding area Ar based on the input image of the corresponding color. Here, the phase distribution can be rephrased as representing the phase modulation pattern in phase modulator 3, and therefore will also be referred to as the "phase modulation pattern" below.

[0048] Specifically, the phase pattern calculation unit 41r calculates a phase modulation pattern as an area phase distribution Dpd for the third area Ar3 based on the input R image. The phase pattern calculation unit 41g calculates a phase modulation pattern as an area phase distribution Dpd for the first area Ar1 based on the input G image, and the phase pattern calculation unit 41b calculates a phase modulation pattern as an area phase distribution Dpd for the second area Ar2 based on the input B image. The calculation method for the area phase distribution Dpd for each area Ar has already been explained with reference to Figures 5 to 8, so we will avoid repeating the explanation.

[0049] Each phase-drive value conversion unit 42 converts the phase modulation pattern input from the corresponding phase pattern calculation unit 41 into a drive signal value for the phase modulator 3. In other words, it obtains a drive signal value for each pixel of the phase modulator 3 that realizes the phase distribution as the input phase modulation pattern. Specifically, the phase-to-drive value conversion unit 42r receives the phase modulation pattern for the third area Ar3 calculated by the phase pattern calculation unit 41r and converts it into a drive signal value to obtain the drive signal value for each pixel in the third area Ar3. The phase-to-drive value conversion unit 42g receives the phase modulation pattern for the first area Ar1 calculated by the phase pattern calculation unit 41g and converts it into a drive signal value to obtain the drive signal value for each pixel in the first area Ar1. Furthermore, the phase-drive value conversion unit 42b receives the phase modulation pattern for the second area Ar2 calculated by the phase pattern calculation unit 41b and converts it into a drive signal value to obtain the drive signal value for each pixel in the second area Ar2.

[0050] The drive unit 43 has a drive circuit configured to drive each pixel of the phase modulator 3 individually, and drives the phase modulator 3 according to the drive signal value for each pixel of each area Ar input from each phase-drive value conversion unit 42.

[0051] To implement the control method as described in Figure 9 as the first embodiment, the control unit 4 operates as follows. In other words, the light emission control unit 40 causes the light-emitting elements 2r, 2g, and 2b to emit light simultaneously during each frame period. Specifically, in this example, the light emission control unit 40 starts the emission of light from the light-emitting elements 2r, 2g, and 2b at the start of each frame period and stops the emission of light from the light-emitting elements 2r, 2g, and 2b at the end of each frame period.

[0052] Furthermore, each phase pattern calculation unit 41 sequentially calculates the phase modulation pattern for the corresponding area of ​​the corresponding color frame image that is input sequentially in the time direction, and each phase-to-drive value conversion unit 42 sequentially converts the phase modulation pattern output sequentially from the corresponding phase pattern calculation unit 41 into drive signal values. The drive unit 43 then simultaneously drives each area Ar during each frame period based on the drive signal value for each area Ar output from each phase-drive value conversion unit 42. Specifically, in this example, the drive unit 43 drives the phase modulator 3 so that the state in which each area Ar is driven based on the drive signal value from each phase-drive value conversion unit 42 continues from the start timing to the end timing of each frame period.

[0053] The operation of the control unit 4 as described above realizes the control method as the first embodiment, as explained in Figure 9 above.

[0054] (1-4. Regarding color balance adjustment) Now, let's consider performing color balance adjustments, such as white balance adjustments, on the reproduced image. If the formation of the reconstructed image, or in other words, the formation of the light intensity distribution pattern on the reconstructed surface Sp, is performed by an intensity modulator that modulates spatial light intensity, then color balance adjustment can be achieved by controlling the amount of light of the target color using the dimming and shading functions of the intensity modulator. However, when the reconstructed image is formed by spatial light phase modulation, as in the illumination device 1, the phase modulator 3 cannot perform dimming or shading like an intensity modulator, and therefore color balance adjustment cannot be achieved by controlling the spatial light modulator.

[0055] Therefore, the color balance of the reproduced image in the lighting device 1 can be adjusted by adjusting the amount of light emitted from the light-emitting unit 2. For example, as illustrated in Figure 11, color balance adjustment can be achieved by adjusting the emission time per unit time for the target color of light (emission time per frame period in the figure). For example, if the color reproduction of the reconstructed image tends to be weak in red, the emission time per unit time of the G and B light is shortened relative to the R light, as shown in the figure, to adjust the settings so that the redness in the reconstructed image becomes relatively stronger.

[0056] Such color balance adjustment can be achieved by controlling the emission of light-emitting elements 2r, 2g, and 2b by the light emission control unit 40 provided in the control unit 4. For example, the light emission control unit 40 can be configured to receive instruction values ​​for the balance of R light, G light, and B light emission amounts, and the light emission control unit 40 can be configured to control the emission time per unit time of the light-emitting elements 2r, 2g, and 2b based on these instruction values.

[0057] In the above example, the adjustment of the amount of light emitted for each color was achieved by controlling the light emission time per unit time. However, the adjustment of the amount of light emitted for each color can also be achieved by controlling the drive current value of the light-emitting element of the light-emitting unit 2. Alternatively, if multiple light-emitting elements are provided for each color, the amount of light emitted for each color may be adjusted by adjusting the number of light-emitting elements that are in a light-emitting state.

[0058] <2. Second Embodiment> Next, a second embodiment will be described. The second embodiment applies the lighting device described in the first embodiment to a projector device. In the following explanation, parts that are the same as those already explained will be denoted by the same reference numeral and their explanation will be omitted.

[0059] Figure 12 shows an example of the configuration of a projector device 10 as a second embodiment. The differences from the lighting device 1 shown in Figure 1 are the addition of an intensity modulator 11, the replacement of the second mirror M2 with a polarizing beam splitter 12, and the replacement of the control unit 4 with a control unit 14.

[0060] In the projector device 10, the R light, G light, and B light emitted from the phase modulator 3 and reflected by the first mirror M1 are reflected by the reflective surface of the polarizing beam splitter 12 and incident on the intensity modulator 11, which is configured as a reflective spatial light intensity modulator. The intensity modulator 11 is composed of, for example, a DMD or a reflective liquid crystal panel.

[0061] In the projector device 10, the intensity modulation surface, which is the surface on which spatial light intensity modulation occurs in the intensity modulator 11, is designated as the regeneration surface Sp. That is, in the projector device 10, a full-color regeneration image is formed on the intensity modulation surface by the phase modulator 3.

[0062] In the intensity modulator 11, spatial light intensity modulation is performed on the reconstructed image by the phase modulator 3 to correct the resolution of the reconstructed image, specifically, spatial light intensity modulation for increasing resolution. The reconstructed image, which has undergone spatial light intensity modulation by the intensity modulator 11, passes through the reflective surface of the polarizing beam splitter 12 and enters the projection lens 8. As a result, an enlarged image of the reconstructed image, which has undergone spatial light intensity modulation by the intensity modulator 11, is projected onto a predetermined projection surface such as the surface of the screen Sc.

[0063] In such a projector device 10, the image reproduced by the phase modulator 3 functions as projector illumination light that reproduces the brightness distribution of the image to be displayed. This allows for an expansion of the dynamic range of the projected image compared to when the projected image is generated solely by spatial light intensity modulation by the intensity modulator 11. This is a similar concept to, for example, the area-divided driving of the backlight in a liquid crystal television (television receiver) according to the input image.

[0064] In this case, the reconstructed image obtained by performing spatial optical phase modulation based on the Freeform method, etc., generally tends to have low spatial resolution. In particular, in this embodiment, the phase modulator 3 is divided into areas and each area Ar is phase-modulated, which is disadvantageous in terms of resolution. Therefore, the intensity modulator 11 applies spatial light intensity modulation to the reconstructed image to compensate for the high-frequency components of the input image, thereby enabling the reproduction of a high-resolution image as a projection image.

[0065] Figure 13 is an explanatory diagram of the control method for image reproduction in the second embodiment. As can be seen by comparing with Figure 9 above, in this case as well, the control of the light-emitting unit 2 and the drive control of the phase modulator 3 are the same as in the first embodiment. In the second embodiment, the intensity modulator 11 performs spatial light intensity modulation based on a resolution correction image, which is an image for correcting the resolution of the reconstructed image, for each frame period. Specifically, for each frame of the input image, a resolution correction image is generated based on the frame image, and spatial light intensity modulation is performed for each frame period based on the resolution correction image of the corresponding frame.

[0066] Figure 14 is an explanatory diagram illustrating an example configuration of the control unit 14 for realizing the control method as the second embodiment described above. In addition to the internal configuration example of the control unit 14, Figure 14 also shows the light-emitting unit 2, phase modulator 3, and intensity modulator 11 shown in Figure 12.

[0067] The difference from the control unit 4 shown in Figure 10 is the addition of a resolution-corrected image generation unit 44 and a drive unit 45. The resolution-corrected image generation unit 44 generates a resolution-corrected image based on the input R image, G image, and B image. The resolution-corrected image may be, for example, an image in which the maximum values ​​of R, G, and B are assigned to each pixel.

[0068] Furthermore, there are various possible methods for generating resolution-corrected images, and the method is not limited to any particular technique. For example, instead of limiting ourselves to the simple method of assigning the maximum values ​​of R, G, and B as described above, we can also consider generating a resolution correction image based on the comparison result between the assumed image of the reconstructed image by the phase modulator 3 (the image of the reconstructed image assumed from each phase modulation pattern calculated by the phase pattern calculation units 41r, 41g, and 41b) and the input image (the full-color image realized by the R image, G image, and B image). For example, one method is to divide the luminance value of the input image by the luminance value of the assumed image of the reconstructed image. Alternatively, the difference image between the input image and the assumed image of the reconstructed image could be used as the resolution correction image.

[0069] The drive unit 45 drives each pixel of the intensity modulator 11 according to the resolution-corrected image input from the resolution-corrected image generation unit 44.

[0070] As can be understood from the above explanation, the intensity modulator 11 is driven so that spatial light intensity modulation is performed for each frame period according to the resolution-corrected image generated from the corresponding frame image. The spatial light intensity modulation in the intensity modulator 11 only needs to be performed "simultaneously" with the spatial light phase modulation of each area Ar in the phase modulator 3. Specifically, in this example, the drive unit 45 drives the intensity modulator 11 such that, for each frame period, the state of performing spatial light intensity modulation according to the resolution-corrected image of the corresponding frame continues from the start timing to the end timing of the frame period.

[0071] With the projector device 10 described above, it is possible to obtain a projected image with high dynamic range and high resolution.

[0072] <3. Third Embodiment> The third embodiment involves compressing the drive signal value of the phase modulator 3. Figure 15 is a diagram illustrating the relationship between the drive signal value of the phase modulator 3 and the amount of phase modulation, for each of the R, G, and B colors. In phase modulator 3, since the characteristics of the liquid crystal molecules are basically the same for each pixel, the amount of phase modulation differs depending on the wavelength of the incident light. Specifically, the shorter the wavelength, the larger the amount of phase modulation for the same range of drive signal values. In this example, the maximum phase difference in the phase modulation pattern is assumed to be 2π. To ensure a maximum phase difference of 2π for all three light streams (R, G, and B), the gamma setting of the phase modulator 3 is adjusted to match the R light, which has the longest wavelength. For example, if the phase modulator 3 has 256 gradations from 0 to 255, the gamma setting of the phase modulator 3 is adjusted so that the phase difference between the R light stream when the drive signal value is 0 and when the drive signal value is 255 is 2π. However, with such settings, as shown in the diagram, the phase difference between the G light and B light with respect to the drive signal value range from 0 to 255 becomes greater than 2π. Specifically, in the example shown, the phase difference of the G light is 2.8π and the phase difference of the B light is 3.8π. If the phase difference between the minimum and maximum values ​​of the drive signal becomes larger than the specified phase difference (2π in this case), it may become impossible to perform appropriate spatial light phase modulation according to the calculated phase modulation pattern in both the second area Ar2 where G light is incident and the first area Ar1 where B light is incident, potentially resulting in an inability to properly reproduce a full-color image.

[0073] Therefore, the drive signal value is compressed for area Ar, where light in the shortest wavelength band is incident. Specifically, in this example, three types of light—R light, G light, and B light—are used, and the gamma setting of the phase modulator 3 is configured so that the maximum phase difference for R light is 2π. Thus, the drive signal value is compressed for areas Ar of G light and B light, which are in wavelength bands other than R light, i.e., the second area Ar2 and the first area Ar1, so that the maximum phase difference is 2π.

[0074] Figure 16 is an explanatory diagram of the compression process for drive signal values. Figure 16A illustrates, for comparison, the relationship between the drive signal value and the phase modulation amount for R light when the gamma setting is matched to R light. As shown in the figure, for R light in this case, the phase modulation amount is 2π for drive signal values ​​ranging from 0 to 255.

[0075] Figure 16B shows an example of compression processing for G light, and Figure 16C shows an example of compression processing for B light. Here, as an example of compression processing, a compression process that shifts the drive signal value towards the maximum value is illustrated. That is, the drive signal value is compressed within a range from the maximum value of 255 to the drive signal value at which the phase difference from the phase modulation amount when the drive signal value = 255 is 2π. Specifically, in the illustrated example, for the G light, the drive signal value at which the phase difference from the phase modulation amount when the drive signal value = 255 is 2π is 76, and therefore, for the G light (second area Ar2), the drive signal value is compressed within the range of 76 to 255. Also, for the B light, the drive signal value at which the phase difference from the phase modulation amount when the drive signal value = 255 is 2π is 121, and therefore, for the B light (first area Ar1), the drive signal value is compressed within the range of 121 to 255.

[0076] In this context, "compression" of the drive signal value means converting the target drive signal value to a value within a narrower range than the range from the minimum to the maximum value of the drive signal value (hereinafter referred to as the "compression range"). Therefore, although the above example shows the compression range being shifted towards the maximum value for the target wavelength band, it is also possible to shift it towards the minimum value, and the range within the range from the minimum to the maximum value of the drive signal is arbitrary.

[0077] Figure 17 is a diagram illustrating an example of the configuration of the control unit 14A included in the projector device 10A that performs the compression processing of the drive signal value as described above. Similar to Figure 14, it shows the light-emitting unit 2, the phase modulator 3, and the intensity modulator 11 together. Note that the configuration of the projector device 10A is the same as in Figure 12, except that a control unit 14A is provided instead of the control unit 14, so redundant explanation will be avoided.

[0078] The control unit 14A differs from the control unit 14 in that it has additional drive value compression units 46 (referred to as drive value compression units 46g and 46b, respectively) for the signal processing systems of the G image and B image. As shown in the figure, the drive value compression unit 46g is provided between the phase-drive value conversion unit 42g and the drive unit 43, and the drive value compression unit 46b is provided between the phase-drive value conversion unit 42b and the drive unit 43.

[0079] The drive value compression unit 46g compresses the drive signal value of the second area Ar2, which is input from the phase-drive value conversion unit 42g, so that the phase difference between the minimum and maximum values ​​of the compressed drive signal value is 2π, and outputs it to the drive unit 43. The drive value compression unit 46b compresses the drive signal value of the first area Ar1 input from the phase-drive value conversion unit 42b so that the phase difference between the minimum and maximum values ​​of the compressed drive signal value is 2π, and outputs it to the drive unit 43.

[0080] Here, as illustrated in Figures 16B and 16C, the conversion formula for the drive signal value when the compression range is shifted towards the maximum value is shown below. G-light converted drive signal value = 76 + pre-conversion drive signal value × (255 - 76) / 255 The converted drive signal value of light B = 121 + the pre-conversion drive signal value × (255 - 121) / 255 Furthermore, even when the compression range is set to a range closer to the minimum value, the converted drive signal value can be obtained in the same manner as the above formula.

[0081] In the above example, compression processing was performed on the drive signal values ​​converted from the phase modulation pattern, but the same result can be obtained by compressing the phase modulation pattern itself. Specifically, the phase modulation pattern calculated by the phase pattern calculation units 41g and 41b, i.e., the value indicating the amount of phase modulation for each pixel, is compressed so that the phase difference between the minimum and maximum values ​​of the converted drive signal values ​​by the phase-to-drive value conversion units 42g and 42b is 2π. Even when compression processing is performed on the phase modulation pattern in this way, the result is that the drive signal values ​​are compressed. In this sense, in this technology, compressing the phase modulation pattern in this way is treated as synonymous with "compressing the drive signal values".

[0082] <4. Fourth Embodiment> The fourth embodiment performs a drive mode switching related to image reproduction. In the lighting device 1 and projector devices 10 and 10A described above, the brightness of the reproduced image can be improved by simultaneously applying spatial light phase modulation to each light source in area Ar of the phase modulator 3. However, due to the low resolution of the image obtained by spatial light phase modulation in each area Ar, color mixing tends to occur in regions where the color change in the reproduced image is steep, as illustrated in Figure 18. Specifically, the example in Figure 18 illustrates a reproduced image consisting of the words "OPEN," "COFFEE," and "STAND." The letters of "OPEN" have wide spacing, while the letters of "COFFEE" and "STAND" have narrow spacing. In "COFFEE" and "STAND," adjacent letters have different color schemes, but due to the narrow spacing, color mixing tends to occur between these letters (see the textured area in the figure).

[0083] Therefore, in the fourth embodiment, when color mixing is likely to occur in the reproduced image, instead of a mode in which spatial light phase modulation of each color area Ar is performed simultaneously, as described in the previous embodiments, in other words, a mode in which light of each color corresponding to each area Ar is simultaneously incident, is selected in which light of each color is incident on the phase modulator 3 in a time-division manner, so that spatial light phase modulation of each color is performed in a time-division manner in the phase modulator 3 (hereinafter referred to as the "color mixing suppression mode"). On the other hand, if color mixing is unlikely to occur in the reproduced image, a mode is selected to prioritize the brightness of the reproduced image, in which light of the corresponding color is simultaneously incident on each area Ar, as in the former case, and spatial light phase modulation of each area Ar is performed simultaneously (hereinafter referred to as the "brightness-prioritizing mode").

[0084] Here, the brightness-prioritizing mode described above is an example of the simultaneous drive mode in this technology, that is, a mode in which spatial light phase modulation is performed simultaneously in each phase modulation area while light of the wavelength band corresponding to each phase modulation area is incident on each phase modulation area. Furthermore, the color mixing suppression mode described above is an example of the time-division drive mode in this technology, that is, a mode in which light of different wavelength bands is incident on the phase modulator in a time-division manner, so that spatial light phase modulation for each light of different wavelength bands is performed in a time-division manner in the phase modulator.

[0085] Figure 19 is an explanatory diagram of the brightness-prioritizing mode and the color mixing suppression mode, and specifically schematically shows the driving methods of the light-emitting unit 2, the phase modulator 3, and the intensity modulator 11 for each of the brightness-prioritizing mode and color mixing suppression mode. The driving method for the light-emitting unit 2, phase modulator 3, and intensity modulator 11 in brightness-prioritizing mode is the same as that described in Figure 13, so a redundant explanation will be avoided.

[0086] In color mixing suppression mode, since each color is driven in a time-division manner, one frame is divided into subframes for each color. Specifically, one frame is divided into subframes for R light, G light, and B light. As shown in the diagram, in color mixing suppression mode, the light-emitting unit 2 emits R light, G light, and B light in a time-division manner during each frame period. Specifically in this example, the R light, G light, and B light are emitted in a time-division manner in that order. Furthermore, in the color mixing suppression mode, the phase modulator 3 should be configured such that spatial light phase modulation for the corresponding color is performed in the third area Ar3 (red region), the second area Ar2 (green region), and the first area Ar1 (blue region) during the subframe period in which the corresponding light is incident. Here, we have given an example in which each area Ar is kept in a driven state for the duration of one frame, but each area Ar only needs to be driven for at least the subframe period in which light of the corresponding color is incident.

[0087] Furthermore, in the color mixing suppression mode, the intensity modulator 11 is driven as follows: during the R subframe period (the period of R light emission), the R subframe image is used as a resolution correction image and driven based on the resolution correction image; during the G subframe period (the period of G light emission), the G subframe image is used as a resolution correction image and driven based on the resolution correction image; and during the B subframe period (the period of B light emission), the B subframe image is used as a resolution correction image and driven based on the resolution correction image.

[0088] Figure 20 is a diagram illustrating an example of the configuration of the control unit 14B included in the projector device 10B as a fourth embodiment that enables switching between the brightness-prioritizing mode and the color mixing suppression mode described above. The main difference between projector device 10B and projector device 10A is that projector device 10B is provided with a control unit 14B instead of control unit 14A. The configuration other than the control unit 14B, such as the optical system, is the same as that described in Figure 12, so redundant explanation will be avoided.

[0089] The control unit 14B differs from the control unit 14A in that it includes a mode control unit 47 and an output switching unit 48. Furthermore, the projector device 10B is provided with an operation unit 15, as shown in the figure. The operation unit 15 comprehensively represents the various controls formed on the projector device 10B for user operation input. In this example, the switching between brightness-prioritizing mode and color mixing suppression mode is performed based on user input via the control unit 15.

[0090] The mode control unit 47 is configured with, for example, a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and controls the operation of the light emission control unit 40, the drive unit 43, the output switching unit 48, and the drive unit 45 to switch between brightness-prioritizing mode and color mixing suppression mode. The mode control unit 47 performs control for switching between brightness-prioritizing mode and color mixing suppression mode based on operation input information from the operation unit 15.

[0091] The output switching unit 48 receives the resolution-corrected image generated by the resolution-corrected image generation unit 44, as well as the R image, G image, and B image. The output switching unit 48 outputs the image instructed by the mode control unit 47 from among these input images to the drive unit 45.

[0092] In the control unit 14B configured as described above, when the brightness-prioritizing mode is indicated by user input, the mode control unit 47 instructs the light emission control unit 40 to simultaneously emit light from the light-emitting elements 2r, 2g, and 2b during each frame period. In addition, in brightness-prioritizing mode, the mode control unit 47 controls the drive unit 43 to drive the phase modulator 3 so that spatial light phase modulation for each color in each area Ar is performed simultaneously during each frame period. Furthermore, in brightness-prioritizing mode, the mode control unit 47 instructs the output switching unit 48 to input a resolution-corrected image from the resolution-corrected image generation unit 44 to the drive unit 45 during each frame period, and controls the drive unit 45 so that spatial light intensity modulation based on the resolution-corrected image is performed during each frame period.

[0093] On the other hand, when the color mixing suppression mode is instructed, the mode control unit 47 instructs the light emission control unit 40 to time-division emit light from the light emission unit 2 to emit light from the light-emitting elements 2r, 2g, and 2b during each frame period. That is, the light-emitting element 2r is emitted during the R subframe period, the light-emitting element 2g is emitted during the G subframe period, and the light-emitting element 2b is emitted during the B subframe period. Furthermore, in the color mixing suppression mode, the mode control unit 47 instructs the output switching unit 48 to input the R image, G image, and B image to the drive unit 45 in a time-division manner during each frame period for driving the intensity modulator 11, and controls the drive unit 45 so that spatial light intensity modulation based on these R image, G image, and B image is performed in a time-division manner during each frame period. That is, the drive unit 45 is controlled so that spatial light intensity modulation based on the R image is performed during the R subframe period, spatial light intensity modulation based on the G image is performed during the G subframe period, and spatial light intensity modulation based on the B image is performed during the B subframe period. In this example, the driving of the phase modulator 3 in color mixing suppression mode can be the same as in brightness-prioritizing mode (see Figure 19).

[0094] In the above example, the switching between brightness-prioritizing mode and color-mixing suppression mode was described based on user input. However, this switching can also be performed based on the results of image analysis of the input image. In that case, the mode control unit 47 could, for example, perform an image analysis of the input image to determine whether or not there are regions in the image where color changes are abrupt. If such regions exist, it could select color-mixing suppression mode; otherwise, it could select brightness-prioritizing mode. Alternatively, the switching between brightness-prioritizing mode and color-mixing suppression mode could be based on information about the content type of the input image. For example, anime content tends to have areas with steep color changes, while landscape images tend not to have areas with steep color changes. In other words, depending on the content type of the input image, there may or may not be areas with steep color changes. For this reason, metadata indicating the content type could be attached to the input image, and the switching between brightness-prioritizing mode and color-mixing suppression mode could be performed based on the content type information of the input image identified from this metadata.

[0095] Furthermore, while the above example shows how the spatial light intensity modulation period in the intensity modulator 11 is switched between a period per frame and a period per subframe when switching between brightness-prioritizing mode and color mixing suppression mode, the spatial light intensity modulation period can also be set to a period per subframe in brightness-prioritizing mode. In other words, in this case, in brightness-prioritizing mode, spatial light intensity modulation based on the same resolution-corrected image is performed for each subframe period within each frame period.

[0096] Furthermore, although the above example shows that the drive of the phase modulator 3 is the same in brightness-prioritizing mode and color mixing suppression mode, in color mixing suppression mode, spatial light phase modulation for each color in area Ar may be performed in time division during each frame period. That is, the drive unit 43 is controlled so that spatial light phase modulation for R light in the third area Ar3 is performed during the R subframe period, spatial light phase modulation for G light in the second area Ar2 is performed during the G subframe period, and spatial light phase modulation for B light in the first area Ar1 is performed during the B subframe period.

[0097] <5. Fifth Embodiment> The fifth embodiment addresses noise caused by the zeroth-order light of the phase modulator 3. Figure 21 schematically shows the relationship between the zeroth-order light of the phase modulator 3 and the regenerated image when images of each wavelength band are superimposed in the same region centered on the optical axis on the regeneration surface Sp. In the figure, the dotted line represents the zeroth-order light beam for the R light of the phase modulator 3, the dashed line represents the zeroth-order light beam for the G light of the phase modulator 3, and the solid line represents the zeroth-order light beam for the B light of the phase modulator 3. As with Figure 3 above, this example illustrates the case where two light-emitting elements 2r, 2g, and 2b are provided, and two light beams of the corresponding color are incident on each area Ar of the phase modulator 3. The zero-order light referred to here is generated by reflected light from the inter-pixel separation section of the phase modulator 3, partial orientation disturbances of the liquid crystal, etc. Furthermore, Figure 21 shows an example of a reconstructed image that includes the words "OPEN" and "COFFEE STAND".

[0098] As shown in the diagram, when images of each color are superimposed on the same region centered on the optical axis of the regeneration surface Sp, the 0th-order light components of each color from the phase modulator 3 are superimposed on the regeneration image as noise, leading to a degradation of the image quality of the regeneration image.

[0099] Therefore, in the fifth embodiment, as illustrated in Figure 22, for example, spatial optical phase modulation is performed in the phase modulator 3 for each area Ar so that the regenerated image from each area Ar is irradiated to a region outside the irradiation area of ​​the 0th-order light of the phase modulator 3 on the regeneration surface Sp.

[0100] Figure 23 is an explanatory diagram of spatial optical phase modulation used to offset the illumination area of ​​the reconstructed image, as described above. Here, only the relationship between the 0th-order light and the reconstructed image for the first area Ar1 is shown as representative. Figure 23A illustrates, for comparison, the relationship between the light beam of the regenerated image from the first area Ar1 (shown as the solid line in the figure) and the light beam of the 0th-order light (G light) (shown as the dotted line in the figure) when the regenerated image is illuminated in a region centered on the optical axis Ax of the optical system on the regeneration surface Sp. In the figure, the region labeled "Pr" on the regeneration surface Sp represents the illumination region of the 0th-order light of the G light from the first area Ar1. Hereafter, the region Pr, which is the illumination region of the 0th-order light, will be referred to as "Irradiation Region Pr". As shown in the diagram, in this case, the intensity modulator 11 will be positioned so that its center coincides with the optical axis Ax.

[0101] In contrast, in the fifth embodiment, as illustrated in Figure 23B, spatial optical phase modulation is performed in the first area Ar1 so that the regenerated image is irradiated to a region outside the irradiation region Pr of the 0th-order light on the regeneration surface Sp. Although not shown in the diagram, spatial light phase modulation is similarly performed for the second area Ar2 and the third area Ar3 so that the reconstructed image is irradiated to a region outside the irradiation area Pr. For clarification, in this case as well, the condition that the reconstructed images of each color are superimposed on the same region on the reconstruction surface Sp is satisfied. In this case, the intensity modulator 11 is positioned to enable spatial light intensity modulation for the reconstructed image irradiated in a region outside the irradiation area Pr, as described above. That is, it is not positioned so that its center coincides with the optical axis Ax.

[0102] Here, for each area Ar, in order to shift the reconstructed image to a region outside the irradiated area Pr as described above, the lens component mentioned above should be adjusted in spatial optical phase modulation.

[0103] Figure 24 is a diagram showing an example configuration of the projector device 10C as the fifth embodiment. The difference from the projector device 10B described in the fourth embodiment is that a control unit 14B' is provided instead of the control unit 14B. Although not shown in the diagram, in the control unit 14B', the phase pattern calculation units 41r, 41g, and 41b calculate phase modulation patterns for superimposing the reconstructed images of R light, G light, and B light onto the same region outside the irradiation region Pr, respectively. This is where it differs from the control unit 14B. Furthermore, in the projector device 10C, the intensity modulator 11 is not positioned where its center coincides with the optical axis Ax, but rather is positioned to perform spatial light intensity modulation of the regenerated image irradiated in a region outside the irradiation area Pr on the regeneration surface Sp.

[0104] In this case, the optical system is configured such that the light beams of the reconstructed images of each color from the phase modulator 3 are reflected by the first mirror M1 and then reflected by the reflective surface of the polarizing beam splitter 12 and guided to the intensity modulator 11, while the zero-order light from the phase modulator 3 is reflected in a different direction from the light beams of the reconstructed images of each color at the first mirror M1, as indicated by "X" in the figure, and is not guided to the polarizing beam splitter 12.

[0105] In the above example, the reconstructed image is shifted laterally relative to the irradiation area Pr (see Figure 22), but as shown in Figure 25, the reconstructed image can also be shifted vertically relative to the irradiation area Pr, and the direction of the reconstructed image shift is arbitrary.

[0106] When performing the image shift described above, it is important to consider that the amount of light bending due to spatial light phase modulation differs depending on the wavelength of the incident light. Specifically, in spatial light phase modulation, the shorter the wavelength of the incident light, the smaller the amount of light bending tends to be. Therefore, especially when a large shift in the reconstructed image is desired, it is necessary to consider which wavelength band of light is incident on which area Ar of the phase modulator 3. For example, assuming that the reconstructed image is shifted to the left of the irradiation area Pr as illustrated in Figure 22, if the first area Ar1 = G light, the second area Ar2 = B light, and the third area Ar3 = R light are incident as in the previous embodiments (see Figure 3), the maximum possible shift amount of the reconstructed image cannot be maximized. In other words, the maximum possible shift amount of the reconstructed image depends on the bending amount of the shortest wavelength B light, but with the distribution of incident light to each area Ar as shown in Figure 3, the incident area for B light is the central second area Ar2, so under the premise of shifting the reconstructed image to the left of the irradiation area Pr, the maximum possible shift amount of the reconstructed image cannot be maximized.

[0107] Therefore, as a modification of the fifth embodiment, as shown in Figure 26, the light incident on each area Ar is allocated such that the wavelength of the incident light becomes progressively shorter, from area Ar located at the end opposite to the shift direction of the reconstructed image (third area Ar3) to area Ar located at the end in the shift direction (first area Ar1). Specifically, when shifting the reconstructed image to the left side of the irradiation area Pr, the allocation is such that third area Ar3 = R light, second area Ar2 = G light, and first area Ar1 = B light, as shown in the figure.

[0108] This minimizes the amount of B-light bending required to illuminate the reconstructed image in an area outside the irradiation region Pr. In other words, it becomes possible to increase the amount of shift possible in the reconstructed image compared to when B-light is incident on the second area Ar2 or the third area Ar3. Therefore, in cases where a large shift in the reconstructed image is desired, the reconstructed image in each wavelength band can be appropriately irradiated outside the zero-order light irradiation region, thereby improving the image quality of the reconstructed image.

[0109] Figure 27 shows an example of the configuration of a projector device 10D as a modified example of the fifth embodiment. The difference from the projector device 10C shown in Figure 24 is that, as shown as the light-emitting unit 2D in the figure, the positions of the light-emitting elements 2g and 2b are swapped from those of the light-emitting unit 2, so that in the phase modulator 3, B light is incident on the first area Ar1 and G light is incident on the second area Ar2. Although not shown in the diagram, in this modified projector device 10D, spatial light phase modulation in the first area Ar1 is performed based on the drive signal value based on the phase modulation pattern of light B obtained by the signal processing system of light B, i.e., the phase pattern calculation unit 41b, the phase-to-drive value conversion unit 42b, and the drive value compression unit 46b, and spatial light phase modulation in the second area Ar2 is performed based on the drive signal value based on the phase modulation pattern of light G obtained by the signal processing system of light G, i.e., the phase pattern calculation unit 41g, the phase-to-drive value conversion unit 42g, and the drive value compression unit 46g.

[0110] Here, an example was given above of applying the regenerated image shift configuration as the fifth embodiment (a configuration in which the regenerated image is irradiated outside the irradiation area Pr) to the projector device 10B of the fourth embodiment. However, the regenerated image shift configuration as the fifth embodiment can also be suitably applied to the projector devices 10 and 10A described in the second and third embodiments.

[0111] Furthermore, it should be noted that the configuration for image shifting as the fifth embodiment, the configuration for compressing the drive signal value described in the third embodiment, and the configuration for switching the drive mode described in the fourth embodiment can also be suitably applied to the lighting device 1 described in the first embodiment.

[0112] <6. Sixth Embodiment> The sixth embodiment corrects the misalignment of the optical axis of the light incident on the phase modulator 3. Figure 28 shows the behavior of the R light, G light, and B light beams when the optical axis of the incident light to the phase modulator 3 is misaligned. In this context, the misalignment of the incident light axis refers to the deviation between the actual position of the incident light axis and the design value of the incident light axis position. As shown in the figure, if the optical axis of the incident light to the phase modulator 3 is misaligned, it becomes impossible to project a reconstructed image to a predetermined position on the reconstructed surface Sp. If the optical axis of the incident light is misaligned for at least one of the R, G, and B light, it becomes impossible to superimpose the reconstructed images of each color on the same region on the reconstructed surface Sp, resulting in a deterioration of the image quality of the reconstructed image.

[0113] Therefore, in the sixth embodiment, signal processing is performed to cancel the optical axis misalignment of the light incident on the phase modulator 3. Here, signal processing refers to signal processing performed during the generation process of the drive signal for area Ar in the phase modulator 3.

[0114] Figure 29 is a diagram illustrating an example of the configuration of the control unit 14E included in the projector device 10E as the sixth embodiment. Furthermore, since the configuration of the projector device 10E other than the control unit 14E is the same as that of the projector device 10D, which is a modified example of the fifth embodiment described in Figure 27, we will avoid repeating the explanation.

[0115] The control unit 14E differs from the control unit 14B' of the projector device 10D described in Figure 27 (see Figure 20 for its components) in that it includes a correction control unit 49 and image shift units 50 (designated as 50r, 50g, and 50b, respectively) corresponding to the R image, G image, and B image. In reality, the control unit 14E also includes a mode control unit 47 and an output switching unit 48, but for illustrative purposes, these are omitted from Figure 29. In this case, the processing of the mode control unit 47 can also be realized by software processing of the correction control unit 49 if the correction control unit 49 is configured as a computer device. That is, the processing of the mode control unit 47 and the processing of the correction control unit 49 are realized by software processing using a common computer device.

[0116] The correction control unit 49 is configured with, for example, a microcomputer having a CPU, ROM, and RAM, and is capable of controlling the operation of the light emission control unit 40, the drive unit 43, the drive unit 45, and the image shift units 50r, 50g, and 50b. Furthermore, the correction control unit 49 receives user operation input information from the operation unit 15. The correction control unit 49 controls at least the image shift units 50r, 50g, and 50b to perform signal processing that cancels the optical axis misalignment of the incident light to the phase modulator 3 for each of the R light, G light, and B light.

[0117] In this example, it is assumed that information indicating the optical axis misalignment of the incident light to the phase modulator 3 for each of the R, G, and B rays is obtained as optical axis misalignment information Ia. Optical axis misalignment information Ia here refers to information indicating the manner of optical axis misalignment of the incident light to the phase modulator 3, and specifically in this example, it is information indicating the direction and amount of optical axis misalignment. The optical axis misalignment information Ia for R light, G light, and B light can be obtained, for example, by placing a test board with a test pattern for measuring optical axis misalignment (e.g., a grid pattern) on the projection surface, and visually measuring the direction and amount of misalignment of the reproduced image relative to the test pattern when the reproduced image of R light only, G light only, and B light only are projected onto the test board. Alternatively, the optical axis misalignment information Ia for each color of light could be determined based on the results of measuring the position of the illumination area of ​​each color of light relative to the phase modulator 3 using, for example, a dedicated measuring instrument. In any case, this example assumes that optical axis misalignment information Ia for each color of light has been acquired by some method. As will be described later, this embodiment proposes a method that enables measurement of optical axis misalignment without using a test board by displaying a test pattern on the intensity modulator 11, but the processing of the correction control unit 49 to realize this method will be explained separately.

[0118] The correction control unit 49 is configured with optical axis misalignment information Ia for each of the R light, G light, and B light, for example, by operation input via the operation unit 15. The correction control unit 49 instructs the image shift unit 50r to receive the R light optical axis misalignment information Ia, the G light optical axis misalignment information Ia to receive the image shift unit 50g, and the B light optical axis misalignment information Ia to receive the image shift unit 50b.

[0119] Each image shift unit 50 performs a process to shift each input image based on the specified optical axis misalignment information Ia when performing image reconstruction based on the input image.

[0120] Figure 30 is an explanatory diagram of the image shifting process in the image shifting unit 50. In the diagram, frame Fp represents the frame of the input image. During the input image shifting process, the input image is shifted relative to frame Fp according to the optical axis misalignment information Ia. Specifically, the input image is shifted in the opposite direction to the optical axis misalignment indicated by the optical axis misalignment information Ia, by an amount corresponding to the amount of optical axis misalignment indicated by the optical axis misalignment information Ia. By performing this input image shifting process, the misalignment of the optical axis of the incident light relative to the phase modulator 3 can be canceled out through signal processing.

[0121] Here, the method for measuring optical axis misalignment in this embodiment will be described with reference to Figures 31 and 32. First, as shown in Figure 31A, the projector device 10E is positioned opposite the predetermined projection surface, and as shown in Figure 31B, a test projection image is projected onto the projection surface. This test projection image is projected as a composite image of an image obtained by phase modulation (spatial light phase modulation) and an image obtained by intensity modulation (spatial light intensity modulation), as shown in the figure. Specifically, in this case, the image obtained by phase modulation is a cross pattern image, as shown in the figure, and the image obtained by intensity modulation is a grid pattern image.

[0122] The test projection images described above are projected in a time-division manner for each of the R, G, and B light streams. Then, a person visually inspects the projected test images of each color and measures the optical axis misalignment for each of the R, G, and B light streams.

[0123] Figure 32 illustrates a test projection image that is projected onto the projection surface when there is a misalignment of the optical axis of the incident light. If the optical axis of the incident light is misaligned, the center of the cross pattern formed by phase modulation will be offset from the center of the grid pattern formed by intensity modulation. The figure shows an example where the center of the cross pattern is offset to the right by "Dx" and downward by "Dy" relative to the center of the grid pattern. By measuring the deviation of this cross-shaped grid pattern, the direction and amount of the optical axis misalignment of the light incident on the phase modulator 3 can be determined.

[0124] To enable the measurement of the optical axis misalignment as described above, the correction control unit 49 performs the following processing. First, the correction control unit 49 waits for an instruction to start measuring the optical axis misalignment. In this example, it is assumed that the instruction to start measuring is given by a user input via the operation unit 15. Therefore, the correction control unit 49 waits for this operation input. When an operation input is received to instruct the start of measurement, the correction control unit 49 processes the R light, G light, and B light to project test projection images in a predetermined order. At this time, when projecting a test projection image of a target color, the correction control unit 49 instructs the light emission control unit 40 to emit light from the corresponding color light-emitting element in the light-emitting unit 2, and also controls the drive unit 43 to perform spatial light phase modulation to form a cross pattern reconstructed image in a predetermined area on the reconstruction surface Sp in the corresponding area Ar. Furthermore, the correction control unit 49 controls the drive unit 45 so that spatial light intensity modulation to form a grid pattern image on the projection surface is performed in the intensity modulator 11.

[0125] As a result of the processing by the correction control unit 49 described above, test projection images, as illustrated in Figure 31B, are projected onto the projection surface sequentially for each of the R, G, and B colors, making it possible to measure the optical axis misalignment of the incident light from the phase modulator 3 for each of the R, G, and B light.

[0126] In the above description, the optical axis misalignment cancellation process involves shifting the input image to the phase pattern calculation unit 41 based on the optical axis misalignment information Ia. However, the optical axis misalignment cancellation process is not limited to this; it can also involve shifting the phase modulation pattern calculated by the phase pattern calculation unit 41 based on the optical axis misalignment information Ia.

[0127] Figure 33 is an explanatory diagram of the phase modulation pattern shifting process for optical axis misalignment cancellation. This example shows the phase modulation pattern shifting process for the first area Ar1 as a representative example, but the phase modulation pattern shifting is performed in a similar manner for other areas Ar. In the figure, the area labeled "R_Ar1" schematically represents the pixel range of the first area Ar1. As shown in the figure, the calculated phase modulation pattern is shifted relative to the pixel range R_Ar1 of this first area Ar1 by an amount corresponding to the amount of optical axis misalignment indicated by the optical axis misalignment information Ia, in the opposite direction to the optical axis misalignment direction indicated by the optical axis misalignment information Ia.

[0128] By shifting the phase modulation pattern in this way, the misalignment of the optical axis of the light incident on the phase modulator 3 can be canceled out by signal processing, similar to the case where the input image is shifted.

[0129] Figure 34 is a diagram illustrating an example of the configuration of a control unit 14F included in a projector device 10F, which is a modified example of the sixth embodiment, in which optical axis misalignment is canceled by shifting the phase modulation pattern as described above. The projector device 10F differs from the projector device 10E in that it is equipped with a control unit 14F instead of the control unit 14E. The control unit 14F differs from the control unit 14E in that the image shift units 50r, 50g, and 50b are omitted, and instead, a pattern shift unit 51 for each color (hereinafter, each color will be designated as code 51r, 51g, and 51b) is provided.

[0130] In this case, the correction control unit 49 instructs the pattern shift unit 51r to receive the optical axis misalignment information Ia for the R light, the pattern shift unit 51g to receive the optical axis misalignment information Ia for the G light, and the pattern shift unit 51b to receive the optical axis misalignment information Ia for the B light.

[0131] Each pattern shift unit 51 performs a process to shift the phase modulation pattern input from the phase pattern calculation unit 41 of the corresponding color based on the specified optical axis misalignment information Ia when performing image reconstruction based on the input image.

[0132] Although the configuration for canceling optical axis misalignment as the sixth embodiment was shown above as an example of how it can be applied to the fifth embodiment, this configuration for canceling optical axis misalignment can be applied to any of the configurations of the first to fifth embodiments described so far.

[0133] Furthermore, while the above example illustrates a configuration that performs optical axis misalignment cancellation processing for all R, G, and B colors, the optical axis misalignment cancellation processing only needs to be performed for at least one target color (area Ar). For example, if optical axis misalignment does not occur (or can be ignored) for a specific area Ar, it is conceivable to adopt a configuration that performs optical axis misalignment cancellation processing only for the other areas Ar excluding that specific area Ar.

[0134] <7. Seventh Embodiment> The seventh embodiment uses a diffuser plate to defocus the reconstructed image. In this case, when the reconstructed image is formed by the phase modulator 3, the intensity distribution of the light incident on the phase modulator 3 may become non-uniform, or in other words, unevenness in light intensity may occur, due to the degree of collimation in the collimation lens 5, etc. When unevenness in intensity occurs in the light incident on the phase modulator 3 in this way, random noise is superimposed on the reconstructed image as a result. Furthermore, such random noise in the reconstructed image can also be caused by the phase modulation pattern set in each area Ar.

[0135] Figure 35 shows an image of random noise occurring in the reproduced image and an image of the projected image with noise caused by this random noise.

[0136] In the seventh embodiment, a method is employed to defocus the reproduced image using a diffuser plate in order to suppress the degradation of the image quality of the projected image caused by random noise occurring in the reproduced image.

[0137] Figure 36 shows an example of the configuration of the projector device 10G as the seventh embodiment. Here, as an example of projector device 10G, we illustrate a configuration in which a diffuser plate is added to the projector device 10D shown in Figure 27 above. As shown in the figure, projector device 10G differs from projector device 10D in that a diffuser plate 20 is inserted in the optical path from the phase modulator 3 to the intensity modulator 11. Specifically, in this example, the diffuser plate 20 is inserted in the optical path between the first mirror M1 and the polarizing beam splitter 12. This diffuser plate 20 allows for the defocusing of the reconstructed images of R light, G light, and B light.

[0138] Figure 37 is an explanatory diagram of the effect of defocusing the reconstructed image, showing an image of the defocused reconstructed image and an image of the projection image obtained by applying spatial light intensity modulation by the intensity modulator 11 to the defocused reconstructed image. As can be seen by comparing with Figure 35 above, defocusing the reconstructed image makes random noise in the reconstructed image less noticeable, and this reduces noise in the projected image as well. In other words, the image quality of the projected image is improved.

[0139] Furthermore, the seventh embodiment can also be suitably applied when correcting the optical axis misalignment of the incident light to the phase modulator 3, as in the sixth embodiment.

[0140] <8. Variation> Herein, the embodiments are not limited to the specific examples described above, but can take various forms as variations. For example, in the above example, three types of light—R light, G light, and B light—were given as examples of "multiple lights with different wavelength bands" incident on the phase modulator 3 for image reconstruction. However, "multiple lights with different wavelength bands" are not limited to these R light, G light, and B light; they can also be intermediate colored lights such as cyan or magenta. Furthermore, "multiple lights with different wavelength bands" may include light in the invisible light band, such as IR (infrared) light. Furthermore, the number of "multiple lights with different wavelength bands" is not limited to three; it should be at least two. In other words, the number of divisions of area Ar in the phase modulator 3 is not limited to three; it should be two or more.

[0141] Furthermore, although the above assumes that area Ar in the phase modulator 3 is divided equally, it may also be divided unevenly.

[0142] Furthermore, while the above explanation has given an example using a reflective phase modulator as phase modulator 3, a transmissive phase modulator can also be used. Similarly, although an example using a reflective intensity modulator was given for the intensity modulator 11, a transmissive intensity modulator can also be used.

[0143] Furthermore, regarding the light-emitting section 2, an example was given in which a semiconductor laser is used as the light-emitting element. However, other light sources besides semiconductor lasers, such as LEDs (Light Emitting Diodes) or UHP lamps (Ultra-High Pressure Mercury Lamps), can also be used as light sources to irradiate the phase modulator 3 with "multiple lights of different wavelength bands".

[0144] Furthermore, in the explanation above, we have given an example of spatial optical phase modulation based on the Freeform method, that is, spatial optical phase modulation that relies on the refraction phenomenon of light, as an example of spatial optical phase modulation for regenerating a desired light intensity distribution on the regeneration surface Sp. However, this technology can also be suitably applied to cases where spatial optical phase modulation is performed using methods that rely on the diffraction phenomenon of light, such as CGH (Computer-Generated Hologram).

[0145] <9. Summary of Embodiments> As described above, the lighting device as an embodiment (1, projector devices 10, 10A, 10B, 10C, 10D, 10E, 10F, 10G) comprises: a light-emitting unit (2, 2D) that emits multiple lights of different wavelength bands; a phase modulator (3) that performs spatial light phase modulation with respect to the incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit to each phase modulation area (area Ar), which is an area that divides the phase modulation plane on which spatial light phase modulation is performed; and a control unit (4, 14, 14A, 14B, 14B', 14E, 14F) that simultaneously performs spatial light phase modulation in each phase modulation area when light of the wavelength band corresponding to each phase modulation area is incident on each phase modulation area. According to the above configuration, when obtaining a reconstructed image by combining images from light of different wavelength bands, such as R light, G light, and B light, on a predetermined reconstructed surface, it becomes unnecessary to spatially phase modulate the light of each wavelength band in a time-resolved manner. Therefore, it is no longer necessary to time-divisionally inject light of each wavelength band into the phase modulator, thereby improving the brightness of the reconstructed image. Furthermore, with the above configuration, it is not necessary to provide a phase modulator for each wavelength band, thus preventing an increase in the size and cost of the optical system. As a result, it is possible to improve the brightness of the reconstructed image while miniaturizing the optical system and reducing costs.

[0146] Furthermore, in the illumination device as an embodiment, the control unit controls the drive of the phase modulator for each phase modulation area so that the images of each wavelength band generated by the spatial optical phase modulation of each phase modulation area are superimposed on the same area on the regeneration surface (see Figures 4 to 8). As a result, even if spatial optical phase modulation is performed for each phase modulation area, it becomes possible to reconstruct the image by superimposing images of each wavelength band onto the same region in the image reconstruction plane. For example, if red light, green light, and blue light are used as light in different wavelength bands, the red, green, and blue images will be superimposed on the same region of the reconstructed surface, and a full-color reconstructed image can be appropriately obtained.

[0147] Furthermore, in the illumination device as an embodiment, the control unit adjusts the color balance of the reconstructed image obtained by spatial light phase modulation for each phase modulation area by controlling the amount of light emitted for each wavelength band in the light-emitting unit (see Figure 11). Unlike intensity modulation (spatial light intensity modulation), spatial light phase modulation does not have the function of attenuating incident light. Therefore, by controlling the amount of light emitted for each wavelength band in the light-emitting part as described above, it becomes possible to adjust the color balance of the reproduced image. By controlling the amount of light emitted, it becomes unnecessary to separately install optical components such as liquid crystal panels in the optical path to reduce light output when adjusting the color balance. This allows for miniaturization of the optical system and cost reduction by reducing the number of components.

[0148] Furthermore, in the lighting device as an embodiment, the control units (14A, 14B, 14B', 14E, 14F) perform compression processing of the drive signal value in the phase modulation area where light from at least the shortest wavelength band among multiple lights of different wavelength bands is incident. In general, in a phase modulator, the shorter the wavelength of the incident light, the greater the phase change for the same drive signal value. Therefore, the drive signal value is compressed so that the phase change is equivalent to the change for light in other wavelength bands. This prevents the amount of phase modulation from differing due to differences in wavelength bands, and enables the acquisition of an appropriate reconstructed image corresponding to the input image (target image).

[0149] Furthermore, in the lighting device as an embodiment, the control units (14B, 14B', 14E, 14F) are capable of switching between a simultaneous drive mode, in which spatial light phase modulation is performed simultaneously in each phase modulation area while light of the wavelength band corresponding to each phase modulation area is incident on each phase modulation area, and a time-division drive mode, in which light of different wavelength bands is incident on the phase modulator in a time-division manner, so that spatial light phase modulation for each light of different wavelength bands is performed in a time-division manner in the phase modulator. This allows users to select simultaneous drive mode when prioritizing brightness of the reproduced image, or time-division drive mode when prioritizing suppression of color unevenness in the reproduced image. Therefore, it is possible to ensure that appropriate image reproduction is performed according to each requirement, such as prioritizing brightness or suppressing color unevenness.

[0150] Furthermore, in the illumination device as an embodiment, the control units (14B', 14E, 14F) perform drive control for each phase modulation area in the phase modulator so that the reconstructed image produced by each phase modulation area is irradiated to an area on the reconstructed surface that is outside the irradiation area of ​​the 0th-order light of the phase modulator. This helps prevent the superposition of zero-order light components onto the reconstructed image on the reconstructed surface. Therefore, it is possible to prevent the zero-order light component from being superimposed as noise in the reproduced image, thereby improving the image quality of the reproduced image.

[0151] Furthermore, in the illumination device (projector device 10D, 10G) as an embodiment, light is incident on the phase modulator in such a way that the wavelength of the incident light becomes progressively shorter, from the phase modulation area located at the end opposite to the shift direction of the reconstructed image for illuminating the reconstructed image outside the irradiation area of ​​the 0th-order light to the phase modulation area located at the end in the shift direction. In spatial optical phase modulation, the shorter the wavelength of the incident light, the smaller the amount of light bending tends to be. With the above configuration, for multiple lights of different wavelength bands, the shorter the wavelength band of the light, the smaller the amount of light bending required to illuminate outside the zero-order light irradiation region becomes. Therefore, the reconstructed image for each wavelength band can be appropriately irradiated outside the zero-order light irradiation region, thereby improving the image quality of the reconstructed image.

[0152] Furthermore, in the lighting device as an embodiment, the control units (14E, 14F) perform signal processing to cancel the optical axis misalignment in the drive signal generation process for the target phase modulation area, which is at least one phase modulation area among the phase modulation areas, based on optical axis misalignment information indicating the manner of optical axis misalignment of the incident light into the target phase modulation area. If the optical axis misalignment of the incident light occurs in at least one phase modulation area, it is not possible to superimpose images of each wavelength band onto the same region in the reconstructed plane. Therefore, as described above, signal processing for optical axis misalignment cancellation is performed for the target phase modulation area based on the optical axis misalignment information of the incident light. This allows images of each wavelength band to be superimposed on the same region on the reconstructed surface, even if there is a misalignment of the optical axis of the incident light into the phase modulation area, thereby enabling the acquisition of an appropriate reconstructed image. Furthermore, by performing optical axis misalignment cancellation as a signal processing step in drive signal generation, it becomes unnecessary to provide separate optical components to correct the optical axis misalignment, thus enabling miniaturization of the optical system and cost reduction.

[0153] Furthermore, in the illumination device as an embodiment, the light-emitting unit is configured to emit R light, G light, and B light as multiple lights of different wavelength bands, and the phase modulator has a phase modulation area into which R light is incident, a phase modulation area into which G light is incident, and a phase modulation area into which B light is incident. This makes it possible to obtain a full-color image on the playback surface.

[0154] The projector apparatus as an embodiment (10, 10A, 10B, 10C, 10D, 10E, 10F, 10G) comprises: a light-emitting unit that emits multiple lights of different wavelength bands; a phase modulator that performs spatial light phase modulation on incident light from the light-emitting unit, wherein light of different wavelength bands is incident from the light-emitting unit to each phase modulation area, which is an area that divides the phase modulation surface on which spatial light phase modulation is performed; an intensity modulator (11) that performs spatial light intensity modulation on the light incident through the phase modulator; a projection lens (8) that projects the light whose spatial light intensity modulation has been performed by the intensity modulator onto the projection surface; and a control unit (14, 14A, 14B, 14B', 14E, 14F) that simultaneously performs spatial light phase modulation in each phase modulation area when light of the wavelength band corresponding to each phase modulation area is incident on each phase modulation area. Such a projector device can also provide the same functions and effects as the lighting device described in the above-described embodiment.

[0155] Furthermore, in the projector device as an embodiment, the control unit generates a resolution correction image based on the input image to correct the resolution of the reproduced image generated by spatial light phase modulation by a phase modulator, and drives and controls the intensity modulator based on the resolution correction image. As a result, the reconstructed image produced by the phase modulator is subjected to resolution correction by spatial light intensity modulation in the intensity modulator, and the resolution-corrected reconstructed image can be projected onto the projection surface via a projection lens. Therefore, it is possible to improve the image quality of the projected image.

[0156] Furthermore, in the projector device (10G) as an embodiment, a diffuser plate (20) is inserted in the optical path from the phase modulator to the intensity modulator. The diffuser plate described above makes it possible to defocus the regenerated image irradiated from the phase modulator to the intensity modulator. By defocusing the reconstructed image projected onto the intensity modulator in this way, it becomes possible to make the noise generated in the reconstructed image less noticeable, thereby preventing the noise from being reflected in the projected image and causing a decrease in the image quality of the projected image.

[0157] Furthermore, the effects described herein are merely illustrative and not limited to those described herein, and other effects may also occur.

[0158] <10. This Technology> This technology can also be configured as follows: (1) A light-emitting section that emits multiple lights of different wavelengths, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas, while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas. Lighting device. (2) The control unit, The phase modulator's drive control is performed for each phase modulation area so that the images of each wavelength band generated by spatial optical phase modulation in each phase modulation area are superimposed on the same region on the regeneration surface. The lighting device described in (1) above. (3) The control unit, By controlling the amount of light emitted for each wavelength band in the light-emitting section, the color balance of the reconstructed image obtained by spatial light phase modulation in each phase modulation area is adjusted. The lighting device described in (1) or (2) above. (4) The control unit, For the phase modulation area where light from at least the shortest wavelength band among the multiple lights of different wavelength bands is incident, the drive signal value is compressed. A lighting device as described in any of (1) to (3) above. (5) The control unit, The device is switchable between a simultaneous drive mode, in which spatial light phase modulation is performed simultaneously in each of the phase modulation areas while light of the wavelength band corresponding to each phase modulation area is incident on each of the phase modulation areas, and a time-division drive mode, in which light of different wavelength bands is incident on the phase modulator in a time-division manner, so that spatial light phase modulation for each light of different wavelength bands is performed in a time-division manner in the phase modulator. A lighting device as described in any of (1) to (4) above. (6) The control unit, The phase modulator performs drive control for each phase modulation area so that the reconstructed image produced by each phase modulation area is irradiated onto a region on the reconstructed surface that is outside the irradiation area of ​​the zeroth-order light of the phase modulator. A lighting device as described in any of (1) to (5) above. (7) The phase modulator includes: Light is incident on the area outside the irradiation region of the 0th-order light such that the wavelength of the incident light becomes progressively shorter, from the phase modulation area located at the end opposite to the shift direction of the reconstructed image to the phase modulation area located at the end in the shift direction. The lighting device described in (6) above. (8) The control unit, For at least one of the aforementioned phase modulation areas, which is a target phase modulation area, the drive signal generation process for the target phase modulation area performs signal processing to cancel the optical axis misalignment based on optical axis misalignment information indicating the manner of optical axis misalignment of the incident light to the target phase modulation area. A lighting device as described in any of (1) to (7) above. (9) The light-emitting unit is configured to emit R light, G light, and B light as a plurality of lights with different wavelength bands. The phase modulator has a phase modulation area into which the R light is incident, a phase modulation area into which the G light is incident, and a phase modulation area into which the B light is incident. A lighting device as described in any of (1) to (8) above. (10) A light-emitting section that emits multiple lights of different wavelengths, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. An intensity modulator that performs spatial light intensity modulation on light incident via the phase modulator, A projection lens that projects light whose spatial light intensity has been modulated by the intensity modulator onto a projection surface, The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas, while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas. Projector device. (11) The control unit, Based on the input image, a resolution correction image is generated to correct the resolution of the reconstructed image produced by spatial light phase modulation by the phase modulator, and the intensity modulator is driven and controlled based on the resolution correction image. The projector device described in (10) above. (12) A diffuser plate is inserted in the optical path from the phase modulator to the intensity modulator. The projector device according to the above (10) or (11).

Description of Reference Signs

[0159] 1 Illumination device 10, 10A, 10B, 10C, 10D, 10E, 10F Projector device 2, 2D Light emitting unit 2r, 2g, 2b Light emitting element 3 Phase modulator 4, 14, 14A, 14B, 14B', 14E, 14F Control unit 5r, 5g, 5b Collimation lens 6 First dichroic mirror 7 Second dichroic mirror 8 Projection lens M1 First mirror M2 Second mirror Sm Phase modulation surface Sc Screen Sp Reproduction surface Ar Area (phase modulation area) Dpr Base phase distribution Dpa, Dpa1, Dpa2, Dpa3 Area base phase distribution Dpl, Dpl-2, Dpl-2, Dpl-3 Lens component Dpd Area phase distribution 40 Light emission control unit 41, 41r, 41g, 41b Phase pattern calculation unit 42, 42r, 42g, 42b Phase-drive value conversion unit 43 Drive unit 44 Resolution correction image generation unit 45 Drive unit 11 Intensity modulator 12 Polarizing beam splitter 15 Operation unit 46, 46g, 46b Drive value compression unit 47 Mode control unit 48 Output switching unit 49 Correction control unit 50, 50r, 50g, 50b Image shift unit 51, 51r, 51g, 51b Pattern shift section Fp picture frame R_Ar1 Pixel range 20 Diffuser

Claims

1. A light-emitting section that emits multiple lights of different wavelengths, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, By controlling the amount of light emitted for each wavelength band in the light-emitting section, the color balance of the reconstructed image obtained by spatial light phase modulation in each phase modulation area is adjusted. Lighting device.

2. A light-emitting unit that emits multiple lights of different wavelength bands, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, The phase modulator performs drive control for each phase modulation area so that the reconstructed image produced by each phase modulation area is irradiated to an area on the reconstructed surface that is outside the irradiation area of ​​the zeroth-order light of the phase modulator. Lighting device.

3. The phase modulator includes: Light is incident on the area outside the irradiation region of the zeroth-order light, such that the wavelength of the incident light becomes progressively shorter, from the phase modulation area located at the end opposite to the shift direction of the reconstructed image to the phase modulation area located at the end in the shift direction. The lighting device according to claim 2.

4. A light-emitting unit that emits multiple lights of different wavelength bands, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, For at least one of the aforementioned phase modulation areas, which is a target phase modulation area, the drive signal generation process for the target phase modulation area performs signal processing to cancel the optical axis misalignment based on optical axis misalignment information indicating the manner of optical axis misalignment of the incident light to the target phase modulation area. Lighting device.

5. The control unit is The phase modulator's drive control is performed for each phase modulation area so that the images of each wavelength band generated by spatial optical phase modulation in each phase modulation area are superimposed on the same region on the regeneration surface. A lighting device according to any one of claims 1 to 4.

6. The control unit is For the phase modulation area where light from at least the shortest wavelength band among the multiple lights of different wavelength bands is incident, the drive signal value is compressed. A lighting device according to any one of claims 1 to 4.

7. The control unit is The device is switchable between a simultaneous drive mode, in which spatial light phase modulation is performed simultaneously in each of the phase modulation areas while light of the wavelength band corresponding to each phase modulation area is incident on each of the phase modulation areas, and a time-division drive mode, in which light of different wavelength bands is incident on the phase modulator in a time-division manner, so that spatial light phase modulation for each light of different wavelength bands is performed in a time-division manner in the phase modulator. A lighting device according to any one of claims 1 to 4.

8. A light-emitting section that emits multiple lights of different wavelengths, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. An intensity modulator that performs spatial light intensity modulation on light incident via the phase modulator, A projection lens that projects light whose spatial light intensity has been modulated by the intensity modulator onto a projection surface, The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, By controlling the amount of light emitted for each wavelength band in the light-emitting section, the color balance of the reconstructed image obtained by spatial light phase modulation in each phase modulation area is adjusted. Projector device.

9. A light-emitting unit that emits multiple lights of different wavelength bands, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. An intensity modulator that performs spatial light intensity modulation on light incident via the phase modulator, A projection lens that projects light whose spatial light intensity has been modulated by the intensity modulator onto a projection surface, The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, The phase modulator performs drive control for each phase modulation area so that the reconstructed image produced by each phase modulation area is irradiated to an area on the reconstructed surface that is outside the irradiation area of ​​the zeroth-order light of the phase modulator. Projector device.

10. The phase modulator includes: Light is incident on the area outside the irradiation region of the zeroth-order light, such that the wavelength of the incident light becomes progressively shorter, from the phase modulation area located at the end opposite to the shift direction of the reconstructed image to the phase modulation area located at the end in the shift direction. The projector device according to claim 9.

11. A light-emitting unit that emits multiple lights of different wavelength bands, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. An intensity modulator that performs spatial light intensity modulation on light incident via the phase modulator, A projection lens that projects light whose spatial light intensity has been modulated by the intensity modulator onto a projection surface, The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, The control unit, For at least one of the aforementioned phase modulation areas, which is a target phase modulation area, the drive signal generation process for the target phase modulation area performs signal processing to cancel the optical axis misalignment based on optical axis misalignment information indicating the manner of optical axis misalignment of the incident light to the target phase modulation area. Projector device.

12. A light-emitting unit that emits multiple lights of different wavelength bands, A phase modulator that performs spatial light phase modulation with respect to incident light from the light-emitting unit, wherein light of a different wavelength band is incident from the light-emitting unit into each phase modulation area, which is an area that divides the phase modulation plane in which the spatial light phase modulation is performed. An intensity modulator that performs spatial light intensity modulation on light incident via the phase modulator, A projection lens that projects light whose spatial light intensity has been modulated by the intensity modulator onto a projection surface, The system includes a control unit that simultaneously performs spatial light phase modulation in each of the phase modulation areas while light of a wavelength band corresponding to each of the phase modulation areas is incident on each of the phase modulation areas, A diffuser plate is inserted in the optical path from the phase modulator to the intensity modulator. Projector device.

Citation Information

Patent Citations

  • Projection System and Method

    JP2018532152A

  • Projection type display device

    JP2021026195A

  • Projection apparatus and interface apparatus

    WO2016098281A1

  • Lighting device and projector

    WO2019017128A1

  • Optical phase control device and display device

    WO2019208205A1