Three-dimensional image display system and method
Patent Information
- Application Number
- JP2023542478
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-01-14
- Filing Date
- 2021-12-09
- Publication Date
- 2024-11-22
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional 3D display systems face issues with large footprints and conflicts between binocular guidance and accommodation, leading to uncomfortable viewing experiences, especially in close-up tasks, due to their bulkiness and inability to effectively convey monocular focus cues.
A display system utilizing a light source, first and second optical image expanders with micropatterned surfaces, and a spatial light modulator to collimate and expand light beams, reducing the system's footprint while supporting ocular accommodation and providing correct 3D image display.
The system achieves a compact and lightweight 3D image display with reduced conflicts between binocular guidance and accommodation, enhancing user comfort and image quality.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates generally to display devices, and more particularly to display systems for displaying three-dimensional (3D) images. The present disclosure also relates to methods for displaying three-dimensional images. The present disclosure further relates to volumetric displays, including head-mounted and head-up display systems implementing the disclosed display systems.
[0002] Stereoscopic display devices such as head-mounted displays and near-eye displays are widely used in the fields of aviation, engineering, gaming, medicine, and the like. Such stereoscopic display devices can convey three-dimensional images in a true sense. Such display devices rely on binocular disparity as the most powerful depth information for perceiving 3D images. However, such display devices do not take into account other natural mechanisms that the human visual apparatus possesses. Ignoring the characteristics of the human visual system, such as the relationship between accommodation and vergence, is a constraint in applying stereoscopic display devices to close-up tasks. This stems from the fact that when the focal plane of a single available display is at a distance of 2 to 10 m from the user and the content to be shown to the user is within arm's reach, the mismatch between the depth information of accommodation and vergence is too large, resulting in an uncomfortable viewing experience. In such cases, the user may experience blurred vision, eye strain, and difficulty concentrating on the formed image. As a result, the user may feel discomfort while watching 3D images and be forced to shorten the viewing time.
[0003] To alleviate the conflict between vergence and accommodation in stereo near-eye displays, several solutions have been proposed, including light field displays, holographic displays, and volumetric displays. However, while these devices solve the conflict between vergence and accommodation, they generally suffer from bulkiness in practical applications. For example, 3D display devices employing volumetric displays provide good quality images and address the conflict between vergence and accommodation, but are quite bulky. Volumetric displays generally have a projection volume that is combined with a high refresh rate rear image projection unit. This projection volume may be, for example, a reciprocating membrane or a stack of electrically switchable light diffusing elements, or it may be a solid, liquid, or gas medium that is excited by other means or directly by the projected image. In these cases, the projection unit, especially one that may not be refocused, requires a large space to ensure sufficient depth of field, which is achieved by significantly extending the optical path from the projection unit to the projection volume. The large footprint provided by the projection unit is a disadvantageous factor, thus limiting the widespread acceptance of such volumetric displays.
[0004] In another example, a light field approach is employed to achieve an acceptable footprint. Here, a display panel with a very high image resolution, such as an 8K display (or multiple 8K displays), and a microlens or lenslet array are used. However, such systems have drawbacks with respect to image artifacts and general perceived image quality. To ensure a perceptually seamless representation of the light field, multiple views must be presented, ranging from tens to hundreds, such as 60, 100, or 200 views. In this architecture, the views or rays are generated by splitting the display panel through lens elements. Thus, even when using panels with very high image refresh rates, the effective resolution may be small. Alternatively, if the image resolution is kept to a reasonable value, the number of views or rays generated may be small, which may give perceptible image artifacts to the image.
[0005] In yet another example, it has been proposed to improve the footprint of a volumetric display device consisting of a rear image projection unit with a stack of electrically switchable light diffusing elements and a solid projection volume by employing telecentric optics. By employing large reflective optical elements of the same order of magnitude as the light diffusing elements, the optical path and therefore the overall volume of the 3D display are reduced. In this way, the volume of the system can be halved while maintaining optimal image quality with uniform magnification and large depth field of view. However, the footprint reduction in this case is only moderate and does not achieve the footprint desired for next generation 3D display technology.
[0006] In light of the foregoing discussion, therefore, a need exists to overcome various problems associated with conventional display systems, particularly with respect to 3D image display with an emphasis on close-up tasks, such as in pure virtual reality environments and augmented reality scenarios.
[0007] The present disclosure seeks to provide a display system and method for displaying three-dimensional images, which in particular addresses problems related to vergence-accommodation conflicts and large footprints. The present disclosure also seeks to provide head-mounted and head-up display systems that can convey monocular focus cues and accommodation support while reducing the footprint to make the display device compact and substantially lightweight. It is an object of the present disclosure to provide a solution that at least partially overcomes the problems encountered in the prior art, and to provide a display system and method for the correct display of three-dimensional images.
[0008] According to a first aspect, an embodiment of the present disclosure provides a display system for displaying a three-dimensional image, the display system comprising: a light source adapted to emit a light beam towards the first optical system; the first optical system adapted to collimate the light beam and provide the collimated light beam towards a spatial light modulator; the spatial light modulator for modulating the collimated light beam; wherein the modulated light beam is provided in a first direction, and the display system further comprises: a first optical image expander tilted at a first angle α with respect to the first direction and adapted to reflect the modulated light beam in a second direction; a second optical image expander inclined at a second angle β with respect to the second direction and disposed in the optical path after the first optical image expander, the second optical image expander being used to reflect the light beam reflected by the first optical image expander in a third direction; a screen element disposed in the optical path after the second optical image expander; and Equipped with The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: having at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch consisting of the first facet and the second facet; the first facet is inclined at a third angle γ with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is angled relative to the third facet; a second pitch consisting of the third facet and the fourth facet; The third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective.
[0009] According to a second aspect, an embodiment of the present disclosure provides a method for displaying a three-dimensional image, the method comprising: Emitting a light beam from a light source toward a first optical system; receiving the light beam with the first optical system and collimating the light beam towards a spatial light modulator; modulating the collimated light beam with the spatial light modulator and providing the light beam in a first direction; receiving the modulated light beam at a first optical image expander at a first angle α relative to the first direction and reflecting the modulated light beam in a second direction (D2); receiving the reflected light beam at a second optical image expander at a second angle β relative to the second direction and reflecting the light beam in a third direction; and receiving the light beam reflected in the third direction at a screen element disposed in an optical path after the second optical image expander; and Including, The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: having at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch consisting of the first facet and the second facet; the first facet is inclined at a third angle γ with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is angled relative to the third facet; a second pitch consisting of the third facet and the fourth facet; The third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective.
[0010] Embodiments of the present disclosure substantially eliminate or at least partially solve the aforementioned problems in the prior art, allowing for the correct display of three-dimensional images. A display device according to the present disclosure for displaying three-dimensional images has the advantages of a smaller footprint compared to prior art displays, and fewer vergence and accommodation conflicts in the generated three-dimensional images.
[0011] Further aspects, advantages, features and objects of the present disclosure will become apparent from the accompanying drawings and detailed description of illustrative embodiments, taken in conjunction with the appended claims.
[0012] Naturally, features of what is disclosed herein can be combined in various ways without departing from the scope of the present disclosure as defined in the appended claims. [Brief description of the drawings]
[0013] The foregoing summary and the following detailed description of exemplary embodiments will be better understood when read in conjunction with the accompanying drawings. For the purpose of illustrating the present disclosure, there are shown in the drawings exemplary configurations of the present disclosure (hereinafter the disclosure). However, the disclosure is not limited to the specific methods and instrumentalities described therein. In addition, persons skilled in the art will appreciate that the drawings are not drawn to scale. Wherever possible, the same elements have been designated by the same numerals. Embodiments of the present disclosure will now be described, by way of example only, with reference to the following drawings, in which: [Figure 1] FIG. 1 is a block diagram showing a configuration of a display system for displaying a three-dimensional image according to an embodiment of the present disclosure. [Diagram 2] 2 is a schematic diagram of a first optical image expander for the display system of FIG. 1 according to one embodiment of the present disclosure. [Diagram 3] 3 is a schematic diagram of the first optical image expander of FIG. 2 according to an embodiment of the present disclosure. Also depicted is a reflection of a light beam modulated by the first optical image expander. [Figure 4] 1 is a schematic diagram of a portion of a display system according to an embodiment of the present disclosure, the display system implementing a first optical image expander and a second optical image expander together with a projection volume for displaying a three-dimensional image; [Figure 5A] 1 is a schematic diagram illustrating an optical image magnification system having a first optical image expander and a second optical image expander according to an embodiment of the present disclosure. [Figure 5B] 5B is a cross-sectional view of the opening of FIG. 5A according to an embodiment of the present disclosure. [Figure 5C] 1 is a schematic diagram illustrating a portion of a display system including an optical image magnification system with a projection volume according to an embodiment of the present disclosure. [Figure 5D] 1 is a schematic diagram of a portion of a display system including an optical image magnification system having a projection volume according to another embodiment of the present disclosure. [Figure 6]6A, 6B and 6C are schematic diagrams of a first optical image expander according to different embodiments of the present disclosure. [Figure 7A] FIG. 1 is an illustration of image elements obtained when the pitch of the first optical image expander and the second optical image expander is large, according to an embodiment of the present disclosure. [Figure 7B] FIG. 13 is an illustration of image elements obtained when the pitch of the first optical image expander and the second optical image expander is small, according to another embodiment of the present disclosure. [Figure 7C] 2 is an illustration of an image element formed on a screen element according to an embodiment of the present disclosure. [Figure 7D] FIG. 2 is an illustration of an image element formed on a screen element according to another embodiment of the present disclosure. [Figure 8] FIG. 2 is an illustration of a composite light diffusing element according to an embodiment of the present disclosure. [Figure 9] 2 is a flowchart listing steps of a method for displaying a three-dimensional image according to one embodiment of the present disclosure. Detailed Description of the Embodiments
[0014] In the accompanying drawings, underlined numbers are used to represent the item at or adjacent to the location of the number. Numbers without underlines relate to the item identified by the line connecting the number. When a number is not underlined and is accompanied by an arrow, it is used to identify the generic item to which the arrow points.
[0015] Next, exemplary embodiments of the present disclosure and ways in which it may be implemented are described in detail. Although several ways of implementing the present disclosure are described, one of ordinary skill in the art will recognize that other embodiments are possible for implementing or practicing the present disclosure.
[0016] According to a first aspect, an embodiment of the present disclosure provides a display system for displaying a three-dimensional image, the display system comprising: a light source adapted to emit a light beam towards the first optical system; the first optical system adapted to collimate the light beam and provide the collimated light beam towards a spatial light modulator; the spatial light modulator for modulating the collimated light beam; wherein the modulated light beam is provided in a first direction, and the display system further comprises: a first optical image expander tilted at a first angle α with respect to the first direction and adapted to reflect the modulated light beam in a second direction; a second optical image expander inclined at a second angle β with respect to the second direction and disposed in the optical path after the first optical image expander, the second optical image expander being used to reflect the light beam reflected by the first optical image expander in a third direction; a screen element disposed in the optical path after the second optical image expander; and Equipped with The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: having at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch consisting of the first facet and the second facet; the first facet is inclined at a third angle γ with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is angled relative to the third facet; a second pitch consisting of the third facet and the fourth facet; The third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective.
[0017] According to a second aspect, an embodiment of the present disclosure provides a method for displaying a three-dimensional image, the method comprising: Emitting a light beam from a light source toward a first optical system; receiving the light beam with the first optical system and collimating the light beam towards a spatial light modulator; modulating the collimated light beam with the spatial light modulator and providing the light beam in a first direction; receiving the modulated light beam at a first optical image expander at a first angle α relative to the first direction and reflecting the modulated light beam in a second direction (D2); receiving the reflected light beam at a second optical image expander at a second angle β relative to the second direction and reflecting the light beam in a third direction; and receiving the light beam reflected in the third direction at a screen element disposed in an optical path after the second optical image expander; and Including, The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: having at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch consisting of the first facet and the second facet; the first facet is inclined at a third angle γ with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is angled relative to the third facet; a second pitch consisting of the third facet and the fourth facet; The third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective.
[0018] As used herein, the term "three-dimensional image" refers to an image that provides a viewer of the image with a perception of depth. Hereinafter, the terms "user", "viewer", "viewer", "observer" and "human" are used interchangeably without limitation. The three-dimensional image may be a volumetric image, where a volumetric image may be an image having height, width and depth in three-dimensional space. The three-dimensional (3D) image may be a volumetric image of at least one three-dimensional object (e.g., a statue, a vehicle, a weapon, a musical instrument, an abstract design, etc.), a three-dimensional scene (e.g., a beach view, a mountainous environment, an indoor environment, etc.), etc. Furthermore, the term "three-dimensional image" also encompasses three-dimensional computer-generated surfaces. Furthermore, the term "three-dimensional image" also encompasses three-dimensional point clouds.
[0019] The term "display system" or "display system" as used herein refers to a device configured to present three-dimensional (3D) images to a user in such a way that the three-dimensional images truly appear to have actual physical depth. In other words, a display system can operate as a device for visually presenting three-dimensional images in a three-dimensional space. Examples of such display systems include televisions, computer monitors, portable device displays, and the like. Display systems also include display devices that can be positioned near a user's eyes, for example, by a user mounting a near-eye display device on his or her head. Examples of such near-eye display systems include, but are not limited to, head-mounted displays (HMDs), head-up displays (HUDs), virtual reality display systems, augmented reality display systems, mixed reality display systems, and the like.
[0020] The display system comprises a light source that is used to emit a light beam towards a first optical system. The light source can be anything that can generate a light beam. For example, the light source can be a natural light source or an artificial light source. The light source emits a light beam. In general, the light beam is a collection of light beams. The light beam can be a parallel light beam, a converging light beam or a diverging light beam. The light beam is directed towards the first optical system. The first optical system can be used to expand, shape and / or collimate the light beam, as will be described in more detail below.
[0021] In some embodiments, the light source is selected to be at least one of a laser, a light emitting diode (LED), and a superluminescent light emitting diode (SLED) that emits in the visible light spectrum. A laser (LASER) is an abbreviation for Light Amplification by the Stimulated Emission of Radiation, and is a device that generates a light beam by stimulating atoms or molecules to emit light rays of a particular wavelength. The laser used in this disclosure must emit in the visible light spectrum because the light beam generated by the laser is used to encode image information. A light emitting diode (LED) may be a semiconductor device that emits a light beam when a current is passed through it. Here, the carriers of the current, such as electrons and holes, can combine with the semiconductor to emit light. A superluminescent light emitting diode (SLED) is a semiconductor edge emitting device. The light beam emitted from the laser may be already collimated or substantially collimated. It can be expected that the light beam emitted by a laser can be easily collimated to a high degree, as compared to a light beam emitted by, for example, a light emitting diode (LED), when the light beam emitted by the light source has a divergence angle. Thus, in some instances, when the light source is a laser, collimation may not be necessary for the purposes of this disclosure. However, when the laser beam is small, it needs to be expanded (stretched) and shaped to fit the geometry of the SLM.
[0022] When using a laser as a light source, the coherent nature of the laser can cause the phenomenon of speckle. Speckle is a random distribution of small light intensity variations that can occur due to the interference of light passing through an uneven optical surface. This is a side effect of using a laser. However, it can be mitigated by using a despeckling device such as a small vibrating diffuser or mirror that helps to average the light intensity and hide the speckle. Therefore, when using a laser as a light source, a despeckling device can be used before the first optical system. SLEDs can have the characteristics of LEDs and lasers. The light beam emitted from an SLED can be highly directional and have a broad spectral distribution. Therefore, the speckle pattern associated with the light beam emitted from a laser may not be present in the light beam emitted from an SLED. Therefore, contrary to lasers, SLEDs may not require active speckle mitigation measures such as a despeckling device.
[0023] The display system includes a first optical system. The first optical system is used to expand, form, shape, and / or collimate a light beam and provide the expanded, formed, shaped, and / or collimated light beam toward the spatial light modulator. The first optical system may be any suitable optical device used to collimate a light beam. Here, a collimated light beam is a light beam having a substantially parallel light beam. The light beam traveling from the light source toward the first optical system may not be collimated. The first optical system collimates the light beam, thereby making the light beam parallel, diverging as little as possible, and collimating as little as possible while propagating toward the display element. As mentioned above, when the light source is a laser, collimation may not be necessary in the display system of the present disclosure.
[0024] In some embodiments, the first optical system is selected as a system of at least one of the following optical components: lenses, prisms, metasurfaces, holographic optical elements, diffractive optical elements, reflective optical elements. The lenses may be pieces of curved glass surfaces that can help to bend the light beam passing through them. Here, the lenses used can collimate the light beam as it passes through them. The prisms may be polygonal transparent optical elements that help to bend the light beam passing through them. Here, the prisms used can align the particles of the light beam incident on it so that the light beam emerging from the prism is collimated. The metasurfaces are thin nanostructured artificial optical elements. In metasurfaces, the bending of the light beam is performed by scattering the light beam by nanostructures of different sizes, as opposed to bending the light beam by refraction, as in conventional optical elements (such as lenses). The metasurfaces used here can scatter the light beam of the light beam to generate a collimated light beam. The diffractive optical elements can have a microstructure pattern that can help to control the phase of the light beam passing through them. A diffractive optical element as used in this disclosure may change the phase of a light beam passing through it such that the light beam exiting it is parallel, i.e., it may collimate it. A reflective optical element as used herein may collimate an incoming light beam by reflection.
[0025] The divergence angle of the light beam after being collimated in the first optical system may be less than 1.5 degrees. Such a divergence angle of less than 1.5 degrees ensures that the light beam can be properly utilized to generate a three-dimensional image, as in the embodiments of the present disclosure. In one example, the light beam has a divergence angle of 1 degree. In another example, the light beam has a divergence angle of 0.5 degrees. In yet another example, the light beam has a divergence angle of 0 degrees.
[0026] The display system includes a spatial light modulator that is used to modulate a collimated light beam. The modulated light beam is provided in a first direction. A spatial light modulator is a component of a display system and may be defined as a device that has an array of light modulating elements and can perform some form of modulation on a light beam. For the purposes of this disclosure, the term "spatial light modulator" or "SLM" refers to the light modulating elements that control or modify the incoming or outgoing light, the circuitry used to control the light modulating elements on the device, and all the control circuitry and memory on the device that is performing the spatial light modulation. The light modulating element may be one, two, or an array of multiple light modulating elements. For example, each element of the spatial light modulator can change the direction of the incoming or outgoing light, the intensity of the incoming or outgoing light, the polarity of the incoming or outgoing light, the wavelength of the incoming or outgoing light, the focus of the incoming or outgoing light, etc. Typically, a spatial light modulator can change the amplitude of a light beam. Some spatial light modulators can change the phase of a light beam. As used herein, a spatial light modulator may vary the amplitude of a collimated light beam and provide it in a first direction, hi some embodiments, the spatial light modulator may be controlled by a control logic or control unit that synchronizes the operation of the light source and the spatial light modulator.
[0027] In some embodiments, the spatial light modulator is selected to be at least one of a reflective spatial light modulator and a transmissive spatial light modulator. Examples of reflective spatial light modulators include, but are not limited to, digital micromirror devices. The reflective spatial light modulators typically included in display systems may be two-dimensional and may modulate a collimated light beam directed to the active area of the spatial light modulator through a prism assembly. The reflective spatial light modulator may be a digital micromirror device (DMD) capable of high image refresh rates. Alternatively, it may be a fast switching liquid crystal on silicon (LCoS) or ferroelectric liquid crystal on silicon FLCoS type modulator. In some embodiments, a transmissive spatial light modulator may achieve similar effects.
[0028] In some embodiments, the spatial light modulator is selected to be at least one of a digital micromirror device, an electroluminescent (LCoS), a ferroelectric liquid crystal on silicon (FLCoS) modulator, and a liquid crystal display micropanel. A digital micromirror device (DMD) may have a high refresh rate and be composed of a matrix of tiny mirrors corresponding to the pixel structure of a 3D image. The matrix of tiny mirrors is electrically addressable. An LCoS may be a high refresh rate miniature with a silicon backplane on which a liquid crystal layer is deposited. A ferroelectric liquid crystal on silicon (FLCoS) modulator may be a silicon backplane on which a ferroelectric liquid crystal is deposited. Here, the term "ferroelectric" may refer to a material that may have spontaneous electric polarization properties. It will be understood that the digital micromirror device type, the LCoS type, and the FLCoS type modulators may be reflective spatial light modulators, and the liquid crystal display micropanel may be a transmissive spatial light modulator.
[0029] It should be noted that the spatial light modulator configuration may mean that there is no prism assembly. This would be more common when using digital micromirror devices. However, this may not be a typical implementation of a display system. In one embodiment, the spatial light modulator is an LCoS and the prism assembly is a polarization sensitive beam splitter cube. Due to the high parallelism of the collimated light beam after modulation by the spatial light modulator, the shape of the collimated light beam remains almost unchanged, i.e. the degree of collimation is preserved. This allows for a lensless projection system that is essentially focus-free, i.e. an additional projection lens may not be required.
[0030] The 2D images formed by spatial light modulators may be very small and not suitable for direct viewing: because spatial light modulators are typically small microdisplay devices, the 2D images formed may need to be enlarged for practical use.
[0031] The display system includes a first optical image expander that is inclined at a first angle α with respect to a first direction. The first optical image expander is used to reflect a modulated light beam in a second direction. The first optical image expander may be a reflective Fresnel mirror surface used to expand a two-dimensional image into one dimension (i.e., in one direction). Thus, an image with an overall height of 'a' can be expanded to have an expanded length a' where a < a' by using the first optical image expander. The Fresnel mirror surface may be a first fine pattern surface that is inclined at a first angle α with respect to the first direction. Here, the first direction may be the optical axis of the light beam from the spatial light modulator. The pattern pitch of the first optical image expander typically corresponds to the pixel size of the spatial light modulator.
[0032] The display system includes a second optical image expander that is inclined at a second angle β with respect to a second direction. The second optical image expander is on the optical path after the first optical image expander and is used to reflect the light beam reflected by the first optical image expander in a third direction. That is, the modulated light beam is directed in the direction of the second optical image expander and further reflected by the second optical image expander after the first reflection by the first optical image expander, and is directed in the third direction. The second optical image expander may be a reflective Fresnel mirror surface including a second fine pattern surface, similar to the first optical image expander. The second fine pattern surface is arranged at a second angle β with respect to the second direction. As described above, the first optical image expander expands the image in only one direction and directs the expanded light beam in the second direction. However, the image is required to be expanded in both directions. Therefore, the second optical image expander expands the image in another direction, thus enabling complete 2D image expansion.
[0033] The first and second optical image expanders can be realized in organic or inorganic materials using molding, lithography, etching or other suitable manufacturing methods. Materials used to form the surface structure can be mineral glass, acrylic glass, polycarbonate or the like, as well as metals, such as aluminum and its alloys, magnesium and its alloys, titanium and its alloys. To improve reflectivity, the surface can be coated with a thin-film reflective coating of a metal mirror or a stack of broadband dielectric mirrors. Preferably, a reflectivity of 98% or more is ensured over the entire visible spectrum at the target incidence-reflection angles.
[0034] In some embodiments, the first angle α and the second angle β are each from 1 degree to 10 degrees. The first angle α and the second angle β can be from 1, 2, 3, 4, 5, 6 degrees to 5, 6, 7, 8, 9, 10 degrees. The first angle α and the second angle β can be changed depending on the required image magnification. If a larger image magnification is required, the first angle α and the second angle β can be decreased. However, in such a case, the total length of the optical image magnification system having the first optical image expander and the second optical image expander may increase. If a smaller image magnification is required, the first angle α and the second angle β may be increased. The range of α and β between 1° and 10° works for most of the practical scenarios. However, if it is desired to magnify a very small image from the spatial light modulator, the first angle α and the second angle β can be less than 1 degree. Similarly, if the desired image magnification is small, ie, there is no need for high image magnification, the upper limits of the first angle α and the second angle β are not limited and may be greater than 10 degrees.
[0035] It can be seen that the spatial light modulator responsible for modulating the light and outputting the image information has cross-sectional dimensions of x and y, and therefore the dimensions of the collimated light beam will also be x and y. In this configuration, the dimensions of the magnified image can be expressed as:
[0036] x'=y / (tan(α))
[0037] y'=x / (tan(β))
[0038] The sizes of the first and second optical image expanders and the corresponding first and second angles α and β may be selected to maintain the aspect ratio of the original image. If the expanded image is constructed to have an unnatural image aspect ratio, the above-mentioned configuration parameters can be used to achieve the correct aspect ratio of the resulting expanded image.
[0039] The first optical image expander has a first micropatterned surface and a first pitch. The first micropatterned surface has at least a first facet and a second facet tilted relative to the first facet. The first pitch is made up of the first facet and the second facet. The first facet is tilted at a third angle γ with respect to the first direction, and at least a portion of the first facet is reflective. Here, the first micropatterned surface can be defined as a surface including one or more micropatterns in the form of, for example, ridges or protrusions. In this specification, a facet may refer to one of the faces in the micropatterned surface. The first facet in the first micropatterned surface may correspond to the first facet, and the second facet in the first micropatterned surface may correspond to the second facet. The first facet and the second facet may not be in the same plane, and the second facet may be tilted relative to the first facet. The second facets may be angled relative to the first facets to form a generally triangular or tooth shape on the first micropattern surface. The first pitch is defined as the distance between two vertices on the first micropattern surface on the first optical image expander. Alternatively, the first pitch is defined as the distance between the tips of two adjacent micropatterns on the first optical image expander.
[0040] As mentioned above, the first facet is inclined at a third angle γ with respect to the first direction, where the first direction is the direction of the modulated light beam impinging on the first optical image expander. Due to the triangular shape of the first micropatterned surface, a portion of the first facet may be located in the shadow of the second facet with respect to the modulated light beam impinging on the first optical image expander. Therefore, the modulated light beam may only impinge on a portion of the first facet, specifically near its tip. Therefore, only the portion of the first facet that is not in the shadow of the second facet needs to be made reflective in order for the modulated light beam to impinge on the first facet and be reflected in the second direction. The portion of the first facet that is in the shadow of the second facet may be coated with a light absorbing coating to prevent unwanted reflections. Similarly, the second facet that does not receive or reflect the modulated light beam may be coated with a light absorbing coating to prevent unwanted reflections. However, in some embodiments, for ease of manufacture and cost effectiveness, the entire first optical image expander having a micropattern is made to have a reflective surface.
[0041] The second optical image expander has a second micropattern surface and a second pitch. The second micropattern surface has at least a third facet and a fourth facet that is tilted relative to the third facet. The second pitch is comprised of the third facet and the fourth facet. The third facet is tilted at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective. Similar to the first optical image expander, the second optical image expander has a second micropattern surface. Similar to the first micropattern surface, the second micropattern surface is comprised of a third facet and a fourth facet, and the fourth facet may be tilted relative to the third facet to form a generally triangular shape. The second pitch is defined as the distance between two vertices of the second micropattern surface of the second optical image expander. Alternatively, the second pitch is defined as the distance between the tips of two adjacent micropatterns in the second optical image expander.
[0042] The first pitch and the second pitch may be much larger than the pitch of the spatial light modulator. This can be better understood by taking the example of the first micropatterned surface. Each pixel of the spatial light modulator can be reflected from each tooth of the first micropatterned surface. Typically, as discussed, the first micropatterned surface may be tilted at an angle of about 1 to 10 degrees. Thus, a typical pitch of the optical image expander would correspond to the pitch of the spatial light modulator divided by sin(α). In one example, the minimum pitch of the spatial light modulator would be considered to be about 4 micrometers. The minimum pitch of the first micropatterned surface would be achieved at a large tilt angle of about 10 degrees. In this case, sin(10)=0.17, so the pitch would be 4 / 0.17=23.5 microns. In the case where the pitch of the spatial light modulator is about 7 micrometers and the tilt angle of the first micropattern surface is about 4 degrees, the pitch of the micropattern will be about 100 micrometers, which is much larger than the pitch of the spatial light modulator, as calculated above. It can be understood that if the pitch of either the first micropattern surface or the second micropattern surface is small, diffraction of the incident light beam will occur, which is undesirable. Therefore, the first pitch of the first micropattern surface and the second pitch of the second micropattern surface may generally be larger than the pitch of the spatial light modulator.
[0043] The light beam reflected by the first optical image expander may travel in a second direction toward the second optical image expander. As mentioned above, the third facet is inclined at a third angle δ with respect to the second direction. Due to the triangular shape of the second micropatterned surface, a portion of the third facet may be in the shadow of the fourth facet with respect to the reflected light beam impinging on the second optical image expander. The light beam may only impinge on a portion of the third facet, specifically near its tip. Therefore, only the portion of the third facet that is not in the shadow of the fourth facet needs to be made reflective in order for the light beam to impinge on the third facet and be reflected. The portion of the third facet that is in the shadow of the fourth facet may be coated with a light absorbing coating to prevent unwanted reflections. Similarly, the fourth facet that does not receive or reflect the modulated light beam may also be coated with a light absorbing coating to prevent unwanted reflections. However, in some embodiments, for ease of manufacture and cost effectiveness, the entire micropatterned second optical image expander is made to have a reflective surface.
[0044] In some embodiments, at least one of the first to fourth facets is selected from at least one of a flat facet and a curved facet. Typically, the first facet, the second facet, the third facet and the fourth facet may be flat facets. The flat facets reflect light beams in the visible light range with high efficiency. Curved facets may be used to reflect diverging light beams. Curved facets may be used, among others, to compensate for divergence angles and / or to improve the fill factor of the image in the projection volume. Although the above-mentioned embodiments have been described with the first facet, the second facet, the third facet and the fourth facet being flat facets, a person skilled in the art will understand that the first facet, the second facet and / or the third facet and / or the fourth facet may also be curved facets with minor modifications to the described embodiments.
[0045] In some embodiments, the third angle γ and the fourth angle δ are each 45 degrees. As mentioned above, the first facet is inclined at the third angle γ with respect to the first direction, and the third facet is inclined at the fourth angle δ with respect to the second direction. A typical practical case is an orthogonal arrangement. In this case, a light beam received at a first optical image expander from a first direction can be reflected along a second direction orthogonal to the first direction toward a second optical image expander and further reflected along a third direction orthogonal to the second direction away from the second optical image expander. To achieve this, each of the third angle δ and the fourth angle δ is substantially equal to 45 degrees. In this case, the reflection follows the rule of geometric optics that the angle of incidence is equal to the angle of reflection.
[0046] In operation, the first optical image expander is positioned at a first angle α with respect to the incident modulated light beam, and the first facet, which is a reflective facet, is positioned at a third angle δ with respect to the modulated light beam. When manufacturing the first optical image expander, it is useful to know the first angle α at which the first optical image expander is tilted in order to properly select the third angle δ to ensure the desired reflection direction, which is the second orientation of the first optical image expander.
[0047] A feature of the disclosed first optical image expander unit geometry is that the pitch of the first optical image expander is not a detrimental factor in operation. The first optical image expander can operate with a small or large first pitch. The difference determining the particular selection of the first pitch of the first optical image expander is regulated by the light diffusion properties of a screen element disposed in the optical path after the second optical image expander. (The screen element will be described in detail later.) As mentioned above, in the first optical image expander, only a portion of the first facet can be effectively utilized for redirecting the modulated light beam. A portion of the first facet may be in the shadow of a previous facet and therefore may not effectively participate in the reflection. This may result in discontinuities in the expanded image. When the modulated light beam hits the first facet, only a small portion of it will be reflected. The reflected light beam will correspond to the "useful image information" in the expanded image. The remaining portion of the modulated light beam, which may not carry image information, may not be reflected and may correspond to a "shadow region" in the magnified image. As the first angle α, which is the tilt angle of the first optical image expander, decreases, the effective linear fill factor (the ratio of "useful image information" to "shadow region") of the magnified image also decreases. To determine the effective linear fill factor of the magnified image, which is independent of the pitch of the first micro-pattern surface, the following formula can be applied:
[0048] "Useful image information" / "Shadow area" = tan(γ) / tan(α)
[0049] For example, if the third angle δ is equal to 45° and the first angle α is equal to 2°, the effective linear fill factor of the magnified image is 3.5%. If the first pitch of the first micro-patterned surface is fine, the effective linear fill factor of the magnified image may be such that there are fewer gaps between adjacent image elements. Although no image information is lost, it can be seen that if the spacing between adjacent image elements is large and the scattering power of the projection volume is low, the resulting magnified image may have perceptible artifacts related to white space. In view of this, it is considered more preferable to use the first optical image expander and the second optical image expander with a finer pitch and to reduce the gaps between adjacent image elements. The scattering of light within the diffusing element of the projection volume will help to blend the multiple image elements into a smoothed image, which will favor the perceived image quality. It will be understood that the matters described for the first micro-patterned surface are also applicable to the second micro-patterned surface without departing from the scope of the present disclosure.
[0050] The display system comprises a screen element disposed in the optical path after the second optical image expander. By screen element in this context is meant a display for displaying image information received from the second optical image expander. It may be understood that the screen element may be disposed along a third direction. In this disclosure, the screen element is also referred to as a "projection volume" and the two terms have been used interchangeably without limitation.
[0051] In some embodiments, the screen element has two or more image projection surfaces. And the display system includes a controller configured to synchronize the operation of the light source, the spatial light modulator, and the screen element to provide image plane information to each of the two or more image projection surfaces of the screen element. Throughout this disclosure, the term "projection surface" refers to an optical component that, in operation, displays an image plane of a given depth thereon. It should be noted that a 3D image will have at least two image planes, each having a different depth. Thus, the screen element may include at least two projection surfaces. The controller may synchronize the light source, the spatial light modulator, and the screen element. The screen element may receive the projection of the image plane of the given depth in synchronization with the light source and the spatial light modulator to display graphic information represented in the given image plane in the given projection surface.
[0052] As previously mentioned, to display a 3D image, the 3D image may be divided into two or more two-dimensional (2D) image slices, which may be referred to as "image information." Each of these image slices corresponds to a separate planar portion of the 3D image, and each piece of image information corresponds to an image slice. Combining such image slices of an object allows the display of a 3D image, which allows a viewer to perceive the depth of the object displayed as a 3D image. Each image slice may be presented at a different focal length relative to the viewer, which allows the viewer to perceive depth corresponding to multiple depth planes of the image.
[0053] In some embodiments, the screen element is a multi-plane volumetric display having a plurality of display elements. The plurality of display elements may be comprised of 2-40 individual light diffusing elements, which may be spaced apart from each other by a distance. In some embodiments, a spacer may be used to shift adjacent display elements in depth, where the plurality of display elements are positioned at different focal distances relative to the viewer. In this way, the projection volume is discretized and can be addressed in a time-sequential manner. To generate a 3D image, a plurality of 2D image slices can be presented to the display elements, each at a different focal distance.
[0054] In some embodiments, the plurality of display elements comprises at least one liquid crystal-based light diffusing element configured to have two optical states, one of which is a first optical state having a high light transmission and the other of which is a second optical state having a high haze value. Throughout this disclosure, the term "light diffusing" refers to an optical component that, in operation, displays an image plane of a given depth thereon. The first optical state represents a high light transmission, and in such a first optical state, each light diffusing element is transparent. Thus, in the first optical state, a light beam passing through the light diffusing element will not interact with the medium of the light diffusing element. Thus, in the first optical state, no image information will be presented on the light diffusing element. The second optical state represents a high haze value, and in such a second optical state, each light diffusing element is opaque. Thus, in the second optical state, the light diffusing element acts to significantly scatter the incident visible light beam. Thus, in the second optical state, image information is presented on the light diffusing element.
[0055] As mentioned above, when the light diffusing element is configured in a first optical state, the incident light beam passes through it without substantial interaction. On the other hand, when the light diffusing element is configured in a second optical state, the incident light beam is scattered, allowing the image to be observed from a wide viewing angle when the image is focused at a predetermined physical distance. In the projection volume, at one moment, all light diffusing elements except one may be configured in the first optical state and one light diffusing element may be configured in the second optical state. Then, synchronously, the projection system (here, the light source) may project a corresponding 2D image slice onto the light diffusing element in the second optical state. At the next moment, the projection system may be turned off and the projection volume may be reconfigured. Here, the one light diffusing element may be configured from the second optical state to the first optical state and the adjacent light diffusing element may be configured from the first optical state to the second optical state. The projection system may then be adapted to project a new 2D image slice onto the light diffusing element in the second optical state. This process may be continuously repeated to cycle all of the optical diffusing elements through the second optical state to reconstruct a perceptible 3D image in the predetermined projection volume. Configuring the optical diffusing elements into the first optical state or the second optical state may be performed by application of a voltage, where an applied voltage may correspond to the first optical state and no applied voltage may correspond to the second optical state.
[0056] In some embodiments, the liquid crystal of the at least one liquid crystal-based light diffusing element is a polymer-free cholesteric liquid crystal. The polymer-free cholesteric liquid crystals typically used in such light diffusing elements can allow fast transitions from a first optical state to a second optical state, and vice versa. The transitions can be on the order of hundreds of microseconds, such as 200-600 microseconds.
[0057] Alternatively, to combat possible image artifacts associated with the magnification or reduction of an unfocused image, the light diffusing element of the projection volume can have a composite structure. The scattering power of the light diffusing element is related to the thickness of the active layer, which is the liquid crystal layer. A thicker active layer also provides a higher degree of smoothing of the projected image. This can help hide image artifacts associated with white space caused by image magnification (done using a combination of the first and second optical image expanders). However, a thicker active layer may require a higher driving voltage, which may be undesirable, for example, in a portable display system that relies on a battery for power supply.
[0058] In some embodiments, the at least one liquid crystal-based light diffusing element has at least two active diffusing layers. Here, a light diffusing element including at least two active diffusing layers may be referred to as a composite light diffusing element. The two active diffusing layers may be a first active diffusing layer and a second active diffusing layer. The composite light diffusing element may further include two outermost substrates together with an internal substrate. Typically, all substrates may be made of mineral glass. In particular, all substrates may be high transparency display glass. Alternatively, the substrates may be implemented as polymer substrates. The outermost substrate may be made of a thick material to provide rigidity to the overall structure. The thickness range of the outermost substrate is typically in the range of 0.4 to 1.1 millimeters. However, if the projection volume is implemented in a manner of bonding individual light diffusing elements, the thickness of the outermost substrate may exceed 1.1 millimeters to ensure a certain gap between the target active layers. The internal substrate may be a thin dielectric layer separating the two active liquid crystal layers. Typically, the internal substrate may be selected to be as thin as possible. For example, the inner substrate may be a film-like substrate having a thickness of 100-300 micrometers. The inner substrate may be coated on both sides with transparent conductors such as, but not limited to, indium tin oxide (ITO) and doped zinc oxide (ZnO) transparent electrodes. The outer substrate may also be coated with a transparent electrode facing the active layer. The first active diffusing layer may be arranged in the direction of the incident light beam and configured to be a pre-scattering layer. The first active diffusing layer may be significantly thinner than the second active diffusing layer. For example, a typical thickness range for the first active diffusing layer is 1-6 micrometers. In contrast, the second active diffusing layer may be significantly thicker and may have a thickness of 7-25 micrometers. The thickness of both active layers is determined by spacers, such as deposited spacers and photospacers, as known in the art. In the current example, the active layer may be contained within the liquid crystal cell by applying a polymer gasket around the periphery.
[0059] In operation, an incident light beam carrying image information may first be scattered by the first thin active diffusing layer. Because this is a thin layer, the scattering power is weak and the scattering cone is narrow. The pre-scattered light beam then passes through the inner substrate into the second active diffusing layer.
[0060] The second active diffusing layer forms the corresponding image depth plane and has strong light scattering properties. The pre-scattered light ensures a high image fill factor, so that even when the image is enlarged, it is perceived as a smooth image. Such an architecture of a single light diffusing element combats image artifacts caused by low image fill factor and reduces the maximum required voltage to efficiently drive the light diffusing element. Furthermore, in this example, the reduced electric field strength also minimizes radio frequency (RF) leakage, which leads to further benefits.
[0061] That is, first the active layer (image depth plane) is started to transition from a first optical state to a second optical state. Then the pre-scattering layer is configured to transition from the first optical state to the second optical state. A delay is introduced to ensure that the image depth plane has reached the second optical state. Then the spatially modulated light (image) is projected towards the pre-scattering layer. Then the light source (of the projection unit) is turned off for a while. Then the transition of said image depth plane from the second optical state to the first optical state is started. Then the pre-scattering layer is also configured to transition from the second optical state to the first optical state. The whole process is repeated with the next diffusion element of the projection volume.
[0062] The volumetric display system of the present disclosure comprises a light source, such as a laser or SLED, that allows substantial collimation of the emitted light beam, and in some embodiments comprises a first optical system for forming, shaping and / or collimating the light beam, a first optical image expander and a second optical image expander. The first and second optical image expanders may typically be reflective, such as DMD or LCoS, or technically transmissive, such as LCD. The first optical system or other suitable optical system may be used as beam expansion optics to match the aperture of the spatial light modulator. The light beam is directed towards the first optical image expander. The first optical image expander is typically a slice of a Fresnel type mirror array whose smallest dimension substantially corresponds to the respective dimension of the spatial light modulator. Once the modulated light beam is expanded in any direction and reflected, it hits a second optical image expander whose size is equal to the size of the cross section of the projection volume. As a result, the expanded light beam is reflected by the second optical image expander and directed to the projection volume, where it is visualized at a certain physical depth by light scattering. The first optical image expander and the second optical image expander are arranged at a small or very small angle with respect to the incident light beam, so that the overall footprint of the display system is compact. In contrast, the prior art assumes the use of a projection lens including a large parabolic reflector as a technical solution to ensure a similar size image, which contributes to a reduction in the overall footprint, but is still bulky. The display system described herein significantly improves the image quality, but without using an image magnification unit and without worrying about the overall footprint of the volumetric display device.
[0063] In some embodiments, additional beam forming optics can be used between the spatial light modulator and the first optical image expander. Alternatively, a second beam forming optics can be disposed between the second optical image expander and the projection volume. Additionally, the volumetric display system includes control logic that allows the light source, the projection volume, the spatial light modulator, and the external image source to operate in sync to output a perceptually 3D image. In some embodiments, additional optics can be used in the optical path before the projection volume. This additional optics can include, but is not limited to, holographic optical elements, holographic diffusing elements, microlens (lenslet) arrays, or optical metasurfaces with optical properties tuned to mimic the functionality of controlled diffusing elements and / or lenslet arrays.
[0064] The display systems of the present disclosure can be employed in many applications, including as direct-view volumetric display devices that traditionally suffer from large form factors and may be bulky, requiring optically complex projection lenses and additional optical components to ensure a reasonable footprint.
[0065] In some embodiments, the head mounted display system comprises a display system as disclosed above. According to some embodiments of the present disclosure, a "head mounted display system" is a display device that can be worn by a user, for example, as part of a helmet worn on the wearer's head. The head mounted display system may have a display system in front of one or both eyes and provide a 3D view in virtual reality and augmented reality environments. The head mounted display system may be used in applications such as, but not limited to, military, aviation, gaming, virtual cinema, medical, etc. Here, the projection volume may be re-imaged by a secondary image forming optic such as an eyepiece. In the case of an augmented reality display, an image combiner may also be included. The image combiner may be a type of semi-reflective beam splitter that allows reflection of the projection light and transmission of ambient light. Alternatively, the eyepiece and image combiner may be a single unit, for example, a curved beam splitter such as an aspheric beam splitter or a freeform beam splitter. In some examples, the image source may be combined with a refractive waveguide.
[0066] In some embodiments, a head mounted up system has a display system as disclosed above. A head up display system is a display located in the field of view of a pilot or driver and provides important information. For example, a head up display system employing the display system of the present disclosure may be employed in an automobile. There is a constant demand for space saving in an automobile dashboard, and a display device with a minimal footprint is desired. The display system of the present disclosure is compact and therefore may be employed in a head up display in an automobile or other similar application. Conventional head up display systems are usually unable to convey 3D information that is perceived at various depths. A multifocal architecture based on volumetric display technology may solve this. However, a multifocal architecture may be quite bulky, requiring a large volume, for example, in the dash of a vehicle. By employing the display system of the present disclosure, a multifocal engine may be realized in a thin form factor. Here, a display system equivalent to a direct view volumetric display may be combined with a secondary optical system to provide multiple virtual image depth planes. This display system may essentially be a scaled down version of a direct view volumetric display with similar components. Additionally, the display system may be complemented by secondary imaging optics such as an eyepiece or an image combiner. The eyepiece may be implemented as part of the image combiner. In some embodiments, the eyepiece is a separate lens or lens assembly, such as, but not limited to, a Fresnel lens or multiple Fresnel lenses, a holographic lens, a diffractive lens, a metasurface lens, a refractive lens, or any combination thereof. The image combiner may be a windshield coated with a semi-reflective coating. The windshield may be coated with a notched reflective coating that effectively reflects narrow wavelengths of the image source and transmits the inverse spectral range and a broad wavelength range, thus contributing to a highly transparent and unobtrusive windshield.In alternative embodiments, the eyepiece functionality may be embedded directly into the windshield in the form of a wavelength-selective holographic optical element, a diffractive optical element, or an optical metasurface.
[0067] The present specification also relates to a method for displaying such a 3D image. The various embodiments and variants disclosed above apply mutatis mutandis to the method for displaying a 3D image.
[0068] In some embodiments, the first angle α and the second angle β are each between 1 degree and 10 degrees.
[0069] In some embodiments, the third angle γ and the fourth angle δ are each 45 degrees.
[0070] The divergence angle of the light beam after being collimated in the first optical system may be less than 1.5 degrees.
[0071] Referring to FIG. 1, a block diagram of a display system for displaying a three-dimensional image according to an embodiment of the present disclosure is shown. The display system 100 includes a light source 102, a first optical system 104, a spatial light modulator 106, a first optical image expander 108, a second optical image expander 110, a screen element 112, and a controller 114. The light source 102 is used to emit a light beam toward the first optical system 104. The first optical system 104 is used to expand, shape, form, and / or collimate the light beam and provide a collimated light beam toward the spatial light modulator 106. The spatial light modulator 106 is used to modulate the collimated light beam. The modulated light beam is provided in a first direction. The first optical image expander 108 is tilted at a first angle α with respect to the first direction. The first optical image expander 108 is used to reflect the modulated light beam in a second direction. The second optical image expander 110 is inclined at a second angle β with respect to the second direction. The second optical image expander 110 is in the optical path after the first optical image expander 108 and is used to reflect the reflected light beam in a third direction. The screen element 112 is disposed in the optical path after the second optical image expander 110. The controller 116 is configured to synchronize the operation of the light source 102, the spatial light modulator 106 and the screen element 112 to provide image plane information to each of two or more image planes of the screen element 112.
[0072] Referring to FIG. 2, a schematic diagram of a first optical image expander 200 for a display system (e.g., the display system 100 of FIG. 1) according to an embodiment of the present disclosure is illustrated. As shown, the first optical image expander 200 is implemented as a fine surface diffraction grating, such as a Fresnel mirror. The first optical image expander 200 has a first finely patterned surface 202 having a first facet 204 and a second facet 206. Here, the pitch P of the first finely patterned surface 202 is composed of the first facet 204 and the second facet 206. In the present disclosure, the second optical image expander has a configuration similar to that of the first optical image expander 200, the second finely patterned surface therein has a configuration similar to that of the first finely patterned surface 202, and the third and fourth facets of the second finely patterned surface are similar to the first and second facets 204 and 206 of the first finely patterned surface 202 of the first optical image expander 200.
[0073] Referring to FIG. 3, a schematic diagram of a first optical image expander 300 according to an embodiment of the present disclosure is shown. The first optical image expander 300 is an element similar to the first optical image expander 200 of FIG. 2. FIG. 3 also depicts the reflection of the light beam modulated by the first optical image expander 300. The first optical image expander 300 is positioned at a first angle α with respect to a first direction D1 of a collimated light beam 302 carrying image information. The first angle α is varied according to the requirement of how much the image should be expanded. When the collimated light beam 302 hits the first optical image expander 300, it is reflected in a second direction D2. From the figure, it can be observed that an input image having an overall height a is expanded into an enlarged image having a length a' (a < a').
[0074] Referring to FIG. 4, a schematic diagram of a portion of a display system 400 according to an embodiment of the present disclosure is shown. The display system 400 implements a first optical image expander 402 (similar to the first optical image expander 300 of FIG. 3) and a second optical image expander 404, along with a projection volume 406 for displaying a three-dimensional image. As shown, the first optical image expander 402 reflects the modulated light beam toward a second direction D2. The second optical image expander 404 reflects the reflected light beam toward a third direction D3. The projection volume 406 is disposed in a third direction 410, and as the light beam travels in the third direction 410, it strikes a screen element of the projection volume 406 to form a 3D image. Here, a first optical image expander 402 and a second optical image expander 404 enable the expansion and direction of a complete 2D image towards a projection volume 406 of a display system 400 .
[0075] Referring to FIG. 5A, a schematic diagram of an optical image expanding system 500A for a display system (e.g., display system 400 of FIG. 4) according to an embodiment of the present disclosure is shown. The optical image expanding system 500A includes a first optical image expander 502 and a second optical image expander 504. A modulated light beam carrying image information is incident through an aperture 506. The aperture 506 may be a virtual, conceptual aperture or may be a physically real aperture. The modulated light beam is directed to the first optical image expander 502, which is disposed at a first angle α with respect to the initial propagation direction of the modulated light beam. The first optical image expander 502 linearly expands the light beam in one dimension and reflects it towards the second optical image expander 504, which is disposed at a second angle β with respect to the propagation direction of the reflected light beam reflected from the first optical image expander 502.
[0076] Referring to Figure 5B, a cross-sectional view of the aperture 506 of Figure 5A is illustrated, according to one embodiment of the present disclosure. The dimensions of the aperture are given by length x and width y. It can be understood that the spatial light modulator (such as spatial light modulator 106 of Figure 1) responsible for modulating the light and outputting the image information also has cross-sectional dimensions of x and y, and therefore the dimensions of the collimated light beam will also be x and y.
[0077] Referring to Figure 5C, there is shown a schematic diagram of a portion of a display system 500C (e.g., display system 400 of Figure 4) including an optical image magnification system (e.g., optical image magnification system 500A of Figure 5A) having a projection volume 512, according to an embodiment of the present disclosure. The arrangement including a first optical image expander 502 and a second optical image expander 504 is complemented by a projection volume 512 for displaying a three-dimensional image. Here, it can be seen that the magnified image displayed on a layer of the projection volume 512 has a length x' and a width y'. In this arrangement, the dimensions of the magnified image can be expressed as follows:
[0078] x'=y / (tan(α))
[0079] y'=x / (tan(β))
[0080] The sizes of the first optical image expander 502 and the second optical image expander 504 and their corresponding first and second angles α and β may be selected to maintain the aspect ratio of the original image. If the expanded image is constructed to have an unnatural image aspect ratio, the above-mentioned configuration parameters can be used to achieve the correct aspect ratio of the resulting expanded image.
[0081] Referring to FIG. 5D, a schematic diagram of a portion of a display system 500D according to another embodiment of the present disclosure is shown. The portion of the display system 500D shown includes an optical image magnification system (e.g., optical image magnification system 500A of FIG. 5A) and a projection volume 512. The display system 500D further includes a spatial light modulator 520 and a prism assembly 524. Here, a collimated light beam 526 directed to the active area of the spatial light modulator 520 passes through the prism assembly 524 and is modulated. After passing through the prism assembly 524 and the aperture 506, the modulated light beam is directed toward a first optical image expander 502, which is typically a slice of a Fresnel-type mirror array whose smallest dimensions substantially correspond to the respective dimensions of the spatial light modulator 520. Once the modulated light beam is expanded and reflected in either direction, it strikes a second optical image expander 504 whose size is equal to the size of the cross section of the projection volume 512. As a result, the expanded light beam 530 is reflected off the second optical image expander 504 and directed towards the projection volume 512, where it becomes visible at a certain physical depth by light scattering. Because the first optical image expander 502 and the second optical image expander 504 are positioned at a small or very small angle with respect to the incident light beam, the overall footprint of the display system 500D is compact.
[0082] Referring to FIG. 6A, a schematic diagram of a first optical image expander 600A according to an embodiment of the present disclosure is shown. The first optical image expander 600A reflects a modulated light beam in a second direction. The first optical image expander 600A has a micropatterned first surface 602 and is at a first angle α with the modulated light beam traveling in a first direction D1. The first micropatterned surface 602 has a first pitch P1 and when reflecting the modulated light beam, it reflects only a small portion of it resulting in a segment 612 of "useful" information in the expanded image. Meanwhile, a segment 610 of the expanded image corresponds to a shadow area and does not convey image information.
[0083] Referring to Figure 6B, a schematic diagram of a first optical image expander 600B according to an embodiment of the present disclosure is shown. The first optical image expander 600B reflects the modulated light beam in a second direction. The first image expander 600B has a first pitch P2 that is smaller than the first pitch P1 of the first image expander 600A of Figure 6A.
[0084] Referring to Figure 6C, a schematic diagram of a first optical image expander 600C according to an embodiment of the present disclosure is shown. The first optical image expander 600C reflects the modulated light beam in a second direction. The first image expander 600C has a first pitch P3 that is smaller than the first pitch P1 of the first image expander 600A in Figure 6A and the first pitch P2 of the first image expander 600B in Figure 6B.
[0085] Referring to Figure 7A, an illustration of an image element 700A according to an embodiment of the present disclosure is shown. Image element 700A is obtained when the pitch of the first optical image expander (e.g., first optical image expander 600A in Figure 6A) and the second optical image expander is coarse or large, such as the first pitch P1 shown in Figure 6A.
[0086] Referring to Figure 7B, an illustration of an image element 700B according to another embodiment of the present disclosure is shown. Image element 700B is obtained when the pitch of the first optical image expander (e.g., first optical image expander 600C in Figure 6C) and the second optical image expander is fine or small, such as the first pitch P3 shown in Figure 6C.
[0087] Referring to FIG. 7C, an illustration of an image element 700C formed on a screen element according to an embodiment of the present disclosure is shown. The image element 700C is formed when the pitch of the first optical image expander (e.g., the first optical image expander 600A in FIG. 6A) and the second optical image expander is coarse or large, e.g., the first pitch P1 as shown in FIG. 6A. No image information will be lost no matter what the pitch is. However, even if image information is not lost, if the spacing between adjacent image elements, called image feature points, is large and the scattering power of the screen element is low, the resulting image may contain perceptible artifacts related to white space, as shown in FIG. 7C.
[0088] Referring to FIG. 7D, an illustration of an image element 700D formed on a screen element according to an embodiment of the present disclosure is shown. The image element 700D is formed when the pitch of the first optical image expander (e.g., the first optical image expander 600C in FIG. 6C) and the second optical image expander is fine or small, such as the first pitch P3 shown in FIG. 6C. Because the pitch of the first optical image expander and the second optical image expander is fine or small, the gap between adjacent image elements is reduced. The scattering of light in the diffusing element of the projection volume helps to blend the multiple image elements into a smoothed image, which makes the perceived image quality more favorable.
[0089] Referring to FIG. 8, a composite light diffusing element 800 according to an embodiment of the present disclosure is shown. The composite light diffusing element 800 has a first active diffusing layer 802, a second active diffusing layer 804, a first outermost substrate 806, a second outermost substrate 808, and an inner substrate 810. The first outermost substrate 806 and the second outermost substrate 808 may be made of a thick material to provide rigidity to the overall structure. The inner substrate 810 is typically selected to be as thin as possible. The first side 812 and the second side 814 of the inner substrate are coated with a transparent conductor. The sides of the first outermost substrate 806 and the second outermost substrate 808 facing the first active diffusing layer 802 and the second active diffusing layer 804, respectively, are also coated with a transparent conductor. As shown, the first outermost substrate 806 and the second outermost substrate 808 facing the first active diffusing layer 802 and the second active diffusing layer 804, respectively, are coated with transparent electrodes 826 and 828, respectively. Furthermore, the first active diffusing layer 802 is arranged in the direction D of the incident light beam and configured to be a pre-scattering layer. The first active diffusing layer 802 is much thinner than the second active diffusing layer 804. The first active diffusing layer 802 is contained within the liquid crystal cell by applying a polymer gasket along the side surfaces 818, 820. The second active diffusing layer 804 is contained within the liquid crystal cell by applying a polymer gasket along the side surfaces 822, 824.
[0090] FIG. 9 is a flow chart 900 listing steps of a method for displaying a 3D image according to another embodiment of the present disclosure. The method includes, in step 902, emitting a light beam, where the light beam may be emitted from a light source toward a first optical system. The method includes, in step 904, collimating and shaping the light beam, where the light beam is received by the first optical system and the light beam is collimated toward a spatial light modulator. The method includes, in step 906, modulating the collimated light beam, where the collimated light beam is modulated on the spatial light modulator and provided in a first direction. The method includes, in step 908, reflecting the modulated light beam in a second direction, where the modulated light beam is received by a first optical image expander at a first angle α with respect to the first direction, expanded, and reflected in the second direction. The first optical image expander has a first micropattern surface and a first pitch. The first micropatterned surface has at least a first facet and a second facet tilted relative to the first reflective facet. The first pitch consists of the first facet and the second reflective facet, where the at least the first reflective facet is tilted at a third angle γ with respect to the first direction, and at least a portion of the at least the first facet is reflective. The method includes, in step 910, reflecting the light beam in a third direction. The reflected light beam is received by a second optical image expander at a second angle β with respect to the second direction, expanded, and reflected back to the third direction. The second optical image expander has a second micropatterned surface and a second pitch. The second micropatterned surface has at least a third facet and a fourth facet tilted relative to the third facet. The second pitch consists of the third facet and the fourth reflective facet. The third facet is tilted at a fourth angle "δ" with respect to the second direction, and at least a portion of the third facet is reflective. The method includes, at step 912, receiving the reflected light beam at a screen element.Here, the screen element is positioned in the light path after the second light expander.
[0091] Modifications of the embodiments of the present disclosure described above are possible without departing from the scope of the disclosure as defined in the appended claims. The terms "including," "comprising," "incorporating," "having," "being," and the like, used to describe and claim the present disclosure, are intended to be interpreted in an open-ended manner, and may include items, parts, elements, etc. that are not expressly stated. The singular terms "a," "an," and "an" are also to be interpreted as relating to the plural.
Claims
1. 1. A display system for displaying a three-dimensional image, comprising: a light source used to emit a light beam towards a first optical system; the first optical system used to collimate the light beam and provide the collimated light beam towards a spatial light modulator; the spatial light modulator for modulating the collimated light beam; wherein the modulated light beam is provided in a first direction (D1), and the display system further comprises: a first optical image expander arranged at a first angle (α) with respect to the first direction and used to reflect the modulated light beam in a second direction (D2); a second optical image expander, inclined at a second angle (β) with respect to the second direction and disposed on the optical path after the first optical image expander, for reflecting the light beam reflected by the first optical image expander in a third direction (D3); a screen element disposed in the optical path after the second optical image expander; and Equipped with The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch (P) consisting of the first facet and the second facet; the first facet is inclined at a third angle (γ) with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is inclined relative to the third facet; a second pitch consisting of the third facet and the fourth facet; the third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective. Display system.
2. 10. The display system of claim 1, wherein the first optical system is selected as a system of at least one of the following optical components: a lens, a prism, a metasurface, a holographic optical element, a diffractive optical element, and a reflective optical element.
3. A display system as described in claim 1 or 2, wherein the divergence angle of the light beam after being collimated in the first optical system is less than 1.5 degrees.
4. 4. The display system of claim 1, wherein the first angle (α) and the second angle (β) are each between 1 degree and 10 degrees.
5. 5. A display system according to claim 1, wherein the third angle (γ) and the fourth angle (δ) are each 45 degrees.
6. 6. The display system of claim 1, wherein at least one of the first facet, the second facet, the third facet and the fourth facet is selected from at least one of a flat facet, a curved facet.
7. 7. The display system of claim 1, wherein the light source is selected to be at least one of a laser, a light emitting diode (LED), and a superluminescent light emitting diode (SLED) emitting in the visible light spectrum.
8. 8. A display system according to claim 1, wherein the spatial light modulator is selected to be at least one of a reflective spatial light modulator, a transmissive spatial light modulator.
9. 9. The display system of claim 1, wherein the spatial light modulator is selected to be at least one of a digital micromirror device, a liquid crystal on silicon (LCoS), a ferroelectric liquid crystal on silicon (FLCoS) modulator, and a liquid crystal display micropanel.
10. 10. A display system according to claim 1, wherein the screen element is a multi-plane volumetric display having a plurality of display elements.
11. The plurality of display elements includes at least one liquid crystal based light diffusing element configured to have two optical states, the first optical state has high light transmission; The second optical state has a high haze value. The display system of claim 10.
12. 12. The display system of claim 11, wherein the liquid crystal of the at least one liquid crystal based light diffusing element is a polymer-free cholesteric liquid crystal.
13. 12. The display of claim 10 or 11, wherein the at least one liquid crystal based light diffuser element has at least two active diffusing layers.
14. A display system according to any one of claims 1 to 13, the screen element having two or more image projection surfaces; the display system includes a controller configured to synchronize operation of the light source, the spatial light modulator, and the screen element to provide image plane information for each of two or more image projection surfaces of the screen element. Display system.
15. A head mounted display system comprising a display system according to any one of claims 1 to 14.
16. A head-up display system comprising a display system according to any one of claims 1 to 14.
17. A method for displaying a three-dimensional image, comprising the steps of: Emitting a light beam from a light source toward a first optical system; receiving the light beam with the first optical system and collimating the light beam toward a spatial light modulator; modulating the collimated light beam with the spatial light modulator and providing the light beam in a first direction (D1); receiving the modulated light beam at a first optical image expander at a first angle (α) relative to the first direction and reflecting the modulated light beam in a second direction (D2); receiving the reflected light beam at a second optical image expander at a second angle (β) relative to the second direction and reflecting the light beam in a third direction (D3); receiving the light beam reflected in the third direction (D3) at a screen element disposed in the optical path after the second optical image expander; Including, The first optical image expander has a first micropatterned surface, the first micropatterned surface comprising: at least a first facet and at least a second facet that is inclined relative to the first facet; having at least a first pitch (P) consisting of the first facet and the second facet; the first facet is inclined at a third angle (γ) with respect to the first direction, and at least a portion of the first facet is reflective; The second optical image expander has a second micropatterned surface, the second micropatterned surface comprising: at least a third facet and at least a fourth facet that is inclined relative to the third facet; a second pitch consisting of the third facet and the fourth facet; the third facet is inclined at a fourth angle δ with respect to the second direction, and at least a portion of the third facet is reflective. method.
18. 18. The method of claim 17, wherein the first angle (α) and the second angle (β) are each from 1 degree to 10 degrees.
19. 19. The method of claim 17 or 18, wherein the third angle (γ) and the fourth angle (δ) are each 45 degrees.
20. 20. The method of claim 17, wherein the divergence angle of the light beam after being collimated in the first optical system is less than 1.5 degrees.
