Mixed display optical engine, mixed display method and augmented reality display device

By using a hybrid display optical machine in a holographic imaging system, using polarization spectroscopic elements to separate the optical path, combined with the imaging of holographic and two-dimensional display components, the problems of low light energy utilization and dissatisfaction with the field of view are solved, and efficient light energy is achieved Utilization and field of view expansion.

WO2024244907A1PCT designated stage expired Publication Date: 2024-12-05SUNNY OPTICAL ZHEJIANG RES INST CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/091234
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-30
Filing Date
2024-05-06
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

The light energy utilization rate of existing holographic imaging systems is less than 10%, and the display screen resolution is limited, so it cannot meet the field of view and pupil requirements of AR-HMD and AR-HUD at the same time, resulting in visual radiation regulation conflicts and light energy waste.

Method used

Using a hybrid display optical machine, the illumination light is separated into the first and second polarized optical paths through the polarization spectrometer, and is used for the holographic display component and the two-dimensional display component respectively. The simultaneous imaging of holographic and two-dimensional images is achieved by combining the imaging lens group to improve the light Ability to utilize and field of view.

Benefits of technology

It effectively improves the utilization rate of light energy, expands the display field of view, reduces device costs, meets the field of view and pupil output needs of AR devices, and solves the problem of visual radiation regulation conflict.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024091234_05122024_PF_FP_ABST
    Figure CN2024091234_05122024_PF_FP_ABST
Patent Text Reader

Abstract

A mixed display optical engine, a mixed display method and an augmented reality display device. The mixed display optical engine comprises a lighting assembly, a polarized light-splitting element, a holographic display assembly, a two-dimensional display assembly and an imaging lens group, wherein the polarized light-splitting element is arranged on a light-emitting optical path of the lighting assembly, and has a first light-splitting optical path and a second light-splitting optical path, which are separated from each other; the holographic display assembly is arranged in the first light-splitting optical path, and has a holographic image face and a separate image face; the two-dimensional display assembly is arranged in the second light-splitting optical path, and has a two-dimensional image source face, which is flush with the holographic image face; and the imaging lens group is arranged on object sides of the holographic display assembly and two-dimensional display assembly.
Need to check novelty before this filing date? Find Prior Art

Description

Hybrid display optical machine, hybrid display method and augmented reality display device

[0001] Related applications

[0002] This application claims priority to Chinese patent application number 202310636351.0, filed on May 30, 2023, entitled “Hybrid display optical machine, hybrid display method and augmented reality display device,” the entire text of which is hereby incorporated by reference. Technical Field

[0003] The present application relates to the field of augmented reality technology, and in particular to a hybrid display optical machine, a hybrid display method, and an augmented reality display device. Background Art

[0004] With the rise of augmented reality display devices such as AR-HMDs (head-mounted augmented reality) and AR-HUDs (head-up augmented reality), people have been exploring a wide range of display solutions. Solutions based on display screens such as TFT-LCD (thin-film transistor liquid crystal), LCOS (liquid crystal on silicon), DLP (digital light processing), Micro-LED (micro-light-emitting diode), and OLED (organic light-emitting diode) are becoming increasingly mature. However, these displays are all flat-panel solutions and rely solely on binocular parallax to produce a 3D effect. This means that the left and right eyes display different images with different parallax angles, giving objects in the displayed image a sense of spatial depth. However, because the virtual image distance projected by the actual display is fixed, vergence-accommodation conflict (VAC) is inevitable.

[0005] In order to solve the VAC problem, holographic display solutions based on spatial light modulators (SLMs) are considered to be the best solution for 3D stereoscopic display. The current mainstream computational holographic solutions are all based on the imaging mode of pure phase liquid crystal spatial light modulators (LC-SLMs). However, LC-SLMs have polarization requirements for the illumination light, that is, the illumination light must have a linear polarization state, and the polarization direction must be parallel to the extraordinary optical axis (e-light) of the liquid crystal, which will lead to waste of light energy in other polarization states in the optical path. In addition, since the holographic optical path is implemented based on the reflective LC-SLM, most of the optical paths have beam splitters (BSs), and the actual light efficiency utilization rate that can be used for system imaging is less than 10%, resulting in great waste.

[0006] For example, as shown in Figure 1, a related holographic imaging system 1P includes, arranged in sequence along the optical path, a laser 10P, a polarizer 20P, a collimating lens 30P, a beam splitter prism 40P, a spatial light modulator 50P, an imaging lens 60P, and an aperture 70P. Laser light emitted by laser 10P is first selected by polarizer 20P, then collimated by collimating lens 30P and passed through beam splitter prism 40P for the first time to illuminate spatial light modulator 50P. After the phase or amplitude of the light at the corresponding pixel position is modulated according to the hologram loaded on spatial light modulator 50P, the light passes through beam splitter prism 40P for a second time to form a holographic reconstruction image through FFT (Fourier transform) diffraction at the focal plane of imaging lens 60P. Finally, zero-order light is filtered out by aperture 70P, and the holographic image is transmitted. However, in this solution: due to the presence of the polarizer, the elliptically polarized light emitted by the laser is selected once, resulting in a loss of half of the optical path energy (such as 25%); the energy is reduced to one-quarter due to passing through the dichroic prism 40P twice; at the same time, the average diffraction energy utilization rate of the spatial light modulator 50P is 60% to 70%, and the imaging lens 60P and the aperture 70P also cause partial light loss, resulting in the light energy utilization rate of the related holographic imaging system 1P being less than 10%.

[0007] In addition, the related holographic imaging system 1P only uses a spatial light modulator 50P (phase or amplitude type LC-SLM) for computational holographic imaging, and its screen resolution is relatively limited, with a maximum of only 4K (4096*2240). However, due to the spatial bandwidth product (SBP) of the LC-SLM, the product between the field of view (FOV) and the exit pupil (eyebox) of the optical machine is a constant, that is, the field of view and the exit pupil of the display optical machine based on computational holography are a pair of limiting parameters and cannot be made larger at the same time. In other words, whether in the application of AR-HUD or in the application of AR-HMD, in order to meet the exit pupil requirements of the optical machine, its diagonal field of view (D-FOV) parameters will be compressed to a very small size, such as a 30° field of view angle and a 2mm*2mm exit pupil. This is far from the relevant display optical machine parameter requirements (such as a 50° field of view angle and a 4mm*4mm exit pupil), and it is difficult to meet the application requirements of current products.

[0008] Summary of the Invention

[0009] According to various embodiments of the present application, the present application provides a hybrid display optical engine, a hybrid display method, and an augmented reality display device.

[0010] In a first aspect, the present application provides a hybrid display optical engine, comprising:

[0011] an illumination assembly for emitting illumination light along a light path;

[0012] a polarization splitter element, the polarization splitter element being disposed in the light emitting path of the illumination assembly and having a first split light path and a second split light path separated from each other, for splitting illumination light propagating along the light emitting path to form first polarized illumination light propagating along the first split light path and second polarized illumination light propagating along the second split light path;

[0013] a holographic display assembly, the holographic display assembly being disposed in the first splitting optical path of the polarization splitting element, and having a holographic image plane and a separated image plane spaced behind the holographic image plane, for modulating the first polarized illumination light to form holographic image light for generating a holographic reconstruction image at the holographic image plane and the separated image plane;

[0014] a two-dimensional display component, the two-dimensional display component being disposed in the second beam splitting optical path of the polarization beam splitting element, and the two-dimensional display component having a two-dimensional image source surface flush with the holographic image surface, for modulating the second polarized illumination light to form a two-dimensional image light; and

[0015] An imaging lens group is arranged on the object side of the holographic display component and the two-dimensional display component, and is used to modulate the holographic image light from the holographic display component and the two-dimensional image light from the two-dimensional display component to simultaneously form images.

[0016] In one embodiment, the polarization beam splitting element is a polarization beam splitting prism; the holographic display component is located on the transmission side of the polarization beam splitting prism; and the two-dimensional display component is located on the reflection side of the polarization beam splitting prism.

[0017] In one embodiment, the holographic display assembly includes a spectrometer located on the transmission side of the polarization spectrometer element, a first spatial light modulator arranged on the transmission side of the spectrometer at an angle relative to the first spectrometer optical path, and a Fourier lens group arranged on the reflection side of the spectrometer; wherein the focal plane of the Fourier lens group is flush with the two-dimensional image source plane to provide the holographic image plane.

[0018] In one embodiment, the holographic display assembly further includes an aperture arranged on the holographic image plane.

[0019] In one embodiment, the holographic display assembly further includes a second spatial light modulator, which is arranged on a side of the light splitting device away from the Fourier lens group at an angle relative to the first light splitting optical path.

[0020] In one embodiment, the holographic display assembly further includes an LCOS device, which is arranged on a side of the light splitting device away from the Fourier lens group at an angle relative to the first light splitting optical path.

[0021] In one embodiment, the holographic display assembly includes a beam splitter located on the transmission side of the polarization beam splitter element and a first spatial light modulator disposed perpendicularly to the first beam splitting optical path on the transmission side of the beam splitter.

[0022] In one embodiment, the holographic display assembly further includes a second spatial light modulator, which is arranged on a side of the light splitting device away from the imaging lens group in parallel with the first light splitting optical path.

[0023] In one embodiment, the holographic display component further includes an LCOS device and a display lens group, the LCOS device is arranged on a side of the spectroscopic device away from the imaging lens group in parallel with the first spectroscopic optical path, and the display lens group is arranged in the optical path between the LCOS device and the spectroscopic device.

[0024] In one embodiment, the two-dimensional display assembly includes a reflective element located on the reflective side of the polarization splitting element and a display device arranged on the reflective side of the reflective element, and the display surface of the display device serves as the two-dimensional image source surface.

[0025] In one embodiment, the reflective element is a reflector obliquely arranged in the second split light path; and the display device is a DLP display screen.

[0026] In one embodiment, the illumination assembly includes a laser and a collimating lens group, and the collimating lens group is arranged in the optical path between the laser and the polarization beam splitting element.

[0027] In a second aspect, the present application further provides an augmented reality display device, comprising:

[0028] the device body; and

[0029] Any of the hybrid display light engines described above, wherein the hybrid display light engine is arranged in the device body to perform augmented reality display.

[0030] In a third aspect, the present application further provides a hybrid display method, comprising:

[0031] emitting illumination light along a light path;

[0032] Splitting the illumination light propagating along the light-emitting optical path to form a first polarized illumination light propagating along a first split optical path and a second polarized illumination light propagating along a second split optical path;

[0033] modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and the plurality of split image planes;

[0034] modulating the second polarized illumination light propagating along the second split light path through a two-dimensional image source plane flush with the holographic image plane to form a two-dimensional image light; and

[0035] The holographic image light and the two-dimensional image light are modulated to form images simultaneously through an imaging lens group.

[0036] In one embodiment, the step of modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and the plurality of separated image planes comprises the steps of:

[0037] transmitting a portion of the first polarized illumination light through a beam splitter to propagate to a first spatial light modulator;

[0038] After loading the hologram, the portion of illumination light is modulated by the first spatial light modulator to form a first holographic light that propagates back to the optical splitter; and

[0039] A portion of the first holographic light is reflected by the optical splitter to pass through a Fourier lens group or directly form a first holographic image light.

[0040] In one embodiment, the step of modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and the plurality of separated image planes further comprises the steps of:

[0041] reflecting another portion of the first polarized illumination light through the optical splitter to propagate to the second spatial light modulator;

[0042] After loading the hologram, the second spatial light modulator modulates another portion of the illumination light to form a second holographic light that propagates back to the optical splitter; and

[0043] A portion of the second holographic light is transmitted through the optical splitter to pass through a Fourier lens group or directly form a second holographic image light.

[0044] In one embodiment, the step of modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and the plurality of separated image planes further comprises the steps of:

[0045] reflecting another portion of the first polarized illumination light through the optical splitter to propagate to the LCOS device;

[0046] modulating another portion of the illumination light through the LCOS device to form a two-dimensional image light that propagates back to the optical splitter device; and

[0047] A portion of the two-dimensional image light is transmitted through the optical splitter to form a two-dimensional picture flush with the two-dimensional image source surface through a Fourier lens group.

[0048] In one embodiment, the step of modulating the second polarized illumination light propagating along the second split light path through a two-dimensional image source plane flush with the holographic image plane to form a two-dimensional image light comprises the following steps:

[0049] Reflecting the second polarized illumination light through a reflective element to propagate to the DLP display screen;

[0050] The second polarized illumination light is modulated through the DLP display screen to form the two-dimensional image light.

[0051] The details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the conventional technology, the following briefly introduces the drawings required for use in the embodiments or the conventional technology descriptions. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the disclosed drawings without any creative work.

[0053] FIG1 is a schematic diagram of an optical path of a related holographic imaging system;

[0054] FIG2 is a first example of a hybrid display optical engine according to an embodiment of the present application;

[0055] FIG3 is a schematic diagram showing a screen displayed by the hybrid display optical engine according to the first example of the present application;

[0056] FIG4 shows a second example of a hybrid display optical engine according to the above embodiment of the present application;

[0057] FIG5 shows a third example of a hybrid display optical engine according to the above embodiment of the present application;

[0058] FIG6 is a schematic diagram showing a screen displayed by the hybrid display optical engine according to the third example of the present application;

[0059] FIG7 shows a fourth example of a near-eye display device according to the above embodiment of the present application;

[0060] FIG8 shows a fifth example of a near-eye display device according to the above-described embodiment of the present application;

[0061] FIG9 is a schematic diagram showing a screen displayed by the hybrid display optical engine according to the fifth example of the present application;

[0062] FIG10 shows a sixth example of the near-eye display device according to the above-described embodiment of the present application.

[0063] Explanation of the main component symbols: 1. Hybrid display optical machine; 10. Illumination component; 100. Light emitting optical path; 11. Laser; 12. Collimating lens group; 20. Polarization splitter element; 200. Polarization splitter prism; 201. First splitter optical path; 202. Second splitter optical path; 30. Holographic display component; 301. Holographic image plane; 302. Separated image plane; 31. Splitting device; 32. First spatial light modulator; 33. Fourier lens group; 34. Aperture; 35. Second spatial light modulator; 36. LCOS device; 37. Display lens group; 40. Two-dimensional display component; 400. Two-dimensional image source plane; 41. Reflection element; 410. Reflector; 42. Display device; 420. DLP display screen; 50. Imaging lens group.

[0064] The above description of the main component symbols is combined with the accompanying drawings and specific implementation methods to further illustrate this application in detail. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0066] It should be noted that when a component is referred to as being "mounted on" another component, it may be directly on the other component or there may be a central component. When a component is considered to be "set on" another component, it may be directly set on the other component or there may be a central component. When a component is considered to be "fixed to" another component, it may be directly fixed to the other component or there may be a central component.

[0067] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein in the specification of this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The term "or / and" as used herein includes any and all combinations of one or more of the associated listed items.

[0068] Considering that the light energy utilization rate of related holographic imaging systems is less than 10%, and in order to meet the pupil requirements of the optical machine, its diagonal field of view (D-FOV) parameter will be compressed to a very small level, which seriously affects the practicality of AR devices. This application provides a hybrid display optical machine, a hybrid display method, and an augmented reality display device, which can effectively increase the display field of view while improving the system's light energy utilization rate.

[0069] Specifically, in a first aspect, referring to Figures 2 to 8 , one embodiment of the present application provides a hybrid display optical engine 1, which may include an illumination assembly 10, a polarization beam splitter 20, a holographic display assembly 30, a two-dimensional display assembly 40, and an imaging lens assembly 50. The illumination assembly 10 has an emission optical path 100 for emitting illumination light along the emission optical path 100. The polarization beam splitter 20 is disposed in the emission optical path 100 of the illumination assembly 10 and has a first split optical path 201 and a second split optical path 202, which are separated from each other, for splitting the illumination light propagating along the emission optical path 100 into a first polarized illumination light propagating along the first split optical path 201 and a second polarized illumination light propagating along the second split optical path 202.

[0070] More specifically, as shown in FIG2 , the holographic display assembly 30 is disposed in the first splitting optical path 201 of the polarization beam splitting element 20. The holographic display assembly 30 comprises a holographic image plane 301 and a plurality of separated image planes 302 spaced apart behind the holographic image plane 301, for modulating the first polarized illumination light to form holographic image light for generating a holographic reconstruction image at the holographic image plane 301 and the separated image planes 302. The two-dimensional display assembly 40 is disposed in the second splitting optical path 202 of the polarization beam splitting element 20. The two-dimensional display assembly 40 comprises a two-dimensional image source plane 400 flush with the holographic image plane 301, for modulating the second polarized illumination light to form two-dimensional image light. The imaging lens assembly 50 is disposed on the object side of the holographic display assembly 30 and the two-dimensional display assembly 40, for modulating the holographic image light from the holographic display assembly 30 and the two-dimensional image light from the two-dimensional display assembly 40 for simultaneous imaging.

[0071] The hybrid display optical engine 1 of the present application uses the holographic display component 30 to perform holographic 3D imaging on the first polarized illumination light split by the polarization beam splitter 20. Furthermore, the two-dimensional display component 40 uses the second polarized illumination light split by the polarization beam splitter 20 to perform two-dimensional imaging. This allows for a mixed display of 3D and 2D images, effectively increasing the display field of view of the optical engine and significantly improving the system's light energy utilization. Furthermore, compared to solutions that increase the field of view by combining two independent optical paths, the hybrid display optical engine 1 of the present application enables the holographic display component 30 and the two-dimensional display component 40 to share the imaging lens assembly 50, effectively reducing device costs.

[0072] Alternatively, as shown in FIG2 , the polarization beam splitter element 20 mentioned in the present application may be a polarizing beam splitter prism 200 (PBS). Furthermore, the polarization state of the first polarized illumination light mentioned in the present application is orthogonal to the polarization state of the second polarized illumination light; for example, when the first polarized illumination light is P light (Parallel Light), the second polarized illumination light is S light (Perpendicular Light).

[0073] For example, in the first example of the present application, as shown in FIG2 , the holographic display component 30 is located on the transmission side of the polarization beam splitter prism 200, and the two-dimensional display component 40 is located on the reflection side of the polarization beam splitter prism 200; that is, the first polarized illumination light is P light, and the second polarized illumination light is S light.

[0074] Optionally, as shown in Figure 2, the holographic display component 30 may include a spectrometer 31 located on the transmission side of the polarization spectrometer element 20, a first spatial light modulator 32 arranged on the transmission side of the spectrometer 31 at an angle relative to the first spectrometer optical path 201, and a Fourier lens group 33 arranged on the reflection side of the spectrometer 31; the focal plane of the Fourier lens group 33 is flush with the two-dimensional image source surface 400 to provide the holographic image surface 301. In this way, a portion of the P light transmitted through the polarization splitter element 20 is first transmitted by the splitter device 31 to propagate to the first spatial light modulator 32, and then the hologram is loaded on the first spatial light modulator 32 to modulate this portion of the illumination light to form a holographic light that propagates back to the splitter device 31; thereafter, a portion of the holographic light will be reflected by the splitter device 31 to propagate to the Fourier lens group 33 and form a Fourier holographic image at the focal plane of the Fourier lens group 33, that is, the focal plane of the Fourier lens group 33 forms the holographic image plane 301, and subsequently generates a series of separated image planes 302 with smaller intervals; finally, the formed holographic image light will propagate to the imaging lens group 50 for 3D imaging. It can be understood that the first spatial light modulator 32 mentioned in the present application can be implemented as a phase-type LC-SLM to achieve holographic modulation by loading a pure phase hologram to form 3D holographic reconstruction imaging; the spectrometer device 31 mentioned in the present application refers to an ordinary beam splitter prism (Beam Splitter, abbreviated as BS).

[0075] Optionally, as shown in FIG2 , the holographic display assembly 30 may further include an aperture 34 , which is disposed on the holographic imaging surface 301 to block zero-order light to prevent the zero-order light from entering a subsequent imaging system, thereby improving the holographic imaging effect.

[0076] Optionally, as shown in FIG2 , the two-dimensional display assembly 40 of the present application may include a reflective element 41 located on the reflective side of the polarization beam splitting element 20 and a display device 42 disposed on the reflective side of the reflective element 41, with the display surface of the display device 42 serving as the two-dimensional image source surface 400. Thus, the S light reflected by the polarization beam splitting element 20 is first reflected by the reflective element 41 to propagate to the display device 42, and then modulated by the display device 42 to form a two-dimensional image light, which is then propagated to the imaging lens assembly 50 for 2D imaging.

[0077] Optionally, as shown in FIG2 , the reflective element 41 may be, but is not limited to, implemented as a reflector 410 disposed obliquely in the second split light path 202; and the display device 42 may be, but is not limited to, implemented as a DLP display screen 420. It will be appreciated that the DLP display screen 420 mentioned in this application has no requirements for the polarization state of the illumination light, requiring only that the incident light be illuminated at a certain angle (usually a dozen degrees), making it particularly suitable for the optical path design of the hybrid display optical engine 1 of this application.

[0078] As shown in FIG2 , the surface of the DLP display screen 420 is the two-dimensional image source surface 400. Because the two-dimensional image source surface 400 is flush with the holographic image surface 301, the 2D image displayed on the DLP display screen 420 and the holographic display screen flush with it (i.e., the holographic reconstruction image formed at the holographic image surface 301) form a virtual image with an infinite virtual image distance (VID) after passing through the imaging lens assembly 50. Based on the object-image correspondence, the separated image surface 302 behind the holographic image surface 301 is imaged at different virtual image distances because the object distance is less than one focal length, thereby achieving multi-depth 3D display.

[0079] Optionally, the screen size of the first spatial light modulator 32 is equal to the screen size of the DLP display 420, ensuring that the illumination spot provided by the illumination assembly 10 can simultaneously match the illumination requirements of the first spatial light modulator 32 and the DLP display 420, thereby efficiently utilizing light energy. It is understood that the size of the illumination spot provided by the illumination assembly 10 should not be smaller than the diagonal length of the first spatial light modulator 32 and the DLP display 420.

[0080] Optionally, as shown in FIG2 , the lighting assembly 10 may include a laser 11 and a collimating lens group 12. The collimating lens group 12 is disposed in the optical path between the laser 11 and the polarization beam splitter 20 and is configured to collimate the laser light emitted by the laser 11 to form illumination light that propagates to the polarization beam splitter 20. It will be understood that the laser 11 mentioned in this application may not be limited to being implemented as an RGB three-color laser and transmitted to the collimating lens group 12 via an optical fiber for collimation.

[0081] Optionally, the imaging lens assembly 50 mentioned in this application may be, but is not limited to, composed of one or more lenses. It is understood that the lens surface profiles in the imaging lens assembly 50 mentioned in this application may be, but is not limited to, implemented as one or more of a standard spherical surface, an aspheric surface, a freeform surface, and a diffractive surface, and this application will not elaborate on this. Furthermore, the Fourier lens assembly 33 and the collimating lens assembly 12 mentioned in this application may be, but are not limited to, composed of one or more lenses, and this application will not elaborate on this.

[0082] The screen displayed by the hybrid display optical machine 1 according to the above-mentioned first example of the present application is shown in FIG3 , which can be applied to the display systems of AR-HMD and AR-HUD. For example, in the application of AR-HUD: two-dimensional images (2D images) can be used to display information about the vehicle itself, such as basic information such as vehicle speed, battery / fuel level, etc.; holographic images (3D images) can be used to display navigation information to be integrated with the real scene. In summary, the hybrid display optical machine 1 not only realizes the 3D display of the screen, but also expands the field of view size, and can effectively improve the utilization rate of light energy for display.

[0083] FIG4 illustrates a second example of a hybrid display optical engine 1 according to the aforementioned embodiment of the present application. Compared to the aforementioned first example, the hybrid display optical engine 1 according to the second example differs in that the holographic display assembly 30 may include a beam splitter 31 located on the transmission side of the polarization beam splitter 20 and a first spatial light modulator 32 disposed perpendicularly to the transmission side of the beam splitter 31 relative to the first beam splitting optical path 201. Thus, a portion of the P light transmitted through the polarization beam splitter 20 is first transmitted by the beam splitter 31 and propagates to the first spatial light modulator 32. The first spatial light modulator 32 then modulates this portion of illumination light after loading a hologram onto it, forming holographic light that propagates back to the beam splitter 31. Subsequently, a portion of the holographic light is reflected by the beam splitter 31 to form Fresnel holographic images on the holographic image plane 301 and the subsequent separated image plane 302. Finally, the formed holographic image light propagates to the imaging lens assembly 50 for 3D imaging.

[0084] In order to expand the image of the 3D holographic display and utilize the energy lost by the P light passing through the spectrometer 31, the present application can further introduce a second spatial light modulator on the basis of the hybrid display optical machine 1 of the above-mentioned first example or the above-mentioned second example to achieve a hybrid 3D display with a larger field of view and higher light efficiency.

[0085] Exemplarily, as shown in Figure 5, compared with the above-mentioned first example according to the present application, the difference of the hybrid display optical machine 1 according to the third example of the present application is that: the holographic display component 30 further includes a second spatial light modulator 35, and the second spatial light modulator 35 is arranged at an angle relative to the first splitting optical path 201 on the side of the splitting device 31 away from the Fourier lens group 33; that is, the second spatial light modulator 35 is arranged at an angle relative to the first splitting optical path 201 on the other reflective side of the splitting device 31. In this way, when a part of the P light transmitted through the polarization splitter element 20 is transmitted by the splitter device 31 to propagate to the first spatial light modulator 32 and is modulated into the first holographic light, the other part of the P light transmitted through the polarization splitter element 20 is reflected by the splitter device 31 to propagate to the second spatial light modulator 35 and is modulated into the second holographic light, so that both parts of the P light transmitted and reflected through the splitter device 31 can be utilized for 3D holographic imaging, which not only greatly improves the utilization rate of light energy, but also the first holographic light modulated through the first spatial light modulator 32 and the second holographic light modulated through the second spatial light modulator 35 can also form a spliced ​​Fourier holographic image at the holographic image surface 301, and then form the display effect shown in Figure 6 through the imaging lens group 50 to obtain a larger 3D display field of view.

[0086] As shown in Figure 7, if the second spatial light modulator 35 is introduced on the basis of the above-mentioned second example to form a fourth example of the hybrid display optical machine 1, the second spatial light modulator 35 is arranged on the side of the splitting device 31 away from the imaging lens group 50 in parallel with the first splitting optical path 201 to perform Fresnel holographic imaging, which will not be described in detail in this application.

[0087] In addition, based on the above-mentioned first example and the above-mentioned second example of the present application, the present application can also introduce an LCOS device to replace the second spatial light modulator 35, so as to increase the 2D display field of view while improving the utilization rate of light energy.

[0088] For example, as shown in FIG8 , the hybrid display optical engine 1 according to the fifth example of the present application differs from the first example described above in that the holographic display assembly 30 further includes an LCOS device 36, which is disposed parallel to the first splitting optical path 201 on a side of the splitting optical device 31 away from the Fourier lens assembly 33. That is, the LCOS device 36 is disposed parallel to the first splitting optical path 201 on the other reflective side of the splitting optical device 31. Thus, while a portion of the P light transmitted through the polarization splitting element 20 is transmitted by the splitting optical device 31 to propagate to the first spatial light modulator 32 and be modulated into holographic light, another portion of the P light transmitted through the polarization splitting element 20 is reflected by the splitting optical device 31 to propagate to the LCOS device 36 and be modulated into two-dimensional image light. This allows both the portion of the P light transmitted and the portion reflected by the splitting optical device 31 to be utilized for 3D holographic imaging and 2D imaging, respectively, greatly improving light energy utilization. At the same time, the two-dimensional image light modulated by the LCOS device 36 will form a two-dimensional picture flush with the two-dimensional image source surface 400 after passing through the Fourier lens group 33, so as to form a spliced ​​2D picture with the picture passing through the DLP display screen 420, and then pass through the imaging lens group 50 to form the display effect shown in Figure 9, so as to obtain a larger 2D display field of view.

[0089] It can be understood that in the combined display screen shown in Figure 9, the 3D display area is placed in the center of the screen, that is, the central area of ​​the optical machine field of view, to perform 3D and 2D displays in separate fields of view, so that in the application of AR-HMD, the central field of view of 0° to 10° can be used for 3D display, and the large field of view of 10° to 40° can be used to display 2D virtual information.

[0090] In addition, as shown in Figure 10, compared with the above-mentioned second example according to the present application, the difference of the hybrid display optical machine 1 according to the sixth example of the present application is that the holographic display component 30 further includes an LCOS device 36 and a display lens group 37, and the LCOS device 36 is arranged on a side of the spectrometer 31 away from the imaging lens group 50 in parallel with the first spectrometer optical path 201, and the display lens group 37 is located in the optical path between the LCOS device 36 and the spectrometer 31. Thus, while a portion of the P light transmitted through the polarization beam splitter 20 is transmitted by the beam splitter 31 and propagates to the first spatial light modulator 32 to be modulated into holographic light, another portion of the P light transmitted through the polarization beam splitter 20 is reflected by the beam splitter 31 and propagates through the display lens group 37 to the LCOS device 36 to be modulated into two-dimensional image light. This allows both the portion of the P light transmitted and the portion reflected by the beam splitter 31 to be utilized for 3D holographic imaging and 2D imaging, respectively, greatly improving light energy utilization. At the same time, the two-dimensional image light modulated by the LCOS device 36, after passing through the display lens group 37 and the beam splitter 31, forms a two-dimensional image aligned with the two-dimensional image source surface 400, thereby forming a spliced ​​2D image with the image transmitted by the DLP display screen 420 to obtain a larger 2D display field of view.

[0091] In a second aspect, an embodiment of the present application may further provide an augmented reality display device, which may include the aforementioned hybrid display optical engine 1 and a device body (not shown in the figure), wherein the hybrid display optical engine 1 is disposed in the device body to perform augmented reality display. It is understood that the device body mentioned in this application may be a head-mounted display device body to form an AR-HMD device, or a head-up display device body to form an AR-HUD device, and this application will not elaborate on this.

[0092] In a third aspect, a hybrid display method according to an embodiment of the present application may include the following steps:

[0093] S100: emitting illumination light along the light path;

[0094] S200: Splitting the illumination light propagating along the light-emitting optical path to form a first polarized illumination light propagating along a first split optical path and a second polarized illumination light propagating along a second split optical path;

[0095] S300: modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and a plurality of split image planes;

[0096] S400: modulating the second polarized illumination light propagating along the second split light path through a two-dimensional image source surface flush with the holographic image surface to form a two-dimensional image light; and

[0097] S500: modulating the holographic image light and the two-dimensional image light through an imaging lens group to form images simultaneously.

[0098] There is no restriction on the order between step S300 and step S400 mentioned in this application. They can be performed simultaneously or staggered within a very short period of time. This application will not elaborate on this.

[0099] For example, in the first example of the present application, step S300 of the hybrid display method may include the following steps:

[0100] S310: transmitting a portion of the first polarized illumination light through a light splitting device to propagate to a first spatial light modulator;

[0101] S320: modulating the portion of illumination light after loading the hologram through the first spatial light modulator to form a first holographic light that propagates back to the optical splitter; and

[0102] S330: Reflecting a portion of the first holographic light through the optical splitter to form a first holographic image light through a Fourier lens group or directly.

[0103] Optionally, compared to the above-mentioned first example of the present application, in the second example of the present application, step S300 of the hybrid display method may further include the following steps:

[0104] S340: Reflecting another portion of the first polarized illumination light through the optical splitter to propagate to a second spatial light modulator;

[0105] S350: modulating another portion of the illumination light after loading the hologram through the second spatial light modulator to form a second holographic light that propagates back to the optical splitter; and

[0106] S360: transmitting a portion of the second holographic light through the optical splitter to form a second holographic image light through a Fourier lens group or directly.

[0107] Optionally, compared to the first example of the present application, in the third example of the present application, step S300 of the hybrid display method may further include the following steps:

[0108] S340′: reflecting another portion of the first polarized illumination light through the optical splitter to propagate to the LCOS device;

[0109] S350': modulating another portion of the illumination light through the LCOS device to form a two-dimensional image light that propagates back to the optical splitter device; and

[0110] S360': transmitting a portion of the two-dimensional image light through the light splitting device to form a two-dimensional picture flush with the two-dimensional image source surface through a Fourier lens group.

[0111] According to the above embodiment of the present application, step S400 of the hybrid display method may include the following steps:

[0112] S410: reflecting the second polarized illumination light through a reflective element to propagate to the DLP display screen;

[0113] S420: Modulating the second polarized illumination light through the DLP display screen to form the two-dimensional image light.

[0114] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0115] The above embodiments merely illustrate several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. A hybrid display optical machine, characterized in that: include: An illumination assembly, for emitting illumination light along a light emitting path; a polarization beam splitter element, the polarization beam splitter element being arranged in the light emitting optical path of the lighting assembly, and having a first beam splitting optical path and a second beam splitting optical path separated from each other, for splitting the illumination light propagating along the light emitting optical path to form a first polarized illumination light propagating along the first beam splitting optical path and a second polarized illumination light propagating along the second beam splitting optical path; a holographic display component, the holographic display component being arranged in the first split light path of the polarization splitting element, and having a holographic image plane and a separation image plane spaced behind the holographic image plane, for modulating the first polarized illumination light to form a holographic image light for generating a holographic reconstruction image at the holographic image plane and the separation image plane; A two-dimensional display component, which is arranged in the second beam splitting light path of the polarization beam splitting element, and has a two-dimensional image source surface flush with the holographic image surface, and is used to modulate the second polarized illumination light to form a two-dimensional image light; as well as An imaging lens group is arranged on the object side of the holographic display component and the two-dimensional display component, and is used to modulate the holographic image light and the two-dimensional image light to simultaneously form an image.

2. The hybrid display optical machine according to claim 1, wherein: The polarization beam splitting element is a polarization beam splitting prism; the holographic display component is located on the transmission side of the polarization beam splitting prism; and the two-dimensional display component is located on the reflection side of the polarization beam splitting prism.

3. The hybrid display optical machine according to claim 1, wherein: The holographic display component includes a beam splitter located on the transmission side of the polarization beam splitter element, a first spatial light modulator arranged on the transmission side of the beam splitter at an angle relative to the first beam splitting optical path, and a Fourier lens group arranged on the reflection side of the beam splitter; wherein the focal plane of the Fourier lens group is flush with the two-dimensional image source plane to provide the holographic image plane.

4. The hybrid display optical machine according to claim 3, wherein: The holographic display component further includes an aperture arranged on the holographic image plane.

5. The hybrid display optical machine according to claim 3, wherein: The holographic display component further includes a second spatial light modulator, which is arranged on a side of the light splitting device away from the Fourier lens group at an angle relative to the first light splitting optical path.

6. The hybrid display optical machine according to claim 3, wherein: The holographic display component further includes a silicon-based liquid crystal device, which is arranged on a side of the light-splitting device away from the Fourier lens group in parallel with the first light-splitting optical path.

7. The hybrid display optical machine according to claim 1, wherein: The holographic display assembly includes a beam splitter located on the transmission side of the polarization beam splitter element and a first spatial light modulator disposed perpendicularly to the first beam splitter optical path on the transmission side of the beam splitter.

8. The hybrid display optical machine according to claim 7, wherein: The holographic display component further includes a second spatial light modulator, which is arranged on a side of the light splitting device away from the imaging lens group in parallel with the first light splitting path.

9. The hybrid display optical machine according to claim 7, wherein: The holographic display component further includes a silicon-based liquid crystal device and a display lens group. The silicon-based liquid crystal device is arranged on a side of the spectroscopic device away from the imaging lens group in parallel with the first spectroscopic optical path, and the display lens group is arranged in the optical path between the silicon-based liquid crystal device and the spectroscopic device.

10. The hybrid display optical engine according to any one of claims 1 to 9, wherein: The two-dimensional display component includes a reflective element located on the reflective side of the polarization beam splitting element and a display device arranged on the reflective side of the reflective element, and the display surface of the display device serves as the two-dimensional image source surface.

11. The hybrid display optical machine according to claim 10, wherein: The reflective element is a reflector obliquely arranged in the second light splitting path; and the display device is a digital light processing display screen.

12. The hybrid display optical engine according to any one of claims 1 to 9, wherein: The lighting assembly includes a laser and a collimating lens group, and the collimating lens group is arranged in the optical path between the laser and the polarization beam splitting element.

13. An augmented reality display device, characterized in that: include: Equipment body; and The hybrid display optical machine as described in any one of claims 1 to 12, wherein the hybrid display optical machine is arranged in the device body to perform augmented reality display.

14. A hybrid display method, characterized in that: include: emitting illumination light along a light-emitting light path; Splitting the illumination light propagating along the light-emitting optical path to form a first polarized illumination light propagating along a first split light path and a second polarized illumination light propagating along a second split light path; modulating the first polarized illumination light propagating along the first split light path to form holographic image light for generating holographic reconstruction images at the holographic image plane and the plurality of separated image planes; Modulating the second polarized illumination light propagating along the second split light path through a two-dimensional image source plane flush with the holographic image plane to form a two-dimensional image light; as well as The holographic image light and the two-dimensional image light are modulated to form images simultaneously through an imaging lens group.

15. The hybrid display method according to claim 14, wherein: The step of modulating the first polarized illumination light propagating along the first split light path to form a holographic image light for generating a holographic reconstruction image at a holographic image plane and a plurality of separated image planes comprises the steps of: transmitting a portion of the first polarized illumination light through a beam splitter to propagate to a first spatial light modulator; After loading the hologram, the first spatial light modulator modulates the portion of illumination light to form a first holographic light that propagates back to the light splitting device; as well as A portion of the first holographic light is reflected by the optical splitter to pass through a Fourier lens group or directly form a first holographic image light.

16. The hybrid display method according to claim 15, wherein: The step of modulating the first polarized illumination light propagating along the first split light path to form a holographic image light for generating a holographic reconstruction image at a holographic image plane and a plurality of separated image planes further comprises the steps of: Reflecting another portion of the first polarized illumination light through the beam splitter to propagate to the second spatial light modulator; Through the second spatial light modulator, after loading the hologram, another part of the illumination light is modulated to form a second holographic light that propagates back to the light splitting device; as well as A portion of the second holographic light is transmitted through the optical splitter to form a second holographic image light through a Fourier lens group or directly.

17. The hybrid display method according to claim 15, wherein: The step of modulating the first polarized illumination light propagating along the first split light path to form a holographic image light for generating a holographic reconstruction image at a holographic image plane and a plurality of separated image planes further comprises the steps of: Reflecting another part of the first polarized illumination light through the beam splitter to propagate to the liquid crystal on silicon device; modulating another portion of the illumination light through the silicon-based liquid crystal device to form a two-dimensional image light that propagates back to the light splitting device; as well as A portion of the two-dimensional image light is transmitted through the light splitting device to form a two-dimensional picture flush with the two-dimensional image source surface through a Fourier lens group.

18. The hybrid display method according to any one of claims 15 to 17, wherein: The step of modulating the second polarized illumination light propagating along the second split light path through the two-dimensional image source plane flush with the holographic image plane to form the two-dimensional image light comprises the steps of: Reflecting the second polarized illumination light through a reflective element to propagate to a digital light processing display screen; The second polarized illumination light is modulated by the digital light processing display screen to form the two-dimensional image light.

Citation Information

Patent Citations

  • Projection device, head-up display device and built-in vision assist system

    CN109031676A

  • Display system, display method thereof and vehicle

    CN109143576A

  • Projection optical system and head-up display device of automobile

    CN112558308A

  • Exposure device and method based on LCOS chip

    CN112947011A

  • Holographic near-eye display system and method based on multiple spatial light modulators

    CN115793239A