A multi-stage multi-dimension controllable augmented reality near-eye display device

Abstract

The application discloses a kind of multi-level multi-dimension controllable augmented reality near-eye display device, which is composed of display collimating module, light control module and display panel.The display collimating module includes display source, absorbing polarizer and collimating mirror, the display source projects different film sources according to the visual effect level, and is modulated through absorbing polarizer and collimating mirror, projects parallel S polarized light;The light control module includes polarization converter, reflective polarizer and reflective film, the light of corresponding area is polarized and modulated according to the visual effect level, and the projection direction is changed;The display panel is optically transparent multiplex holographic optical element, different display functions can be realized according to different projection directions.The device can realize three-level control of visual effect, multi-dimensional mixed display control of two-dimensional and three-dimensional information and arbitrary control of display area.

Description

I. TECHNICAL FIELD

[0001] The present application relates to the field of augmented reality near-eye display technology, and particularly relates to a multi-level and multi-dimension controllable augmented reality near-eye display device. II. BACKGROUND

[0002] Among numerous augmented reality display devices, head-mounted near-eye displays occupy an important position in augmented reality technology due to high immersion, real-time interactivity and wide application fields.

[0003] Traditional head-mounted 3D displays based on binocular parallax 3D display technology are plagued by the problem of vergence-accommodation conflict, which greatly reduces the user's visual comfort and use time. Current solutions include integrated imaging 3D display technology and retinal projection display technology. The retinal projection technology based on Maxwell's observation method focuses the light beam containing image information to the human eye's principal point through an optical system, and then projects it directly onto the retina to form an image visual, which to some extent alleviates the vergence-accommodation conflict problem of traditional near-eye displays, and allows users to focus on real environment objects without affecting the clarity of virtual images, and three-dimensional images can be displayed through binocular parallax with high clarity, but the depth cue of single eye focus is lost, and the 3D sense is weak. The integrated imaging 3D display technology based on geometric optics realizes full-parallax true three-dimensional display through light field images and micro-array structures, and the 3D sense is strong, but the field of view is small and the spatial resolution is low due to the micro-array structure and micro-display screen.

[0004] Traditional 2D / 3D hybrid display schemes are roughly divided into two categories. One is space division multiplexing technology, such as using two groups of projection to project 2D images and 3D images on a concave half-mirror array to present 2D / 3D hybrid images, but the system volume is doubled due to the increase of projector devices. The other method is time division multiplexing technology, which uses the human eye's persistence of vision to make two-dimensional images or three-dimensional images linearly superimposed in space, requiring high response speed display devices, and the pixel utilization efficiency of a single display panel is low. Due to the limitations of reconstructed image quality or system hardware structure, the optical transparent head-mounted near-eye augmented reality display still needs to be further improved. III. SUMMARY

[0005] The present application provides a multi-level and multi-dimension controllable augmented reality near-eye display device, which has the same left and right structures. The single side structure is shown in the accompanying drawings. Figure 1 The device is composed of a display collimating module, a light control module and a display panel, and has four display modes of primary vision, secondary vision, tertiary vision and mixed vision.

[0006] The display collimation module includes a display source, an absorptive polarizer, and a collimating lens. The display source projects different source materials according to the visual effect level: ordinary 2D source materials for Level 1 and Level 2 visual effects, 3D source materials for Level 3 visual effects, and a hybrid 2D / 3D source material for mixed visual effects. The absorptive polarizer has its transmission axis perpendicular to the incident plane and is used to filter light from the display source, generating S-polarized light. The collimating lens is used to collimate the light filtered by the absorptive polarizer, generating parallel S-polarized projected light.

[0007] The light control module includes a polarization converter, a reflective polarizer, and a reflective film. The polarization converter is an active liquid crystal device that achieves pixelated control of the polarization state of incident light by loading a pixelated mask. The pixelated mask is a black-and-white mask with the same outlines as different sub-images in the displayed image. The black areas of the pixelated mask correspond to ordinary 2D images used for primary or secondary vision; light passing through these areas does not change its polarization state. The white areas of the pixelated mask correspond to 3D images used for tertiary vision; light passing through these areas will change from S-polarized light to P-polarized light, as shown in the attached diagram. Figure 2 As shown. The reflective polarizer has the characteristic of reflecting P-polarized light and transmitting S-polarized light, and is used to control the projection light to illuminate the multiplexed holographic optical element at a specific angle θ1. The reflective properties of the reflective film are independent of polarization, and are used to illuminate the multiplexed holographic optical element with the S-polarized light transmitted through the reflective polarizer at a specific angle θ2.

[0008] The display panel is a multiplexed holographic optical element, which also functions as a focusing lens and a lens array. It can reconstruct a 3D image from light irradiated by θ1, focus light irradiated by θ2 onto the pupil, and allow ambient light that does not meet the irradiation conditions to pass directly through the multiplexed holographic optical element.

[0009] The multiplexed holographic optical element is a reflective volume holographic grating, which is made by holographically exposing the holographic material twice.

[0010] The first holographic exposure diagram is attached. Figure 3 As shown, the exposure apparatus includes a lens array and a holographic material. The lens array and the holographic material are parallel and in close contact. Signal light I and reference light I are parallel lights with the same wavelength, and they are located on opposite sides of the holographic material. Signal light I illuminates the holographic material perpendicularly, and reference light I arrives at the holographic material at an incident angle θ1, interfering with signal light I. The optical function of the lens array is recorded on the holographic material, completing the first holographic exposure of the multiplexed holographic optical element.

[0011] The second holographic exposure diagram is attached. Figure 4As shown, the exposure device includes a focusing lens and a holographic material. The focusing lens and the holographic material are parallel and close to each other, the signal light II and the reference light II are parallel lights and have the same wavelength, and the two are located on the two sides of the holographic material. The signal light II vertically irradiates the holographic material, the reference light II is incident on the holographic material at an angle θ2, and interference occurs with the signal light II to record the optical function of the lens array on the holographic material, completing the second holographic exposure of the multiplexed holographic optical element. The difference between the incident angles of the reference light I and the reference light II should be greater than the half-angle bandwidth Δθ of the multiplexed holographic optical element to avoid different incident lights satisfying the Bragg condition from generating mutually interfering reconstructed lights.

[0012] The multiplexed holographic optical element can be a single-layer multiple-exposure structure or a multi-layer single-exposure structure.

[0013] The light path of the multi-level multi-dimensional controllable augmented reality near-eye display device in the first and second visual modes is as shown in the accompanying Figure 5 As shown, the left and right display sources display ordinary 2D images with or without parallax, and the polarization converters are all loaded with black masks. The light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and all the generated projection light is S-polarized light. At this time, the projection light transmits through the reflective polarizer and is reflected by the reflective film to irradiate the multiplexed holographic optical element in parallel at an angle θ2, and then is directly focused in the pupil to realize retinal 2D or 3D display.

[0014] The light path of the multi-level multi-dimensional controllable augmented reality near-eye display device in the third visual mode is as shown in the accompanying Figure 6 As shown, the left and right display sources display light field images containing 3D information, and the polarization converters are all loaded with white masks. The light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and all the generated projection light is P-polarized light. At this time, the projection light is reflected by the reflective polarizer to irradiate the multiplexed holographic optical element in parallel at an angle θ1, is reconstructed as a 3D image, and realizes integrated imaging 3D display.

[0015] In the mixed vision mode, the left and right display sources display ordinary 2D images without parallax or with parallax and light field images containing 3D information, the polarization converter loads a black-and-white mixed mask corresponding to the profiles of the ordinary images and the light field images, the light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and the generated projection light is mixed projection light of S-polarized light and P-polarized light. At this time, the P-polarized light in the mixed projection light is reflected by the reflective polarizer, is parallelly irradiated at an angle of θ1 to the multiplex holographic optical element, and is reconstructed as a 3D image. The remaining S-polarized light in the mixed projection light transmits through the reflective polarizer, is reflected by the reflective film, is parallelly irradiated at an angle of θ2 to the multiplex holographic optical element, and is then directly focused in the pupil. Thus, 2D / 3D mixed display combining retinal 2D display and integrated imaging 3D display is realized.

[0016] The application provides a multi-level and multi-dimensional controllable augmented reality near-eye display device, which can realize three-level control of visual effects, multi-dimensional mixed display control of two-dimensional and three-dimensional information and arbitrary control of display areas through polarization conversion, reflective polarizer and reflective film, effectively improves the pixel utilization efficiency of a single display panel, is simple in structure and easy to miniaturize, combines retinal projection technology and integrated imaging display, effectively avoids the shortcomings of single display technology, is suitable for various application scenarios and processors with different computing capabilities, and has potential development and application value. IV. BRIEF DESCRIPTION OF DRAWINGS

[0017] FIG. 1 is a single-side schematic view of a multi-level and multi-dimensional controllable augmented reality near-eye display device according to the application. Figure 1 FIG. 1 is a single-side schematic view of a multi-level and multi-dimensional controllable augmented reality near-eye display device according to the application.

[0018] FIG. 2 is a schematic view of the polarization state change of the light emitted after the light is incident on different regions of the polarization converter. Figure 2 FIG. 2 is a schematic view of the polarization state change of the light emitted after the light is incident on different regions of the polarization converter.

[0019] FIG. 3 is a schematic view of the first holographic exposure light path of the multiplex holographic optical element. Figure 3 FIG. 3 is a schematic view of the first holographic exposure light path of the multiplex holographic optical element.

[0020] FIG. 4 is a schematic view of the second holographic exposure light path of the multiplex holographic optical element. Figure 4 FIG. 4 is a schematic view of the second holographic exposure light path of the multiplex holographic optical element.

[0021] FIG. 5 is a schematic view of the light path of the device in the first and second vision modes according to the application. Figure 5 FIG. 5 is a schematic view of the light path of the device in the first and second vision modes according to the application.

[0022] FIG. 6 is a schematic view of the light path of the device in the third vision mode according to the application. Figure 6 FIG. 6 is a schematic view of the light path of the device in the third vision mode according to the application.

[0023] The reference signs in the drawings are as follows:

[0024] 1 display source, 2 absorbing polarizer, 3 collimator, 400 polarization converter, 401 polarization converter black mask part, 402 polarization converter white mask part, 5 reflective polarizer, 6 reflective film, 7 multiplexing holographic optical element, 8 viewer, 9 S polarized projection light, 10 P polarized projection light, 11 signal light I, 12 lens array, 13 holographic material, 14 reference light I, 15 signal light II, 16 focusing lens, 17 reference light II, 18 reproduced light I, 19 reverse extension line of reproduced light I, 20 virtual 2D image, 21 reproduced light II, 22 reverse extension line of the same object point reproduced light, 23 virtual 3D image.

[0025] It should be understood that the above-mentioned drawings are only schematic and not drawn to scale. V. Specific implementation method

[0026] A typical embodiment of a multi-level multi-dimensional controllable augmented reality near-eye display device of the present application will be described in detail below, and the present application will be further described in detail. It is necessary to point out here that the following embodiment is only used to further illustrate the present application and cannot be understood as limiting the protection scope of the present application. Those skilled in the art can make some non-essential improvements and adjustments to the present application according to the above content of the present application, which still belongs to the protection scope of the present application.

[0027] The present application provides a multi-level multi-dimensional controllable augmented reality near-eye display device, which has the same structure on the left and right sides, and a single-sided structure as shown in the accompanying drawings. Figure 1 The device is composed of a display collimation module, a light control module and a display panel, and has four display modes of primary vision, secondary vision, tertiary vision and mixed vision.

[0028] The display collimation module comprises a display source, an absorbing polarizer and a collimator. The display source projects different film sources according to the visual effect level, projects ordinary 2D film sources under primary and secondary vision, projects 3D film sources under tertiary vision, and projects 2D / 3D mixed film sources under mixed vision; the transmission axis of the absorbing polarizer is perpendicular to the incident plane, and is used to filter light from the display source to produce S polarized light; the collimator is used to collimate the light filtered by the absorbing polarizer to produce parallel S polarized projection light.

[0029] The light control module comprises a polarization converter, a reflective polarizer and a reflective film. The polarization converter is an active liquid crystal device, which controls the polarization state of incident light by loading a pixelated mask. The pixelated mask is a black-and-white mask with the same profile as different sub-images in the display image. The black area of the pixelated mask corresponds to the common 2D image for primary or secondary vision, and the light passing through this area does not change the polarization state; the white area of the pixelated mask corresponds to the 3D image for tertiary vision, and the light passing through this area will be converted from S-polarized light to P-polarized light, as shown in the accompanying Figure 2 The reflective polarizer has the characteristics of reflecting P-polarized light and transmitting S-polarized light, which is used to control the projection light to be irradiated at a specific angle of 35° onto the multiplexed holographic optical element. The reflective film has a reflective characteristic independent of polarization, which is used to irradiate the S-polarized light transmitted by the reflective polarizer at a specific angle of 45° onto the multiplexed holographic optical element.

[0030] The display panel, i.e. the multiplexed holographic optical element, has the functions of focusing lens and lens array at the same time, which can reconstruct the light irradiated at 35° into a 3D image and focus the light irradiated at 45° to the pupil, and other ambient light not meeting the irradiation conditions is directly transmitted through the multiplexed holographic optical element.

[0031] The multiplexed holographic optical element is a reflective volume holographic grating, which is made by twice holographic exposure of holographic material.

[0032] The first holographic exposure schematic diagram is shown in the accompanying Figure 3 The exposure device comprises a lens array and a holographic material, and the focal length of the lens array is -14 mm. The lens array and the holographic material are parallel and in close contact, the signal light I and the reference light I are parallel light and have the same wavelength, and they are located on the two sides of the holographic material respectively. The signal light I irradiates the holographic material vertically, and the reference light I is incident on the holographic material at an angle of 35° and interferes with the signal light I, recording the optical function of the lens array on the holographic material, completing the first holographic exposure of the multiplexed holographic optical element.

[0033] The second holographic exposure schematic diagram is shown in the accompanying Figure 4As shown, the exposure device includes a focusing lens and a holographic material, the back intercept of the focusing lens is 26mm. The focusing lens and the holographic material are parallel and close, the signal light II and the reference light II are parallel light and have the same wavelength, and the two are located on the two sides of the holographic material. The signal light II vertically irradiates the holographic material, the reference light II is incident on the holographic material at an angle of 45°, and interference occurs with the signal light II, and the optical function of the lens array is recorded on the holographic material, completing the second holographic exposure of the multiplexed holographic optical element. The difference between the incident angles of the reference light I and the reference light II should be greater than 10° of the half-angle bandwidth of the multiplexed holographic optical element, so as to avoid the generation of mutually interfering reproduced light by different incident lights satisfying the Bragg condition.

[0034] The multiplexed holographic optical element can be a single-layer multiple-exposure structure or a multi-layer single-exposure structure.

[0035] The light path of the multi-level multi-dimensional controllable augmented reality near-eye display device in the first and second visual modes is as shown in the accompanying Figure 5 As shown, the left and right display sources display ordinary 2D images with or without parallax, and the polarization converters are all loaded with black masks. The light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and all the generated projection light is S-polarized light. The projection light has the same wavelength as the reference light II, and the wavelength is 532nm. At this time, the projection light is reflected by the reflective polarizer and reflected by the reflective film, and is parallelly irradiated on the multiplexed holographic optical element at an angle of 45°. The generated reproduced light I is directly focused in the pupil at 26mm, realizing retinal 2D or 3D display.

[0036] The light path of the multi-level multi-dimensional controllable augmented reality near-eye display device in the third visual mode is as shown in the accompanying Figure 6 As shown, the left and right display sources display light field images containing 3D information, and the polarization converters are all loaded with white masks. The light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and all the generated projection light is P-polarized light. The projection light has the same wavelength as the reference light I, and the wavelength is 532nm. At this time, the projection light is reflected by the reflective polarizer, and is parallelly irradiated on the multiplexed holographic optical element at an angle of 35°. A spherical wave array with a focal length of -14mm is generated, a central depth plane is generated at -14mm, and a 3D image is reconstructed near the central depth plane, realizing integrated imaging 3D display.

[0037] In the mixed vision mode, the display sources on the left and right display ordinary 2D images without parallax or with parallax and light field images containing 3D information without parallax or with parallax. The polarization converter loads a black-and-white mixed mask corresponding to the profiles of the ordinary images and the light field images. The light of the display source passes through the absorbing polarizer, the collimating mirror and the polarization converter, and the generated projection light is mixed projection light of S-polarized light and P-polarized light, and the wavelength of the projection light is still 532 nm. At this time, the P-polarized light in the mixed projection light is reflected by the reflective polarizer and is parallelly irradiated at an angle of 35° to the multiplexed holographic optical element and is reconstructed as a 3D image. The remaining S-polarized light in the mixed projection light transmits through the reflective polarizer and is reflected by the reflective film and is parallelly irradiated at an angle of 45° to the multiplexed holographic optical element and is then directly focused in the pupil. Thus, 2D / 3D hybrid display combining retinal 2D display and integrated imaging 3D display is realized.

[0038] In the embodiment, by modulating the projection light of different contents by the polarization converter, the reflective polarizer and the reflective film, three-level control of visual effects, multi-dimensional hybrid display control of two-dimensional and three-dimensional information and arbitrary control of display areas can be realized, the pixel utilization efficiency of a single display panel is effectively improved, the structure is simple and easy to miniaturize, the retinal projection technology and the integrated imaging display are combined, the disadvantages of a single display technology are effectively avoided, various application scenarios and processors with different computing capabilities are adapted, and potential development and application value is achieved.

Claims

1. A multi-level, multi-dimensional controllable augmented reality near-eye display device, characterized in that, The device comprises a display collimation module, a light control module, and a display panel. The display collimation module includes a display source, an absorptive polarizer, and a collimating lens. The display source projects different source materials according to the visual effect level: ordinary 2D source materials under first and second-level visual perception, 3D source materials under third-level visual perception, and a hybrid 2D / 3D source material under mixed visual perception. The transmission axis of the absorptive polarizer is perpendicular to the incident plane, used to filter light from the display source and generate S-polarized light. The collimating lens is used to collimate the light filtered by the absorptive polarizer, generating parallel S-polarized projection light. The light control module includes a polarization converter, a reflective polarizer, and a reflective film. The polarization converter is an active liquid crystal device that achieves pixelated control of the polarization state of the incident light by loading a pixelated mask. The pixelated mask is a black and white mask with the same outline as different sub-images in the displayed image. The black area of ​​the film corresponds to a normal 2D image used for primary or secondary vision. Light passing through this area will not change its polarization state. The white area of ​​the pixelated mask corresponds to a 3D image used for tertiary vision. Light passing through this area will change from S-polarized light to P-polarized light. The reflective polarizer has the characteristic of reflecting P-polarized light and transmitting S-polarized light, and is used to control the projection light to illuminate the multiplexed holographic optical element at an angle θ1. The reflective properties of the reflective film are independent of polarization, and are used to illuminate the multiplexed holographic optical element at an angle θ2 of the S-polarized light transmitted through the reflective polarizer. The display panel is the multiplexed holographic optical element, which also has the functions of a focusing lens and a lens array. It can reconstruct a 3D image from the light illuminating at θ1, focus the light illuminating at θ2 onto the pupil, and allow ambient light that does not meet the illumination conditions to pass directly through the multiplexed holographic optical element.

2. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that, The multiplexed holographic optical element is a reflective volume holographic grating, fabricated by two holographic exposures of the holographic material. The first holographic exposure device includes a lens array and the holographic material, which are parallel and in close contact. Signal light I and reference light I are parallel beams with the same wavelength, located on opposite sides of the holographic material. Signal light I illuminates the holographic material perpendicularly, while reference light I arrives at the holographic material at an incident angle θ1 and interferes with signal light I. The optical function of the lens array is recorded on the holographic material, completing the process described above. The first holographic exposure of the multiplexed holographic optical element; the second holographic exposure device includes a focusing lens and a holographic material, the focusing lens and the holographic material are parallel and closely attached, the signal light II and the reference light II are parallel lights with the same wavelength, and they are located on opposite sides of the holographic material. The signal light II illuminates the holographic material perpendicularly, and the reference light II is incident on the holographic material at an incident angle θ2 and interferes with the signal light II. The optical function of the lens array is recorded on the holographic material, thus completing the second holographic exposure of the multiplexed holographic optical element.

3. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that, In primary and secondary visual modes, the left and right display sources display ordinary 2D images with or without parallax. The polarization converter is then fully loaded with a black mask. The light from the display source passes through the absorptive polarizer, collimating lens, and polarization converter, and all the projected light generated is S-polarized light. At this time, the projected light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element at an angle of θ2. Then, it is directly focused into the pupil to realize retinal 2D or 3D display.

4. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that, In the three-level visual mode, the left and right display sources display light field images containing 3D information. The polarization converter is fully loaded with a white mask. The light from the display source passes through the absorptive polarizer, collimating lens and polarization converter, and all the projected light is P-polarized light. At this time, the projected light is reflected by the reflective polarizer and illuminates the multiplexed holographic optical element at an angle of θ1, and is reconstructed into a 3D image, realizing integrated imaging 3D display.

5. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that, In the hybrid vision mode, the left and right display sources display ordinary 2D images with or without parallax and light field images containing 3D information. The polarization converter loads a black-and-white hybrid mask corresponding to the outlines of the ordinary image and the light field image. The light from the display source passes through the absorptive polarizer, collimating lens, and polarization converter, and the resulting projection light is a hybrid projection light of S-polarized light and P-polarized light. At this time, the P-polarized light in the hybrid projection light is reflected by the reflective polarizer and illuminates the multiplexed holographic optical element at an angle θ1, and is reconstructed into a 3D image. The remaining S-polarized light in the hybrid projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element at an angle θ2, and is then directly focused into the pupil, thereby realizing a 2D / 3D hybrid display that combines retinal 2D display and integrated imaging 3D display.

6. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that, The multiplexed holographic optical element is a single-layer multiple exposure structure or a multi-layer single exposure structure.

7. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 2, characterized in that, The difference in incident angle between the first holographic exposure reference light I and the second holographic exposure reference light II should be greater than the half-angle bandwidth Δθ of the multiplexed holographic optical element to avoid crosstalk between incident lights that do not meet the Bragg condition.

Images