Multistage multi-dimensional controllable augmented reality near-to-eye display device

Abstract

The invention discloses a multi-stage and multi-dimensional controllable augmented reality near-to-eye display device. The device is composed of a display collimation module, a light control module and a display panel. The display collimation module comprises a display source, an absorption type polaroid and a collimating mirror, the display source projects different film sources according to visual effect levels, and parallel S polarized light is projected through modulation of the absorption type polaroid and the collimating mirror; the light-operated module comprises a polarization converter, a reflective polaroid and a reflective film, performs polarization modulation on the light in the corresponding area according to the visual effect grade, and changes the projection direction; the display panel is an optically transparent multiplexing type holographic optical element, and can realize different display functions according to different projection directions. The device can realize three-level control of a visual effect, multi-dimensional mixed display control of two-dimensional and three-dimensional information and arbitrary control of a display area.

Description

1. Technical Field

[0001] The present invention relates to the field of augmented reality near-eye display technology, and in particular to a multi-level and multi-dimensional controllable augmented reality near-eye display device. 2. Background Technology

[0002] Among the numerous augmented reality display devices, head-mounted near-eye displays occupy an important position in augmented reality technology due to their high immersion, real-time interactivity and wide range of applications.

[0003] Traditional head-mounted 3D displays based on binocular parallax 3D display technology are deeply troubled by the problem of convergence-accommodation conflict, which greatly reduces the user's visual comfort and usage time. Current solutions include integrated imaging 3D display technology and retinal projection display technology. Retinal projection technology based on Maxwell observation method focuses the light beam containing image information to the principal point of the human eye lens through an optical system, and then directly projects it onto the retina to form image vision, which alleviates the convergence-accommodation conflict problem of traditional near-eye displays to a certain extent, and also allows users to focus and see real environment objects without affecting the clarity of virtual images. In addition, binocular parallax can be used to display three-dimensional stereo images with high clarity, but the depth clues of monocular focus adjustment are lost, and the 3D sense is weak. Integrated imaging 3D display technology based on geometric optics realizes full parallax true three-dimensional display through light field images combined with micro-array structure, with a strong sense of 3D, but limited by the micro-array structure and micro-display screen, the field of view is small and the spatial resolution is low.

[0004] Traditional 2D / 3D hybrid display solutions can be roughly divided into two categories. One is space division multiplexing technology, such as using two sets of projections to project 2D images and 3D images onto a concave half-mirror array, thereby presenting a 2D / 3D hybrid image, but due to the increase in projector equipment, the system volume doubles. Another method is time division multiplexing technology, which uses the persistence effect of the human eye to linearly superimpose two-dimensional images or three-dimensional images in space. It requires a display device with a high response speed, and the pixel utilization efficiency of a single display panel is low. Due to the limitations of the reconstructed image quality or the system hardware structure, the optically transparent head-mounted near-eye augmented reality display still needs further improvement. III. Summary of the invention

[0005] The present invention proposes a multi-level and multi-dimensional controllable augmented reality near-eye display device, the left and right structures are the same, and the single-side structure is as shown in the attached Figure 1 As shown, the device consists of a display collimation module, a light control module and a display panel, and the device has four modes of primary vision, secondary vision, tertiary vision and mixed vision display.

[0006] The display collimation module comprises a display source, an absorption polarizer and a collimator. The display source projects different film sources according to the visual effect level, projects ordinary 2D film sources under primary and secondary vision, projects 3D film sources under tertiary vision, and projects 2D / 3D mixed film sources under mixed vision; the transmission axis of the absorption polarizer is perpendicular to the incident surface, and is used to filter the light from the display source to generate S-polarized light; the collimator is used to collimate the light filtered by the absorption polarizer to generate parallel S-polarized projection light.

[0007] The light control module includes a polarization converter, a reflective polarizer and a reflective film. The polarization converter is an active liquid crystal device that realizes pixelated control of the polarization state of the incident light by loading a pixelated mask. The pixelated mask is a black and white mask with the same outline as the different sub-images in the displayed image. The black area of ​​the pixelated mask corresponds to an ordinary 2D image for primary or secondary vision, and the light passing through this area will not change the polarization state; the white area of ​​the pixelated mask corresponds to a 3D image for tertiary vision, and the light passing through this area will be converted from S polarized light to P polarized light, as shown in the attached figure. Figure 2 As shown. The reflective polarizer has the property of reflecting P polarized light and transmitting S polarized light, and is used to control the projection light to irradiate the multiplexed holographic optical element at a specific angle θ1. The reflective property of the reflective film is independent of polarization, and is used to irradiate the S polarized light that has transmitted the reflective polarizer onto the multiplexed holographic optical element at a specific angle θ2.

[0008] The display panel is a multiplexed holographic optical element, which has the functions of a focusing lens and a lens array. It can reconstruct the light irradiated by θ1 into a 3D image and focus the light irradiated by θ2 to the pupil. Other ambient light that does not meet the irradiation conditions directly passes through the multiplexed holographic optical element.

[0009] The multiplexed holographic optical element is a reflective volume holographic grating, which is produced by double holographic exposure of a holographic material.

[0010] The first holographic exposure diagram is as follows Figure 3 As shown, the exposure device includes a lens array and a holographic material. The lens array and the holographic material are parallel and close to each other, and the signal light I and the reference light I are parallel lights with the same wavelength, and are located on both sides of the holographic material. The signal light I irradiates the holographic material vertically, and the reference light I is incident on the holographic material at an angle of θ1 and interferes with the signal light I, and the optical function of the lens array is recorded on the holographic material, completing the first holographic exposure of the multiplexed holographic optical element.

[0011] The second holographic exposure diagram is as attached Figure 4As shown, the exposure device includes a focusing lens and a holographic material. The focusing lens and the holographic material are parallel and close to each other, and the signal light II and the reference light II are parallel lights with the same wavelength, and are respectively located on both sides of the holographic material. The signal light II irradiates the holographic material vertically, and the reference light II is incident on the holographic material at an angle of incidence θ2, and interferes with the signal light II, and the optical function of the lens array is recorded on the holographic material, completing the second holographic exposure of the multiplexed holographic optical element. The difference between the incident angles of the reference light I and the reference light II should be greater than the half-angle bandwidth Δθ of the multiplexed holographic optical element to avoid the generation of crosstalk reproduction light by different incident lights that meet the Bragg condition.

[0012] The multiplexed holographic optical element may be a single-layer multiple-exposure structure or a multi-layer single-exposure structure.

[0013] The optical paths of the multi-level, multi-dimensional, controllable augmented reality near-eye display device in the primary and secondary visual modes are shown in the attached Figure 5 As shown, the display source displays a normal 2D image with or without parallax, and the polarization converter is fully loaded with a black mask. The light of the display source passes through the absorption polarizer, collimator and polarization converter, and all the projection light generated is S polarized light. At this time, the projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element in parallel at an angle of θ2, and then is directly focused in the pupil to achieve retinal 2D or 3D display.

[0014] The optical path of the multi-level, multi-dimensional controllable augmented reality near-eye display device in the three-level visual mode is as shown in the attached figure. Figure 6 As shown, the display source displays a light field image containing 3D information, and the polarization converter is fully loaded with a white mask. The light of the display source passes through the absorption polarizer, collimator and polarization converter, and all the projection light generated is P polarized light. At this time, the projection light is reflected by the reflective polarizer, and illuminates the multiplexed holographic optical element in parallel at an angle of θ1, and is reconstructed into a 3D image, realizing integrated imaging 3D display.

[0015] In the hybrid vision mode, the multi-level, multi-dimensional controllable augmented reality near-eye display device displays ordinary 2D images with or without parallax and light field images containing 3D information on the left and right display sources. The polarization converter will load a black and white mixed mask corresponding to the outlines of the ordinary image and the light field image. The light from the display source passes through the absorption polarizer, the collimator and the polarization converter, and the generated projection light is a mixed projection light of S polarized light and P polarized light. At this time, the P polarized light in the mixed projection light is reflected by the reflective polarizer, and illuminates the multiplexed holographic optical element in parallel at an angle of θ1, and is reconstructed into a 3D image. The remaining S polarized light in the mixed projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element in parallel at an angle of θ2, and is then directly focused in the pupil. Thereby, a 2D / 3D hybrid display combining retinal 2D display and integrated imaging 3D display is realized.

[0016] The present invention provides a multi-level and multi-dimensional controllable augmented reality near-eye display device. The device modulates projection light of different contents through a polarization converter, a reflective polarizer and a reflective film, so as to realize three-level control of visual effects, multi-dimensional mixed display control of two-dimensional and three-dimensional information and arbitrary control of the display area, effectively improving the pixel utilization efficiency of a single display panel, having a simple structure and being easy to miniaturize, combining retinal projection technology with integrated imaging display, effectively avoiding the shortcomings of a single display technology, adapting to a variety of application scenarios and processors with different computing capabilities, and having potential development and application value. IV. Description of the drawings

[0017] Attached Figure 1 A schematic diagram of a multi-level, multi-dimensional, controllable augmented reality near-eye display device Attached Figure 2 Schematic diagram of the change in polarization state of the outgoing light after the light is incident on different areas of the polarization converter Attached Figure 3 Schematic diagram of the optical path for the first holographic exposure of a multiplexed holographic optical element

[0018] Attached Figure 4 Schematic diagram of the second holographic exposure optical path of the multiplexed holographic optical element

[0019] Attached Figure 5 Schematic diagram of the optical path of the device of the present invention in the primary and secondary visual modes

[0020] Attached Figure 6 Schematic diagram of the optical path of the device of the present invention in the three-level visual mode

[0021] The diagrammatic numbers in the accompanying drawings are:

[0022] 1 display source, 2 absorption polarizer, 3 collimator, 400 polarization converter, 401 black mask part of polarization converter, 402 white mask part of polarization converter, 5 reflection polarizer, 6 reflection film, 7 multiplexed holographic optical element, 8 viewer, 9S polarized projection light, 10P polarized projection light, 11 signal light I, 12 lens array, 13 holographic material, 14 reference light I, 15 signal light II, 16 focusing lens, 17 reference light II, 18 reproduction light I, 19 reverse extension line of reproduction light I, 20 virtual 2D image, 21 reproduction light II, 22 reverse extension line of reproduction light of the same object point, 23 virtual 3D image.

[0023] It should be understood that the above drawings are only schematic and are not drawn to scale. V. Specific implementation methods

[0025] A typical embodiment of a multi-level, multi-dimensional, controllable augmented reality near-eye display device of the present invention is described in detail below, and the present invention is further described in detail. It is necessary to point out here that the following embodiments are only used to further illustrate the present invention and cannot be understood as limiting the scope of protection of the present invention. Personnel skilled in the art in this field may make some non-essential improvements and adjustments to the present invention based on the above content of the present invention, which still fall within the scope of protection of the present invention.

[0026] The present invention proposes a multi-level and multi-dimensional controllable augmented reality near-eye display device, the left and right structures are the same, and the single-side structure is as shown in the attached Figure 1 As shown, the device consists of a display collimation module, a light control module and a display panel, and the device has four modes of primary vision, secondary vision, tertiary vision and mixed vision display.

[0027] The display collimation module comprises a display source, an absorption polarizer and a collimator. The display source projects different film sources according to the visual effect level, projects ordinary 2D film sources under primary and secondary vision, projects 3D film sources under tertiary vision, and projects 2D / 3D mixed film sources under mixed vision; the transmission axis of the absorption polarizer is perpendicular to the incident surface, and is used to filter the light from the display source to generate S-polarized light; the collimator is used to collimate the light filtered by the absorption polarizer to generate parallel S-polarized projection light.

[0028] The light control module includes a polarization converter, a reflective polarizer and a reflective film. The polarization converter is an active liquid crystal device that realizes pixelated control of the polarization state of the incident light by loading a pixelated mask. The pixelated mask is a black and white mask with the same outline as the different sub-images in the displayed image. The black area of ​​the pixelated mask corresponds to an ordinary 2D image for primary or secondary vision, and the light passing through this area will not change the polarization state; the white area of ​​the pixelated mask corresponds to a 3D image for tertiary vision, and the light passing through this area will be converted from S polarized light to P polarized light, as shown in the attached figure. Figure 2 The reflective polarizer has the property of reflecting P polarized light and transmitting S polarized light, and is used to control the projection light to irradiate the multiplexed holographic optical element at a specific angle of 35°. The reflective property of the reflective film is independent of polarization, and is used to irradiate the S polarized light transmitted through the reflective polarizer onto the multiplexed holographic optical element at a specific angle of 45°.

[0029] The display panel is a multiplexed holographic optical element, which has the functions of a focusing lens and a lens array. It can reconstruct the light irradiated at 35° into a 3D image and focus the light irradiated at 45° to the pupil. Other ambient light that does not meet the irradiation conditions directly passes through the multiplexed holographic optical element.

[0030] The multiplexed holographic optical element is a reflective volume holographic grating, which is produced by double holographic exposure of a holographic material.

[0031] The first holographic exposure diagram is as follows Figure 3 As shown, the exposure device includes a lens array and a holographic material, and the focal length of the lens array is -14mm. The lens array and the holographic material are parallel and close to each other, and the signal light I and the reference light I are parallel lights with the same wavelength, and are located on both sides of the holographic material. The signal light I irradiates the holographic material vertically, and the reference light I is incident on the holographic material at an angle of 35° and interferes with the signal light I, and the optical function of the lens array is recorded on the holographic material, completing the first holographic exposure of the multiplexed holographic optical element.

[0032] The second holographic exposure diagram is as attached Figure 4As shown, the exposure device includes a focusing lens and a holographic material, and the focusing lens has a back intercept of 26 mm. The focusing lens and the holographic material are parallel and close to each other, and the signal light II and the reference light II are parallel lights with the same wavelength, and are respectively located on both sides of the holographic material. The signal light II irradiates the holographic material vertically, and the reference light II is incident on the holographic material at an angle of 45°, and interferes with the signal light II, and the optical function of the lens array is recorded on the holographic material, completing the second holographic exposure of the multiplexed holographic optical element. The difference between the incident angles of the reference light I and the reference light II should be greater than the half-angle bandwidth of the multiplexed holographic optical element of 10°, so as to avoid the generation of crosstalk reproduction light by different incident lights that meet the Bragg condition.

[0033] The multiplexed holographic optical element may be a single-layer multiple-exposure structure or a multi-layer single-exposure structure.

[0034] The optical paths of the multi-level, multi-dimensional, controllable augmented reality near-eye display device in the primary and secondary visual modes are shown in the attached Figure 5 As shown, the display source on the left and right displays a normal 2D image with or without parallax, and the polarization converter is fully loaded with a black mask. The light of the display source passes through the absorption polarizer, collimator and polarization converter, and all the projection light generated is S polarized light. The projection light has the same wavelength as the reference light II, which is 532nm. At this time, the projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element at an angle of 45°. The generated reproduction light I is directly focused in the pupil at 26mm, realizing retinal 2D or 3D display.

[0035] The optical path of the multi-level, multi-dimensional controllable augmented reality near-eye display device in the three-level visual mode is as shown in the attached figure. Figure 6 As shown, the display source on the left and right displays a light field image containing 3D information, and the polarization converter is fully loaded with a white mask. The light of the display source passes through the absorption polarizer, collimator and polarization converter, and all the projection light generated is P polarized light. The projection light has the same wavelength as the reference light I, which is 532nm. At this time, the projection light is reflected by the reflective polarizer, and illuminates the multiplexed holographic optical element in parallel at an angle of 35°, generating a spherical wave array with a focal length of -14mm, generating a central depth plane at -14mm, and reconstructing a 3D image near the central depth plane, realizing integrated imaging 3D display.

[0036] In the hybrid vision mode, the multi-level, multi-dimensional controllable augmented reality near-eye display device displays ordinary 2D images with or without parallax and light field images containing 3D information on the left and right display sources. The polarization converter will load a black and white mixed mask corresponding to the outlines of the ordinary image and the light field image. The light from the display source passes through the absorption polarizer, collimator and polarization converter, and the generated projection light is a mixed projection light of S polarized light and P polarized light, and the wavelength of the projection light is still 532nm. At this time, the P polarized light in the mixed projection light is reflected by the reflective polarizer, and illuminates the multiplexed holographic optical element in parallel at an angle of 35°, and is reconstructed into a 3D image. The remaining S polarized light in the mixed projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element in parallel at an angle of 45°, and is then directly focused in the pupil. Thereby, a 2D / 3D hybrid display combining retinal 2D display and integrated imaging 3D display is realized.

[0037] In this embodiment, projection light of different contents is modulated by a polarization converter, a reflective polarizer, and a reflective film, so that three-level control of visual effects, multi-dimensional mixed display control of two-dimensional and three-dimensional information, and arbitrary control of the display area can be achieved, which effectively improves the pixel utilization efficiency of a single display panel. The structure is simple and easy to miniaturize, and retinal projection technology and integrated imaging display are combined to effectively avoid the shortcomings of a single display technology. It is adaptable to a variety of application scenarios and processors with different computing capabilities, and has potential development and application value.

Claims

1. A multi-level and multi-dimensional controllable augmented reality near-eye display device, characterized in that: The device is composed of a display collimation module, a light control module and a display panel; the display collimation module comprises a display source, an absorption polarizer and a collimator; the display source projects different film sources according to the visual effect level, projects ordinary 2D film sources under primary and secondary vision, projects 3D film sources under tertiary vision, and projects 2D / 3D mixed film sources under mixed vision; the transmission axis of the absorption polarizer is perpendicular to the incident surface, and is used to filter the light from the display source to generate S-polarized light; the collimator is used to collimate the light filtered by the absorption polarizer to generate parallel S-polarized projection light; the light control module comprises a polarization converter, a reflective polarizer and a reflective film; the polarization converter is an active liquid crystal device, which realizes pixelated control of the polarization state of the incident light by loading a pixelated mask; the pixelated mask is a black and white mask with the same outline as different sub-images in the displayed image, wherein the pixelated mask The black area corresponds to an ordinary 2D image for primary or secondary vision, and the light will not change the polarization state when passing through this area. The white area of ​​the pixelated mask corresponds to a 3D image for tertiary vision, and the light will be converted from S polarized light to P polarized light when passing through this area. The reflective polarizer has the characteristics of reflecting P polarized light and transmitting S polarized light, and is used to control the projection light to irradiate the multiplexed holographic optical element at a specific angle θ1. The reflective property of the reflective film is independent of polarization, and is used to irradiate the S polarized light that passes through the reflective polarizer onto the multiplexed holographic optical element at a specific angle θ2. The display panel is a multiplexed holographic optical element, and has the functions of a focusing lens and a lens array. It can reconstruct the light irradiated with θ1 into a 3D image, and focus the light irradiated with θ2 to the pupil. Other ambient light that does not meet the irradiation conditions directly passes through the multiplexed holographic optical element.

2. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: The multiplexed holographic optical element is a reflective volume holographic grating, which is made by holographically exposing the holographic material twice; the first holographic exposure device includes a lens array and a holographic material, the lens array and the holographic material are parallel and close to each other, the signal light I and the reference light I are parallel lights, and have the same wavelength, and are respectively located on both sides of the holographic material, the signal light I irradiates the holographic material vertically, the reference light I is incident on the holographic material at an angle of θ1, and interferes with the signal light I, and the optical function of the lens array is recorded on the holographic material, completing the The first holographic exposure of the multiplexed holographic optical element; the second holographic exposure device includes a focusing lens and a holographic material, the focusing lens and the holographic material are parallel and close to each other, the signal light II and the reference light II are parallel lights and have the same wavelength, and are respectively located on both sides of the holographic material, the signal light II irradiates the holographic material vertically, the reference light II reaches the holographic material at an incident angle θ2 and interferes with the signal light II, and the optical function of the lens array is recorded on the holographic material, thereby completing the second holographic exposure of the multiplexed holographic optical element.

3. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: In the primary and secondary visual modes, the left and right display sources display ordinary 2D images with or without parallax, and the polarization converters are all loaded with black masks. The light from the display source passes through the absorption polarizer, the collimator and the polarization converter, and all the projection light generated is S-polarized light. At this time, the projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element in parallel at an angle of θ2, and then is directly focused in the pupil to achieve retinal 2D or 3D display.

4. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: In the three-level visual mode, the left and right display sources display light field images containing 3D information, and the polarization converters are all loaded with white masks. The light from the display source passes through the absorption polarizer, the collimator and the polarization converter, and all the projection light generated is P polarized light. At this time, the projection light is reflected by the reflective polarizer and illuminates the multiplexed holographic optical element in parallel at an angle of θ1, and is reconstructed into a 3D image, realizing integrated imaging 3D display.

5. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: In the mixed vision mode, the left and right display sources display ordinary 2D images with or without parallax and light field images containing 3D information. The polarization converter will load a black and white mixed mask corresponding to the outlines of the ordinary image and the light field image. The light from the display source passes through the absorption polarizer, collimator and polarization converter, and the generated projection light is a mixed projection light of S polarized light and P polarized light. At this time, the P polarized light in the mixed projection light is reflected by the reflective polarizer, and illuminates the multiplexed holographic optical element in parallel at an angle of θ1, and is reconstructed into a 3D image. The remaining S polarized light in the mixed projection light passes through the reflective polarizer, is reflected by the reflective film, and illuminates the multiplexed holographic optical element in parallel at an angle of θ2, and is then directly focused in the pupil, thereby realizing a 2D / 3D mixed display combining retinal 2D display and integrated imaging 3D display.

6. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: The multiplexed holographic optical element may be a single-layer multiple-exposure structure or a multi-layer single-exposure structure.

7. The multi-level, multi-dimensional controllable augmented reality near-eye display device according to claim 1, characterized in that: The difference between the incident angles of the first holographic exposure reference light I and the second holographic exposure reference light II should be greater than the half-angle bandwidth Δθ of the multiplexed holographic optical element to avoid the generation of crosstalk reconstructed light by incident lights that meet the Bragg condition.

Images