A continuous zoom augmented reality display device

Abstract

The present invention provides a continuously zoomable augmented reality display device. The device includes: a display module, a projection module, and a beam splitting module; the display module includes a collimated backlight module, a black-and-white liquid crystal screen, a color filter, and an array of special-shaped optical elements; the collimated backlight module is used to emit collimated light beams, the black-and-white liquid crystal screen is used to load the light amplitude information of a given image, the color filter is used to load the light frequency information of the given image, so that the collimated light beams are converted into light beams with the given image information after passing through the black-and-white liquid crystal screen and the color filter; the array of special-shaped optical elements is used to perform primary modulation on the light beams to construct volume pixels and generate a first image with display depth; the projection module is used to perform secondary modulation on the first image to reconstruct the volume pixels and generate a second image with display depth; the beam splitting module is used to project the second image onto a real viewing area in front of the user and enable the user to observe the real world through the beam splitting module.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality technology, and in particular to an augmented reality display device with continuous zoom. Background Art

[0002] Augmented reality is a display technology that seamlessly integrates real-world information with virtual world information. Its principle is to load virtual information with certain equipment and put it into the real world within a certain time and space range to be perceived by human senses, thereby achieving a sensory experience beyond reality. As a display technology that can achieve the combination of virtual and real, augmented reality has received more and more attention.

[0003] With the help of augmented reality display devices, users can observe virtual images superimposed on real scenes, and can perceive virtual information and real information at the same time. Accordingly, augmented reality display technology can combine a variety of virtual technical information with display operations, and can be applied in many fields such as industrial production and vehicle transportation, greatly promoting the development of the industry. However, the current naked-eye augmented reality display device has a single focal plane, and only relies on the visual perspective relationship obtained by mathematical derivation to display the depth information of virtual objects. It is impossible to truly construct virtual objects at the corresponding depth, so it is impossible to achieve the integration of virtual information and the real world. Therefore, the existing naked-eye augmented reality technology still needs to be developed. Summary of the invention

[0004] In view of the problem that the existing naked-eye augmented reality technology has a single focusing plane and the performance in integrating virtual information with the real world needs to be improved, the present invention proposes an augmented reality display device with continuous zoom.

[0005] The present invention provides a continuously zooming augmented reality display device, comprising: a display module, a projection module and a light splitting module; wherein the display module comprises a collimated backlight module, a black and white liquid crystal screen, a color filter and a special-shaped optical element array;

[0006] The collimated backlight module is used to emit a collimated light beam, the black-and-white liquid crystal screen is used to load the light amplitude information of a given image, and the color filter is used to load the light frequency information of a given image, so that the collimated light beam is converted into a light beam having the given image information after passing through the black-and-white liquid crystal screen and the color filter; the special-shaped optical element array is used to perform primary modulation on the light beam having the given image information to construct pixels and generate a first image having a display depth; wherein the blank area defined by the shape of the special-shaped optical element array is a visual depth area, and the area where the optical element array is located is a physical depth area, the visual depth area is used to display content that relies on a visual perspective relationship to realize depth display, and the physical depth area is used to generate display content of physically constructed pixels;

[0007] The projection module is configured to perform secondary modulation on the first image to reconstruct volume pixels, generate a second image with a display depth, and transmit it to the beam splitting module;

[0008] The beam splitting module is configured to project the second image onto a real viewing area in front of the user and enable the user to observe the real world through the beam splitting module.

[0009] Further, each light control unit in the special-shaped optical element array is cylindrical. When the focal length of each light control unit is f, the diameter of the light control unit and the center distance between two adjacent light control units are both p, the in-screen display depth of the first image is D in =Hf / (aH - f), the out-screen display depth is D out =Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), the total display depth D = D in + D out ; where H is the equivalent object distance from the display module to the projection module, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black and white liquid crystal screen.

[0010] Further, when the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h1, the distance from the in-screen image of the display module to the projection module is h2, and the equivalent object distance from the display module to the projection module is H, then the magnification of the close-up image of the projection module is k near =F / (F - h1), the magnification of the long-distance image is k far =F / (F - h2), the display depth of the second image is k near k far D; where D represents the display depth of the first image.

[0011] Further, when the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h1, and the distance from the in-screen image of the display module to the projection module is h2, then the distance between the position where the beam splitting module projects the second image onto the real viewing area in front of the user and the user's position is in the range of [U, V]; where U = Fh1 / (F - h1), V = Fh2 / (F - h2).

[0012] Further, when the equivalent object distance from the display module to the projection module is H and the width of the blank area in the horizontal direction is S, then the image display width range at a distance of U from the user's position is 0~S U , and the image display width range at a distance of V from the user's position is 0~S V ; where, , ;

[0013] When the height of the blank area in the vertical direction is W, the image display height range at a distance U from the user's location is 0 to W U , and the image display height range at a distance V from the user's location is 0 to W V ; wherein, .

[0014] Furthermore, the light control unit in the special-shaped optical element array is a one-dimensional linear lens unit or a two-dimensional lens unit.

[0015] Furthermore, the projection module includes one or more curved mirrors.

[0016] Furthermore, the beam splitting module is a beam splitter or other optical device that can transmit and reflect light according to a set ratio.

[0017] The beneficial effects of the present invention are as follows:

[0018] (1) The continuous zoom augmented reality display device provided by the present invention includes a display module, a projection module, and a beam splitting module; wherein, a special-shaped optical element array is arranged in the display module, and this array divides the display area into a visual depth area that realizes depth display depending on the visual perspective relationship and a physical depth area that realizes depth display through real constructed body pixels according to the characteristics of the display content. The visual depth area is suitable for displaying display content with complex textures that do not require real constructed depth information; the physical depth area is suitable for displaying display content with simple textures that require real constructed depth information.

[0019] (2) By using the continuous zoom augmented reality display device provided by the present invention, a virtual image with continuous depth can be seen fused in the real scene in the [U, V] space in front of the observation area, thereby realizing the continuous zoom augmented reality display effect; moreover, by adjusting the equivalent focal length of the projection module and / or the distance from the on-screen / off-screen image of the display module to the projection module, the distance between the virtual image and the user can be adjusted; by adjusting the equivalent object distance between the display module and the projection module, the magnification of the near-view image and the far-view image can be adjusted; by adjusting the shape of the blank area defined by the special-shaped optical element array, the width and height of the virtual image display can be adjusted. Description of the Drawings

[0020] Figure 1 is one of the structural schematic diagrams of a continuous zoom augmented reality display device provided by an embodiment of the present invention;

[0021] Figure 2 is one of the structural schematic diagrams of the display module provided by an embodiment of the present invention;

[0022] Figure 3 Schematic diagram of some parameters between the display module and the projection module in a continuously zoomable augmented reality display device provided by an embodiment of the present invention;

[0023] Figure 4 Schematic diagram of the blank area defined by the special-shaped optical element array and the parameters of the light control unit in the display module provided by an embodiment of the present invention;

[0024] Figure 5 Schematic diagram of the equivalent object distance between the display module and the projection module provided by an embodiment of the present invention;

[0025] Figure 6 Second structural schematic diagram of a continuously zoomable augmented reality display device provided by an embodiment of the present invention;

[0026] Figure 7 Second structural schematic diagram of the display module provided by an embodiment of the present invention;

[0027] Figure 8 Third structural schematic diagram of a continuously zoomable augmented reality display device provided by an embodiment of the present invention. Detailed implementation manners

[0028] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0029] Combined with Figure 1 and Figure 2 As shown, an embodiment of the present invention provides a continuously zoomable augmented reality display device, including: a display module 1, a projection module 2, and a beam splitting module 3; wherein, the display module 1 includes a collimated backlight module 11, a black and white liquid crystal screen 12, a color filter 13, and a special-shaped optical element array 14;

[0030] The collimated backlight module 11 is used to emit collimated light beams. The black-and-white liquid crystal screen 12 is used to load the light amplitude information of a given image. The color filter 13 is used to load the light frequency information of the given image, so that the collimated light beam is converted into a light beam with the given image information after passing through the black-and-white liquid crystal screen 12 and the color filter 13. The special-shaped optical element array 14 is used to perform primary modulation on the light beam with the given image information to construct volume pixels and generate a first image with a display depth. Among them, the blank area defined by the shape of the special-shaped optical element array 14 is the visual depth area, and the area where the optical element array is located is the physical depth area. The visual depth area is used to display the content that realizes the depth display depending on the visual perspective relationship, and the physical depth area is used to generate the display content of the physical constructed volume pixels.

[0031] The projection module 2 is used to perform secondary modulation on the first image to reconstruct volume pixels, generate a second image with a display depth and transmit it to the beam splitting module 3. The beam splitting module 3 is used to project the second image on the real viewing area in front of the user and enable the user to observe the real world through the beam splitting module.

[0032] Specifically, the display module 1, the projection module 2, and the beam splitting module 3 can be arranged coaxially or off-axis. The collimated backlight module 11, the black-and-white liquid crystal screen 12, the color filter 13, and the special-shaped optical element array 14 are tightly attached in sequence. The collimated backlight module 11 emits collimated light beams to the black-and-white liquid crystal screen 12, and the black-and-white liquid crystal screen 12 adds the light amplitude information of the given image to the collimated light beams. The color filter 13 adds the light frequency information of the given image to the collimated light beams by selectively transmitting light of specific wavelength bands. After the collimated light beams pass through the black-and-white liquid crystal screen 12 and the color filter 13, the light beams at this time have been converted into light beams carrying the light amplitude and light frequency information of the given image. Then, the special-shaped optical element array 14 performs primary modulation on the light beams, constructs volume pixels, generates an image with a certain display depth (in this embodiment, denoted as the first image), and transmits the generated first image to the projection module 2. The function of the projection module 2 is to perform secondary modulation on the image information light beam transmitted by the display module 1, reconstruct volume pixels, and generate an image with a certain display depth again (in this embodiment, denoted as the second image), and transmit the generated second image to the beam splitting module 3. The function of the beam splitting module 3 is to change the path of the light transmitted by the projection module 2, project it into the real space in front of the user's viewing area, generate the final image, and the user can observe the real world through the beam splitting module 3. The out-of-screen image generated by the display module 1 will become a near-view image after passing through the projection module 2 and the beam splitting module 3, and the in-screen image will become a far-view image.

[0033] For example, the collimated backlight module 11 can be a side - lit backlight or a direct - lit backlight, and optical elements for enhancing collimation can be added. The array of shaped optical elements 14 can be an array structure composed of one - dimensional linear lens units (cylindrical lens units), or an array structure composed of two - dimensional lens units (circular lens units, square lens units). The plane of the light - controlling unit of the array of shaped optical elements 14 faces the color filter 13, and the array of shaped optical elements 14 is placed orthogonally to the color filter 13 to suppress the periodic fringes generated by the interaction of two periodic structures. The projection module 2 can be composed of one or more curved mirrors, and the curved mirror can be a curved reflector or a curved lens, and the surface type can be spherical, aspherical or free - form surface. The beam - splitting module can be composed of a beam - splitter or other optical devices that can transmit and reflect light according to a certain ratio.

[0034] In one embodiment, as shown in conjunction with Figure 3 and Figure 4 each light - controlling unit in the array of shaped optical elements 14 is cylindrical. When the focal length of each light - controlling unit is f, the diameter of the light - controlling unit and the center - to - center spacing of two adjacent light - controlling units are both p, the in - screen display depth of the first image is D in =Hf / (aH - f), the out - screen display depth is D out =Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), and the total display depth D = D in +D out ; where H is the equivalent object distance from the display module 1 to the projection module 2, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black - and - white liquid - crystal screen.

[0035] Specifically, the in - screen display depth represents the display depth when the first image is an in - screen image, and the out - screen display depth represents the display depth when the first image is an out - screen image. The display module transmits a light beam with the first - image information of specific intensity, color, and direction angle to the projection module 2.

[0036] In one embodiment, as shown in conjunction with Figure 3 and Figure 5 when the equivalent focal length of the projection module 2 is F, the distance from the out - screen image of the display module 1 to the projection module 2 is h1, the distance from the in - screen image to the projection module 2 is h2, and the equivalent object distance from the display module 1 to the projection module 2 is H, then the magnification of the near - view image of the projection module 2 is k near =F / (F - h1), the magnification of the far - view image is k far =F / (F - h2), and the display depth of the second image is k near k far D; where D represents the display depth of the first image, and 0 < D < F.

[0037] In one embodiment, in combination with Figure 1 and Figure 3 as shown, when the equivalent focal length of the projection module 2 is F, the distance from the out-of-screen image of the display module 1 to the projection module 2 is h1, and the distance from the in-screen image to the projection module 2 is h2, the beam splitting module 3 projects the second image at a distance within the interval [U, V] between the real viewing area in front of the user and the user's location; where U = Fh1 / (F - h1), V = Fh2 / (F - h2). It should be noted that there is h1 = H - D out , h2 = H + D in . Therefore, when it is necessary to adjust the distance interval [U, V] where the projected image is located, it can be achieved by adjusting the equivalent object distance H and the equivalent focal length F.

[0038] In one embodiment, the shape of the blank area depends on specific requirements. In combination with Figure 3 and Figure 4 as shown, when the equivalent object distance from the display module 1 to the projection module 2 is H and the width of the blank area in the horizontal direction is S, the image display width range at a distance U from the user's location is 0 to S U , and the image display width range at a distance V from the user's location is 0 to S V ; where ;

[0039] When the height of the blank area in the vertical direction is W, the image display height range at a distance U from the user's location is 0 to W U , and the image display height range at a distance V from the user's location is 0 to W V ; where .

[0040] In one embodiment, as Figure 6 shown, a continuous zoom augmented reality display device includes a display module 1, a projection module 2, and a beam splitting module 3. As Figure 7 shown, the display module 1 includes a collimated backlight module 11, a black and white liquid crystal screen 12, a color filter 13, and an irregular optical element array 14.

[0041] In this embodiment, the projection module 2 is located above the display module 1, the beam splitting module 3 is located above the projection module 2, and the display module 1, the projection module 2, and the beam splitting module 3 are placed off-axis.

[0042] In the display module 1, the collimated backlight module 11 is a side-integrated waveguide with a collimated optical element, the special-shaped optical element array 14 is a special-shaped cylindrical lens grating array, the sizes of the black and white liquid crystal screen 12 and the color filter 13 are both 6.4 inches. The black and white liquid crystal screen 12 is tightly attached to the color filter 13, and the color filter 13 is orthogonally placed with the special-shaped cylindrical lens grating array and tightly attached to the plane of the special-shaped cylindrical lens grating array 14. The special-shaped cylindrical lens grating array 14 is composed of several cylindrical lens units. There is a trapezoidal area blank at the position near the bottom edge of the center, with the lower side length being 1 / 2 of the array length, the upper side length being 1 / 4 of the array length, and the height being 3 / 5 of the array width. The focal length f of the cylindrical lens unit is 0.6528 mm, the refractive index is 1.61, the aperture and the pitch P between the cylindrical lens units are 0.32 mm.

[0043] In the projection module 2, the curved mirror group is two free-form surface mirrors, the first mirror is a convex mirror, and the second mirror is a concave mirror.

[0044] In the beam splitting module 3, a beam splitter is used, the tilting angle φ is 45°, the transmission-to-reflection ratio is 2.3, the length is 260 mm, and the width is 240 mm.

[0045] Compared with the prior art, the continuous zoom augmented reality display device proposed in the embodiment of the present invention can greatly increase the display depth and achieve a virtual-real fusion display effect.

[0046] In one embodiment, as Figure 8 shown, a continuous zoom augmented reality display device includes: a display module 1, a projection module 2, and a beam splitting module 3. In this embodiment, the projection module 2 is located above the display module 1, the beam splitting module 3 is located above the projection module 2, and the display module 1, the projection module 2, and the beam splitting module 3 are coaxially arranged.

[0047] The display module 1 has the same structure as that in the previous embodiment Figure 7 and will not be described in detail here.

[0048] In the projection module 2, the curved mirror is a spherical lens, the radius of curvature R of the curved mirror is 500 mm, the equivalent focal length F is 250 mm, the length is 260 mm, the width is 192 mm, and the distance H from the display module 1 to the curved mirror is 240 mm.

[0049] In the beam splitting module 3, a beam splitter is used, the tilting angle φ is 45°, the transmission-to-reflection ratio is 2.3, the length is 260 mm, the width is 240 mm, and the distance L from the beam splitter to the curved mirror is 120 mm.

[0050] Compared with the prior art, the continuous zoom augmented reality display device proposed in the embodiment of the present invention can greatly increase the display depth and achieve a virtual-real fusion display effect.

[0051] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A continuously zooming augmented reality display device, characterized in that: include: Display module, projection module and light splitting module; wherein the display module includes a collimated backlight module, a black and white LCD screen, a color filter and a special-shaped optical element array; The collimated backlight module is used to emit a collimated light beam, the black-and-white liquid crystal screen is used to load the light amplitude information of a given image, and the color filter is used to load the light frequency information of a given image, so that the collimated light beam is converted into a light beam having the given image information after passing through the black-and-white liquid crystal screen and the color filter; the special-shaped optical element array is used to perform primary modulation on the light beam having the given image information to construct pixels and generate a first image having a display depth; wherein the blank area defined by the shape of the special-shaped optical element array is a visual depth area, and the area where the optical element array is located is a physical depth area, the visual depth area is used to display content that relies on a visual perspective relationship to realize depth display, and the physical depth area is used to generate display content of physically constructed pixels; The projection module is used to perform secondary modulation on the first image to reconstruct the volume pixels, generate a second image with display depth and transmit it to the light splitting module; The light splitting module is used to project the second image onto a real observation area in front of the user, and enable the user to observe the real world through the light splitting module.

2. The continuously zooming augmented reality display device according to claim 1, characterized in that: Each light control unit in the shaped optical element array is cylindrical. When the focal length of each light control unit is f, the diameter of the light control unit and the center distance between two adjacent light control units are both p, the in-screen display depth of the first image is D in = Hf / (aH - f), and the out-screen display depth is D out = Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), and the total display depth D = D in + D out ; where H is the equivalent object distance from the display module to the projection module, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black and white liquid crystal screen.

3. The continuously zooming augmented reality display device according to claim 1, characterized in that: When the equivalent focal length of the projection module is F, the distance from the screen image of the display module to the projection module is h1, the distance from the screen image to the projection module is h2, and the equivalent object distance from the display module to the projection module is H, then the magnification of the close-range image of the projection module is k near =F / (F-h1), the magnification of the distant image is k far =F / (F-h2), the display depth of the second image is k near k far D; wherein D represents the display depth of the first image.

4. The continuously zooming augmented reality display device according to claim 1, characterized in that: When the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h1, and the distance from the on-screen image to the projection module is h2, then the distance between the real observation area where the second image is projected by the spectroscopic module in front of the user and the user's position is in the interval [U, V]; wherein U=Fh1 / (F-h1), V=Fh2 / (F-h2).

5. The continuously zooming augmented reality display device according to claim 4, characterized in that: When the equivalent object distance from the display module to the projection module is H, and the horizontal width of the blank area is S, the image display width range at a distance U from the user's position is 0~S U , the image display width range at a distance V from the user's location is 0~S V ;in, ; When the vertical height of the blank area is W, the image display height range at a distance U from the user's location is 0~W. U , the image display height range at a distance V from the user's location is 0~W V ;in, .

6. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The light control unit in the special-shaped optical element array is a one-dimensional linear lens unit or a two-dimensional lens unit.

7. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The projection module includes one or more curved mirrors.

8. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The light splitting module is a beam splitter or other optical device that can transmit and reflect light in a set ratio.

Images