Continuous zooming augmented reality display device

Abstract

The invention provides a continuous zooming augmented reality display device. The device comprises a display module, a projection module and a light splitting module, the display module comprises a collimation backlight module, a black and white liquid crystal screen, a color filter and a special-shaped optical element array; the collimating backlight module is used for emitting a collimated light beam, the black and white liquid crystal screen is used for loading light amplitude information of a given image, and the color filter is used for loading light frequency information of the given image, so that the collimated light beam is converted into a light beam with the given image information after passing through the black and white liquid crystal screen and the color filter; the special-shaped optical element array is used for carrying out primary modulation on the light beam to construct body pixels and generate a first image with display depth; the projection module is used for carrying out secondary modulation on the first image so as to reconstruct body pixels and generate a second image with a display depth; and the light splitting module is used for projecting the second image to a real observation area in front of the user and enabling the user to observe the real world through the light splitting module.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality technology, and in particular to an augmented reality display device with continuous zoom. Background Art

[0002] Augmented reality is a display technology that seamlessly integrates real-world information with virtual world information. Its principle is to load virtual information with certain equipment and put it into the real world within a certain time and space range to be perceived by human senses, thereby achieving a sensory experience beyond reality. As a display technology that can achieve the combination of virtual and real, augmented reality has received more and more attention.

[0003] With the help of augmented reality display devices, users can observe virtual images superimposed on real scenes, and can perceive virtual information and real information at the same time. Accordingly, augmented reality display technology can combine a variety of virtual technical information with display operations, and can be applied in many fields such as industrial production and vehicle transportation, greatly promoting the development of the industry. However, the current naked-eye augmented reality display device has a single focal plane, and only relies on the visual perspective relationship obtained by mathematical derivation to display the depth information of virtual objects. It is impossible to truly construct virtual objects at the corresponding depth, so it is impossible to achieve the integration of virtual information and the real world. Therefore, the existing naked-eye augmented reality technology still needs to be developed. Summary of the invention

[0004] In view of the problem that the existing naked-eye augmented reality technology has a single focusing plane and the performance in integrating virtual information with the real world needs to be improved, the present invention proposes an augmented reality display device with continuous zoom.

[0005] The present invention provides a continuously zooming augmented reality display device, comprising: a display module, a projection module and a light splitting module; wherein the display module comprises a collimated backlight module, a black and white liquid crystal screen, a color filter and a special-shaped optical element array; The collimated backlight module is used to emit a collimated light beam, the black-and-white liquid crystal screen is used to load the light amplitude information of a given image, and the color filter is used to load the light frequency information of a given image, so that the collimated light beam is converted into a light beam having the given image information after passing through the black-and-white liquid crystal screen and the color filter; the special-shaped optical element array is used to perform primary modulation on the light beam having the given image information to construct pixels and generate a first image having a display depth; wherein the blank area defined by the shape of the special-shaped optical element array is a visual depth area, and the area where the optical element array is located is a physical depth area, the visual depth area is used to display content that relies on a visual perspective relationship to realize depth display, and the physical depth area is used to generate display content of physically constructed pixels; The projection module is configured to perform secondary modulation on the first image to reconstruct volume pixels, generate a second image with a display depth, and transmit it to the beam splitting module; The beam splitting module is configured to project the second image onto a real viewing area in front of the user and enable the user to observe the real world through the beam splitting module.

[0006] Further, each light control unit in the special-shaped optical element array is cylindrical. When the focal length of each light control unit is f, the diameter of the light control unit and the center distance between two adjacent light control units are both p, the in-screen display depth of the first image is D in =Hf / (aH - f), the out-screen display depth is D out =Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), the total display depth D = D in +D out ; where H is the equivalent object distance from the display module to the projection module, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black and white liquid crystal screen.

[0007] Further, when the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h 1 , the distance from the in-screen image to the projection module is h 2 , and the equivalent object distance from the display module to the projection module is H, then the magnification of the close-up image of the projection module is k near =F / (F - h 1 ), the magnification of the distant-view image is k far =F / (F - h 2 ), and the display depth of the second image is k near k far D; where D represents the display depth of the first image.

[0008] Further, when the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h 1 , the distance from the in-screen image to the projection module is h 2 ), then the distance between the position where the beam splitting module projects the second image onto the real viewing area in front of the user and the user's position is in the interval [U, V]; where U = Fh 1 / (F - h 1 ), V = Fh 2 / (F - h 2 ).

[0009] Furthermore, when the equivalent object distance from the display module to the projection module is H, and the width of the blank area in the horizontal direction is S, the image display width range at a distance U from the user's position is 0 to S. U , the image display width range at a distance V from the user's location is 0~S V ;in, , ; When the vertical height of the blank area is W, the image display height range at a distance U from the user's location is 0~W. U , the image display height range at a distance V from the user's location is 0~W V ;in, .

[0010] Furthermore, the light control unit in the special-shaped optical element array is a one-dimensional linear lens unit or a two-dimensional lens unit.

[0011] Furthermore, the projection module includes one or more curved mirrors.

[0012] Furthermore, the light splitting module is a beam splitter or other optical device that can transmit and reflect light in a set ratio.

[0013] The beneficial effects of the present invention are: (1) The continuously zooming augmented reality display device provided by the present invention comprises a display module, a projection module and a light splitting module; wherein an array of special-shaped optical elements is arranged in the display module, and the array divides the display area into a visual depth area for realizing depth display by visual perspective relationship and a physical depth area for realizing depth display by real constructed pixels according to the characteristics of the displayed content. The visual depth area is suitable for displaying display content with complex textures that does not require real constructed depth information; the physical depth area is suitable for displaying display content with simple textures that requires real constructed depth information.

[0014] (2) By using the continuously zooming augmented reality display device provided by the present invention, a virtual image with continuous depth can be seen in the [U, V] space in front of the observation area, integrated into the real scene, thereby achieving a continuously zooming augmented reality display effect; and by adjusting the equivalent focal length of the projection module and / or the distance from the screen-entering / screen-exiting image of the display module to the projection module, the distance between the virtual image and the user can be adjusted; by adjusting the equivalent object distance between the display module and the projection module, the magnification of the near-field image and the distant field image can be adjusted; and by adjusting the shape of the blank area defined by the special-shaped optical element array, the width and height of the virtual image display can be adjusted. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 One of the structural schematic diagrams of a continuously zooming augmented reality display device provided by an embodiment of the present invention; Figure 2 One of the structural schematic diagrams of the display module provided by the embodiment of the present invention; Figure 3 A schematic diagram of some parameters between a display module and a projection module in a continuously zooming augmented reality display device provided by an embodiment of the present invention; Figure 4 A schematic diagram of parameters of a blank area and a light control unit defined by an array of special-shaped optical elements in a display module provided by an embodiment of the present invention; Figure 5 A schematic diagram of an equivalent object distance between a display module and a projection module provided in an embodiment of the present invention; Figure 6 A second structural schematic diagram of a continuously zooming augmented reality display device provided by an embodiment of the present invention; Figure 7 A second structural diagram of a display module provided by an embodiment of the present invention; Figure 8 The third structural schematic diagram of a continuously zooming augmented reality display device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0016] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution in the embodiment of the present invention will be clearly described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0017] Combination Figure 1 and Figure 2 As shown, an embodiment of the present invention provides an augmented reality display device with continuous zoom, comprising: a display module 1, a projection module 2 and a light splitting module 3; wherein the display module 1 comprises a collimating backlight module 11, a black and white liquid crystal screen 12, a color filter 13 and a special-shaped optical element array 14; The collimated backlight module 11 is used to emit a collimated light beam, the black-and-white liquid crystal screen 12 is used to load the light amplitude information of a given image, and the color filter 13 is used to load the light frequency information of a given image, so that the collimated light beam is converted into a light beam having the given image information after passing through the black-and-white liquid crystal screen 12 and the color filter 13; the special-shaped optical element array 14 is used to perform primary modulation on the light beam having the given image information to construct pixels and generate a first image having a display depth; wherein the blank area defined by the shape of the special-shaped optical element array 14 is a visual depth area, and the area where the optical element array is located is a physical depth area, the visual depth area is used to display content that relies on a visual perspective relationship to realize depth display, and the physical depth area is used to generate display content that physically constructs pixels; The projection module 2 is used to perform secondary modulation on the first image to reconstruct the pixels, generate a second image with display depth and transmit it to the spectroscopic module 3; the spectroscopic module 3 is used to project the second image onto a real observation area in front of the user, and enable the user to observe the real world through the spectroscopic module.

[0018] Specifically, the display module 1, the projection module 2 and the light splitting module 3 can be placed coaxially or off-axis. The collimated backlight module 11, the black-and-white liquid crystal screen 12, the color filter 13 and the special-shaped optical element array 14 are tightly fitted in sequence. The collimated backlight module 11 emits a collimated light beam to the black-and-white liquid crystal screen 12, and the black-and-white liquid crystal screen 12 adds the light amplitude information of a given image to the collimated light beam; the color filter 13 selectively transmits light of a specific wavelength band, thereby adding the light frequency information of a given image to the collimated light beam; after the collimated light beam passes through the black-and-white liquid crystal screen 12 and the color filter 13, the light beam at this time has been converted into a light beam carrying the light amplitude and light frequency information of a given image; the special-shaped optical element array 14 then performs a primary modulation on the light beam, constructs pixels, generates an image with a certain display depth (in this embodiment, recorded as the first image), and transmits the generated first image to the projection module 2. The function of the projection module 2 is to perform secondary modulation on the image information beam transmitted from the display module 1, reconstruct the pixels, and generate an image with a certain display depth (in this embodiment, referred to as the second image) again, and transmit the generated second image to the spectroscopic module 3. The function of the spectroscopic module 3 is to change the path of the light transmitted from the projection module 2, project it in the real space in front of the user's observation area, generate the final image, and the user can observe the real world through the spectroscopic module 3. The out-of-screen image generated by the display module 1 will become a near-view image after passing through the projection module 2 and the spectroscopic module 3, and the in-screen image will become a distant view image.

[0019] For example, the collimated backlight module 11 can be a side - lit backlight or a direct - lit backlight, and optical elements for enhancing collimation can be added. The array of non - standard optical elements 14 can be an array structure composed of one - dimensional linear lens units (cylindrical lens units), or an array structure composed of two - dimensional lens units (circular lens units, square lens units). The plane of the light - controlling unit of the array of non - standard optical elements 14 faces the color filter 13, and the array of non - standard optical elements 14 is placed orthogonally to the color filter 13 to suppress the periodic fringes generated by the interaction of two periodic structures. The projection module 2 can be composed of one or more curved mirrors, and the curved mirror can be a curved reflecting mirror or a curved lens, and the surface type can be spherical, aspherical or free - form surface. The beam - splitting module can be composed of a beam - splitter or other optical devices that can transmit and reflect light according to a certain ratio.

[0020] In one embodiment, as shown in conjunction with Figure 3 and Figure 4 , each light - controlling unit in the array of non - standard optical elements 14 is cylindrical. When the focal length of each light - controlling unit is f, the diameter of the light - controlling unit and the center - to - center spacing of two adjacent light - controlling units are both p, the in - screen display depth of the first image is D in =Hf / (aH - f), the out - screen display depth is D out =Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), and the total display depth D = D in +D out ; where H is the equivalent object distance from the display module 1 to the projection module 2, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black - and - white liquid - crystal screen.

[0021] Specifically, the in - screen display depth represents the display depth when the first image is an in - screen image, and the out - screen display depth represents the display depth when the first image is an out - screen image. The display module transmits the light beam with the first - image information of specific intensity, color and direction angle to the projection module 2.

[0022] In one embodiment, as shown in conjunction with Figure 3 and Figure 5 , when the equivalent focal length of the projection module 2 is F, the distance from the out - screen image of the display module 1 to the projection module 2 is h 1 , the distance from the in - screen image to the projection module 2 is h 2 , and the equivalent object distance from the display module 1 to the projection module 2 is H, then the magnification of the near - view image of the projection module 2 is k near =F / (F - h 1 ), the magnification of the far - view image is k far =F / (F - h 2 ), and the display depth of the second image is k near kfar D; wherein D represents the display depth of the first image, satisfying 0 <D<F。

[0023] In one embodiment, in combination Figure 1 and Figure 3 As shown, when the equivalent focal length of the projection module 2 is F, the distance from the screen image of the display module 1 to the projection module 2 is h 1 , the distance from the screen image to the projection module 2 is h 2 When the distance between the real observation area in front of the user where the second image is projected by the light splitting module 3 and the user's position is in the interval [U, V]; wherein U=Fh 1 / (Fh 1 ), V = Fh 2 / (Fh 2 ). It should be noted that there is h 1 =HD out ,h 2 =H+D in Therefore, when it is necessary to adjust the distance interval [U, V] where the projection image is located, it can be achieved by adjusting the equivalent object distance H and the equivalent focal length F.

[0024] In one embodiment, the shape of the blank area depends on specific needs. Figure 3 and Figure 4 As shown in FIG. 1 , when the equivalent object distance from the display module 1 to the projection module 2 is H and the horizontal width of the blank area is S, the image display width range at a distance U from the user's position is 0 to S. U , the image display width range at a distance V from the user's location is 0~S V ;in, ; When the vertical height of the blank area is W, the image display height range at the distance U from the user's position is 0~W U , the image display height range at a distance V from the user's location is 0~W V ;in, .

[0025] In one embodiment, Figure 6 The augmented reality display device with continuous zoom shown in FIG. 1 includes a display module 1, a projection module 2 and a light splitting module 3. Figure 7 As shown, the display module 1 includes a collimating backlight module 11 , a black and white liquid crystal screen 12 , a color filter 13 and a special-shaped optical element array 14 .

[0026] In this embodiment, the projection module 2 is located above the display module 1 , the light splitting module 3 is located above the projection module 2 , and the display module 1 , the projection module 2 and the light splitting module 3 are placed off-axis.

[0027] In the display module 1, the collimating backlight module 11 is a side-entry optical waveguide integrated collimating optical element, the special-shaped optical element array 14 is a special-shaped cylindrical lens grating array, the size of the black and white LCD screen 12 and the color filter 13 are both 6.4 inches, the black and white LCD screen 12 and the color filter 13 are tightly fitted, and the color filter 13 is placed orthogonally to the special-shaped cylindrical lens grating array and tightly fits the plane of the special-shaped cylindrical lens grating array 14. The special-shaped cylindrical lens grating array 14 is composed of a number of cylindrical lens units, and the center near the bottom edge has a trapezoidal area with a lower side length of 1 / 2 array length, an upper side length of 1 / 4 array length, and a height of 3 / 5 array width. The focal length f of the cylindrical lens unit is 0.6528mm, the refractive index is 1.61, and the spacing P between the aperture and the cylindrical lens unit is 0.32mm.

[0028] In the projection module 2, the curved mirror group is two free-form curved mirrors, the first mirror is a convex mirror, and the second mirror is a concave mirror.

[0029] The light splitting module 3 uses a beam splitter, which is tilted at an angle φ of 45°, has a transmission-reflection ratio of 2.3, is 260 mm long, and is 240 mm wide.

[0030] Compared with the prior art, the continuous zoom augmented reality display device proposed in the embodiment of the present invention can greatly increase the display depth and achieve a display effect of virtual-real fusion.

[0031] In one embodiment, Figure 8 The continuous zoom augmented reality display device shown includes: a display module 1, a projection module 2 and a light splitting module 3. In this embodiment, the projection module 2 is located above the display module 1, the light splitting module 3 is located above the projection module 2, and the display module 1, the projection module 2 and the light splitting module 3 are coaxially placed.

[0032] The display module 1 is similar to the previous embodiment. Figure 7 The structure is the same as that of , and will not be repeated here.

[0033] In the projection module 2, the curved mirror is a spherical lens, the curvature radius R of the curved mirror is 500 mm, the equivalent focal length F is 250 mm, the length is 260 mm, the width is 192 mm, and the distance H from the display module 1 to the curved mirror is 240 mm.

[0034] In the light splitting module 3, a beam splitter is used, which is tilted at an angle φ of 45°, has a transmission-reflection ratio of 2.3, is 260 mm long, 240 mm wide, and a distance L from the beam splitter to the curved mirror is 120 mm.

[0035] Compared with the prior art, the continuous zoom augmented reality display device proposed in the embodiment of the present invention can greatly increase the display depth and achieve a display effect of virtual-real fusion.

[0036] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A continuously zooming augmented reality display device, characterized in that: include: Display module, projection module and light splitting module; wherein the display module includes a collimated backlight module, a black and white LCD screen, a color filter and a special-shaped optical element array; The collimated backlight module is used to emit a collimated light beam, the black-and-white liquid crystal screen is used to load the light amplitude information of a given image, and the color filter is used to load the light frequency information of a given image, so that the collimated light beam is converted into a light beam having the given image information after passing through the black-and-white liquid crystal screen and the color filter; the special-shaped optical element array is used to perform primary modulation on the light beam having the given image information to construct pixels and generate a first image having a display depth; wherein the blank area defined by the shape of the special-shaped optical element array is a visual depth area, and the area where the optical element array is located is a physical depth area, the visual depth area is used to display content that relies on a visual perspective relationship to realize depth display, and the physical depth area is used to generate display content of physically constructed pixels; The projection module is used to perform secondary modulation on the first image to reconstruct the volume pixels, generate a second image with display depth and transmit it to the light splitting module; The light splitting module is used to project the second image onto a real observation area in front of the user, and enable the user to observe the real world through the light splitting module.

2. The continuously zooming augmented reality display device according to claim 1, characterized in that: Each light control unit in the special-shaped optical element array is cylindrical. When the focal length of each light control unit is f, the diameter of the light control unit and the center distance between two adjacent light control units are both p, the in-screen display depth of the first image is D in = Hf / (aH - f), and the out-screen display depth is D out = Hf / (aH + f), the field of view angle is A and 0 < A < 2arctan(p / 2f), and the total display depth D = D in + D out ; where H is the equivalent object distance from the display module to the projection module, a is a preset value and a > 150 / HR, and HR represents the horizontal resolution of the black and white liquid crystal screen.

3. The continuously zooming augmented reality display device according to claim 1, characterized in that: When the equivalent focal length of the projection module is F, the distance from the screen image of the display module to the projection module is h1, the distance from the screen image to the projection module is h2, and the equivalent object distance from the display module to the projection module is H, then the magnification of the close-range image of the projection module is k near =F / (F-h1), the magnification of the distant image is k far =F / (F-h2), the display depth of the second image is k near k far D; wherein D represents the display depth of the first image.

4. The continuously zooming augmented reality display device according to claim 1, characterized in that: When the equivalent focal length of the projection module is F, the distance from the out-screen image of the display module to the projection module is h1, and the distance from the on-screen image to the projection module is h2, then the distance between the real observation area where the second image is projected by the spectroscopic module in front of the user and the user's position is in the interval [U, V]; wherein U=Fh1 / (F-h1), V=Fh2 / (F-h2).

5. The continuously zooming augmented reality display device according to claim 4, characterized in that: When the equivalent object distance from the display module to the projection module is H, and the horizontal width of the blank area is S, the image display width range at a distance U from the user's position is 0~S U , the image display width range at a distance V from the user's location is 0~S V ;in, ; When the vertical height of the blank area is W, the image display height range at a distance U from the user's location is 0~W. U , the image display height range at a distance V from the user's location is 0~W V ;in, .

6. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The light control unit in the special-shaped optical element array is a one-dimensional linear lens unit or a two-dimensional lens unit.

7. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The projection module includes one or more curved mirrors.

8. The continuously zooming augmented reality display device according to any one of claims 1 to 5, characterized in that: The light splitting module is a beam splitter or other optical device that can transmit and reflect light in a set ratio.

Images