Multi-view retina projection augmented reality near-to-eye display optical system

Abstract

The invention provides a multi-view retina projection augmented reality near-eye display optical system, illumination light waves radiated by light-emitting subunits on an illumination source form a two-dimensionally distributed dense view point array on a human eye pupil plane, and the range of the view point array formed by display light waves is larger than the moving range of human eye pupils. One viewpoint can enter the center of the pupil at any pupil position, so that the image source is directly projected to the retina of the human eye through the display light wave corresponding to the viewpoint for clear imaging; the process does not depend on the focusing function of a crystalline lens, no matter the human eye is focused to any distance, the virtual image can be clearly imaged on the retina all the time, and the large-range depth of field is achieved; external environment light can be directly transmitted from the optical combiner to enter human eyes for imaging, so that optical perspective display is realized.

Description

Technical Field

[0001] The present invention belongs to the technical field of near-eye display, and in particular relates to a multi-viewpoint retinal projection augmented reality near-eye display optical system. Background Art

[0002] For the existing augmented reality (AR) near-eye display optical system, the display beam must be focused by the human eye lens to be clearly imaged on the retina, and the depth of field range for observing virtual images is quite limited. When the human eye lens deviates from this focusing state, the virtual image will appear blurred. When this system is applied to binocular display, there will be a mismatch between the focusing distance of a single eye and the convergence distance of the binocular eyes, resulting in a visual convergence and focus conflict (Vergence accommodation conflict, VAC), which will cause visual fatigue and discomfort to the human eye. In order to expand the depth of field range of the traditional near-eye display system and solve the VAC problem, a retinal projection type display solution can be adopted.

[0003] The retinal projection display system focuses the display beam loaded with image information to a viewpoint located in the center of the human pupil, and the viewpoint size is much smaller than the diameter of the human pupil. The display beam directly passes through the viewpoint and is projected onto the retina for imaging, and the human visual system can perceive the virtual image information. This imaging process is independent of the focusing function of the human eye lens. Under any focusing state of the lens, the virtual image can always be clearly imaged on the retina, achieving a wide range of depth of field expansion. For refractive errors of the lens, such as myopia, hyperopia, astigmatism, etc., the retinal projection display solution can present clear virtual image information to the human eye, and the user does not need to wear specially customized corrective lenses, which is conducive to adapting to a wider user group. At the same time, since the imaging process of the virtual image by the retina of the human eye does not rely on the focusing function of the lens, retinal projection display can effectively solve the VAC problem.

[0004] However, the eyebox size provided by the retinal projection display system is quite small. When the pupil of the human eye slightly deviates from the viewpoint position, the virtual image will appear incomplete or even disappear completely, which greatly limits the application field of retinal projection display. For the existing eyebox expansion method of the retinal projection display system, optical elements such as beam splitter arrays, multiplexed holographic optical elements, geometric phase lenses, polarization gratings, and Dammann gratings can be used to statically replicate multiple discrete viewpoints in space at the same time. However, due to the change of ambient light intensity, the increase or decrease of the pupil diameter of the human eye will cause multiple viewpoints to enter the human eye pupil at the same time or cause no viewpoint to enter the human eye pupil, which will cause multiple images or visual blind spots. Another method is to dynamically move the viewpoint in space, using polarization control elements to achieve dynamic movement of the viewpoint by changing the polarization state of the display light beam, but the number of viewpoints that can be achieved by this method is small and cannot continuously cover the movement range of the human eye. In addition, the viewpoint position can be dynamically deflected using a mechanical deflection mirror or a moving device, but this method introduces a complex mechanical device, resulting in a large volume and weight of the optical system structure and low practicality. Even if the LED array can be used as an illumination source, each LED sub-light-emitting unit corresponds to a viewpoint. The dynamic movement of the viewpoint in space is achieved by dynamically switching different LED sub-light-emitting units, but the size of a single LED sub-light-emitting unit is large, which is equivalent to an extended light source. The viewpoint size formed on the pupil plane of the human eye is large, and the depth of field range of the virtual image cannot be expanded. The above-mentioned existing technical solutions for the eye box of the extended retinal projection display system still have great limitations, such as only being able to produce a small number of discrete viewpoint arrays, using complex mechanical deflection devices in the system, or the size of the viewpoints formed is large. Summary of the invention

[0005] To solve the above problems, the present invention provides a multi-viewpoint retinal projection augmented reality near-eye display optical system, so that at any pupil position, there is a viewpoint that can enter the pupil center, and the display light wave corresponding to the viewpoint is directly projected to the human eye retina for imaging, so that the virtual image information can be clearly perceived by the human eye visual system.

[0006] A multi-viewpoint retinal projection augmented reality near-eye display optical system, comprising an illumination source 11, a first shaping component, an image source 12 to be displayed near the eye to a human eye, a polarization beam splitter prism 13, a second shaping component, an optical combiner 14, an eye tracking camera 15, and a processing module; wherein the illumination source 11 comprises a plurality of array-arranged and independently controllable sub-light-emitting units, and each sub-light-emitting unit radiates a beam of illumination light waves;

[0007] The illumination light waves radiated by each sub-light-emitting unit are regulated by the first shaping component and then incident on the polarization beam splitter prism 13; the illumination light waves are reflected by the beam splitting surface of the polarization beam splitter prism 13 and then incident on the image source 12; the image source 12 loads image information on the incident illumination light waves to obtain display light waves; after the display light waves are reflected back to the polarization beam splitter prism 13 by the image source 12, they are directly transmitted from the beam splitting surface to the second shaping component, and then regulated by the second shaping component, they are projected from the off-axis position to the optical combiner 14; the optical combiner 14 focuses the display light waves in the form of a two-dimensionally distributed viewpoint array onto the pupil plane of the human eye, and the range of the viewpoint array formed by the display light waves is larger than the movement range of the pupil of the human eye;

[0008] When near-eye display is required, the eye tracking camera 15 is used to obtain the pupil center position in real time; the processing module determines the sub-light-emitting unit that needs to be lit according to the pupil center position, and the lit sub-light-emitting unit forms a corresponding viewpoint in the human eye pupil, so that the image source 12 is imaged on the retina.

[0009] Furthermore, the processing module determines the sub-light-emitting unit to be lit according to the center position of the pupil as follows:

[0010] The two-dimensional array of sub-light-emitting units and the two-dimensional viewpoint array of display light waves are both constructed with the center of the array as the origin to construct a rectangular coordinate system. It is assumed that the position coordinate of the pupil center is (x P ,y P ), then the theoretical position coordinates of the sub-light-emitting unit that needs to be lit are (αx P ,βy P ), where α is the lateral magnification of the entire optical system, and β is the longitudinal magnification of the entire optical system;

[0011] The theoretical position coordinates (αx P ,βy P ) is the sub-light-emitting unit that is closest to the light source.

[0012] Further, the first shaping component includes a collimating lens 21 and a first reflector 31 coaxial with the illumination source 11;

[0013] The illumination light waves radiated by the sub-light-emitting units are focused by the collimating lens 21 to obtain collimated illumination light waves, and the collimated illumination light waves are then incident on the polarization beam splitting prism 13 via the first reflector 31 .

[0014] Furthermore, the second shaping component includes a collimating lens 22, a second reflector 32, and a third reflector 33, wherein the third reflector 33 is located at an off-axis position of the optical combiner 14; meanwhile, the image source 12, the polarization beam splitter prism 13, the collimating lens 22, and the second reflector 32 are located in a coaxial optical path, and are all located at an off-axis position of the third reflector 33; the vertical distance between the third reflector 33 and the second reflector 32 should ensure that the third reflector 33 does not block the display light wave;

[0015] The display light wave is transmitted from the splitting surface of the polarization splitting prism 13 to the collimating lens 22 for collimation to obtain a collimated display light wave; the collimated display light wave is reflected twice by the second reflector 32 and the third reflector 33 in sequence to the optical combiner 14 .

[0016] Furthermore, the illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 completely fill the effective use area of ​​the image source 12, and the effective use area of ​​the image source 12 is a rectangle.

[0017] Furthermore, each sub-light-emitting unit of the illumination source 11 can be independently controlled, and each sub-light-emitting unit of the illumination source 11 corresponds to a viewpoint that converges on the pupil plane.

[0018] Further, the illumination source 11 is an LCD panel, a Micro-LED panel or a Micro-OLED panel;

[0019] The illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 are monochromatic illumination light waves or polychromatic illumination light waves, and the illumination light waves are perpendicular to the plane where the image source 12 is located.

[0020] Furthermore, the incident angles of the illumination light waves radiated by the sub-light-emitting units at different positions on the illumination source 11 on the image source 12 are different; for the sub-light-emitting units at the edge positions of the illumination source 11, the incident angles of the illumination light waves radiated by them on the image source 12 are the largest, and the maximum incident angle of the collimated illumination light waves incident on the image source 12 is not greater than 12 degrees.

[0021] Furthermore, each pupil center position corresponds to a viewpoint, and the spot size of each viewpoint is less than 0.1 mm.

[0022] Furthermore, the optical combiner 14 includes a diffraction grating 141 and a base layer 142 for supporting the diffraction grating 141;

[0023] The diffraction grating 141 is a reflective holographic grating or a relief grating; the diffraction grating 141 diffracts the illumination light waves radiated by different sub-light-emitting units on the illumination source 11 and projected onto its surface to a viewpoint array located on the pupil plane.

[0024] Beneficial effects:

[0025] The present invention provides a multi-viewpoint retinal projection augmented reality near-eye display optical system, wherein the illumination light waves radiated by each light-emitting subunit on the illumination source form a dense viewpoint array with two-dimensional distribution on the pupil plane of the human eye, and the range of the viewpoint array formed by the display light wave is larger than the moving range of the pupil of the human eye, so that at any pupil position, there is a viewpoint that can enter the center of the pupil, so that the image source is directly projected onto the retina of the human eye through the display light wave corresponding to the viewpoint to form a clear image; this process does not rely on the focusing function of the lens, and no matter what distance the human eye focuses on, the virtual image can always be clearly formed on the retina, realizing a wide range of depth of field; external environmental light can be directly transmitted from the optical combiner into the human eye for imaging, realizing optical perspective display; at the same time, the viewpoint array covers the moving range of the human eye pupil, providing theoretical support for setting a large-size eye box; the display light wave corresponding to each viewpoint has a large aperture angle, and can realize a large field angle display of the virtual image. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a schematic diagram of the augmented reality near-eye display optical system provided by the present invention;

[0027] Figure 2 is a schematic diagram of the optical path of the augmented reality near-eye display optical system provided by an embodiment of the present invention;

[0028] Figure 3 is the position of the illumination optical assembly 41 when the beam splitting surface 131 rotates 45 degrees counterclockwise around the x-axis;

[0029] Figure 4 is the position of the illumination optical assembly 41 when the beam splitting surface 131 rotates 45 degrees clockwise around the x-axis;

[0030] Figure 5 is the position of the illumination optical assembly 41 when the beam splitting surface 131 rotates 45 degrees counterclockwise around the y-axis;

[0031] Figure 6 is the position of the illumination optical assembly 41 when the beam splitting surface 131 rotates 45 degrees clockwise around the y-axis;

[0032] Figure 7 is the MTF curve diagram of the central viewpoint and the edge viewpoint of the formed viewpoint array;

[0033] Figure 8 is the spot size of the 11*11 viewpoint array sampled on the pupil plane;

[0034] Fig. 9It is the spot size focused by the ideal lens of the illumination light wave incident on the image source 12 corresponding to the 11*11 viewpoint array sampled on the pupil plane. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0036] The present invention aims to provide an augmented reality near-eye display optical system with a large depth of field, a large eye box, and a large field of view. Figure 1 As shown, it includes an illumination source 11, a first shaping component, an image source 12 to be displayed near the eye to the human eye, a polarization beam splitter prism 13, a second shaping component, an optical combiner 14, an eye tracking camera 15, and a processing module; wherein the illumination source 11 includes a plurality of sub-light emitting units arranged in an array and independently controllable, and each sub-light emitting unit radiates a beam of illumination light waves;

[0037] The illumination light waves radiated by each sub-light-emitting unit are regulated by the first shaping component and then incident on the polarization beam splitter prism 13; the illumination light waves are reflected by the beam splitting surface of the polarization beam splitter prism 13 and then incident on the image source 12; the image source 12 loads image information on the incident illumination light waves to obtain display light waves; after the display light waves are reflected back to the polarization beam splitter prism 13 by the image source 12, they are directly transmitted from the beam splitting surface to the second shaping component, and then regulated by the second shaping component, they are projected from the off-axis position to the optical combiner 14; the optical combiner 14 focuses the display light waves in the form of a two-dimensionally distributed viewpoint array onto the pupil plane of the human eye, and the range of the viewpoint array formed by the display light waves is larger than the movement range of the pupil of the human eye;

[0038] When near-eye display is required, the eye tracking camera 15 is used to obtain the pupil center position in real time; the processing module determines the sub-light-emitting unit that needs to be lit according to the pupil center position, and the lit sub-light-emitting unit forms a corresponding viewpoint in the human eye pupil, so that the image source 12 is imaged on the retina.

[0039] The processing module determines the sub-light-emitting unit to be lit according to the center position of the pupil as follows:

[0040] The two-dimensional array of sub-light-emitting units and the two-dimensional viewpoint array of display light waves are both constructed with the center of the array as the origin to construct a rectangular coordinate system. It is assumed that the position coordinate of the pupil center is (x P ,y P ), then the theoretical position coordinates of the sub-light-emitting unit that needs to be lit are (αx P ,βy P ), where α is the lateral magnification of the entire optical system, and β is the longitudinal magnification of the entire optical system;P ,βy P ) is the sub-light-emitting unit that is closest to the light source.

[0041] It should be noted that the absolute value of the magnification of the optical system is equal to the image plane size divided by the object plane size. In the present embodiment, the image plane size is the size of the illumination source 11, and the object plane size is the size of the range of the viewpoint array formed. Relative to the local coordinate system located in the pupil plane and the illumination source plane, the object image of the optical system in the present embodiment is inverted, and the magnification is negative. The magnification of the optical system in the present embodiment is equal to the position coordinate mapping coefficients α and β of the viewpoint array and the illumination source light-emitting sub-unit. As the human eye rotates, any pupil center position can correspond to a viewpoint position. The eye tracking camera captures the pupil center position of the human eye in real time, and selects the viewpoint coordinate (x P ,y P ). Based on the selected viewpoint position coordinates (x P ,y P ) and the mapping coefficients α, β, synchronously illuminate the illumination source 11 on the plane with the mapping coordinates (x S ,y S )=(αx P ,βy P )The closest light-emitting subunit.

[0042] That is to say, the illumination light waves radiated by each light-emitting sub-unit on the illumination source, after being regulated by the image source, collimating lens, reflector, and optical combiner, form a two-dimensionally distributed dense viewpoint array on the pupil plane of the human eye. The image source loads image information on the light wave, and the collimating lens, reflector, and optical combiner regulate the wavefront shape of the display beam. The viewpoint array covers the movement range of the human eye pupil, providing a large-sized eye box; the display beam corresponding to each viewpoint has a large aperture angle, realizing a large field angle display of the virtual image; each viewpoint can be independently controlled by each sub-light-emitting unit on the illumination source, and the size of each viewpoint is much smaller than the diameter of the human eye pupil; each viewpoint corresponds to a pupil center position, and as the human eye pupil moves, the eye tracking camera captures the pupil center position in real time, and synchronously refreshes the corresponding light-emitting sub-unit on the illumination source, so that at any pupil position, there is a viewpoint that can enter the pupil center. The display beam corresponding to the viewpoint is directly projected to the human eye retina for imaging, and the virtual image information can be perceived by the human eye visual system. This process does not rely on the focusing function of the lens. No matter what distance the human eye focuses on, the virtual image can always be clearly imaged on the retina, achieving a wide range of depth of field; external ambient light can be directly transmitted from the optical combiner into the human eye for imaging, realizing optical perspective display.

[0043] Furthermore, the first shaping component includes a collimating lens 21 and a first reflector 31 coaxial with the illumination source 11; the second shaping component includes a collimating lens 22, a second reflector 32, and a third reflector 33; that is, the illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 are regulated by the collimating lens 21 and the reflector 31 and then incident on the polarization beam splitter prism 13; the illumination light waves are reflected by the beam splitting surface 131 of the polarization beam splitter prism 13 and then incident on the image source 12; the image source 12 loads image information on the incident illumination light waves and reflects them back to the polarization beam splitter prism 13; the display light waves loaded with image information are directly transmitted from the beam splitting surface 131, and then after being regulated by the collimating lens 22 and the reflectors 32 and 33, they are projected from the off-axis position to the optical combiner 14; the optical combiner 14 focuses the display light waves onto a two-dimensionally distributed viewpoint array on the pupil plane of the human eye.

[0044] It should be noted that, as a preferred embodiment of the present invention, the aperture stop of the optical system is located at the incident surface of the image source 12; the illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 completely fill the effective use area of ​​the image source 12; the effective use area of ​​the image source 12 is a rectangle;

[0045] As a preferred solution of the present invention, the image source 12 is a reflective spatial light modulator or an LCoS display; the image source 12 loads image information to the incident illumination light wave and reflects the illumination light wave;

[0046] As a preferred solution of the present invention, each sub-light-emitting unit of the illumination source 11 can be independently controlled; each sub-light-emitting unit of the illumination source 11 corresponds to a viewpoint that converges on the pupil plane;

[0047] As a preferred embodiment of the present invention, the illumination source 11 is a self-luminous display panel, including but not limited to LCD panel, Micro-LED panel, Micro-OLED panel; the illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 are perpendicular to the plane where the image source 11 is located; the illumination source 11 can radiate monochromatic illumination light waves to achieve monochromatic display; or radiate polychromatic illumination light waves to achieve color display; for the illumination source 11 radiating polychromatic illumination light waves, each light-emitting sub-unit simultaneously includes light-emitting units of red, green, and blue channels. The light-emitting units of different color channels illuminate the image source 12 in a high-frequency sequential manner;

[0048] As a preferred solution of the present invention, in order to realize optical perspective augmented reality display, the reflector 33 is located at an off-axis position of the optical combiner 14; the distance between the reflector 33 and the optical combiner 14 in the y direction should ensure that the reflector 33 does not block the external ambient light;

[0049] The image source 12, the polarization beam splitter prism 13, the collimating lens 22 and the reflector 32 are located in a coaxial optical path; the image source 12, the polarization beam splitter prism 13, the collimating lens 22 and the reflector 32 are all located at an off-axis position of the reflector 33; the distance between the reflectors 33 and 32 in the y direction should ensure that the reflector 33 does not block the display light beam;

[0050] The illumination source 11, the collimating lens 21, and the reflector 31 are located in a coaxial optical path to ensure that the illumination light wave energy radiated by the illumination source 11 can fully enter the display system to ensure display brightness; the illumination source 11, the collimating lens 21, and the reflector 31 constitute an illumination optical group 41 for the image source 12; the illumination optical group 41 is located at an off-axis position of the image source 12;

[0051] The image source 12, the collimating lens 22, and the reflector 31 should maintain a certain spacing distance from the outer surface of the polarization beam splitter prism 13 to avoid structural interference;

[0052] As a preferred solution of the present invention, the reflectors 32 and 33 fold the optical path and project the display light waves from the off-axis position to the optical combiner 14 to realize an optical perspective near-eye display of the off-axis projection type;

[0053] As a preferred solution of the present invention, the reflector 31 reflects the illumination light waves radiated by the illumination source 11 to the polarization beam splitter prism 13;

[0054] As a preferred embodiment of the present invention, the collimating lenses 21 and 22 are aspherical lenses or free-form surface lenses; the reflectors 31, 32, and 33 are aspherical reflectors or free-form surface reflectors;

[0055] As a preferred embodiment of the present invention, the splitting surface 131 of the polarization splitting prism 13 has polarization selectivity; the splitting surface 131 reflects the illumination light waves radiated by the illumination source 11; the splitting surface 131 transmits the display light waves reflected by the image source 12 and loaded with image information;

[0056] The effective light transmission area of ​​the light splitting surface 131 should completely cover the illumination light waves radiated by different sub-light emitting units of the illumination source 11 reflected by the reflector 31 onto its surface;

[0057] As a preferred solution of the present invention, the rotation angle of the beam splitter 131 determines the position of the illumination optical assembly 41; the beam splitter 131 can rotate counterclockwise or clockwise around the x-axis or the y-axis;

[0058] Taking the local coordinate system of the image source 12 as a reference, wherein the local z-axis is perpendicular to the plane where the image source 12 is located, the illumination optical group 41 may be located at the +y-axis side, the -y-axis side, the +x-axis side, and the -x-axis side of the image source 12;

[0059] As a preferred solution of the present invention, the illumination light waves radiated by each sub-light-emitting unit on the illumination source 11 are regulated by the collimating lens 21 and the reflector 31, and then reflected by the beam splitting surface 131, and then incident on the image source 12 in the form of collimated light waves;

[0060] As a preferred embodiment of the present invention, the incident angles of the illumination light waves radiated by the sub-light-emitting units at different positions on the illumination source 11 on the image source 12 are different; for the sub-light-emitting units at the edge positions of the illumination source 11, the incident angles of the illumination light waves radiated by them on the image source 12 are the largest; the maximum incident angle of the collimated illumination light waves incident on the image source 12 is not greater than 12 degrees;

[0061] As a preferred solution of the present invention, the light waves reflected by the image source 12 are directly transmitted from the beam splitting surface 131, and after being regulated by the collimating lens 22, an intermediate image plane is formed in space, so as to significantly reduce the volume of the system;

[0062] As a preferred solution of the present invention, the optical combiner 14 converges the display light waves projected onto its surface to the viewpoint array located on the pupil plane; the optical combiner 14 has a high optical transmittance to the external ambient light to achieve a good optical perspective effect of the external scene;

[0063] As a preferred solution of the present invention, the optical combiner 14 is perpendicular to the z-axis; the optical combiner 14 includes a diffraction grating 141 and a base layer 142;

[0064] As a preferred embodiment of the present invention, the diffraction grating 141 is a reflective holographic grating or a relief grating; the diffraction grating 141 diffracts the illumination light waves radiated by different sub-light-emitting units on the illumination source 11 projected onto its surface to the viewpoint array located on the pupil plane;

[0065] As a preferred embodiment of the present invention, the diffraction grating 141 is characterized by a phase function; the phase function can be described by mathematical forms such as XY polynomials, Zernike polynomials, and NURBS polynomials;

[0066] As a preferred embodiment of the present invention, the base shape of the base layer 142 is a plane; the thickness of the base layer 142 is less than 3 mm; the material of the base layer 142 can be resin or glass;

[0067] As a preferred solution of the present invention, the range of the viewpoint array formed on the pupil plane covers the moving range of the human eye pupil; in the viewpoint array, each viewpoint corresponds to a pupil center position; the spot size of each viewpoint is less than 0.1 mm, which is much smaller than the diameter of the human eye pupil;

[0068] As a preferred solution of the present invention, the number of viewpoints is equal to the number of light-emitting subunits of the illumination source 11, and each viewpoint corresponds to a light-emitting subunit on the illumination source 11; each viewpoint can be independently controlled by a light-emitting subunit of the illumination source 11;

[0069] As a preferred solution of the present invention, the eye tracking camera 15 works synchronously with the illumination source 11 and the image source 12; as the pupil of the human eye moves, the eye tracking camera 15 obtains the center position of the pupil in real time, and synchronously refreshes the corresponding light-emitting subunits on the illumination source 11 at any pupil position, so that the corresponding viewpoint is located at the center of the pupil; the display light beam loaded with image information passes through the viewpoint located at the center of the pupil and is directly projected onto the retina of the human eye for imaging, and the human eye visual system can perceive the virtual image information; this process is independent of the focusing function of the human eye lens, and no matter what distance the human eye focuses on, the virtual image can always be clearly imaged on the retina, achieving a wide range of depth of field extension;

[0070] As a preferred solution of the present invention, the aperture angle of the display beam converging on the viewpoint corresponds to the field angle of the viewpoint;

[0071] As a preferred solution of the present invention, the distance between the viewpoint array and the optical combiner 14 in the z direction corresponds to the exit pupil distance of the near-eye display system.

[0072] Furthermore, if Figure 2 As shown, the illumination source 11 is selected as a Micro-OLED display panel, and the size of the light-emitting subunit is 8um; the size of the light-emitting subunit is in the micrometer range, and it is not an extended light source, and the illumination light wave radiated by it can be considered as a quasi-spherical wave; the illumination light wave radiated by the light-emitting subunit is perpendicular to the plane where the illumination source 11 is located;

[0073] The image source 12 is selected as an LCoS display with a resolution of 1920*1080 and an effective use area of ​​15.36mm*8.64mm (x*y);

[0074] The effective light transmission area of ​​the splitting surface 131 of the polarization beam splitter prism 13 completely covers the illumination light waves radiated by different sub-light-emitting units of the illumination source 11 reflected on its surface by the reflector 31; the size of the polarization beam splitter prism 13 is 25.4mm*25.4mm*25.4mm (x*y*z), and the material is K9;

[0075] The illumination source 11, the collimating lens 21, and the reflector 31 constitute an illumination optical group 41 of the image source 12; the illumination optical group 41 is located at an off-axis position of the image source 12; the rotation angle of the beam splitting surface 131 of the polarization beam splitting prism 13 determines the position of the illumination optical group 41. When the beam splitting surface 131 rotates 45 degrees counterclockwise around the x-axis, the illumination optical group 41 is located at the -y-axis side of the image source 12, as shown in FIG. Figure 3When the beam splitter 131 is rotated 45 degrees clockwise around the x-axis, the illumination optical group 41 is located on the +y-axis side of the image source 12, as shown Figure 4 When the beam splitter 131 is rotated 45 degrees counterclockwise around the y-axis, the illumination optical group 41 is located on the +x-axis side of the image source 12, as shown Figure 5 When the beam splitter 131 is rotated 45 degrees clockwise around the y-axis, the illumination optical group 41 is located on the -x-axis side of the image source 12, as shown Figure 6 As shown;

[0076] The beam splitting surface 131 in the embodiment provided by the present invention rotates 45 degrees counterclockwise around the x-axis, and the illumination optical group 41 is located on the -y-axis side of the image source 12. The spherical illumination light waves radiated by each sub-light-emitting unit of the illumination source 11 are incident on the polarization beam splitting prism 13 after being regulated by the collimating lens 21 and the reflector 31; the illumination light waves are reflected by the beam splitting surface 131 of the polarization beam splitting prism 13 and are incident on the image source 12; the image source 12 loads image information on the incident illumination light waves and reflects them back to the polarization beam splitting prism 13; the display light waves loaded with image information are directly transmitted from the beam splitting surface 131, and then after being regulated by the collimating lens 22 and the reflectors 32 and 33, they are projected from the off-axis position to the optical combiner 14; the optical combiner 14 focuses the display light waves onto a two-dimensionally distributed viewpoint array on the pupil plane of the human eye;

[0077] The surfaces of the collimating lens 21 are 212 and 211 respectively, and the surfaces of the collimating lens 22 are 222 and 221 respectively;

[0078] Table 1 Position coordinates of each surface, relative to the coordinate system located at the center of the pupil plane as a reference

[0079]

[0080]

[0081] The phase function of the diffraction grating 141 is described by an XY polynomial, as shown below:

[0082]

[0083] Among them, λ c is the preparation wavelength of the diffraction grating, A m,n The polynomial coefficients, (x, y) are the local coordinates of the substrate surface of the diffraction grating 141;

[0084] Table 2 Coefficient values ​​of the phase function φ(x,y) representing the diffraction grating 141

[0085]

[0086]

[0087] The collimating lenses 21 and 22 are free-form surface lenses made of E48R, and the reflectors 31, 32, and 33 are free-form surface reflectors made of aluminum. The shape of the free-form surface is described by an XY polynomial, as shown in the following formula:

[0088]

[0089] Where c is the inverse of the radius of curvature, k is the quadratic constant, and A i,j are the polynomial coefficients, (x, y) are the local coordinates of the substrate surface;

[0090] Table 3 Surface factor of each surface

[0091]

[0092]

[0093]

[0094]

[0095] The viewpoint array formed by the near-eye display optical system provided by the embodiment of the present invention on the pupil plane has a range of 6mm*6mm; the distance between the viewpoint array and the optical combiner 14 in the z direction is 60mm;

[0096] The number of light-emitting subunits of the illumination source 11 corresponding to the viewpoint array formed within the range of 6mm*6mm on the pupil plane is 1800*1800; that is, the number of viewpoints formed on the pupil plane is 1800*1800;

[0097] In the range of 6mm*6mm on the pupil plane, the MTF curves of the sampled central viewpoint and edge viewpoint are as follows: Figure 7 As shown;

[0098] The field of view angles of the central viewpoint and edge viewpoints sampled in Table 4 are:

[0099] Viewpoint number X-direction field of view Y-direction field of view #1 44.65° 24.23° #2 44.22° 23.60° #3 44.65° 24.23° #4 44.37° 23.82° #5 44.25° 23.63° #6 44.37° 23.82° #7 44.32° 23.75° #8 44.25° 23.70° #9 44.32° 23.75°

[0100] In the 6mm*6mm range on the pupil plane, the RMS spot size of the sampled 11*11 viewpoint array is as follows: Figure 8 As shown in the figure, the average RMS spot size of each sampled viewpoint is less than 3.5um, which is much smaller than the pupil diameter of the human eye.

[0101] The collimating lens 21 and the reflector 31 regulate the illumination light waves radiated by each sub-light-emitting unit on the illumination source 11, and after being reflected by the beam splitter 131, they are incident on the image source 12 in the form of collimated illumination light waves. To evaluate the collimation of the illumination light waves, an ideal lens is placed on the plane where the image source 12 is located. The spot size of the illumination light waves focused by the ideal lens can be used to evaluate the collimation of the illumination light waves. The smaller the spot size, the higher the collimation of the illumination light waves.

[0102] In the range of 6mm*6mm on the pupil plane, the RMS spot size of the illumination light wave incident on the image source 12 corresponding to the sampled 11*11 viewpoint array and focused by the ideal lens is as follows: Fig. 9 As shown. The average RMS spot size of the illumination light wave incident on the image source 12 focused by the ideal lens is less than 0.2 mm, achieving a high degree of collimation of the illumination light wave;

[0103] In summary, the illumination light waves radiated by each light-emitting sub-unit on the illumination source, after being regulated by the image source, collimating lens, reflector, and optical combiner, form a two-dimensionally distributed dense viewpoint array on the pupil plane of the human eye. The image source loads image information on the light wave, and the collimating lens, reflector, and optical combiner regulate the wavefront shape of the display beam. The viewpoint array covers the movement range of the human eye pupil, providing a large-sized eye box; the display beam corresponding to each viewpoint has a large aperture angle, realizing a large field angle display of the virtual image; each viewpoint can be independently controlled by each sub-light-emitting unit on the illumination source, and the size of each viewpoint is much smaller than the diameter of the human eye pupil; each viewpoint corresponds to a pupil center position, and as the human eye pupil moves, the eye tracking camera captures the pupil center position in real time, and synchronously refreshes the corresponding light-emitting sub-unit on the illumination source, so that at any pupil position, there is a viewpoint that can enter the pupil center. The display beam corresponding to the viewpoint is directly projected to the human eye retina for imaging, and the virtual image information can be perceived by the human eye visual system. This process does not rely on the focusing function of the lens. No matter what distance the human eye focuses on, the virtual image can always be clearly imaged on the retina, achieving a wide range of depth of field; external ambient light can be directly transmitted from the optical combiner into the human eye for imaging, realizing optical perspective display.

[0104] Of course, the present invention may have many other embodiments. Without departing from the spirit and essence of the present invention, those skilled in the art may certainly make various corresponding changes and modifications based on the present invention, but these corresponding changes and modifications should all fall within the scope of protection of the claims attached to the present invention.

Claims

1. A multi-viewpoint retinal projection augmented reality near-eye display optical system, characterized in that: The invention comprises an illumination source (11), a first shaping component, an image source (12) to be displayed near the eye to the human eye, a polarization beam splitter prism (13), a second shaping component, an optical combiner (14), an eye tracking camera (15), and a processing module; wherein the illumination source (11) comprises a plurality of sub-light emitting units arranged in an array and independently controllable, and each sub-light emitting unit radiates a beam of illumination light waves; The illumination light waves radiated by each sub-light-emitting unit are regulated by the first shaping component and then incident on the polarization beam splitter prism (13); the illumination light waves are reflected by the beam splitting surface of the polarization beam splitter prism (13) and then incident on the image source (12); the image source (12) loads image information on the incident illumination light waves to obtain display light waves; after the display light waves are reflected back to the polarization beam splitter prism (13) by the image source (12), they are directly transmitted from the beam splitting surface to the second shaping component, and then, after being regulated by the second shaping component, they are projected from an off-axis position to the optical combiner (14); the optical combiner (14) focuses the display light waves in the form of a two-dimensionally distributed viewpoint array onto the pupil plane of the human eye, and the range of the viewpoint array formed by the display light waves is larger than the movement range of the pupil of the human eye; When near-eye display is required, the eye tracking camera (15) is used to obtain the pupil center position in real time; the processing module determines the sub-light-emitting unit that needs to be lit according to the pupil center position, and the lit sub-light-emitting unit forms a corresponding viewpoint in the pupil of the human eye, so that the image source (12) is imaged on the retina.

2. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The processing module determines the sub-light-emitting unit that needs to be lit according to the center position of the pupil: The two-dimensional array of sub-light-emitting units and the two-dimensional viewpoint array of display light waves are both constructed with the center of the array as the origin to construct a rectangular coordinate system. It is assumed that the position coordinate of the pupil center is (x P ,y P ), then the theoretical position coordinates of the sub-light-emitting unit that needs to be lit are (αx P ,βy P ), where α is the lateral magnification of the entire optical system, and β is the longitudinal magnification of the entire optical system; The theoretical position coordinates (αx P ,βy P ) is the sub-light-emitting unit that is closest to the light source.

3. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The first shaping component comprises a collimating lens (21) coaxial with the illumination source (11) and a first reflecting mirror (31); The illumination light waves radiated by the sub-light-emitting units are focused by the collimating lens (21) to obtain collimated illumination light waves, and the collimated illumination light waves are then incident on the polarization beam splitting prism (13) via the first reflector (31).

4. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The second shaping component comprises a collimating lens (22), a second reflector (32), and a third reflector (33), wherein the third reflector (33) is located at an off-axis position of the optical combiner (14); at the same time, the image source (12), the polarization beam splitter (13), the collimating lens (22), and the second reflector (32) are located in a coaxial optical path and are all located at an off-axis position of the third reflector (33); the vertical distance between the third reflector (33) and the second reflector (32) should ensure that the third reflector (33) does not block the display light wave; The display light wave is transmitted from the splitting surface of the polarization splitting prism (13) to the collimating lens (22) for collimation to obtain a collimated display light wave; the collimated display light wave is reflected twice to the optical combiner (14) via the second reflector (32) and the third reflector (33) in sequence.

5. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The illumination light waves radiated by each sub-light-emitting unit of the illumination source (11) completely fill the effective use area of ​​the image source (12), and the effective use area of ​​the image source (12) is rectangular.

6. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: Each sub-light-emitting unit of the illumination source (11) can be independently controlled, and each sub-light-emitting unit of the illumination source (11) corresponds to a viewpoint that converges on the pupil plane.

7. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The illumination source (11) is an LCD panel, a Micro-LED panel or a Micro-OLED panel; The illumination light waves radiated by each sub-light-emitting unit of the illumination source (11) are monochromatic illumination light waves or polychromatic illumination light waves, and the illumination light waves are all perpendicular to the plane where the image source (12) is located.

8. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The incident angles of the illumination light waves radiated by the sub-light-emitting units at different positions on the illumination source (11) on the image source (12) are different; for the sub-light-emitting units at the edge positions of the illumination source (11), the incident angles of the illumination light waves radiated by them on the image source (12) are the largest, and the maximum incident angle of the collimated illumination light waves incident on the image source (12) is not greater than 12 degrees.

9. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: Each pupil center position corresponds to a viewpoint, and the spot size of each viewpoint is less than 0.1 mm.

10. The multi-viewpoint retinal projection augmented reality near-eye display optical system according to claim 1, characterized in that: The optical combiner (14) comprises a diffraction grating (141) and a base layer (142) for supporting the diffraction grating (141); The diffraction grating (141) is a reflective holographic grating or a relief grating; the diffraction grating (141) diffracts the illumination light waves radiated by different sub-light-emitting units on the illumination source (11) and projected onto its surface to a viewpoint array located on a pupil plane.

Images