Light field display device

The light field generating device addresses VAC in AR and MR by projecting images from a sub-divided display panel through a lens array and fusion lens system, enhancing 3D perception and reducing aberration for improved user comfort.

JP3251931UActive Publication Date: 2025-07-10NAT TAIWAN UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2025001503U
Authority / Receiving Office
JP · JP
Patent Type
Utility models
Current Assignee / Owner
Priority Date
2021-01-22
Filing Date
2025-05-13
Publication Date
2025-07-10
Estimated Expiration
2031-02-22

AI Technical Summary

Technical Problem

Existing augmented reality (AR) and mixed reality (MR) devices suffer from vergence accommodation conflict (VAC) due to the accommodative vergence mismatch, causing discomfort during prolonged use.

Method used

A light field generating device with a display panel divided into sub-regions, a projection lens array, and a fusion lens system that projects images onto the retina to reduce aberration and enhance 3D perception.

Benefits of technology

The device effectively reduces VAC by merging images from multiple sub-regions, providing clear and immersive 3D perception with minimized aberration, suitable for near-eye displays in VR and AR applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0003251931000001_ABST
    Figure 0003251931000001_ABST
Patent Text Reader

Abstract

Provided is a light field display device. 【Solution means】The light field display device 1 is composed of a display panel 11 (laser beam scanner), a projection lens array device 12, and a fusion lens device 13. A scene located on the display panel divided into a plurality of sub-regions is displayed behind the aperture through the projection lens array device and then enters the fusion lens device to form a three-dimensional real-image light field, and is sent as an image to the pupil of a person through the eyepiece unit 2. In the near-eye field of view, the vergence accommodation conflict (VAC) phenomenon of the accommodative esotropia movement generated in most augmented reality (AR) and mixed reality (MR) facilities is reduced. The images output from the light field display device are merged to reduce aberration.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a light field generating device, and particularly to a light field generating device applied to a near-eye vision, in which the vergence accommodation conflict (VAC) phenomenon of the accommodative vergence mismatch generated in most augmented reality (AR) and mixed reality (MR) devices is reduced.

Background Art

[0002] In recent years, for example, virtual reality (VR) such as Google Glasses, Vive, and Oculus Rift, augmented reality (AR), or mixed reality (MR) devices all generate a three-dimensionality (3D) sensation based on the stereoscopic vision principle. However, due to the distance from the display device, i.e., short eye relief, a person's eyes cannot be comfortably viewed for a long time. Also, since the accommodation does not change due to the natural divergence of a person's eyes, a well-known integration collision occurs, i.e., due to the vergence accommodation conflict (VAC), viewers who use the device for a long time will feel unwell.

[0003] The applicant of the present invention proposed the invention of a head-mounted display, US2020 / 0166734A1, and its near-eye light field display device. Although these near-eye light field display devices can significantly improve the image quality of the near-eye light field display device by installing a double telecentric lens, due to the large volume of the panel and optical equipment, they cannot be applied to the existing ergonomic sizes of VR and AR. In addition, US7620309B2, which is a plenoptic camera, can obtain a four-dimensional light field by inserting a microlens array between the main lens and the photosensitive device. The microlens array located in front of the photosensitive device disperses the traveling paths of each light ray before the light rays are concentrated on the photosensitive device. Without the microlens array, each light ray of the light field is concentrated and displayed on the photosensitive device, but the angular information of the light field is lost in the camera sampling process through aggregation processing.

[0004] In line with the development of visual inventions such as VR projectors and Human Machine Interface 4.0, research and development of real-world multi-field display applications has begun, and the market scale has also started to move. In addition, in order to apply the imaging of the light field formed on the retina to AR and VR, regarding the information displayed on the retina of the human eye, the immersive quality of the image is further improved, and the practical application and popularization of light field glasses are realized. Therefore, an invention that can solve the problems related to VAC and the drawbacks of existing technologies is essential.

[0005] In order to eliminate the above-mentioned drawbacks, the inventor of the present invention has carefully studied and utilized the theory to effectively eliminate the above-mentioned drawbacks and proposes the present invention with a reasonable design.

Disclosure of the Invention

Problems to be Solved by the Invention

[0006] The main objective of this invention is to solve the above problems of the prior art, provide a process for reproducing a near-eye light field display as a light field, and particularly provide a light field generating device that merges the images output from the light field generating device to reduce aberration in this process.

Means for Solving the Problems

[0007] This invention is a light field generating device applied to a near-eye light field display to achieve the above objective, including a display panel on which light field information at each light field angle is displayed in a plurality of divided sub-regions, a projection lens array device that displays the scene of the display panel divided into a plurality of sub-regions at a position behind the common aperture, and a fusion lens device through which light passing through the projection lens array device is displayed on an imaging surface to form a three-dimensional real image light field. The real image light field generated by the light field generating device is sent as an image through the eyepiece unit to the entrance pupil and projected onto the retina as a remote image by the light field generating device.

[0008] According to the above embodiment of this invention, in any sub-region on the display panel, the displayed image is imaged on the imaging surface.

[0009] According to the above embodiment of this invention, the images displayed in all sub-regions located on the display panel are all imaged on the imaging surface and overlap with each other.

[0010] According to the above embodiment of this invention, when all the images displayed in all sub-regions located on the display panel are the same, they are imaged on the imaging surface so as to overlap with each other and be approximately the same as each other.

[0011] According to the above embodiment of the present invention, the fusion lens device is a focusing lens system, the projection lens array device is a collimating lens array, the collimating lens array is composed of array-type collimating lenses, each collimating lens is composed of a number of lenses, and the number of the collimating lenses is related to the number of sub-regions of the display panel.

[0012] According to the above embodiment of the present invention, the distance between the display panel and the collimating lens array and the distance between the collimating lens array and the focusing lens system are related to the focal length of the collimating lens array and the focal length of the focusing lens system.

[0013] According to the above embodiment of the present invention, the F value (f-number) of the projection lens array device and the fusion lens device is within the range of 2 to 10.

[0014] Hereinafter, with reference to the drawings, the features and technical contents of the present invention will be described in detail. However, those drawings and the like are for reference and explanation purposes, and the present invention is not limited thereby.

Best Mode for Carrying Out the Invention

[0015] Referring to FIGS. 1 to 7, respectively, they are the structural concept diagram of the light field generating device according to the present invention, the optical path concept diagram of the light field generating device according to the present invention, the MTF diagram of the light field generating device according to the present invention, the spherical aberration diagram of the light field generating device according to the present invention, the VR application structural concept diagram of the light field generating device according to the present invention, the VR application concept diagram of the light field generating device according to the present invention, and the AR application structural concept diagram of the light field generating device according to the present invention. As shown in the figures, the present invention is a light field generating device 1, which is composed of a display panel 11, a projection lens array device 12, and a fusion lens device 13, and displays light on an imaging surface 14. The scene from the display panel 11 divided into a plurality of sub-regions enters the fusion lens device 13 at a position behind the common aperture through the projection lens array device 12, and a three-dimensional real image light field is formed, and then the image is sent to a person's eyes through an eyepiece unit.

[0016] For design verification and for the user to check the perception of the light field quality, the present invention utilizes the optical design software CodeV to realize the light field generating device 1 and checks the simulation results. The light field generating device 1 designed by the present invention is as shown in FIG. 1, and the chief rays of all light field angles overlap on the imaging surface 14 and are as shown in FIG. 2. In the simulation, the present invention uses several types of human eye models, adjusts the parameters of the human eye model, simulates the deformation of the eyepiece unit, and then refocuses. In order to check the clarity of the displayed light field, in the present invention, the modulation transfer function (MTF) of the invention shown in FIG. 3 is analyzed. Using characters as a test pattern, according to human visual perception research, the letter vision of the human eye is 5 arc minutes.

[0017] In this experiment, the diameter of the eyeball is approximately 17 millimeters (mm), and on the retina, the size of an image with an angle of 5 minutes of arc is approximately 25 micrometers (μm). To resolve characters, at least 20 cycles / mm is required. As shown in Figure 3, according to the design of the present invention, under 20 cycles / mm, the MTF reaches 30%. Therefore, the light field effect of the display is clear, the distance effect is good, and the depth of field of the subject is deep.

[0018] Also, the results of the coma aberration analysis are as shown in Figure 4. By comparing the coma aberration between the present invention and a single human eye model, it can be seen that the aberration of the light field generating device by the eyepiece unit is reduced to a level similar to that of the original human eye model, and there are deformations only for each light field angle. As can also be seen from Figure 4, although the curvature and degree of deformation of the retina are relatively high, the deformation is an important effect of light fusion. In other words, excellent effects can be obtained by the present invention.

[0019] The following examples are for explaining the content and details of the present invention, and the claims of the present invention are not limited thereby.

[0020] A specific embodiment of the present invention is a light field generating device 1 applicable to a near-eye light field display. The light field lens of the light field generating device 1 is an eyepiece unit 2, and its structure is as shown in Figures 5 and 6.

[0021] The above light field generating device 1 includes the display panel 11, the projection lens array device 12, and the fusion lens device 13. The display panel 11 is divided into a plurality of sub-regions. The projection lens array device 12 is a collimating lens array, and the collimating lens array is composed of array-type collimating lenses 121. The number of the collimating lenses 121 is related to the number of sub-regions of the display panel 11. Each collimating lens 121 is composed of a large number of lenses. The fusion lens device 13 may be a focusing lens system. Also, the distance between the display panel 11 and the collimating lens array, and the distance between the collimating lens array and the focusing lens system are related to the focal length of the collimating lens array and the focal length of the focusing lens system. The F value (f-number) of the projection lens array device and the fusion lens device is within the range of 2 to 10.

[0022] When using augmented reality (AR) and mixed reality (MR), a light field is projected from the light field generating device 1, and the collimated near-eye light field is presented to the user's eyes through the eyepiece unit 2. Among them, light field information at each light field angle is displayed in each sub-region on the display panel 11 of the light field generating device 1. The collimating lens 121 of the projection lens array device 12 collimates the light from the display panel 11 into parallel light, and the fusion lens device 13 focuses the light passing through the projection lens array device 12 on the imaging surface 14. In this embodiment, the image displayed in any sub-region of the display panel 11 is imaged on the imaging surface 14, overlaps with each other, and when the images displayed in all sub-regions of the display panel 11 are all the same, the images located on the imaging surface 14 overlap with each other and are approximately the same. Also, the display panel 11 may be a laser beam scanner.

[0023] The light rays emitted from the above light field generating device 1 pass through the eyepiece unit 2 composed of a plurality of lenses 21, then enter the pupil of the human eye 3, and the image transmitted from the light field generating device 1 is projected onto the retina and recognized as a remote image.

[0024] The light field generating device 1 according to the present invention may have the VR application structure shown in FIG. 5 above, or may have an AR application structure as shown in FIG. 7. With reference to FIG. 7, the present invention proposes a light field generating device 1 that is compatible with a near-eye light field display and can demonstrate near-eye AR, which is a multi-display device. The light field lens of the light field generating device 1 is the eyepiece unit 2. According to the design of this embodiment, a 45-degree bi-directional dichroic plate glass 4 is used to reduce the aberration of on-axis and off-axis light rays.

[0025] Thereby, the present invention proposes a light field generating device that can be applied to a near-eye visual field and reduce the vergence accommodation conflict (VAC), which is inconsistent with the accommodative vergence movement existing in most stereoscopic VR devices. In this design, the near-eye light field display is recognized as a light field reproduction process. In this process, the image output from the light field generating device is merged to reduce the aberration. The 3D perception of the generated light field can be verified using a human eye model. The light field generating device is verified by a camera with adjustable focal length, and it is proved that the problem of VAC can be solved and AR can be realized.

[0026] As described above, the light field generating device according to the present invention can effectively eliminate various conventional drawbacks, and can reproduce a light field by using a relay lens module as a near-eye VR display device. In addition, the eyepiece unit of the light field generating device is designed to merge the light field captured by the camera array, and at the same time, minimize the aberration of off-axis rays. Then, the present invention is verified by a camera with adjustable focal length, can solve the problem of vergence accommodation conflict (VAC) of the adaptive eye divergence movement, and realizes augmented reality (AR). Therefore, since the present invention is more advanced and more practical, a utility model registration claim is filed according to the law.

[0027] The above is only a better embodiment of the present invention, and the present invention is not limited thereby. All equivalent changes and modifications made based on the scope of the utility model registration claim and the content of the specification related to the present invention are all included within the scope of the utility model registration claim of the present invention.

Brief Description of the Drawings

[0028]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Explanation of Reference Numerals

[0029] 1 Light field generation device 11 Display panel 12 Projection lens array device 121 Collimating lens 13 Fusion lens device 14 Imaging plane 2 Eyepiece unit 21 Lens 3 Human eye 4 Bidirectional dichroic plate glass

Claims

1. A light field display device, wherein in the light field display device, a display panel, a projection lens array device, and a fusion lens device are arranged in this order, the display panel has a plurality of sub-regions, for each sub-region, light field image information corresponding to the angle of light rays when the same scene is viewed from different angles is provided, the projection lens array device projects the image information of each light field of each sub-region to the fusion lens device through a diaphragm in the middle, the fusion lens device focuses the image information of each light field of each sub-region projected from the projection lens array device onto a single imaging plane to generate a single image on the imaging plane, and at this time, corresponding points between the plurality of sub-regions are focused on the same point on the imaging plane to generate a single image on the imaging plane A light field display device characterized by the above.

2. In the light field display device according to Claim 1, further comprising an eyepiece unit, the image on the imaging plane is sent to a person's pupil through the eyepiece unit and projected onto the retina, A light field display device characterized by the above.

3. In the light field display device according to Claim 2, the eyepiece unit collimates the image on the imaging plane, sends it to a person's pupil, and projects it onto the retina A light field display device characterized by the above.

4. In the light field display device according to Claim 2 or Claim 3, a bidirectional dichroic plate glass is arranged between the imaging plane and the eyepiece unit, and by guiding the image on the imaging plane to the eyepiece unit through the bidirectional dichroic plate glass, an image with reduced aberration between on-axis and off-axis is sent to the person's pupil and projected onto the retina A light field display device characterized by the above.

5. In the light field display device according to Claim 1, the fusion lens device is a focusing lens system, The projection lens array device is a collimating lens array, the collimating lens array is composed of array-type collimating lenses, each collimating lens is composed of a large number of lenses, and the number of the collimating lenses is related to the number of the sub-regions of the display panel. A light field display device characterized by the above.

6. In the light field display device according to claim 5, The collimating lens and the sub-region of the display panel are arranged in a one-to-one relationship. A light field display device characterized by the above.

7. In the light field display device according to claim 5 or claim 6, The distance between the sub-region of the display panel and the collimating lens array, and the distance between the collimating lens array and the focusing lens system are related to the focal length of the collimating lens array and the focal length of the focusing lens system. A light field display device characterized by the above.

8. In the light field display device according to claim 7, The distance between the sub-region of the display panel and the collimating lens array is the same as the focal length of the collimating lens array. A light field display device characterized by the above.

9. In the light field display device according to claim 1, The F value (f-number) of the projection lens array device and the fusion lens device is in the range of 2 to 10. A light field display device characterized by the above.

10. In the light field display device according to any one of claims 1 to 9, Instead of the display panel, a laser beam scanner is applied, The laser beam scanner provides light field image information corresponding to the angle of the light beam when the same scene is viewed at different angles for each sub-region. A light field display device characterized by the above.