Light field near-eye display device and light field near-eye display method

Abstract

The present invention proposes a light field near-eye display device and a light field near-eye display method. The light field near-eye display device includes a processor, a display panel, and a lens module. The processor calculates new ray tracing data based on the current exit pupil distance, preset exit pupil distance data, and preset ray tracing data, and adjusts the preset image data based on the new ray tracing data to generate adjusted image data. The display panel is coupled to the processor and emits an image light beam based on the adjusted image data. The lens module includes a microlens array and is arranged between the display panel and the pupil. The image light beam is emitted into the pupil through the lens module and displays a light field image. The light field near-eye display device and the light field near-eye display method of the present invention allow users to view light field images with good image quality.

Description

Technical Field

[0001] The present invention relates to a display technology, and more particularly to a light field near-eye display device and a light field near-eye display method. Background Art

[0002] Light Field Near-Eye Display (LFNED) is one of the current display technologies that can resolve the Vergence-Accommodation Conflict (VAC). It can be divided into two architectures: spatial multiplexing and temporal multiplexing. Temporal multiplexing uses micro-electromechanical system (MEMS) components to change the position of the virtual image, adjusting the clarity of the foreground and background. Spatial multiplexing uses a lens array to project the corresponding parallax image on the panel. For example, a lens array can be placed on an organic light-emitting diode (OLED) display to produce light field images.

[0003] For light field near-eye displays, the relative relationship between the left and right eyeballs and the optical system is the main system parameter. In traditional light field near-eye displays, system parameters are fixed values ​​and rely on system tolerances to provide tolerance errors for the left and right eyeballs, where system parameters may include, for example, inter pupil distance (IPD), eye box, and exit pupil distance (Eye relief). Among them, in traditional light field near-eye displays, the exit pupil distance is set as a system design and cannot be adjusted digitally. Furthermore, traditional light field near-eye displays use mechanical movement to adjust optical variables, thereby causing changes in the exit pupil distance. However, since mechanical adjustments, for example, utilize changes in the relative position of optical-mechanical structures or use active components (such as liquid or liquid crystal material property components), the complexity of the body structure will increase or the image quality will be reduced.

[0004] The "Background" section is intended only to facilitate understanding of the present invention. Therefore, the information disclosed in this section may contain information that does not constitute prior art known to those skilled in the art. The information disclosed in this section does not imply that the information or the problems to be solved by one or more embodiments of the present invention were known or understood by those skilled in the art prior to the filing of this application. Summary of the Invention

[0005] The present invention provides a light field near-eye display device, which allows a user to view a light field image with good image quality.

[0006] Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0007] To achieve one, some, or all of the above-mentioned objectives or other objectives, embodiments of the present invention provide a light field near-eye display device comprising a processor, a display panel, and a lens module. The processor calculates new ray tracing data based on the current exit pupil distance, preset exit pupil distance data, and preset ray tracing data, and adjusts the preset image data based on the new ray tracing data to generate adjusted image data. The display panel is coupled to the processor and emits an image beam based on the adjusted image data. The lens module comprises a microlens array and is disposed between the display panel and the pupil. The image beam is projected into the pupil via the lens module and displays a light field image.

[0008] To achieve one, some, or all of the aforementioned objectives, or other objectives, embodiments of the present invention provide a light field near-eye display method comprising the following steps: calculating new ray tracing data based on a current exit pupil distance, preset exit pupil distance data, and preset ray tracing data; adjusting preset image data based on the new ray tracing data to generate adjusted image data; emitting an image beam based on the adjusted image data via a display panel; and causing the image beam to enter the pupil through a lens module including a microlens array to display a light field image.

[0009] Based on the above, the light field near-eye display device and light field near-eye display method of the present invention can automatically adjust the image data according to the current exit pupil distance, so that the display panel can emit a corresponding image light beam according to the adjusted image data to provide a light field image with good image quality.

[0010] In order to make the above features and advantages of the present invention more clearly understood, embodiments are given below with reference to the accompanying drawings for detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 FIG. 4 is a circuit diagram of a light field near-eye display device according to an embodiment of the present invention.

[0012] Figure 2 FIG. 4 is a schematic diagram of the structure of a light field near-eye display device according to an embodiment of the present invention.

[0013] Figure 3 is a flow chart of a light field near-eye display method according to an embodiment of the present invention.

[0014] Figure 4 FIG. 4 is a schematic diagram of light paths for different exit pupil distances according to an embodiment of the present invention.

[0015] Figure 5 FIG. 4 is a schematic diagram of vector difference calculation according to an embodiment of the present invention. DETAILED DESCRIPTION

[0016] The foregoing and other technical aspects, features, and benefits of the present invention will be more clearly understood in the following detailed description of a preferred embodiment with reference to the accompanying drawings. Directional terms such as up, down, left, right, front, and back, used in the following embodiments, are merely references to the accompanying drawings. Therefore, the directional terms used are for illustrative purposes only and are not intended to limit the present invention.

[0017] Figure 1 FIG is a circuit diagram of a light field near-eye display device according to an embodiment of the present invention. Figure 1 , the light field near-eye display device 100 includes a processor 110, a display panel 120 and a storage device 130. The processor 110 is coupled to the display panel 120 and the storage device 130. In the present embodiment, the processor 110 can generate image data based on original image data, system parameters, such as preset binocular pupil distance, preset eye movement range, preset exit pupil distance, preset ray tracing data and other related data. The processor 110 can drive the display panel 120 according to the image data, so that the display panel 120 can emit a corresponding image light beam to the user's pupil by displaying the image content to display the light field image. In the present embodiment, the light field near-eye display device 100 is, for example, a head-mounted display (HMD), but the present invention is not limited to this.

[0018] In this embodiment, the processor 110 may include a central processing unit (CPU) that performs relevant control functions, driving functions, and image data processing functions, or other programmable general-purpose or dedicated microprocessors, digital signal processors (DSPs), image processing units (IPUs), graphics processing units (GPUs), programmable controllers, application-specific integrated circuits (ASICs), programmable logic devices (PLDs), other similar control devices, or a combination of these devices. In this embodiment, the storage device 130 may be a memory and may be used to store relevant image data, system parameters, image processing modules, and algorithms for calculating relevant parameters, etc., for access and execution by the processor 110.

[0019] In this embodiment, the display panel 120 may be a liquid crystal display (LCD) panel, an organic light-emitting diode (OLED) display panel, a micro-LED display panel, or other suitable display. The processor 110 may drive the display panel 120 to display the corresponding image frame based on the image data. Furthermore, the display panel 120 emits a corresponding image beam to display a light field image in response to displaying the corresponding image frame. In this embodiment, the processor 110 may adjust the image data based on the current exit pupil distance so that the image content displayed on the display panel 120 is adjusted so that the light field image can be displayed within the focus range of the user's pupils.

[0020] Figure 2 FIG is a schematic diagram of the structure of a light field near-eye display device according to an embodiment of the present invention. Figure 1 as well as Figure 2 In this embodiment, the light field near-eye display device 100 can be set in front of the user's field of view. The light field near-eye display device 100 may further include a lens module 140. The user's eye (pupil 201) may face the display panel 120 and the lens module 140 in direction Z. The display panel 120 and the lens module 140 may, for example, be parallel to planes formed by extending in directions X and Y, respectively. The lens module 140 may include a microlens array 141, and the microlens array 141 may include a plurality of microlenses 141_1 to 141_N arranged in an array, where N is a positive integer. The microlenses 141_1 to 141_N may extend and be arranged in directions X and Y, respectively. The lens module 140 may further include other lens elements. In this embodiment, taking the first lens 142 and the second lens 143 as examples, in other embodiments, the number or shape of other lens elements may be adjusted according to the image quality and effect to be presented by the visible light field near-eye display device 100.

[0021] In this embodiment, the lens module 140 is disposed between the display panel 120 and the pupil 201, wherein the image beam generated by the display panel 120 can be projected into the pupil 201 via the lens module 140 to display a light field image. It is worth noting that the light field image result (the imaging result on the user's retina) viewed by the user from the pupil 201 can be regarded as a virtual image equivalently imaged on a distant virtual imaging plane S1, and the equivalent optical path of the image beam can be as follows: Figure 2 shown.

[0022] In this embodiment, from the user's perspective, the user's pupil 201, within the eye movement range 202, can receive the image beam emitted by the sub-display area corresponding to the sub-image content 121_1 of the display panel 120 through the microlens 141_1, thereby observing the sub-virtual image 151_1 as if it were equivalently imaged on the distant virtual imaging plane S1. Similarly, the user's pupil 201, within the eye movement range 202, can receive the image beam emitted by the sub-display area corresponding to the sub-image content 121_2 and 121_3 of the display panel 120 through the microlenses 141_2 and 141_3, respectively, thereby observing the sub-virtual images 151_2 and 151_3 as if they were equivalently imaged on the distant virtual imaging plane S1. In this embodiment, the positions and overlapping relationships of the multiple sub-image contents displayed on the display panel 120 can be determined based on ray tracing data, allowing the user to view a light field image with a 3D object image.

[0023] It is worth noting that Figure 2 As shown in the equivalent optical path relationship between the user's pupil 201, the microlens array 141, and the display panel 120, when the current exit pupil distance Di between the pupil 201 and the microlens array 141 differs from the preset exit pupil distance, the multiple exit pupil positions corresponding to the multiple light trajectories of the multiple image light beams emitted by the display panel 120 and incident on the pupil 201 via the microlenses 141_1 to 141_N will change within the eye movement range 202, thereby affecting the image content of the light field image displayed by the user's pupil 201. Therefore, in this embodiment, the processor 110 can automatically adjust the corresponding multiple sub-image contents displayed by the display panel 120 based on the current exit pupil distance Di, so that the light field image displayed by the multiple image light beams emitted to the user's pupil 201 can be displayed within the focus range of the pupil 201.

[0024] Figure 3 FIG. 1 is a flow chart of a light field near-eye display method according to an embodiment of the present invention. Figures 1 to 3, the light field near-eye display device 100 of this embodiment can execute the light field near-eye display method including the following steps S310 to S340 to provide a good light field image display effect. It is worth noting that in this embodiment, the light field near-eye display device 100 may also include a distance sensor or an input device, wherein the distance sensor or the input device may be coupled to the processor 110. The distance sensor may automatically sense the user to obtain the current exit pupil distance for the pupil 201, and provide the current exit pupil distance to the processor 110. The input device may be manually input by the user or other external electronic device to input the current exit pupil distance and provide it to the processor 110. In this embodiment, the storage device 130 of the light field near-eye display device 100 may pre-store preset exit pupil distance data and preset ray tracing data, and the processor 110 of the light field near-eye display device 100 may obtain the current exit pupil distance Di, for example, from the aforementioned distance sensor or input device.

[0025] In step S310, the processor 110 may calculate new ray tracing data based on the current exit pupil distance Di, the preset exit pupil distance data, and the preset ray tracing data. In step S320, the processor 110 may adjust the preset image data based on the new ray tracing data to generate adjusted image data. In step S330, the light field near-eye display device 100 may emit an image beam based on the adjusted image data via the display panel 120. In step S340, the image beam may be injected into the pupil 201 via the lens module 140 including the microlens array 141 and display a light field image. Therefore, the light field near-eye display device 100 of this embodiment and the light field near-eye display method of this embodiment executed by the light field near-eye display device 100 may automatically adjust the image data based on the current exit pupil distance Di to display a light field image that is suitable for the current exit pupil distance Di. In addition, the method for calculating the new ray tracing data in step S310 will be described below. Figure 4 and Figure 5 The embodiments are described in detail.

[0026] Figure 4 FIG. 1 is a schematic diagram of optical paths for different exit pupil distances according to an embodiment of the present invention. Figure 1 、 Figure 2 and Figure 4In this embodiment, the storage device 120 may pre-store preset exit pupil distance data and preset ray tracing data. The preset exit pupil distance data may include a first preset exit pupil distance De between the first eye box E1 and the microlens array 141, or a second preset exit pupil distance De+ΔDe between the second eye box E2 and the microlens array 140, where the distance ΔDe is the distance between the first eye box E1 and the second eye box E2. It is worth noting that the first preset exit pupil distance De and the second preset exit pupil distance De+ΔDe may be the minimum exit pupil distance and the maximum exit pupil distance, respectively, that enable the light field near-eye display device 100 to effectively display. A distance Dg is defined between the microlens array 141 and the display surface PS of the display panel 120. The preset ray tracing data may include a plurality of first preset exit pupil position coordinates for a plurality of spatial coordinate points within the first eye box E1, or a plurality of second preset exit pupil position coordinates for a plurality of coordinate points within the second eye box E2. The first preset exit pupil distance De corresponds to a plurality of first preset exit pupil position coordinates and a plurality of first preset ray vectors. The second preset exit pupil distance De+ΔDe corresponds to a plurality of second preset exit pupil position coordinates and a plurality of second preset light vectors.

[0027] In this embodiment, the processor 110 can calculate multiple current exit pupil position coordinates of multiple exit pupil positions in the current eye movement range EA based on the following formula (1), where the parameters Pi, Pa, and Pb are the exit pupil position coordinates (spatial coordinates), respectively.

[0028]

[0029] Taking the exit pupil coordinates Pa1(xa,ya,za), Pi1(xi,yi,zi), and Pb1(xb,yb,zb) in the first eye movement range E1, the current eye movement range EA, and the second eye movement range E2 as an example, the exit pupil coordinates Pa1(xa,ya,za), Pi1(xi,yi,zi), and Pb1(xb,yb,zb) are the corresponding exit pupil positions in the first eye movement range E1, the current eye movement range EA, and the second eye movement range E2, respectively. In this regard, the exit pupil coordinates Pa1(xa,ya,za) and the exit pupil coordinates Pb1(xb,yb,zb) are preset exit pupil distance data (known parameters), and the first preset exit pupil distance De and the second preset exit pupil distance De+ΔDe are known parameters. In this way, when the processor 110 obtains the current exit pupil distance De+ΔDi (that is, the current exit pupil distance Di=De+ΔDi at this time), the processor 110 can calculate the current exit pupil position coordinate Pi1(xi,yi,zi) according to the aforementioned formula (1). The distance ΔDi is the distance between the first eye movement range E1 and the current eye movement range EA. Therefore, by analogy, the processor 110 can calculate multiple current exit pupil position coordinates (new ray tracing data) in the current eye movement range EA based on the current exit pupil distance De+ΔDi, the first preset exit pupil distance De, and multiple first preset exit pupil position coordinates in the first eye movement range E1, or calculate multiple current exit pupil position coordinates (new ray tracing data) in the current eye movement range EA based on the current exit pupil distance, the second preset exit pupil distance, and multiple second preset exit pupil position coordinates in the second eye movement range E2, so as to effectively establish new ray tracing data for subsequent image data adjustment.

[0030] Next, the preset ray tracing data may further include a plurality of first preset ray vectors corresponding to the locations (spatial coordinate points) of the lens centers of the plurality of microlenses 141_1 to 141_N in the first eye movement area E1, and a plurality of second preset ray vectors corresponding to the locations (spatial coordinate points) of the lens centers of the plurality of microlenses 141_1 to 141_N in the second eye movement area E2. In this embodiment, the processor 110 may calculate the current ray vectors in the new ray tracing data based on the obtained current exit pupil coordinates, the first preset exit pupil coordinates, the second preset exit pupil coordinates, the first preset ray vectors, and the second preset ray vectors in the current eye movement area EA. To this end, the processor 110 may, for example, perform an interpolation calculation to obtain the current ray vectors. In one embodiment, the interpolation calculation may utilize interpolation or extrapolation, but the present invention is not limited thereto.

[0031] The processor 110 may calculate the current light vector based on the following formula (2), wherein the parameter h1 is the distance between a current exit pupil position coordinate and a corresponding first preset exit pupil position coordinate, and the parameter h2 is the distance between a current exit pupil position coordinate and a corresponding second preset exit pupil position coordinate. is a first preset light vector from the lens center of a microlens to the corresponding first preset exit pupil position, and the parameter is a second preset light vector from the lens center of a microlens to the corresponding second preset exit pupil position.

[0032]

[0033] In detail, match reference Figure 5 , Figure 5 is a schematic diagram of vector difference calculation according to an embodiment of the present invention. It is worth noting that formula (2) represents the calculation of individual microlenses. For the multiple microlenses 141_1 to 141_N in the microlens array 141, the relevant parameters of each microlens need to be substituted into formula (2) for calculation. Figure 5 Take one of the microlenses as an example, and take the exit pupil position coordinates Pa1(xa,ya,za), Pi1(xi,yi,zi), Pb1(xb,yb,zb) on the first eye movement range E1, the current eye movement range EA, and the second eye movement range E2 as examples, and the parameters in formula (2) For example, To indicate that the parameter For example, The exit pupil position coordinates Pa1 (xa, ya, za) and the exit pupil position coordinates Pb1 (xb, yb, zb) are the preset exit pupil distance data (known parameters), and the preset light vector With preset light vector The preset light vectors (known parameters) from the position coordinates Pm1 (xm, ym, zm) of the lens center of a micro lens to the exit pupil position coordinates Pa1 (xa, ya, za) and the exit pupil position coordinates Pb1 (xb, yb, zb) are respectively. In this way, the processor 110 can calculate the preset light vectors according to the above-mentioned preset light vectors. Preset Light Vectors Parameters h1, h2 and formula (2) are used to calculate the current light vector from the position coordinates Pm1 (xm, ym, zm) of the lens center of a microlens to the exit pupil position coordinates Pi1 (xi, yi, zi)

[0034] Therefore, by analogy, the processor 110 can calculate a plurality of current ray vectors from the plurality of microlenses 140_1 to 140_N to the plurality of current exit pupil coordinates in the current eye movement area EA, a plurality of first preset exit pupil coordinates in the first eye movement area E1, a plurality of second preset exit pupil coordinates in the second eye movement area E2, and a plurality of first preset ray vectors and a plurality of second preset ray vectors corresponding to the plurality of microlenses 140_1 to 140_N of the microlens array 140. Furthermore, the processor 110 can adjust the plurality of sub-image contents in the preset image data based on the plurality of current ray vectors corresponding to the plurality of microlenses 140_1 to 140_N, so that the plurality of image beams corresponding to the plurality of sub-image contents form a plurality of sub-light field image units through the plurality of microlenses 140_1 to 140_N, and the plurality of sub-light field image units form a light field image.

[0035] For example, if Figure 4As shown, the first eye movement area E1, the current eye movement area EA, and the second eye movement area E2 corresponding to the exit pupil distances De, De+ΔDi, and De+ΔDe can all receive the sub-image content 401 displayed by the display panel 120 through the central microlens 141_1. That is, for the central microlens 141_1, the positions of the sub-image content 401 received by the first eye movement area E1, the current eye movement area EA, and the second eye movement area E2 corresponding to the exit pupil distances De, De+ΔDi, and De+ΔDe remain essentially unchanged. However, for other microlenses not located in the central position, when the exit pupil distance changes, the positions of the sub-image content received by their corresponding eye movement areas will also change accordingly. For example, the following will further illustrate the case where the exit pupil distance De+ΔDe (corresponding to the second eye movement area E2) changes to the current exit pupil distance De+ΔDi (corresponding to the current eye movement area EA) for microlens 141_2. First, when the light field near-eye display device 100 displays a light field image based on image data corresponding to the second eye movement range E2 at the exit pupil distance De+ΔDe, the image beam emitted by the sub-image content 402 displayed on the display panel 120 can be incident on the second eye movement range E2 located at the exit pupil distance De+ΔDe via the microlens 141_2. Then, when the distance between the pupil and the microlens 141_2 changes to the current exit pupil distance De+ΔDi, the processor 110 can adjust the position of the sub-image content 402 originally displayed on the display panel 120 to the position of the sub-image content 403 through the aforementioned adjustment of the light vectors of the present invention. This allows the image beam emitted by the adjusted sub-image content 403 displayed on the display panel 120 to be incident on the current eye movement range EA (i.e., the current user's pupil) located at the current exit pupil distance De+ΔDi via the microlens 141_2. In addition, it should be noted that the sub-image content 402 and the sub-image content 403 are both displayed on the display surface PS of the display panel 120. Figure 4 The positions of the sub-video content 402 and the sub-video content 403 shown are merely illustrative of the position changes on the display surface PS.

[0036] In summary, the light field near-eye display device and light field near-eye display method of the present invention can automatically adjust image data according to the user's current exit pupil distance. The image content provided by the display panel in the light field near-eye display device enables the display panel to emit a corresponding image light beam based on the adjusted image data, thereby allowing the image light beam to be correctly incident on the user's pupil, so that the light field image can be displayed within the focus range of the pupil, thereby allowing the user to view a light field image with good image quality.

[0037] The above description is only a preferred embodiment of the present invention, and it cannot be used to limit the scope of implementation of the present invention. That is, all simple equivalent changes and modifications made in accordance with the claims of the present invention and the content of the invention description are still within the scope of the patent of the present invention. In addition, any embodiment or claim of the present invention does not need to achieve all the purposes, advantages or features disclosed by the present invention. In addition, the abstract and title are only used to assist in searching patent documents and are not used to limit the scope of rights of the present invention. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only used to name the name of the element or to distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

[0038] Description of Reference Numerals

[0039] 100: Light field near-eye display device

[0040] 110: Processor

[0041] 120: Display panel

[0042] 121_1, 121_2, 121_3, 401, 402, 403: Sub-image content

[0043] 130: Storage device

[0044] 140: Lens module

[0045] 141: Microlens Array

[0046] 141_1~141_N: Microlens

[0047] 142: First lens

[0048] 143: Second lens

[0049] 151_1, 151_2, 151_3: Sub-virtual images

[0050] 201:Pupil

[0051] 202, E1, E2, EA: Eye movement range

[0052] X, Y, Z: direction

[0053] De, Di: Exit pupil distance

[0054] ΔDe, ΔDi, Dg: distance

[0055] h1, h2: parameters

[0056] Pa1(xa,ya,za), Pb1(xb,yb,zb), Pi1(xi,yi,zi), Pm1(xm,ym,zm): position coordinates

[0057] Light Vector

[0058] S1: Virtual imaging plane

[0059] S310, S320, S330, S340: Steps

[0060] PS: Display surface.

Claims

1. A light field near-eye display device, characterized in that: The light field near-eye display device includes a processor, a display panel, and a lens module, wherein: The processor calculates new ray tracing data based on the current exit pupil distance, the preset exit pupil distance data, and the preset ray tracing data, and adjusts the preset image data based on the new ray tracing data to generate adjusted image data; The display panel is coupled to the processor and emits an image beam according to the adjusted image data; and The lens module includes a microlens array and is disposed between the display panel and the pupil, wherein the image light beam is emitted into the pupil via the lens module and displays a light field image, wherein the preset exit pupil distance data includes a first preset exit pupil distance and a second preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinate, a second preset exit pupil position coordinate, a first preset ray vector, and a second preset ray vector; The processor calculates the current exit pupil position coordinates of the new ray tracing data based on the current exit pupil distance, the first preset exit pupil distance, and the first preset exit pupil position coordinates, and calculates the current ray vector of the new ray tracing data according to the following formula: h1 is the distance value between the current exit pupil position coordinate and the corresponding first preset exit pupil position coordinate, h2 is the distance value between the current exit pupil position coordinate and the corresponding second preset exit pupil position coordinate, is a first preset light vector from the lens center of a microlens to the corresponding first preset exit pupil position, is a second preset ray vector from the lens center of a microlens to the corresponding second preset exit pupil position:

2. The light field near-eye display device according to claim 1, characterized in that: The processor performs an interpolation calculation according to the current exit pupil position coordinate, the first preset exit pupil position coordinate, the second preset exit pupil position coordinate, the first preset light vector, and the second preset light vector to obtain the current light vector.

3. The light field near-eye display device according to claim 1, wherein: The first preset exit pupil distance and the second preset exit pupil distance are the minimum exit pupil distance and the maximum exit pupil distance respectively.

4. The light field near-eye display device according to claim 1, wherein: The current exit pupil distance is the distance between the current eye movement range corresponding to the pupil and the microlens array, and the current exit pupil position coordinates are located in the current eye movement range. The first preset exit pupil distance corresponds to the distance between the first preset eye movement range and the microlens array, and the first preset exit pupil position coordinates are located in the first preset eye movement range. The second preset exit pupil distance corresponds to the distance between the second preset eye movement range and the microlens array, and the second preset exit pupil position coordinates are located in the second preset eye movement range.

5. The light field near-eye display device according to claim 1, wherein: The light field image is displayed within a focal range of the pupil.

6. The light field near-eye display device according to claim 1, wherein: It also includes: A distance sensor is coupled to the processor, wherein the processor obtains the current exit pupil distance of the pupil by using the distance sensor.

7. A light field near-eye display device, characterized in that: The light field near-eye display device includes a processor, a display panel, and a lens module, wherein: The processor calculates new ray tracing data based on the current exit pupil distance, the preset exit pupil distance data, and the preset ray tracing data, and adjusts the preset image data based on the new ray tracing data to generate adjusted image data; The display panel is coupled to the processor and emits an image beam according to the adjusted image data; and The lens module includes a microlens array and is disposed between the display panel and the pupil, wherein the image light beam is incident upon the pupil via the lens module and displays a light field image. wherein the preset exit pupil distance data includes a first preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinate; wherein the processor calculates the current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance, and the first preset exit pupil position coordinates; The number of the first preset exit pupil position coordinates is multiple, and the processor calculates multiple current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance, and the multiple first preset exit pupil position coordinates. The processor also calculates multiple current light vectors from the multiple microlenses to the multiple current exit pupil position coordinates in the current eye movement range according to the multiple current exit pupil position coordinates, the multiple first preset exit pupil position coordinates, the multiple second preset exit pupil position coordinates, the multiple first preset light vectors corresponding to the multiple microlenses of the microlens array, and the multiple second preset light vectors. Each of the multiple current light vectors is calculated according to the following formula, wherein h1 is the distance value between one of the multiple current exit pupil position coordinates and the corresponding first preset exit pupil position coordinate, and h2 is the distance value between one of the multiple current exit pupil position coordinates and the corresponding second preset exit pupil position coordinate. is a first preset light vector from the lens center of one of the plurality of microlenses to the corresponding first preset exit pupil position, is a second preset ray vector from the lens center of a microlens to the corresponding second preset exit pupil position:

8. The light field near-eye display device according to claim 7, characterized in that: The processor adjusts a plurality of sub-image contents in the preset image data according to the plurality of current light vectors respectively corresponding to the plurality of microlenses, so that a plurality of image light beams of the plurality of sub-image contents respectively form a plurality of sub-light field image units through the plurality of microlenses, and the plurality of sub-light field image units form the light field image.

9. A light field near-eye display method, characterized in that: The light field near-eye display method includes: Calculate new ray tracing data based on the current exit pupil distance, the preset exit pupil distance data, and the preset ray tracing data; adjusting the preset image data according to the new ray tracing data to generate adjusted image data; emitting an image beam according to the adjusted image data by a display panel; and The image beam is caused to enter the pupil through a lens module including a microlens array and display a light field image, wherein the preset exit pupil distance data includes a first preset exit pupil distance and a second preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinate, a second preset exit pupil position coordinate, a first preset ray vector, and a second preset ray vector. The step of calculating the new ray tracing data further includes calculating the current exit pupil position coordinates of the new ray tracing data based on the current exit pupil distance, the first preset exit pupil distance, and the first preset exit pupil position coordinates, and calculating the current ray vector of the new ray tracing data according to the following formula, wherein h1 is the distance value between the current exit pupil position coordinates and the corresponding first preset exit pupil position coordinates, and h2 is the distance value between the current exit pupil position coordinates and the corresponding second preset exit pupil position coordinates. is a first preset light vector from the lens center of a microlens to the corresponding first preset exit pupil position, is a second preset ray vector from the lens center of a microlens to the corresponding second preset exit pupil position:

10. The light field near-eye display method according to claim 9, characterized in that: The step of calculating the current ray vector of the new ray tracing data comprises: An interpolation calculation is performed according to the current exit pupil position coordinate, the first preset exit pupil position coordinate, the second preset exit pupil position coordinate, the first preset light vector, and the second preset light vector to obtain the current light vector.

11. The light field near-eye display method according to claim 9, characterized in that: The first preset exit pupil distance and the second preset exit pupil distance are the minimum exit pupil distance and the maximum exit pupil distance respectively.

12. The light field near-eye display method according to claim 9, characterized in that: The current exit pupil distance is the distance between the current eye movement range corresponding to the pupil and the microlens array, and the current exit pupil position coordinates are located in the current eye movement range. The first preset exit pupil distance corresponds to the distance between the first preset eye movement range and the microlens array, and the first preset exit pupil position coordinates are located in the first preset eye movement range. The second preset exit pupil distance corresponds to the distance between the second preset eye movement range and the microlens array, and the second preset exit pupil position coordinates are located in the second preset eye movement range.

13. The light field near-eye display method according to claim 9, wherein: The light field image is displayed within a focal range of the pupil.

14. The light field near-eye display method according to claim 9, characterized in that: Also includes: The current exit pupil distance is obtained by using a distance sensor coupled to a processor and targeting the pupil.

15. A light field near-eye display method, characterized in that: The light field near-eye display method includes: Calculate new ray tracing data based on the current exit pupil distance, the preset exit pupil distance data, and the preset ray tracing data; adjusting the preset image data according to the new ray tracing data to generate adjusted image data; emitting an image beam according to the adjusted image data by a display panel; and The image beam is injected into the pupil through a lens module including a microlens array to display a light field image. The preset exit pupil distance data includes a first preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinate, wherein the step of calculating the new ray tracing data includes: Calculating the current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance, and the first preset exit pupil position coordinates, The number of the first preset exit pupil position coordinates is multiple, and the step of calculating the new ray tracing data further includes: Calculating a plurality of current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance, and a plurality of first preset exit pupil position coordinates respectively; and A plurality of current light vectors from the plurality of microlenses to the plurality of current exit pupil position coordinates in the current eye movement range are calculated respectively based on the plurality of current exit pupil position coordinates, the plurality of first preset exit pupil position coordinates, the plurality of second preset exit pupil position coordinates, the plurality of first preset light vectors corresponding to the plurality of microlenses of the microlens array, and the plurality of second preset light vectors. Each of the plurality of current light vectors is calculated according to the following formula, wherein h1 is a distance value between a current exit pupil position coordinate in the plurality of current exit pupil position coordinates and the corresponding first preset exit pupil position coordinate, and h2 is a distance value between a current exit pupil position coordinate in the plurality of current exit pupil position coordinates and the corresponding second preset exit pupil position coordinate. is a first preset light vector from the lens center of one of the plurality of microlenses to the corresponding first preset exit pupil position, is a second preset ray vector from the lens center of a microlens to the corresponding second preset exit pupil position:

16. The light field near-eye display method according to claim 15, characterized in that: The step of adjusting the preset image data according to the new ray tracing data includes: Adjusting a plurality of sub-image contents in the preset image data according to the plurality of current light vectors respectively corresponding to the plurality of micro-lenses, The step of displaying the light field image comprises: A plurality of image light beams of the plurality of sub-image contents respectively pass through the plurality of microlenses to form a plurality of sub-light field image units, and the plurality of sub-light field image units form the light field image.

Images