Eye tracking and personalized viewing zone display system with tunable microstructured optical film

Abstract

The application provides an eye movement tracking and personalized visual area display system of an adjustable microstructure optical film, which comprises a central control processing unit, the central control processing unit acquires spatial position data of both eyes of a viewer in a display panel coordinate system through a viewpoint acquisition unit at a display panel unit, calculates a viewpoint space, and adjusts light rays of the display panel unit through an adjustable microstructure optical layer at the display panel unit to form a discrete light field reconstruction working condition, so that the display panel unit forms dynamic visual area display corresponding to the viewpoint space of the human eye, the display panel light flux in a current target visual area window of a user is increased, and the display panel light leakage in a current non-target visual area direction is reduced, so that the brightness perception of the target visual area of the user is enhanced and privacy display is realized; and the application can realize active modeling and partition reconstruction of a display light field in a three-dimensional space, so that display light rays are directionally converged to a target visual area of the human eye.

Description

Technical Field

[0001] This invention relates to the fields of display technology and computational optics, particularly to a personalized viewing zone display system based on eye tracking and tunable microstructure optical thin films. Specifically, it relates to a display system based on discrete light field reconstruction and dynamic light control using microstructure arrays. The invention also relates to a display technology that integrates viewpoint perception, spatial light field modeling, and tunable microstructure optical control. By constructing a coupling relationship between display zones, microstructure arrays, and the viewing point, the system achieves directional reconstruction and dynamic control of display light in three-dimensional space, thereby realizing a personalized viewing zone display, privacy display, and efficient light energy utilization display system and related methods. Background Technology

[0002] With the development of display technology, especially the rapid progress of self-emissive display technology represented by MicroLED, its advantages such as high brightness, high contrast, long life and low power consumption have made it an important development direction for high-end displays and next-generation display systems.

[0003] In traditional display systems, to meet the needs of multi-angle viewing, a diffusion film or scattering film is usually placed on the light-emitting surface of the display panel to distribute the light emitted by the pixels evenly over a wide angle range, thereby achieving wide-viewing-angle display. However, this type of solution is essentially a passive extension of the display light field. While it improves the viewing angle by uniformly scattering light in space, it also introduces significant technical drawbacks:

[0004] On the one hand, a large amount of light fails to effectively enter the viewer's eyes and is instead distributed to ineffective spatial areas, resulting in low light energy utilization. On the other hand, the indiscriminate distribution of light in space makes the displayed content lack directional selectivity, making it difficult to achieve privacy protection, and at the same time, it easily reduces contrast performance under ambient light conditions.

[0005] In personal display devices or scenarios with a limited number of viewers (such as personal display terminals, vehicle head-up displays, glasses-free 3D displays, and privacy displays), viewers are typically concentrated in a specific spatial area. The display system does not need to emit light uniformly over a large area; instead, it needs to direct the light towards the visual area of ​​the viewer's eyes. In such applications, traditional diffusion-based light field distribution methods not only reduce light efficiency but also hinder the achievement of directional display and privacy control.

[0006] To address these needs, existing technologies have proposed a class of directional light control schemes based on microstructure arrays. For example, these schemes use microlens arrays, microprism arrays, or optical collimating structures to refract or collimate the emitted light, allowing it to propagate within a specific angular range. These technologies achieve, to some extent, viewing angle limitation or mode switching, such as switching between a wide-viewing-angle mode and a privacy mode.

[0007] However, the above technologies still have significant limitations:

[0008] (1) Most existing microstructure arrays are fixed structures, and their optical functions are determined after manufacturing. They can only achieve fixed beam deflection or limited mode switching, making it difficult to achieve continuous and adjustable beam direction control.

[0009] (2) Existing solutions are usually based on overall beam control or fixed angle limitations, and do not establish a correspondence between display zones and spatial observation positions, so they cannot achieve fine light distribution control for different spatial positions;

[0010] (3) Existing technologies lack a modeling and reconstruction mechanism for the display light field in three-dimensional space, and cannot dynamically adjust the light distribution in real time according to the changes in the viewer's position;

[0011] (4) Existing solutions usually lack a collaborative mechanism between viewpoint perception and optical control, and cannot achieve a dynamic display effect where light continuously follows the viewer's movement.

[0012] Therefore, in essence, existing display technologies mainly remain at the level of "light diffusion" or "fixed direction control", and have not yet achieved the active construction and spatial reconstruction of the display light field.

[0013] In summary, there is an urgent need for a new display system that can dynamically control the emitted light from each zone of the display panel based on the viewer's viewpoint information, constructing and reconstructing the target light field distribution in three-dimensional space. This allows the light to continuously and accurately converge onto the viewing area where the viewer's eyes are located, thereby achieving efficient light energy utilization, dynamic view zone following, and privacy display functions. This invention is proposed against this background. Summary of the Invention

[0014] This invention proposes a personalized viewing zone display system based on eye tracking and adjustable microstructure optical thin films, and a discrete light field reconstruction and dynamic viewing zone display system based on microstructure arrays. Its core lies in constructing a closed-loop control mechanism based on viewpoint perception, discrete light field modeling, partitioned light field reconstruction and execution, to achieve active modeling and partitioned reconstruction of the display light field in three-dimensional space, so that the display light rays converge directionally to the target viewing zone of the human eye.

[0015] The present invention adopts the following technical solution.

[0016] A personalized viewing zone display system using eye tracking and tunable microstructured optical films is disclosed. The system includes a central control processing unit. This unit acquires spatial position data of the viewer's eyes in the display panel coordinate system using a viewpoint acquisition unit at the display panel unit and calculates the viewpoint space. It then uses a tunable microstructured optical layer at the display panel unit to adjust the light emission from the display panel unit, forming a discrete light field reconstruction condition. This allows the display panel unit to create a dynamic viewing zone display corresponding to the human eye's viewpoint space. This is achieved by increasing the light flux emitted from the display panel within the user's current target viewing zone window and decreasing the light flux in the current non-target viewing zone direction. The display panel light leakage is reduced to enhance the brightness perception of the user's target viewing area and achieve privacy display. The viewable range and optimal viewing angle of the displayed content can be dynamically adjusted and the viewing area brightness can be optimized. At the same time, it takes into account the imaging quality and system response performance. It is suitable for applications such as naked-eye 3D display, vehicle head-up display, personal terminal display and high-precision directional display. By constructing the coupling relationship between "viewpoint - display zone - microstructure array", a dynamic light control system based on discrete light field reconstruction is realized, forming a closed-loop control mechanism of perception - modeling - control - execution, so that the display light can be dynamically adjusted in real time according to the viewer's position.

[0017] The display panel unit is used to output the original image light, and can be MicroLED, MicroOLED or other self-emissive display panels. Its pixel array constitutes the initial radiation source distribution of the display light field, so that the display panel outputs the image light of the displayed content.

[0018] The viewpoint acquisition unit is used to acquire the spatial position data of the viewer's eyes in the coordinate system of the display panel unit. It is positioned around the visible area of ​​the display panel or at a fixed location opposite to the display panel, preferably at the front end or border area of ​​the display panel, ensuring coverage of the viewer's eye movement range. The spatial position parameters of the viewer's eyes are acquired by sensors or acquisition devices used to measure or calculate the three-dimensional position of the eyes. These spatial position parameters include distance, horizontal offset, vertical offset, azimuth angle, and pitch angle, or a combination thereof.

[0019] The sensor or acquisition device includes a depth measurement device, a camera device or an infrared sensing device, and the spatial position data is used to construct the predetermined viewing window and participate in the light field reconstruction control.

[0020] The adjustable microstructure optical layer includes a microstructure array disposed on the light-emitting side of the display panel unit. The adjustable microstructure optical layer includes multiple adjustable micro-optical units arranged in an array. The multiple adjustable micro-optical units have an associated correspondence with multiple display zones on the display panel unit and are used to change the principal optical axis direction or emission angle range of the light emitted from the corresponding display zone under the action of the driving control quantity of the control signal.

[0021] The central control and processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer.

[0022] The central control processing unit is configured to: construct a predetermined viewing area window corresponding to the viewer's eyes based on the spatial location data and the geometric position information of each of the display partitions, and determine the target emission direction parameters corresponding to each display partition; generate and output the driving control quantity corresponding to each of the adjustable micro-optical units based on the mapping relationship between the target emission direction parameters and the driving control quantity, so that the light rays emitted from multiple display partitions can work together in space to form a light field distribution pointing to the predetermined viewing area window, thereby realizing discrete light field reconstruction and dynamic viewing area display.

[0023] The tunable microstructure optical layer includes a transparent support and driving substrate layer 5, a functional layer 3, and an encapsulation and protection layer 1 disposed in the light emission direction of the display panel. A driving circuit is disposed on the transparent support and driving substrate layer.

[0024] After the light emitted from the display panel enters the tunable microstructure optical layer, the functional layer adjusts the incident light to form the desired transmitted light.

[0025] The functional layer uses a microstructure array to adjust the incident light 6 to generate the desired transmitted light 7. The microstructure array is an adjustable micro-optical unit array, which includes a transmissive micro-louver array or a micro-prism array driven by the driving electrode 4.

[0026] The driving substrate layer of the transparent support and driving substrate layer includes a driving circuit, which is a TFT active matrix or row and column addressing circuit, used to perform pixel-by-pixel or partition addressing control of the adjustable micro optical units in the functional layer.

[0027] The central control processing unit provides corresponding drive control signals to each adjustable micro optical unit through the drive circuit, so that the microstructure array changes the direction, transmission angle range or deflection of the light emitted from the display panel under the action of the drive signal, thereby forming directional control of the light field emitted from the display zone and realizing independent light control of each zone of the display panel.

[0028] The encapsulation protective layer and the transparent support and drive substrate layer form a sealed cavity 2, which is used to accommodate the movable microstructure unit in the functional layer and provide it with dustproof, moisture-proof and mechanical protection.

[0029] Each adjustable micro-optical unit corresponds to a display zone on the display panel unit. The display zone is composed of one or more pixels, and its size and spatial position are dynamically determined by the central control processing unit according to the position of the predetermined viewing window and the light control capability of the microstructure unit.

[0030] The emitted light from each display zone is coordinated and adjusted under the control of the central control processing unit to form a directional light field distribution in the viewpoint space facing the predetermined viewing window of the human eye.

[0031] The central control processing unit constructs the target emission direction parameters corresponding to each display partition based on the spatial position data of the viewer's eyes obtained by the viewpoint acquisition unit and the spatial position of each display partition in the display panel coordinate system, and generates the driving control quantity of each micro-optical unit through a preset discrete light field control model.

[0032] The discrete light field control model is used to describe the coupling relationship between the display partition position, the microstructure unit posture and the direction of the emitted light in three-dimensional space. The model is obtained through theoretical calculation or experimental calibration and is used to spatially discretize and reconstruct the display light, so that the light output from different display partitions can converge in space to the predetermined viewing window where the viewer's eyes are located, thereby realizing dynamic viewing area display and privacy display.

[0033] The central control processing unit acquires facial and depth images of the viewer via the infrared stereo camera, structured light depth camera, and ToF depth sensor of the viewpoint acquisition unit. The acquired image data undergoes preprocessing, including denoising, grayscale conversion, and illumination normalization. Then, it identifies key points for the left and right eyes using a convolutional neural network or depth regression model. Specifically:

[0034] Extract the two-dimensional coordinates (u,v); combine them with the depth information z, and reconstruct the three-dimensional coordinates (X,V) in the camera coordinate system of the viewpoint acquisition unit. c ,Y c Z c )for:

[0035] Z c = z;

[0036] Where f x , f y For focal length, (c x ,c yThe coordinates of the main point are then used. Subsequently, the three-dimensional coordinates are mapped to the display panel coordinate system (X) using a rigid transformation matrix T. s ,Y s Z s ):

[0037]

[0038] In the processing of multiple consecutive frames of data, the positions of both eyes are updated using Kalman filtering, and the corresponding formula is as follows:

[0039]

[0040]

[0041] in This is the final estimate based on current observations. Based on previous observations, Let H be the Kalman gain, H be the observation matrix, and z be the Kalman gain. k Observed values ​​are data actually measured by sensors (such as cameras and depth cameras). The corrected covariance. To predict the covariance, I is the identity matrix;

[0042] The central control processing unit predicts the human eye position at the next moment using a linear or adaptive prediction algorithm, while simultaneously eliminating outliers and compensating for dropped frames to ensure smooth and real-time microstructure unit drive signals; the obtained (X s ,Y s Z s This information is provided for calculating the direction (α, β) of the target's outgoing light rays in the subsequent construction of the discrete light field.

[0043] The tunable microstructure optical layer is disposed on the light-emitting side of the display panel. It is an integrated microelectromechanical system (MEMS) structure, preferably a MEMS tunable optical thin film layer. The optical layer includes a transparent support and driving substrate layer, a functional layer, and an encapsulation and protection layer. The functional layer integrates an array of MEMS microstructure units. The microstructure units can be one or more of the following: transmissive micro-louvers, variable aperture arrays, microlens arrays, or microprism arrays. The micro-optical units are connected to the driving circuit through controllable methods such as electrostatic driving, piezoelectric driving, or electrothermal driving. Under the action of the driving signal, they can undergo minute displacement, tilting, rotation, or geometric deformation in the z-axis, thereby changing the transmission direction, emission angle range, or deflection path of light.

[0044] Through the aforementioned microstructure control mechanism, each microstructure unit can dynamically modulate the direction of the emitted light from its corresponding display zone, transforming the original divergent light field into a directionally selective emitted light field, thereby creating a controllable light distribution in space. Specifically, under different driving states, the microstructure array restricts, deflects, or focuses the light from the display panel, allowing the light to pass through within the target viewing angle range of the human eye, while blocking or deflecting it in non-target viewing angle directions. This achieves active control over the spatial light distribution, resulting in high-contrast and directional display effects.

[0045] The central control processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer, respectively, and is used to construct and execute a discrete light field control model. The central control processing unit receives the spatial position data of the viewer's eyes output by the viewpoint acquisition unit, and calculates the target emission direction parameters corresponding to each partition by combining the spatial position of each display partition in the display panel coordinate system.

[0046] Based on this, the central control processing unit generates driving control quantities for each microstructure unit based on a preset discrete light field control model. The driving control quantities include the target attitude parameters of the microstructure unit (such as tilt angle, opening angle, or deflection) and their corresponding driving voltage or driving signal. By independently controlling each partition microstructure unit, the light emitted from different display partitions can be coordinated and converged in space to the predetermined viewing window, thereby realizing the spatial reconstruction of the display light field.

[0047] In the discrete light field control model, the display panel is divided into multiple display zones, each corresponding to an adjustable microstructure unit. The orientation of each microstructure unit is controlled by several adjustable parameters to determine the emission direction and angle range of the light. The discrete light field control model couples the pixel zones on the display panel, the orientation of the microstructure units, and the three-dimensional spatial position of the viewer's eyes to achieve precise orientation reconstruction of light in three-dimensional space and dynamic viewing zone display.

[0048] In the discrete light field control model, the exit direction of the light rays incident on the human eye corresponding to the display partition in three-dimensional space is completely described by two angles, namely the azimuth angle α and the pitch angle β, expressed as a unit vector. =(sinβcosα,sinβsinα,cosβ) represents;

[0049] Azimuth α and elevation β are determined by the position of each display zone (X). d ,Y d Z d ) and the binocular positions (X) obtained by the viewpoint acquisition unit s ,Y s Z s The calculation is as follows:

[0050]

[0051] α=arctan2(L y ,L x ),

[0052] β=arccos(L z )

[0053] If the microstructure unit has additional attitude parameters of rotation or tilt angle ψ (the attitude ψ of the microstructure unit is not a single scalar parameter, but a set of multi-degree-of-freedom parameters, depending on the type of microstructure and the control method), these parameters are used to adjust the opening direction or deflection characteristics of the microstructure, thereby indirectly affecting the precise direction and emission angle range of the emitted light.

[0054] The actual direction of the emitted light rays from the microstructure unit can be expressed by the formula:

[0055]

[0056] in To display the initial ray direction of the partition, R(ψ) is the rotation matrix for rotating or tilting the microstructure unit. The adjusted light direction is towards the eyes; the precise orientation of the light emitted from the display panel in three-dimensional space is achieved by adjusting the microstructure attitude parameter ψ and matching the target light direction (α,β).

[0057] The above formula is used to establish the display partition position (X). d ,Y d Z d ), microstructure attitude parameter ψ and observation points (X) in three-dimensional space s ,Y s Z s Coupling functions between ) , ψ, ,

[0058] The observation point is the three-dimensional coordinates of the viewer's eyes in space. Based on this coupling function, the direction of the emitted light rays corresponding to each display partition microstructure unit under different driving states is calculated, generating preliminary discrete light field response data. Then, the mapping relationship between the driving control quantity and the microstructure attitude parameter ψ under different microstructure attitudes of each display partition is established, forming a discrete light field control model that can be used by the central control processing unit to calculate the driving state of each microstructure unit in real time.

[0059] The drive control quantities include drive voltage v, drive current i, or pulse width w; by setting the adjustable micro louver structure or tiltable micro prism structure working conditions through the drive control quantities, light from non-target viewing directions is refracted, reflected, or totally internally reflected, thereby reducing lateral light leakage; while light from the target viewing area direction maintains a high transmittance.

[0060] Based on a discrete light field control model, the central control processing unit uses real-time acquired viewer eye position data to find or interpolate the corresponding drive control quantities from the discrete light field control model. This enables precise control and dynamic reconstruction of spatial light, converging the light to the predetermined viewing area window where the viewer is located. This achieves personalized viewing area display and privacy protection. This type of microstructure array essentially constitutes a programmable optical control interface, which modulates the overall light field distribution by changing the local optical response.

[0061] The method for establishing the discrete optical field control model includes theoretical calculation method, experimental calibration method, or a combined method of theoretical calculation and experimental calibration.

[0062] The experimental calibration method first involves actually measuring the optical output of the microstructure unit under different driving states to obtain its influence on the direction and angle range of the emitted light rays. Specifically, this includes the following steps:

[0063] Step 1: Microstructure unit drive settings, specifically: apply a series of different drive control quantities to each microstructure unit, including parameters such as drive voltage, current, pulse width or duty cycle; for each drive state, record the attitude parameters of the microstructure unit (such as tilt angle, rotation angle, z-direction displacement, opening angle or equivalent refraction angle).

[0064] Step 2, Optical Output Measurement, specifically: using optical detection equipment (such as a high-resolution camera, spot measuring instrument or interferometer) to measure the direction and angle distribution of the emitted light rays of each display partition microstructure unit under different driving states; collecting beam data for each microstructure unit in each display partition to form a set of emitted light ray vectors in three-dimensional space;

[0065] Step 3, Data Recording and Discretization: Establish a preliminary correlation between the measured light direction and angle range of each display zone and the corresponding driving quantity, and generate a discrete mapping table or fitting function;

[0066] Step 4: Perform interpolation, fitting, or compensation processing on the experimental data to smooth the sampling gap, correct measurement errors, and establish a continuous or queryable mapping relationship; through fitting functions or multidimensional interpolation, map the desired light direction at any spatial position within the target field of view to the corresponding microstructure driving control quantity to achieve precise control of the beam in three-dimensional space.

[0067] The mapping relationship is not a simple lookup table, but a discretized expression of the coupling relationship between the display partition position, microstructure state, and three-dimensional spatial light distribution. Essentially, it constitutes a discrete light field control model that can be called in real time. The central control processing unit can dynamically calculate and reconstruct the light based on this model, so as to continuously adjust the beam direction as the viewer's position changes. This mapping relationship is used to accurately describe the coupling characteristics between the microstructure unit attitude, the display partition position, and the three-dimensional spatial light direction, providing a precise basis for the central control processing unit to calculate the driving state of each microstructure unit in real time, and realizing the fine reconstruction and dynamic orientation control of the discrete light field.

[0068] Step 5, Mapping Table Construction and Invocation: Using the mapping relationship data obtained in Step 4, a discrete light field mapping table or fitting model is formed that can be directly used for real-time calculations by the central control processing unit. During system operation, the central control processing unit obtains or interpolates the driving control quantities of each microstructure unit from the mapping table or fitting function based on the real-time acquired spatial position data of the viewer's eyes, thereby achieving fine control over the range of light direction, deflection angle, and emission angle, and thus realizing dynamic reconstruction of the discrete light field and directional display of the target viewing area.

[0069] When establishing a discrete optical field control model using a collaborative approach that combines theoretical calculations and experimental calibration, the theoretical calculations and experimental calibrations are used together. That is, a preliminary discrete optical field model is first established through theoretical calculations, and then the theoretical model is corrected and optimized through experimental calibration, thereby forming a high-precision drive control mapping relationship.

[0070] When the functional layer of this invention uses micro-blind units, the display system outputs light transmitted from the micro-blind units, and the supported display operating modes include privacy display mode and wide viewing angle display mode.

[0071] 1. In privacy mode, the central control processing unit controls the micro blind units in each zone, so that the light is mainly directed towards the predetermined viewing area window where the viewer's eyes are located, thereby significantly reducing lateral visibility and achieving privacy protection.

[0072] 2. In wide-viewing-angle mode, by increasing the transmission angle range or reducing directional restrictions, light can propagate over a wider angle range to meet the viewing needs of multiple people.

[0073] When the functional layer of this invention uses a tiltable transparent microprism, the display system outputs outgoing deflected light from the tiltable transparent microprism, and the supported display operating modes include privacy mode and wide viewing angle mode.

[0074] 1. In privacy mode, each partition microprism unit directs the emitted light mainly towards the target viewing window, thereby effectively reducing the visibility of light from non-target directions and achieving user privacy protection;

[0075] 2. In wide-viewing-angle mode, by adjusting the deflection angle or opening direction of the microprism unit, the light can cover a wider range of angles to meet the viewing needs of multiple people. Compared with the use of micro venetian blind units, the transmissive microprism array can reduce the loss of brightness due to obstruction structures while maintaining dynamic viewing area control capabilities, ensuring image clarity, detail performance, and imaging consistency, while also taking into account the continuity of spatial light field reconstruction and control efficiency.

[0076] Compared with traditional display solutions based on diffusion films, this invention improves light energy utilization by redistributing originally ineffective scattered light energy to the target viewing area through a partitioned light field reconstruction mechanism. At the same time, through viewpoint-driven dynamic control, the light can follow the viewer's movement in real time, significantly improving display efficiency and user experience.

[0077] This invention proposes a discrete light field reconstruction and dynamic viewing zone display system based on a microstructure array. The system includes a display panel unit, a viewpoint acquisition unit, an adjustable microstructure optical layer, and a central control and processing unit. The display panel unit outputs the original image light; the viewpoint acquisition unit acquires the spatial position data of the viewer's eyes in the display panel coordinate system; the adjustable microstructure optical layer is disposed on the light-emitting side of the display panel and includes a transparent support and driving substrate layer, a functional layer, and an encapsulation protection layer. The functional layer contains an array of adjustable microstructure units. The driving substrate layer includes TFT active matrix or row / column addressing circuits for partitioned addressing and dynamic adjustment of each microstructure unit. The encapsulation protection layer and the driving substrate layer together form a sealed cavity to provide dustproof, moisture-proof, and mechanical protection. The central control processing unit constructs a target viewing area window based on the spatial position data of the viewer's eyes and the spatial position information of the display partitions provided by the viewpoint acquisition unit. It then determines the target emission direction parameters corresponding to each display partition based on a discrete light field control model. According to the mapping relationship between the target emission direction parameters and the microstructure unit drive control quantities, it generates and outputs the drive signals for each microstructure unit, thereby achieving directional reconstruction of the display light in three-dimensional space. This allows the light output from different display partitions to converge collaboratively within the viewing area of ​​the viewer's eyes. This invention establishes a dynamic light control system based on discrete light field reconstruction by constructing a coupling relationship between "viewpoint—display partition—microstructure array," forming a closed-loop control mechanism of perception—modeling—control—execution. This enables the display light to dynamically adjust in real time according to changes in the viewer's position. Compared with existing technologies, this invention significantly improves light energy utilization efficiency, reduces light leakage from non-target directions, enhances display privacy and viewing area brightness, while also considering imaging quality and system response performance. It is suitable for applications such as naked-eye 3D display, vehicle head-up display, personal terminal display, and high-precision directional display.

[0078] Compared with existing technologies, the core of this invention lies in constructing a system-level collaborative control mechanism that couples "viewpoint—display partition—microstructure array". Specifically, it includes:

[0079] (1) Divide the display panel into multiple display zones with spatial coordinate attributes;

[0080] (2) Establish a one-to-one or correspondence between each display partition and the microstructure array;

[0081] (3) Based on the spatial position of the viewer's eyes, determine the target emission direction for each display zone;

[0082] (4) By driving the microstructure units independently in the partitions, the light from each partition is coordinated and converged in space to the target viewing window.

[0083] Based on the above mechanism, this invention essentially realizes a partitioned light field reconstruction method, that is, constructing a target light field distribution in space by differentially controlling the direction of light emitted from different display partitions, rather than uniformly adjusting the entire beam. Therefore, compared with traditional schemes based on diffusion or fixed direction control, this invention can significantly improve the light energy utilization rate within the viewing area, reduce ineffective scattered light, and improve the dynamic response accuracy of viewing area following.

[0084] Furthermore, compared with existing privacy display technologies based on fixed microstructure arrays, the present invention has at least the following differences:

[0085] (1) The existing microstructure optical function is fixed or only supports mode switching, and cannot achieve continuous adjustable light direction control; in this respect, the existing technology is not comparable to the present invention.

[0086] (2) The prior art has not established a correspondence between display partitions and spatial viewpoints, and cannot realize partition-level dynamic light field control; in this respect, the prior art is not comparable to the present invention.

[0087] (3) The existing technology lacks a viewpoint-driven light field modeling mechanism and cannot realize real-time reconstruction of light as the human eye moves; in this respect, the existing technology is not comparable to the present invention.

[0088] This invention achieves dynamic construction and continuous reconstruction of the display light field in three-dimensional space through the coordinated control of viewpoint perception and microstructure array, enabling light to stably and continuously point to the viewer's visual area, thereby achieving a high-performance, directional, and privacy-preserving display effect. Attached Figure Description

[0089] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments:

[0090] AppendixFigure 1 This is a schematic diagram of the system's logical principle in an embodiment of the present invention;

[0091] Appendix Figure 2 This is a schematic diagram of the microstructure and working principle of the tunable microstructure optical thin film using MEMS micro venetian blind type tunable optical thin film in an embodiment of the present invention (the micro optical unit array in the figure uses micro venetian blind units).

[0092] Appendix Figure 3 This is a schematic diagram of the microstructure and working principle of the tunable microstructure optical thin film using MEMS tiltable microprism type tunable optical thin film in an embodiment of the present invention (the micro optical unit array in the figure uses tiltable transparent microprisms).

[0093] Appendix Figure 4 This is a schematic diagram of the theoretical calculation for establishing a discrete optical field control model in an embodiment of the present invention;

[0094] In the figure: 1-Encapsulation protective layer; 2-Sealed cavity; 3-Functional layer; 4-Drive electrode; 5-Transparent support and drive substrate layer; 6-Incident light; 7-Transmitted light (when the functional layer uses a micro venetian blind unit, it is the light transmitted from the micro venetian blind unit; when the functional layer uses a tiltable transparent microprism, it is the outgoing deflected light output from the tiltable transparent microprism). Detailed Implementation

[0095] The specific embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0096] As shown in the figure, a personalized viewing zone display system using eye tracking and adjustable microstructure optical films is presented. The display system includes a central control processing unit. The central control processing unit acquires the spatial position data of the viewer's eyes in the display panel coordinate system using the viewpoint acquisition unit at the display panel unit and calculates the viewpoint space. It then uses the adjustable microstructure optical layer at the display panel unit to adjust the light emission from the display panel unit to form a discrete light field reconstruction condition, enabling the display panel unit to form a dynamic viewing zone display corresponding to the human eye's viewpoint space. By adjusting (expanding or reducing) light leakage in non-viewpoint target directions, the display privacy and viewing zone brightness are adjusted, allowing the viewable range and optimal viewing angle of the displayed content to be dynamically adjusted and the viewing zone brightness to be optimized. This also takes into account imaging quality and system response performance, making it suitable for applications such as naked-eye 3D display, vehicle head-up display, personal terminal display, and high-precision directional display. By constructing a coupling relationship between "viewpoint - display zone - microstructure array", a dynamic light control system based on discrete light field reconstruction is realized, forming a closed-loop control mechanism of perception - modeling - control - execution, enabling the display light to be dynamically adjusted in real time according to the viewer's position.

[0097] The display panel unit is used to output the original image light, and can be MicroLED, MicroOLED or other self-emissive display panels. Its pixel array constitutes the initial radiation source distribution of the display light field, so that the display panel outputs the image light of the displayed content.

[0098] The viewpoint acquisition unit is used to acquire the spatial position data of the viewer's eyes in the coordinate system of the display panel unit. It is positioned around the visible area of ​​the display panel or at a fixed location opposite to the display panel, preferably at the front end or border area of ​​the display panel, ensuring coverage of the viewer's eye movement range. The spatial position parameters of the viewer's eyes are acquired by sensors or acquisition devices used to measure or calculate the three-dimensional position of the eyes. These spatial position parameters include distance, horizontal offset, vertical offset, azimuth angle, and pitch angle, or a combination thereof.

[0099] The sensor or acquisition device includes a depth measurement device, a camera device or an infrared sensing device, and the spatial position data is used to construct the predetermined viewing window and participate in the light field reconstruction control.

[0100] The adjustable microstructure optical layer includes a microstructure array disposed on the light-emitting side of the display panel unit. The adjustable microstructure optical layer includes multiple adjustable micro-optical units arranged in an array. The multiple adjustable micro-optical units have an associated correspondence with multiple display zones on the display panel unit and are used to change the principal optical axis direction or emission angle range of the light emitted from the corresponding display zone under the action of the driving control quantity of the control signal.

[0101] The central control and processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer.

[0102] The central control processing unit is configured to: construct a predetermined viewing area window corresponding to the viewer's eyes based on the spatial location data and the geometric position information of each of the display partitions, and determine the target emission direction parameters corresponding to each display partition; generate and output the driving control quantity corresponding to each of the adjustable micro-optical units based on the mapping relationship between the target emission direction parameters and the driving control quantity, so that the light rays emitted from multiple display partitions can work together in space to form a light field distribution pointing to the predetermined viewing area window, thereby realizing discrete light field reconstruction and dynamic viewing area display.

[0103] The tunable microstructure optical layer includes a transparent support and driving substrate layer 5, a functional layer 3, and an encapsulation and protection layer 1 disposed in the light emission direction of the display panel. A driving circuit is disposed on the transparent support and driving substrate layer.

[0104] After the light emitted from the display panel enters the tunable microstructure optical layer, the functional layer adjusts the incident light to form the desired transmitted light.

[0105] The functional layer uses a microstructure array to adjust the incident light 6 to generate the desired transmitted light 7. The microstructure array is an adjustable micro-optical unit array, which includes a transmissive micro-louver array or a micro-prism array driven by the driving electrode 4.

[0106] The driving substrate layer of the transparent support and driving substrate layer includes a driving circuit, which is a TFT active matrix or row and column addressing circuit, used to perform pixel-by-pixel or partition addressing control of the adjustable micro optical units in the functional layer.

[0107] The central control processing unit provides corresponding drive control signals to each adjustable micro optical unit through the drive circuit, so that the microstructure array changes the direction, transmission angle range or deflection of the light emitted from the display panel under the action of the drive signal, thereby forming directional control of the light field emitted from the display zone and realizing independent light control of each zone of the display panel.

[0108] The encapsulation protective layer and the transparent support and drive substrate layer form a sealed cavity 2, which is used to accommodate the movable microstructure unit in the functional layer and provide it with dustproof, moisture-proof and mechanical protection.

[0109] Each adjustable micro-optical unit corresponds to a display zone on the display panel unit. The display zone is composed of one or more pixels, and its size and spatial position are dynamically determined by the central control processing unit according to the position of the predetermined viewing window and the light control capability of the microstructure unit.

[0110] The emitted light from each display zone is coordinated and adjusted under the control of the central control processing unit to form a directional light field distribution in the viewpoint space facing the predetermined viewing window of the human eye.

[0111] The central control processing unit constructs the target emission direction parameters corresponding to each display partition based on the spatial position data of the viewer's eyes obtained by the viewpoint acquisition unit and the spatial position of each display partition in the display panel coordinate system, and generates the driving control quantity of each micro-optical unit through a preset discrete light field control model.

[0112] The discrete light field control model is used to describe the coupling relationship between the display partition position, the microstructure unit posture and the direction of the emitted light in three-dimensional space. The model is obtained through theoretical calculation or experimental calibration and is used to spatially discretize and reconstruct the display light, so that the light output from different display partitions converges in space to the predetermined viewing window where the viewer's eyes are located, realizing dynamic viewing area display and privacy display.

[0113] The central control processing unit acquires facial and depth images of the viewer via the infrared stereo camera, structured light depth camera, and ToF depth sensor of the viewpoint acquisition unit. The acquired image data undergoes preprocessing, including denoising, grayscale conversion, and illumination normalization. Then, it identifies key points for the left and right eyes using a convolutional neural network or depth regression model. Specifically:

[0114] Extract the two-dimensional coordinates (u,v); combine them with the depth information z, and reconstruct the three-dimensional coordinates (X,V) in the camera coordinate system of the viewpoint acquisition unit. c ,Y c Z c )for:

[0115] Z c = z;

[0116] Where f x , f y For focal length, (c x ,c y The coordinates of the main point are then used. Subsequently, the three-dimensional coordinates are mapped to the display panel coordinate system (X) using a rigid transformation matrix T. s ,Y s Z s ):

[0117]

[0118] In the processing of multiple consecutive frames of data, the positions of both eyes are updated using Kalman filtering, and the corresponding formula is as follows:

[0119]

[0120]

[0121] in This is the final estimate based on current observations. Based on previous observations, Let H be the Kalman gain, H be the observation matrix, and z be the Kalman gain. k Observed values ​​are data actually measured by sensors (such as cameras and depth cameras). The corrected covariance. To predict the covariance, I is the identity matrix;

[0122] The central control processing unit predicts the human eye position at the next moment using a linear or adaptive prediction algorithm, while simultaneously eliminating outliers and compensating for dropped frames to ensure smooth and real-time microstructure unit drive signals; the obtained (X s ,Y s Z sThis information is provided for calculating the direction (α, β) of the target's outgoing light rays in the subsequent construction of the discrete light field.

[0123] The tunable microstructure optical layer is disposed on the light-emitting side of the display panel, and it is an integrated microelectromechanical system structure, preferably a MEMS tunable optical thin film layer, such as... Figure 2 and Figure 3 As shown, the optical layer includes a transparent support and driving substrate layer, a functional layer, and a packaging and protective layer. The functional layer integrates an array of MEMS microstructure units. These microstructure units can be one or more of the following: transmissive micro-louvers, variable opening arrays, microlens arrays, or microprism arrays. The micro-optical units are connected to the driving circuit via controllable methods such as electrostatic driving, piezoelectric driving, or electrothermal driving. Under the action of a driving signal, they can undergo minute displacement, tilting, rotation, or geometric deformation in the z-axis, thereby changing the transmission direction, emission angle range, or deflection path of light.

[0124] Through the aforementioned microstructure control mechanism, each microstructure unit can dynamically modulate the direction of the emitted light from its corresponding display zone, transforming the original divergent light field into a directionally selective emitted light field, thereby creating a controllable light distribution in space. Specifically, under different driving states, the microstructure array restricts, deflects, or focuses the light from the display panel, allowing the light to pass through within the target viewing angle range of the human eye, while blocking or deflecting it in non-target viewing angle directions. This achieves active control over the spatial light distribution, resulting in high-contrast and directional display effects.

[0125] The central control processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer, respectively, and is used to construct and execute a discrete light field control model. The central control processing unit receives the spatial position data of the viewer's eyes output by the viewpoint acquisition unit, and calculates the target emission direction parameters corresponding to each partition by combining the spatial position of each display partition in the display panel coordinate system.

[0126] Based on this, the central control processing unit generates driving control quantities for each microstructure unit based on a preset discrete light field control model. The driving control quantities include the target attitude parameters of the microstructure unit (such as tilt angle, opening angle, or deflection) and their corresponding driving voltage or driving signal. By independently controlling each partition microstructure unit, the light emitted from different display partitions can be coordinated and converged in space to the predetermined viewing window, thereby realizing the spatial reconstruction of the display light field.

[0127] In the discrete light field control model, the display panel is divided into multiple display zones, each corresponding to an adjustable microstructure unit. The orientation of each microstructure unit is controlled by several adjustable parameters to determine the emission direction and angle range of the light. The discrete light field control model couples the pixel zones on the display panel, the orientation of the microstructure units, and the three-dimensional spatial position of the viewer's eyes to achieve precise orientation reconstruction of light in three-dimensional space and dynamic viewing zone display.

[0128] In the discrete light field control model, the exit direction of the light rays incident on the human eye corresponding to the display partition in three-dimensional space is completely described by two angles, namely the azimuth angle α and the pitch angle β, expressed as a unit vector. =(sinβcosα,sinβsinα,cosβ) represents;

[0129] Azimuth α and elevation β are determined by the position of each display zone (X). d ,Y d Z d ) and the binocular positions (X) obtained by the viewpoint acquisition unit s ,Y s Z s The calculation is as follows:

[0130]

[0131] α=arctan2(L y ,L x ),

[0132] β=arccos(L z )

[0133] If the microstructure unit has additional attitude parameters of rotation or tilt angle ψ (the attitude ψ of the microstructure unit is not a single scalar parameter, but a set of multi-degree-of-freedom parameters, depending on the type of microstructure and the control method), these parameters are used to adjust the opening direction or deflection characteristics of the microstructure, thereby indirectly affecting the precise direction and emission angle range of the emitted light.

[0134] The actual direction of the emitted light rays from the microstructure unit can be expressed by the formula:

[0135]

[0136] in To display the initial ray direction of the partition, R(ψ) is the rotation matrix for rotating or tilting the microstructure unit. The adjusted light direction is towards the eyes; the precise orientation of the light emitted from the display panel in three-dimensional space is achieved by adjusting the microstructure attitude parameter ψ and matching the target light direction (α,β).

[0137] The above formula is used to establish the display partition position (X). d ,Y d Z d ), microstructure attitude parameter ψ and observation points (X) in three-dimensional space s ,Y s Z s Coupling functions between ) , ψ, ,

[0138] The observation point represents the three-dimensional coordinates of the viewer's eyes in space. Based on this coupling function, the emitted light direction of each display partition microstructure unit under different driving states is calculated, generating preliminary discrete light field response data. Then, by establishing the relationship between the driving control quantity and the microstructure attitude parameter ψ under different microstructure postures of each display partition, a mapping relationship between the driving control quantity and the emitted light direction in three-dimensional space is established, forming a discrete light field control model that can be used by the central control processing unit to calculate the driving state of each microstructure unit in real time. Its schematic diagram is shown below. Figure 4 As shown.

[0139] The drive control quantities include drive voltage v, drive current i, or pulse width w; by setting the adjustable micro louver structure or tiltable micro prism structure working conditions through the drive control quantities, light from non-target viewing directions is refracted, reflected, or totally internally reflected, thereby reducing lateral light leakage; while light from the target viewing area direction maintains a high transmittance.

[0140] Based on a discrete light field control model, the central control processing unit uses real-time acquired viewer eye position data to find or interpolate the corresponding drive control quantities from the discrete light field control model. This enables precise control and dynamic reconstruction of spatial light, converging the light to the predetermined viewing area window where the viewer is located. This achieves personalized viewing area display and privacy protection. This type of microstructure array essentially constitutes a programmable optical control interface, which modulates the overall light field distribution by changing the local optical response.

[0141] The method for establishing the discrete optical field control model includes theoretical calculation method, experimental calibration method, or a combined method of theoretical calculation and experimental calibration.

[0142] The experimental calibration method first involves actually measuring the optical output of the microstructure unit under different driving states to obtain its influence on the direction and angle range of the emitted light rays. Specifically, this includes the following steps:

[0143] Step 1: Microstructure unit drive settings, specifically: apply a series of different drive control quantities to each microstructure unit, including parameters such as drive voltage, current, pulse width or duty cycle; for each drive state, record the attitude parameters of the microstructure unit (such as tilt angle, rotation angle, z-direction displacement, opening angle or equivalent refraction angle).

[0144] Step 2, Optical Output Measurement, specifically: using optical detection equipment (such as a high-resolution camera, spot measuring instrument or interferometer) to measure the direction and angle distribution of the emitted light rays of each display partition microstructure unit under different driving states; collecting beam data for each microstructure unit in each display partition to form a set of emitted light ray vectors in three-dimensional space;

[0145] Step 3, Data Recording and Discretization: Establish a preliminary correlation between the measured light direction and angle range of each display zone and the corresponding driving quantity, and generate a discrete mapping table or fitting function;

[0146] Step 4: Perform interpolation, fitting, or compensation processing on the experimental data to smooth the sampling gap, correct measurement errors, and establish a continuous or queryable mapping relationship; through fitting functions or multidimensional interpolation, map the desired light direction at any spatial position within the target field of view to the corresponding microstructure driving control quantity to achieve precise control of the beam in three-dimensional space.

[0147] The mapping relationship is not a simple lookup table, but a discretized expression of the coupling relationship between the display partition position, microstructure state, and three-dimensional spatial light distribution. Essentially, it constitutes a discrete light field control model that can be called in real time. The central control processing unit can dynamically calculate and reconstruct the light based on this model, so as to continuously adjust the beam direction as the viewer's position changes. This mapping relationship is used to accurately describe the coupling characteristics between the microstructure unit attitude, the display partition position, and the three-dimensional spatial light direction, providing a precise basis for the central control processing unit to calculate the driving state of each microstructure unit in real time, and realizing the fine reconstruction and dynamic orientation control of the discrete light field.

[0148] Step 5, Mapping Table Construction and Invocation: Using the mapping relationship data obtained in Step 4, a discrete light field mapping table or fitting model is formed that can be directly used for real-time calculations by the central control processing unit. During system operation, the central control processing unit obtains or interpolates the driving control quantities of each microstructure unit from the mapping table or fitting function based on the real-time acquired spatial position data of the viewer's eyes, thereby achieving fine control over the range of light direction, deflection angle, and emission angle, and thus realizing dynamic reconstruction of the discrete light field and directional display of the target viewing area.

[0149] When establishing a discrete optical field control model using a collaborative approach that combines theoretical calculations and experimental calibration, the theoretical calculations and experimental calibrations are used together. That is, a preliminary discrete optical field model is first established through theoretical calculations, and then the theoretical model is corrected and optimized through experimental calibration, thereby forming a high-precision drive control mapping relationship.

[0150] Example 1: Discrete light field reconstruction display system based on transmissive MEMS micro venetian blind array.

[0151] This embodiment provides a discrete light field reconstruction and dynamic view zone display system based on a microstructure array. The system realizes the partitioned reconstruction and directional output of display light in three-dimensional space through the coordinated control of viewpoint perception and MEMS microstructure array.

[0152] The system mainly includes: a display panel unit, a viewpoint acquisition unit, a central control and processing unit, and a MEMS tunable microstructure optical layer.

[0153] The MEMS tunable microstructure optical layer uses a transmissive MEMS micro venetian blind array as the light field modulation execution unit to achieve directional modulation of the light emitted from each display zone, thereby constructing a discrete light field distribution oriented towards the target viewing area.

[0154] (a) Display panel unit

[0155] The display panel unit is preferably a MicroLED display panel or a MicroOLED display panel, used to output the original image light.

[0156] The display panel unit can be regarded as a discrete light source array, and its pixel units constitute the basis of the radiation distribution of the initial light field.

[0157] Preferably, the light-emitting side of the display panel unit is bonded or nearly bonded to the MEMS adjustable microstructure optical layer to reduce the propagation distance between the light emitted from the pixel and the microstructure unit, thereby reducing light crosstalk and improving the accuracy of spatial light field control and imaging consistency.

[0158] (ii) MEMS tunable microstructure optical layer

[0159] The MEMS tunable microstructure optical layer is disposed on the light-emitting side of the display panel unit, preferably with a thickness of 100μm to 500μm, and is used to modulate the display light field in the spatial domain.

[0160] The optical layer includes: a transparent support and drive substrate layer, a transmissive micro louver functional layer, and an encapsulation and protective layer.

[0161] 1) Transparent support and driving substrate layer:

[0162] The transparent support and driving substrate layer is preferably a TFT glass substrate or other transparent substrate, on which an active matrix driving circuit is integrated for partitioned addressing control of each micro louver unit.

[0163] Preferably, each micro venetian blind unit corresponds to a display zone on the display panel. The display zone is composed of one or more pixels, and its size can be set according to the light field control resolution, for example, an N×M pixel combination (preferably 10×10 pixels), to form a zone-level light field unit.

[0164] Through the above correspondence, spatial mapping between display partitions and microstructure arrays is realized, providing a foundation for subsequent light field reconstruction.

[0165] 2) Transmissive micro-louver functional layer:

[0166] like Figure 2 As shown, the functional layer includes a large number of transmissive MEMS micro louver units arranged in an array.

[0167] Each micro venetian blind unit includes light-blocking blades and its driving structure. Under the action of the driving signal, the opening direction, opening angle, or transmission angle range of the micro venetian blind unit can change continuously.

[0168] By adjusting the posture parameters of the micro venetian blind unit, the directionality of light passing through the unit can be restricted or selected, so that the light from the corresponding display zone forms a controlled angular distribution in space.

[0169] Specifically, in the target viewing area, the micro venetian blinds are in a high-transmittance state, allowing light to propagate in a predetermined direction; in non-target directions, the micro venetian blinds suppress light propagation by blocking or limiting the transmission angle, thereby achieving directional control of the local light field distribution.

[0170] Preferably, the micro venetian blind unit can achieve minute angle adjustment through electrostatic drive, piezoelectric drive or electrothermal drive, so as to achieve dynamic and continuous control of the direction of light emitted from different display zones.

[0171] 3) Encapsulation protective layer:

[0172] The encapsulation protective layer is preferably made of a transparent, high-strength material and together with the driving substrate layer forms a sealed cavity to accommodate the microstructure unit and provide dustproof, moisture-proof and mechanical protection.

[0173] Preferably, an antireflection film is provided on the inner surface of the encapsulation layer to reduce interface reflection and improve light transmission efficiency, thereby improving the overall light field modulation efficiency.

[0174] (III) Viewpoint Acquisition Unit

[0175] The viewpoint acquisition unit is preferably located in the bezel area of ​​the display screen and is used to collect the spatial position data of the viewer's eyes in real time.

[0176] The viewpoint acquisition unit may be an infrared camera, a depth camera, or other visual sensing device, used to acquire the spatial parameters of the viewer's eyes relative to the display panel, including distance, horizontal offset, vertical offset, or equivalent azimuth and pitch angles.

[0177] Based on the aforementioned binocular spatial position data, a predetermined viewing area window can be constructed in front of the display panel to describe the activity area of ​​the viewer's eyes in space and serve as the target area for light field reconstruction.

[0178] (iv) Central control processing unit and discrete optical field reconstruction control

[0179] The central control processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the MEMS microstructure optical layer, respectively, to realize the construction and dynamic control of discrete light fields.

[0180] In the implementation, a screen coordinate system is established with the center of the display panel, and the spatial coordinates of each display partition are pre-recorded.

[0181] The central control processing unit determines the target emission direction parameters corresponding to each display partition based on the spatial position data of the viewer's eyes provided by the viewpoint acquisition unit and the spatial position of each display partition.

[0182] Based on this, the central control processing unit calls the preset discrete light field control model to calculate the driving control quantity of each micro louver unit, thereby realizing the partitioned reconstruction of the display light field.

[0183] The driving control quantities include the opening direction, opening angle or equivalent transmission angle range of the microstructure unit, and the corresponding driving voltage, current or pulse signal parameters.

[0184] Preferably, to reduce computational complexity, the discrete optical field control model can be implemented through lookup tables, interpolation, or calibration compensation, and can be combined with real-time filtering and prediction algorithms to improve the dynamic response performance and stability of the system.

[0185] Specifically, the central control processing unit determines the target light field distribution based on the spatial position data of the viewer's eyes, and discretizes the target light field distribution to each display partition; then, according to the spatial position of each display partition in the coordinate system of the display panel, it calculates the driving control quantity of the corresponding microstructure unit; finally, by independently driving the microstructure array of each partition, it achieves coordinated control of the direction and angle range of the emitted light, so that the emitted light from each display partition converges in space to form a target light field distribution pointing to the predetermined viewing window.

[0186] (V) Working Mode and Results

[0187] This embodiment supports multiple working modes, including privacy display mode and wide viewing angle display mode.

[0188] In privacy mode, the central control processing unit controls the micro blinds in each zone, directing light primarily towards the predetermined viewing area window where the viewer's eyes are located, thereby significantly reducing lateral visibility and achieving privacy protection.

[0189] In wide-viewing-angle mode, by increasing the range of transmission angles or reducing directional restrictions, light can propagate over a wider angle range to meet the needs of multiple viewers.

[0190] Compared with traditional display solutions based on diffusion films, this embodiment improves light energy utilization by redistributing originally ineffective scattered light energy to the target viewing area through a partitioned light field reconstruction mechanism. At the same time, through viewpoint-driven dynamic control, the light can follow the viewer's movement in real time, significantly improving display efficiency and user experience.

[0191] Example 2: A partitioned light field reconstruction display system based on a transmissive MEMS tunable microprism array.

[0192] This embodiment provides a discrete light field reconstruction and dynamic viewing zone display system based on a microstructure array. It differs from Embodiment 1 in that the tunable optical thin film layer uses a transmissive MEMS tunable microprism array as the optical control unit to achieve refraction and directional modulation of the light emitted from each display zone, thereby realizing dynamic viewing zone display and privacy display while maintaining image quality. Except for the differences described below, the other system components and their connections are the same as in Embodiment 1.

[0193] (a) Display panel unit

[0194] The display panel unit is preferably a MicroLED or MicroOLED display panel, used to output the original image light and form the initial light field distribution.

[0195] The light-emitting side of the display panel is bonded or nearly bonded to the MEMS microprism layer to reduce the propagation distance between the light emitted from the pixel and the microstructure unit, thereby reducing light crosstalk and improving the accuracy of light field control and imaging consistency.

[0196] (ii) MEMS tunable microprism optical layer

[0197] The MEMS tunable microprism optical layer is disposed on the light-emitting side of the display panel, and preferably has a thickness of 100μm to 500μm. The optical layer includes a transparent support and driving substrate layer, a transmissive tunable microprism functional layer, and an encapsulation and protective layer.

[0198] 1) Transparent support and driving substrate layer

[0199] The transparent support and driving substrate layer is preferably a TFT glass substrate or other transparent substrate, on which an active matrix driving circuit is formed for independent addressing and driving of the microprism units in each zone.

[0200] Preferably, each microprism unit corresponds to a display zone on the lower display panel, the zone consisting of N×M pixels (preferably 10×10 pixels) to form a zone-level light field unit.

[0201] 2) Transmissive Microprism Functional Layer

[0202] like Figure 3 As shown, the functional layer consists of a large array of transmissive microprism units. Each microprism unit includes a transparent prism body and a matching driving structure. Under the action of the driving signal, its attitude, equivalent wedge angle direction, or deflection amount can be continuously adjusted, thereby realizing the controllable deflection of light from the display zone after transmission.

[0203] Preferably, the microprism unit achieves minute angle adjustment through electrostatic, piezoelectric, or electrothermal driving methods, and its maximum equivalent deflection angle can be set to any range of 1° to 30° or a subrange thereof.

[0204] Through the above adjustments, the emission direction and divergence angle of each zone's light can be independently controlled, thereby forming a discrete light field distribution of the zoned light field in space, constituting a beam set facing the target viewing area.

[0205] 3) Encapsulation protective layer

[0206] The encapsulation protective layer is made of transparent, high-strength material and together with the drive substrate layer, forms a sealed cavity to isolate dust and moisture and ensure device stability.

[0207] Preferably, an antireflective coating is provided on the inner surface to reduce interface reflection and improve light transmission efficiency, thereby ensuring the efficiency of zoned light field modulation and imaging quality.

[0208] (III) Viewpoint Acquisition Unit

[0209] The viewpoint acquisition unit is located on the bezel of the display screen and is used to collect real-time spatial position data of the viewer's eyes, including parameters such as distance, horizontal offset, vertical offset, azimuth angle, and pitch angle.

[0210] The acquired data is used to construct the target viewport window and serves as input for the central control processing unit to reconstruct the light field.

[0211] (iv) Central control processing unit and light field mapping control

[0212] The central control processing unit is electrically connected to the display panel, the viewpoint acquisition unit, and the MEMS microprism layer, and is used to output drive control signals to each partition microprism unit based on real-time viewpoint data.

[0213] In implementation, a central coordinate system for the display panel is established to record the spatial position of each display zone. The central control processing unit determines the target emission direction based on the spatial positions of the eyes and the coordinates of each zone, and calculates the driving control quantities of each microprism unit through a discrete light field control model.

[0214] The driving parameters can include the orientation, opening direction, and deflection of the microprism units, as well as the corresponding voltage, current, or pulse signals. By driving each partition independently, light rays can be converged collaboratively in space to form a discrete light field facing the predetermined viewing window.

[0215] To reduce the real-time computational load, a "target direction - drive control quantity" mapping can be established using lookup tables, interpolation, or calibration compensation methods. At the same time, viewpoint data filtering, prediction, and drive change rate limiting can be combined to ensure that the beam follows the eye smoothly.

[0216] (V) Working Mode and Results

[0217] This embodiment allows you to set a privacy mode and a wide-view mode.

[0218] In privacy mode, each microprism unit directs its emitted light primarily towards the target viewing area window, effectively reducing the visibility of light from non-target directions and protecting user privacy. In wide-viewing-angle mode, by adjusting the deflection angle or opening direction of the microprism units, the light can cover a wider angle range to meet the viewing needs of multiple users. Compared to Embodiment 1, the transmissive microprism array maintains dynamic viewing area control while reducing brightness loss due to obstruction structures, ensuring image clarity, detail, and imaging consistency, while also considering the continuity and control efficiency of spatial light field reconstruction.

Claims

1. A personalized viewing zone display system with eye tracking and tunable microstructure optical thin films, characterized in that: The display system includes a central control processing unit. The central control processing unit acquires the spatial position data of the viewer's eyes in the display panel coordinate system using the viewpoint acquisition unit at the display panel unit and calculates the viewpoint space. It also uses the adjustable microstructure optical layer at the display panel unit to adjust the light emission of the display panel unit to form a discrete light field reconstruction condition, so that the display panel unit forms a dynamic viewing area display corresponding to the human eye's viewpoint space. By increasing the light flux emitted by the display panel within the user's current target viewing area window and reducing the light leakage of the display panel in the current non-target viewing area direction, the system enhances the user's perceived brightness in the target viewing area and achieves privacy display. The central control processing unit acquires facial and depth images of the viewer via the viewpoint acquisition unit. The acquired image data undergoes preprocessing, including denoising, grayscale conversion, and illumination normalization. Then, it identifies key points for the left and right eyes using a convolutional neural network or depth regression model. Specifically: Extract the two-dimensional coordinates (u,v); combine them with the depth information z, and reconstruct the three-dimensional coordinates (X,V) in the camera coordinate system of the viewpoint acquisition unit. c ,Y c Z c )for: WITH c =with ; Where f x , f y For focal length, (c x ,c y The coordinates are set to the primary coordinates, and then the three-dimensional coordinates are mapped to the display panel coordinate system (X) using a rigid transformation matrix T. s ,Y s Z s ): In the processing of multiple consecutive frames of data, the positions of both eyes are updated using Kalman filtering, and the corresponding formula is as follows: in This is the final estimate based on current observations. Based on previous observations, Let H be the Kalman gain, H be the observation matrix, and z be the Kalman gain. k For the observed values, The corrected covariance. To predict the covariance, I is the identity matrix; The central control processing unit predicts the human eye position at the next moment using a linear or adaptive prediction algorithm, while simultaneously eliminating outliers and compensating for dropped frames to ensure smooth and real-time microstructure unit drive signals; the obtained (X s ,Y s Z s This information is provided for calculating the direction (α, β) of the target's outgoing light rays in the subsequent construction of the discrete light field.

2. The personalized viewing zone display system with eye tracking and adjustable microstructure optical thin film according to claim 1, characterized in that: The display panel unit is used to output the original image light, and its pixel array constitutes the initial radiation source distribution of the display light field so that the display panel outputs the image light of the displayed content; The viewpoint acquisition unit is used to acquire the spatial position data of the viewer's eyes in the coordinate system of the display panel unit. It is set at the periphery of the visible area of ​​the display panel or at a fixed position opposite to the display panel. The spatial position parameters of the viewer's eyes are acquired by a sensor or acquisition device used to measure or calculate the three-dimensional position of the eyes. The spatial position parameters include one or a combination of distance, horizontal offset, vertical offset, azimuth angle and pitch angle. The sensor or acquisition device includes a depth measurement device, a camera device or an infrared sensing device, and the spatial position data is used to construct a predetermined viewing window and participate in light field reconstruction control. The adjustable microstructure optical layer includes a microstructure array disposed on the light-emitting side of the display panel unit. The adjustable microstructure optical layer includes multiple adjustable micro-optical units arranged in an array. The multiple adjustable micro-optical units have an associated correspondence with multiple display zones on the display panel unit and are used to change the principal optical axis direction or emission angle range of the light emitted from the corresponding display zone under the action of the driving control quantity of the control signal. The central control and processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer. The central control processing unit is configured to: construct a predetermined viewing area window corresponding to the viewer's eyes based on the spatial location data and the geometric location information of each display partition, and determine the target emission direction parameters corresponding to each display partition; Based on the mapping relationship between the target emission direction parameters and the drive control quantity, a drive control quantity corresponding to each of the adjustable micro-optical units is generated and output, so that the emitted light rays from multiple display zones can work together in space to form a light field distribution pointing towards the predetermined viewing window, thereby realizing discrete light field reconstruction and dynamic viewing zone display.

3. The personalized viewing zone display system with eye tracking and adjustable microstructure optical thin film according to claim 2, characterized in that: The tunable microstructure optical layer includes a transparent support and driving substrate layer (5), a functional layer (3), and an encapsulation protective layer (1) disposed in the light emission direction of the display panel. A driving circuit is disposed on the transparent support and driving substrate layer. After the light emitted from the display panel enters the tunable microstructure optical layer, the functional layer adjusts the incident light to form the desired transmitted light.

4. The personalized visual zone display system with eye tracking and adjustable microstructure optical thin film according to claim 3, characterized in that: The functional layer uses a microstructure array to adjust the incident light (6) to generate the desired transmitted light (7). The microstructure array is an adjustable micro-optical unit array, which includes a transmission micro-louver array or a micro-prism array driven by a driving electrode (4). The driving substrate layer of the transparent support and driving substrate layer includes a driving circuit, which is a TFT active matrix or row and column addressing circuit, used to perform pixel-by-pixel or partition addressing control of the adjustable micro optical units in the functional layer. The central control processing unit provides corresponding drive control signals to each adjustable micro optical unit through the drive circuit, so that the microstructure array changes the direction, transmission angle range or deflection of the light emitted from the display panel under the action of the drive signal, thereby forming directional control of the light field emitted from the display zone and realizing independent light control of each zone of the display panel.

5. The personalized viewing zone display system with eye tracking and adjustable microstructure optical thin film according to claim 4, characterized in that: The encapsulation protective layer and the transparent support and drive substrate layer form a sealed cavity (2) to accommodate the movable microstructure unit in the functional layer and provide it with dustproof, moisture-proof and mechanical protection.

6. The personalized viewing zone display system with eye tracking and adjustable microstructure optical thin film according to claim 4, characterized in that: Each adjustable micro-optical unit corresponds to a display zone on the display panel unit. The display zone is composed of one or more pixels, and its size and spatial position are dynamically determined by the central control processing unit according to the position of the predetermined viewing window and the light control capability of the microstructure unit. The emitted light from each display zone is coordinated and adjusted under the control of the central control processing unit to form a directional light field distribution in the viewpoint space facing the predetermined viewing window of the human eye.

7. The personalized viewing zone display system with eye tracking and adjustable microstructure optical thin film according to claim 4, characterized in that: The central control processing unit constructs the target emission direction parameters corresponding to each display partition based on the spatial position data of the viewer's eyes obtained by the viewpoint acquisition unit and the spatial position of each display partition in the display panel coordinate system, and generates the driving control quantity of each micro-optical unit through a preset discrete light field control model. The discrete light field control model is used to describe the coupling relationship between the display partition position, the microstructure unit posture and the direction of the emitted light in three-dimensional space. The model is obtained through theoretical calculation or experimental calibration and is used to spatially discretize and reconstruct the display light, so that the light output from different display partitions converges in space to the predetermined viewing window where the viewer's eyes are located, realizing dynamic viewing area display and privacy display.

8. The personalized visual zone display system with eye tracking and adjustable microstructure optical thin film according to claim 7, characterized in that: The adjustable microstructure optical layer uses a microstructure array to restrict, deflect, or focus light from the display panel, allowing light to pass through within the target viewing angle range while blocking or deflecting it in non-target viewing angle directions. This achieves active control over the spatial light distribution, resulting in high-contrast and directional display effects; specifically: The central control processing unit is electrically connected to the display panel unit, the viewpoint acquisition unit, and the tunable microstructure optical layer, respectively, and is used to construct and execute a discrete light field control model. The central control processing unit receives the spatial position data of the viewer's eyes output by the viewpoint acquisition unit, and calculates the target emission direction parameters corresponding to each partition by combining the spatial position of each display partition in the display panel coordinate system. Based on this, the central control processing unit generates driving control quantities for each microstructure unit based on a preset discrete light field control model. The driving control quantities include the target attitude parameters of the microstructure unit and its corresponding driving voltage or driving signal. By independently controlling each partition microstructure unit, the light emitted from different display partitions can be coordinated and converged in space to the predetermined viewing window, thereby realizing the spatial reconstruction of the display light field. In the discrete light field control model, the display panel is divided into multiple display zones, each zone corresponding to an adjustable microstructure unit. The orientation of each microstructure unit is controlled by several adjustable parameters to control the emission direction and angle range of light. The discrete light field control model couples the pixel zones on the display panel, the orientation of the microstructure units, and the three-dimensional spatial position of the viewer's eyes to achieve precise orientation reconstruction of light in three-dimensional space and dynamic viewing zone display. In the discrete light field control model, the exit direction of the light rays incident on the human eye corresponding to the display partition in three-dimensional space is described by two angles, namely the azimuth angle α and the pitch angle β, expressed as a unit vector. =(sinβcosα,sinβsinα,cosβ) represents; Azimuth α and elevation β are determined by the position of each display zone (X). d ,Y d Z d ) and the binocular positions (X) obtained by the viewpoint acquisition unit s ,Y s Z s The calculation is as follows: α=arctan2(L y ,L x ), β=arccos(L z ) Among them, L x L y With L z They represent unit vectors respectively In a Cartesian coordinate system, the components of the x, y, and z directions are as follows: If the microstructure unit has an additional rotation or tilt angle ψ as an attitude parameter, these parameters are used to adjust the opening direction or deflection characteristics of the microstructure, thereby indirectly affecting the precise direction and emission angle range of the emitted light rays. The actual emitted ray direction and unit vector of the microstructure unit after microstructural unit modulation They are consistent, and their relationship is as follows: in To display the initial ray direction of the partition, R(ψ) is the rotation matrix for rotating or tilting the microstructure unit. The adjusted light direction is towards the eyes; the precise orientation of the light emitted from the display panel in three-dimensional space is achieved by adjusting the microstructure attitude parameter ψ and matching the target light direction (α,β). The formula is used to establish the display partition location (X). d ,Y d Z d ), microstructure attitude parameter ψ and observation points (X) in three-dimensional space s ,Y s Z s Coupling functions between ) , ψ, , The observation point represents the three-dimensional coordinates of the viewer's eyes in space. Based on this coupling function, the emitted light direction of each display partition's microstructure unit under different driving states is calculated, generating preliminary discrete light field response data. Then, by establishing the relationship between the driving control quantity and the microstructure attitude parameter ψ under different microstructure postures of each display partition, a mapping relationship between the driving control quantity and the emitted light direction in three-dimensional space is established, forming a discrete light field control model that can be used by the central control processing unit to calculate the driving state of each microstructure unit in real time. The drive control quantities include drive voltage v, drive current i, or pulse width w; by setting the adjustable micro louver structure or tiltable micro prism structure working conditions through the drive control quantities, light from non-target viewing directions is refracted, reflected, or totally internally reflected, thereby reducing lateral light leakage; while light from the target viewing area direction maintains a high transmittance. Based on the discrete light field control model, the central control processing unit searches for or interpolates the corresponding drive control quantity from the discrete light field control model according to the real-time acquired viewer eye position data, so as to realize the fine control and dynamic reconstruction of spatial light, thereby converging the light to the predetermined viewing window where the viewer is located.

9. The personalized visual zone display system with eye tracking and adjustable microstructure optical thin film according to claim 7, characterized in that: The method for establishing the discrete optical field control model includes theoretical calculation method, experimental calibration method, or a combined method of theoretical calculation and experimental calibration. The experimental calibration method first involves actually measuring the optical output of the microstructure unit under different driving states to obtain its influence on the direction and angle range of the emitted light rays. Specifically, this includes the following steps: Step 1: Microstructure unit drive settings, specifically: apply a series of different drive control quantities to each microstructure unit, including parameters such as drive voltage, current, pulse width or duty cycle; for each drive state, record the attitude parameters of the microstructure unit; Step 2, Optical Output Measurement, specifically: using optical detection equipment to measure the direction and angle distribution of emitted light rays from each display partition microstructure unit under different driving states; collecting beam data from each microstructure unit within each display partition to form a set of emitted light ray vectors in three-dimensional space; Step 3, Data Recording and Discretization: Establish a preliminary correlation between the measured light direction and angle range of each display zone and the corresponding driving quantity, and generate a discrete mapping table or fitting function; Step 4: Perform interpolation, fitting, or compensation processing on the experimental data to smooth the sampling gap, correct measurement errors, and establish a continuous or queryable mapping relationship; through fitting functions or multidimensional interpolation, map the desired light direction at any spatial position within the target field of view to the corresponding microstructure driving control quantity to achieve precise control of the beam in three-dimensional space. The mapping relationship is a discretized expression of the coupling relationship between the display partition position, microstructure state, and three-dimensional spatial light distribution, forming a discrete light field control model that can be called in real time. The central control processing unit can dynamically calculate and reconstruct the light based on this model, so as to realize the continuous adjustment of the beam direction as the viewer's position changes. This mapping relationship is used to accurately describe the coupling characteristics between the microstructure unit attitude, the display partition position, and the three-dimensional spatial light direction, providing a precise basis for the central control processing unit to calculate the driving state of each microstructure unit in real time, and realizing the fine reconstruction and dynamic orientation control of the discrete light field. Step 5, Mapping Table Construction and Invocation: Using the mapping relationship data obtained in Step 4, a discrete light field mapping table or fitting model is formed that can be directly used for real-time calculations by the central control processing unit. During system operation, the central control processing unit obtains or interpolates the driving control quantities of each microstructure unit from the mapping table or fitting function based on the real-time acquired spatial position data of the viewer's eyes, thereby achieving fine control over the range of light direction, deflection angle, and emission angle, and thus realizing dynamic reconstruction of the discrete light field and directional display of the target viewing area. When establishing a discrete optical field control model using a collaborative approach that combines theoretical calculations and experimental calibration, the theoretical calculations and experimental calibrations are used together. That is, a preliminary discrete optical field model is first established through theoretical calculations, and then the theoretical model is corrected and optimized through experimental calibration, thereby forming a high-precision drive control mapping relationship.

Images