Light field display method, device, equipment and storage medium

Abstract

The present application relates to the field of light field display technology, and discloses a light field display method, device, equipment and storage medium. The method includes: inputting the image signal to be displayed into the LCoS optical machine to generate a driving signal and perform deflection modulation to obtain reflected light; performing polarization state separation to obtain reflected polarized light and transmitted polarized light and generate imaging light; performing reflection angle adjustment and surface segmentation of the Fresnel lens to obtain concentric annular steps; performing reflection focusing to obtain a converged imaging light beam and performing image magnification processing to obtain an enlarged light field image; determining the spatial coordinates of the user's observation eye point and calculating the field of view angle parameters to obtain the initial light field display screen at the user's observation eye point; performing light field information reconstruction to obtain the target light field display screen, and obtaining the user's head movement range to dynamically adjust the display range, and output a dynamic light field display screen. The present application realizes large-size light field display, improves user experience, and protects eyesight.

Description

Technical Field

[0001] The present application relates to the field of light field display technology, and in particular to a light field display method, device, equipment and storage medium. Background Art

[0002] In recent years, with the rapid development of virtual reality (VR) and augmented reality (AR) technologies, people's demand for immersive display experience has been growing. Traditional flat display technology can no longer meet users' pursuit of realistic three-dimensional images. As an emerging three-dimensional display technology, light field display can reproduce the light distribution in the real world, bring continuous focus adjustment and real depth perception to observers, and has broad application prospects. However, the current light field display technology still faces many challenges and urgently needs research breakthroughs.

[0003] Most existing light field display systems use multiple microlens arrays or spatial light modulators, which have problems such as low imaging quality, limited viewing angle, and bulky equipment. For example, light field displays based on microlens arrays require precise alignment and have low imaging resolution; light field displays based on multi-layer LCDs have complex optical systems and are difficult to thin. In addition, changes in the user's viewing position will cause parallax and distortion of the display, reducing the display quality. How to use optical components to optimize imaging effects, simplify system structure, and dynamically adapt to different viewing positions is a key issue that needs to be solved urgently. Summary of the invention

[0004] The present application provides a light field display method, device, equipment and storage medium for realizing large-size light field display, improving user experience and protecting eyesight.

[0005] In a first aspect, the present application provides a light field display method, the light field display method comprising:

[0006] Inputting the image signal to be displayed into the LCoS optical machine to generate a driving signal, and deflecting and modulating the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information;

[0007] Separating the polarization state of the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light;

[0008] Adjusting the reflection angle of the imaging light to obtain refracted light, and performing surface segmentation of the refracted light by a Fresnel lens to obtain concentric annular steps;

[0009] Reflecting and focusing the concentric annular steps to obtain a convergent imaging light beam, and performing image amplification processing using the convergent imaging light beam to obtain an amplified light field image;

[0010] Determine the spatial coordinates of the user's observation eye point according to the amplified light field image, calculate the field angle of the spatial coordinates to obtain field angle parameters, and optimize the position and angle of the optical element according to the field angle parameters to obtain a corresponding initial light field display image at the user's observation eye point;

[0011] The initial light field display picture is reconstructed with light field information to obtain a target light field display picture, and the user's head movement range is obtained to dynamically adjust the display range of the target light field display picture, and a dynamic light field display picture is output.

[0012] In a second aspect, the present application provides a light field display device, the light field display device comprising:

[0013] An input module, used to input the image signal to be displayed into the LCoS optical machine, generate a driving signal, and deflect and modulate the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information;

[0014] A separation module, used for performing polarization state separation on the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light;

[0015] A segmentation module, used for adjusting the reflection angle of the imaging light to obtain a refracted light, and performing surface segmentation of the refracted light by a Fresnel lens to obtain concentric annular steps;

[0016] A processing module, used for reflecting and focusing the concentric annular steps to obtain a convergent imaging light beam, and performing image amplification processing using the convergent imaging light beam to obtain an amplified light field image;

[0017] an optimization module, configured to determine the spatial coordinates of the user's observation eye point according to the amplified light field image, calculate the field angle of the spatial coordinates to obtain field angle parameters, and optimize the position and angle of the optical element according to the field angle parameters to obtain a corresponding initial light field display image at the user's observation eye point;

[0018] The output module is used to reconstruct the light field information of the initial light field display picture to obtain a target light field display picture, obtain the user's head movement range to dynamically adjust the display range of the target light field display picture, and output a dynamic light field display picture.

[0019] In a third aspect, the present application provides a light field display device, comprising: a Fresnel lens, a beam splitter wave plate, a beam splitter lens and an LCoS optical machine; one side of the Fresnel lens is a Fresnel structure, and the other side is a metal reflective film layer, and the Fresnel lens is used to generate a reflective focal length and magnification; the beam splitter wave plate comprises a semi-reflective and semi-transmissive wave plate and a polarized beam splitter, and the beam splitter wave plate is used to achieve light transmission and reflection; the beam splitter lens comprises a reflector and a metal reflective film layer, and the beam splitter lens is used to achieve light refraction; the LCoS optical machine is a module that uses LCOS display technology to generate images; the user's observation eye point is the use observation position of the light field display device, so that the light field display device performs the above-mentioned light field display method.

[0020] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the computer-readable storage medium is run on a computer, the computer executes the above-mentioned light field display method.

[0021] In the technical solution provided by the present application, an LCoS optical machine is used to generate a high-resolution image, and polarization modulation is achieved by deflecting liquid crystal molecules, so that high-quality reflected light can be obtained. The polarization state of the reflected light is separated by a beam splitter to obtain reflected polarized light and transmitted polarized light, and the corresponding imaging light is generated according to the reflected polarized light, so as to achieve full utilization of light energy and precise control of light. By adjusting the reflection angle of the imaging light and dividing the Fresnel lens surface, concentric annular steps are obtained, which effectively realizes the convergence and imaging of light. The image is magnified by using the converged imaging light beam to obtain an enlarged light field image, which improves the visual effect and immersion of the light field display. The spatial coordinates of the user's observation eye point are determined according to the enlarged light field image, and the optimal initial light field display picture is obtained at the user's observation position by calculating the field of view angle and optimizing the position angle of the optical element, so as to achieve dynamic adaptation. The light field information of the initial light field display picture is reconstructed to obtain the target light field display picture, and the display range is dynamically adjusted according to the user's head movement range, and the dynamic light field display picture is output, providing continuous viewing angle changes and stable display effects. By extracting and reconstructing multi-dimensional information, holographic light field display is realized, which brings realistic three-dimensional perception and natural interactive experience to users. The present invention uses LCoS optical machine, Fresnel lens, spectroscopic element, etc. to modulate the light field and reconstruct information, which can reduce the complexity of the optical system, realize the miniaturization and lightweight of the equipment, and has the advantages of high imaging quality, large viewing angle range, and simple equipment structure, thereby realizing large-scale light field display, improving user experience, and protecting eyesight. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0023] Figure 1 A schematic diagram of an embodiment of a light field display method in an embodiment of the present application;

[0024] Figure 2 This is a schematic diagram of an embodiment of a light field display device in an embodiment of the present application;

[0025] Figure 3 It is a schematic diagram of an embodiment of a light field display device in an embodiment of the present application. DETAILED DESCRIPTION

[0026] Embodiments of the present application provide a light field display method, apparatus, device and storage medium. The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] For ease of understanding, the specific process of the embodiment of the present application is described below. Figure 1 , an embodiment of the light field display method in the embodiment of the present application includes:

[0028] Step S101: inputting an image signal to be displayed into an LCoS optical machine, generating a driving signal, and deflecting and modulating the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information;

[0029] It is understandable that the execution subject of the present application may be a light field display device, or a terminal or a server, which is not limited here. The present application embodiment is described by taking a server as the execution subject as an example.

[0030] Specifically, the image signal to be displayed is mapped to spatial coordinates to determine the pixel dot matrix distribution of the LCoS optical machine, so that the position of each pixel corresponds to a specific position in the image signal. According to the pixel dot matrix distribution, the image signal to be displayed is resampled so that the image signal is adapted to the resolution and display requirements of the LCoS optical machine, and a driving signal of the LCoS optical machine is generated. A voltage is applied to the liquid crystal box of the LCoS optical machine to form a voltage distribution of the driving signal, so that the liquid crystal molecules at different positions generate corresponding deflection angles under the action of different voltages. According to the voltage distribution, the deflection angle of the liquid crystal molecules is calculated to obtain the deflection angle distribution of the liquid crystal molecules, which determines how the liquid crystal molecules change the polarization state of the incident light. The polarization state of the incident light is modulated by the deflection angle distribution to generate a polarization state distribution. The polarization state distribution is converted into a spatial frequency distribution by applying Fourier transform. The spatial frequency distribution is filtered to extract the target frequency component carrying the image information, and the target frequency component is converted back to the spatial domain by inverse Fourier transform to obtain the reflected light wavefront distribution carrying the image information. Through the wavefront distribution of the reflected light, the propagation direction of the reflected light is calculated, and spatial filtering is performed to finally obtain the reflected light carrying the image information, ensuring that the reflected light can accurately transmit the image information and achieve high-quality light field display effects.

[0031] Step S102, performing polarization state separation on the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light;

[0032] Specifically, the polarization state parameters of the reflected light are extracted, and the polarization ellipse parameters describing the polarization state of the reflected light are extracted from the reflected light. The polarization ellipse parameters include the amplitude, phase and polarization state information of the reflected light, and the first Stokes vector of the reflected light is calculated based on these parameters. The Stokes vector is a set of parameters that can fully describe the polarization state of light. The material properties of the beam splitter wave plate are obtained, including its refractive index, thickness and material composition, and the first Stokes vector is matrix transformed using these material properties to obtain the second Stokes vector. Through matrix operations in linear algebra, it is determined how the polarization state of light changes under the influence of different optical materials. The energy ratio of the second Stokes vector is calculated to determine the energy distribution ratio of the reflected light and the transmitted light under specific conditions. The obtained splitting efficiency parameters are used to describe the energy distribution of light in the beam splitter wave plate. Dynamic ratioing is performed through the splitting efficiency parameters to control the ratio of reflected polarized light and transmitted polarized light to meet the expected optical performance. The polarization state of the reflected polarized light and the transmitted polarized light is detected, and the polarization state feedback signals are obtained by detecting the changes in their polarization states. These signals are used to adjust and optimize the characteristics of the reflected light. According to these feedback signals, the propagation direction of the reflected polarized light is traced in reverse to obtain its angular distribution in space. The spatial angular distribution reflects the change in the directionality of the light after passing through the optical system. Through the spatial angular distribution, the focusing characteristics of the imaging light are simulated and calculated. The focusing characteristics of the imaging light under different conditions are analyzed by computer simulation methods to generate the corresponding imaging light.

[0033] Step S103, adjusting the reflection angle of the imaging light to obtain the refracted light, and performing surface segmentation of the refracted light by the Fresnel lens to obtain concentric annular steps;

[0034] Specifically, the imaging light is angle sampled, the angles of the imaging light at different spatial positions are measured and recorded, and the angle sampling data are obtained. Then, a spatial angle vector model of the imaging light is established based on these data. The model can fully describe the propagation direction and angle change of the light in space. The angle change gradient of the imaging light is calculated through the spatial angle vector model, and the angle change rate of the light in space is determined to ensure that the propagation path of the light can be accurately described. The angle error is analyzed through the angle change gradient to obtain the angle adjustment residual distribution, identify and quantify the errors generated during the angle adjustment process, and adjust the reflection angle of the imaging light according to the angle adjustment residual distribution to ensure that the light can accurately point to the preset direction to form a refraction light. The wavefront phase distribution of the refraction light is sampled, and the detailed data of the wavefront phase is obtained through sampling. The wavefront phase of the refraction light is reconstructed based on these data. The reconstruction process can generate a continuous wavefront phase distribution to ensure that the phase change of the light is smooth and continuous. According to the continuous wavefront phase distribution and the Fresnel lens, the wavefront phase of the refracted and reflected light is modulated step by step and the surface is segmented to obtain the optimal annular step structure parameters. Through mathematical optimization and calculation, the surface structure of the Fresnel lens is determined so that the light can propagate along the expected path when passing through the Fresnel lens. According to the optimal annular step structure parameters, the wavefront of the refracted and reflected light is modulated through the Fresnel lens to obtain concentric annular steps, ensuring that the light can be accurately focused and distributed at the expected position, forming high-quality imaging light, and ultimately achieving accurate light field display effects.

[0035] Step S104, performing reflection focusing on the concentric annular steps to obtain a converged imaging light beam, and performing image amplification processing using the converged imaging light beam to obtain an amplified light field image;

[0036] Specifically, the geometric parameters of the concentric annular steps are extracted. These parameters include detailed structural information such as the height, width and curvature of the steps. Ray tracing is performed on the refractive light incident on the concentric annular steps according to the geometric parameters. The reflection path of the light on the step surface is simulated by calculation to obtain the reflection light path distribution of the refractive light on the step structure. The wavefront deformation calculation is performed on the refractive light through the reflection light path distribution. The wavefront deformation calculation is used to determine the change in the wavefront of the light after it is reflected by the step structure, and the wavefront deformation data is obtained. The wavefront deformation data is used to perform reflection focusing to ensure that the refractive light can be accurately converged into an imaging beam. The focusing characteristics of the converged imaging beam are analyzed to determine the focusing effect of the beam at the focus, and the focal spot size of the converged imaging beam is obtained. The focal spot size reflects the concentration and resolution of the beam at the focus. According to the focal spot size, the point spread function of the converged imaging beam is calculated to obtain the point spread data. The point spread function describes the propagation characteristics of a point light source in an optical system. The spatial convolution of the convergent imaging beam is performed through the point spread data to obtain the initial light intensity distribution of the beam. The spatial convolution is to apply the point spread function to the beam through mathematical operations to obtain its initial light intensity distribution. The initial light intensity distribution of the beam is sampled to obtain discrete light intensity data, and the energy of the convergent imaging beam is normalized according to the discrete light intensity data to obtain the normalized discrete light intensity distribution, ensuring that the energy distribution of the beam in the entire light field is uniform. According to the normalized discrete light intensity distribution, the convergent imaging beam is reconstructed and amplified. Image reconstruction is to convert the light intensity data into a visible image through a computer algorithm, and amplify it to obtain an amplified light field image, thereby achieving high-resolution and high-quality light field display effects.

[0037] Step S105, determining the spatial coordinates of the user's observation eye point according to the amplified light field image, calculating the field angle of the spatial coordinates to obtain field angle parameters, and optimizing the position and angle of the optical element according to the field angle parameters to obtain a corresponding initial light field display image at the user's observation eye point;

[0038] Specifically, the magnified light field image is subjected to spatial coordinate mapping and spatial feature extraction, and these features include information such as brightness, contrast, and texture in the image. According to the spatial distribution characteristics, the spatial position of the user's observation eye point is estimated, and an algorithm such as machine learning or deep learning model is used to infer the user's eye point position to obtain the spatial coordinates of the user's observation eye point. Taking the user's observation eye point as the starting point, the field of view range of the magnified light field image is traced by ray tracing, and the angle distribution of the light at the edge of the field of view is obtained by simulating the path of light emitted from the eye point and propagating in the image. These angle distributions are used to calculate the horizontal field of view angle and the vertical field of view angle at the user's observation eye point, thereby obtaining the field of view angle parameters. According to the field of view angle parameters, the position of the optical element is optimized, and the optimal position parameters of the optical element are determined using a mathematical optimization algorithm to ensure that the user can obtain the best field of view range when observing the image. At the same time, the angle of the optical element is optimized to obtain the optimal optical element angle parameter. The geometric structure of the optical system is precisely adjusted so that the light can propagate in the best path and reach the user's eye point. Imaging is performed through the optimal optical element position parameters and the optimal optical element angle parameters to generate an initial light field display image corresponding to the user's observation eye point. This image is optically adjusted and optimized to ensure that the user can see high-quality images and provide an excellent visual experience.

[0039] Step S106: reconstruct the light field information of the initial light field display picture to obtain a target light field display picture, obtain the user's head movement range to dynamically adjust the display range of the target light field display picture, and output a dynamic light field display picture.

[0040] Specifically, the light direction information of the initial light field display image is extracted, and the direction information of each light ray is extracted from the initial image to form a light direction vector distribution. These direction vectors describe the propagation path of the light in space. According to the light direction vector distribution, the light energy of the initial light field display image is calculated, and the energy conservation and distribution model is used to obtain light energy distribution data. These data reflect the light energy density at each position in the light field. According to the light energy distribution data, the brightness information of the initial light field display image is reconstructed and the dynamic range is mapped. The light energy distribution is converted into visible brightness data using high dynamic range imaging technology to obtain target brightness data. The depth information of the initial light field display image is extracted, and the depth data of the image is obtained using stereoscopic vision or depth sensing technology. These data describe the distance from each point in the image to the observer. According to the depth data, the parallax information of the initial light field display image is reconstructed, and the stereoscopic effect of the image is reconstructed using the parallax principle to obtain the target parallax data. The target brightness data and the target parallax data are fused to obtain fused light field data. Based on the fused light field data, the initial light field display is reconstructed, and the target light field display is generated through the reconstruction algorithm. The display has real optical properties and depth effects. The spatial position and posture data of the user's head are obtained, and the head tracking technology is used to monitor the user's head position and posture in real time. The movement range of the user's head is determined based on these data. According to the movement range of the user's head, the corresponding real-time display range parameters are determined. These parameters describe the range and direction of the image that needs to be dynamically adjusted. According to the real-time display range parameters, the target light field display is cropped and spatially mapped to ensure that the display always matches the user's observation position and angle, and a dynamic light field display is output.

[0041] In the embodiment of the present application, an LCoS optical machine is used to generate a high-resolution image, and polarization modulation is achieved by deflecting liquid crystal molecules, so that high-quality reflected light can be obtained. The polarization state of the reflected light is separated by a beam splitter to obtain reflected polarized light and transmitted polarized light, and the corresponding imaging light is generated according to the reflected polarized light, so as to achieve full utilization of light energy and precise control of light. By adjusting the reflection angle of the imaging light and dividing the Fresnel lens surface, concentric annular steps are obtained, which effectively realizes the convergence and imaging of light. The image is magnified by using the converged imaging light beam to obtain an enlarged light field image, which improves the visual effect and immersion of the light field display. The spatial coordinates of the user's observation eye point are determined according to the enlarged light field image, and the optimal initial light field display picture is obtained at the user's observation position by calculating the field of view angle and optimizing the position angle of the optical element, so as to achieve dynamic adaptation. The initial light field display picture is reconstructed with light field information to obtain a target light field display picture, and the display range is dynamically adjusted according to the user's head movement range, and a dynamic light field display picture is output, providing continuous viewing angle changes and stable display effects. By extracting and reconstructing multi-dimensional information, holographic light field display is realized, which brings realistic three-dimensional perception and natural interactive experience to users. The present invention uses LCoS optical machine, Fresnel lens, spectroscopic element, etc. to modulate the light field and reconstruct information, which can reduce the complexity of the optical system, realize the miniaturization and lightweight of the equipment, and has the advantages of high imaging quality, large viewing angle range, and simple equipment structure, thereby realizing large-scale light field display, improving user experience, and protecting eyesight.

[0042] In a specific embodiment, the process of executing step S101 may specifically include the following steps:

[0043] (1) Performing spatial coordinate mapping on the image signal to be displayed to obtain the pixel matrix distribution of the LCoS optical machine, and resampling the image signal to be displayed according to the pixel matrix distribution to obtain the driving signal of the LCoS optical machine;

[0044] (2) Applying voltage to the liquid crystal box of the LCoS optical machine to obtain the voltage distribution of the driving signal, and calculating the deflection angle of the liquid crystal molecules based on the voltage distribution to obtain the deflection angle distribution;

[0045] (3) Modulating the polarization state of the incident light by means of the deflection angle distribution to obtain the polarization state distribution, and performing Fourier transform on the polarization state distribution to obtain the spatial frequency distribution;

[0046] (4) Filtering the spatial frequency distribution to obtain the target frequency component carrying the image information, and performing inverse Fourier transform on the target frequency component to obtain the reflected light wavefront distribution carrying the image information;

[0047] (5) The propagation direction of the reflected light is calculated and spatially filtered based on the wavefront distribution of the reflected light to obtain the reflected light carrying the image information.

[0048] Specifically, the image signal to be displayed is mapped to a spatial coordinate. The two-dimensional coordinate system of the image signal is converted into the pixel matrix coordinate system of the LCoS (liquid crystal silicon) optical machine. Assume that the resolution of the input image signal is , and the resolution of the LCoS optical machine is , the image signal is mapped to the pixel matrix of LCoS through resampling methods such as linear interpolation or nearest neighbor interpolation. Mapped to the pixel matrix of the LCoS optical machine through the following formula:

[0049] ;

[0050] ;

[0051] in, and are the corresponding pixel coordinates in the LCoS optical machine. The image signal to be displayed is resampled according to the new pixel matrix distribution to ensure that each LCoS pixel can accurately represent the local information of the original image, thereby generating a high-quality driving signal. Through bilinear interpolation, image distortion is reduced and image quality is maintained. A voltage is applied to the liquid crystal box of the LCoS optical machine to generate a voltage distribution of the driving signal. Assume that the driving signal is , whose voltage distribution can be expressed as a function ,in is the pixel coordinate of the LCoS optical machine. This voltage distribution will cause the liquid crystal molecules to deflect. The deflection angle of the liquid crystal molecules With applied voltage There is usually a nonlinear relationship between them, which can be expressed as:

[0052] ;

[0053] in It is a function that describes the relationship between voltage and the deflection angle of liquid crystal molecules. , modulates the polarization state of the incident light. After the incident light passes through the liquid crystal molecules, its polarization state changes, which can be represented by the Jones Matrix. Assume that the initial polarization state of the incident light is , then after passing through the liquid crystal layer, the polarization state of the output light It can be expressed as:

[0054] ;

[0055] in is the Jones matrix corresponding to the liquid crystal layer. Polarization state distribution After Fourier transform, we get the spatial frequency distribution. The formula of Fourier transform is:

[0056] ;

[0057] in represents the distribution in frequency space, and is the frequency coordinate, is an imaginary unit, is the base of natural logarithms Represents the polarization state distribution of the output light in the spatial domain. Filtering is performed in the frequency space to retain the target frequency components carrying image information. Filtering can be achieved by setting a bandpass filter or a low-pass filter. Assume that the filter function is , then the frequency distribution after filtering is:

[0058] ;

[0059] in represents the frequency distribution after filtering, is a filter function that describes which frequency components are retained or suppressed. Through the inverse Fourier transform, the filtered frequency components are converted back to the spatial domain to obtain the reflected light wavefront distribution carrying image information. The inverse Fourier transform formula is:

[0060] ;

[0061] in represents the distribution of the reflected light wavefront in the spatial domain, is the distribution in frequency space. The propagation direction of the reflected light is calculated and spatially filtered by the reflected light wavefront distribution to obtain the reflected light carrying image information. The propagation direction calculation can be realized by the optical phase distribution model, assuming that the phase distribution is , then the propagation direction is represented by the gradient of the light:

[0062] ;

[0063] in represents the gradient of the phase distribution, and The phases are and When calculating the propagation direction of the reflected light, the influence of spatial filtering needs to be considered to ensure that the final reflected light has high-quality image information and accurate directionality.

[0064] In a specific embodiment, the process of executing step S102 may specifically include the following steps:

[0065] (1) Extract the polarization state parameters of the reflected light to obtain the polarization ellipse parameters, and calculate the first Stokes vector of the reflected light based on the polarization ellipse parameters;

[0066] (2) Obtaining the material properties of the beam splitter wave plate and performing matrix transformation on the first Stokes vector to obtain the second Stokes vector;

[0067] (3) Calculate the energy ratio of the second Stokes vector to obtain the splitting efficiency parameter;

[0068] (4) Dynamically proportioning the reflected polarized light and the transmitted polarized light by using the light splitting efficiency parameter, and detecting the polarization states of the reflected polarized light and the transmitted polarized light to obtain a polarization state feedback signal;

[0069] (5) According to the polarization state feedback signal, the propagation direction of the reflected polarized light is traced in reverse to obtain the spatial angle distribution;

[0070] (6) The focusing characteristics of the imaging light are simulated and calculated through the spatial angle distribution and the corresponding imaging light is generated.

[0071] Specifically, the polarization state of the reflected light is expressed as polarization ellipse parameters. The polarization ellipse parameters include the major axis, minor axis and phase difference of the ellipse. These parameters can describe the polarization state of light. Assuming that the electric field component of the reflected light is and The directions are and , then the parameters of the polarization ellipse can be calculated by the following formula:

[0072] ;

[0073] in, and Respectively represent the electric field in and The amplitude of the direction, represents the angular frequency, Indicates time, represents the phase difference. Based on these parameters, the first Stokes vector of the reflected light is calculated. The Stokes vector is a set of parameters that describe the polarization state, usually expressed as , , and It is defined as follows:

[0074] ;

[0075] in, represents the total intensity, represents the linear polarization component, Represents the +45° and -45° linear polarization components, Represents the right-handed and left-handed circular polarization components. Obtain the material properties of the beam splitter, such as its refractive index and thickness. These properties can affect the polarization state of light. Perform a matrix transformation on the first Stokes vector to reflect the effect of the beam splitter on the light. The matrix transformation of the beam splitter can be represented by the Jones matrix:

[0076] ;

[0077] in, is the first Stokes vector, is the second Stokes vector, is the Jones matrix of the beam splitter. This matrix depends on the material properties of the beam splitter and the incident angle of the light. The energy ratio of the second Stokes vector is calculated to determine the energy distribution of the reflected light and the transmitted light. The beam splitting efficiency parameter can be calculated from the ratio of the Stokes vectors. For example, the energy ratio of the reflected light is The energy ratio of the transmitted light It can be expressed as:

[0078] ;

[0079] in, Represents the total intensity component of the second Stokes vector. Dynamically proportioning is performed through the splitting efficiency parameter to obtain reflected polarized light and transmitted polarized light. The polarization state of the reflected polarized light and the transmitted polarized light is detected to obtain a polarization state feedback signal. Polarization state detection can be completed using a polarimeter or a polarizer combination. The polarimeter can measure the Stokes parameters of light to obtain a polarization state feedback signal. According to the polarization state feedback signal, the propagation direction of the reflected polarized light is reversely traced. Reverse tracing is achieved through ray tracing algorithms, which can simulate the propagation path of light in space. Assuming that the propagation direction of the light in space is d, its propagation path can be described by the geometric optics formula:

[0080] ;

[0081] in, is the phase gradient, which represents the rate of change of phase in the direction of light propagation. By tracing the propagation direction of the reflected light in reverse, its spatial angle distribution can be obtained. These angle distributions describe the propagation direction and angle of the light in space. The focusing characteristics of the imaging light are simulated and calculated through the spatial angle distribution, and the corresponding imaging light is generated. The focusing characteristics of the imaging light can be simulated by ray tracing software, which can calculate the focusing effect of the light after passing through the optical element. For example, when the light passes through the lens, its focusing characteristics can be calculated by the lens formula:

[0082] ;

[0083] in, represents the focal length of the lens, represents the object distance (the distance the light travels from the object to the lens), Represents the image distance (the distance the light travels from the lens to the image plane).

[0084] In a specific embodiment, the process of executing step S103 may specifically include the following steps:

[0085] (1) Performing angle sampling on the imaging light to obtain angle sampling data, and establishing a spatial angle vector model of the imaging light based on the angle sampling data;

[0086] (2) Calculate the angle change gradient of the imaging light through the spatial angle vector model;

[0087] (3) Analyze the angle error through the angle change gradient to obtain the angle adjustment residual distribution, and adjust the reflection angle of the imaging light according to the angle adjustment residual distribution to obtain the reflected light pointing to the preset direction;

[0088] (4) sampling the wavefront phase distribution of the reflected light to obtain wavefront phase sampling data; reconstructing the wavefront phase of the reflected light according to the wavefront phase sampling data to obtain a continuous wavefront phase distribution;

[0089] (5) According to the continuous wavefront phase distribution and the Fresnel lens, the wavefront phase is modulated step by step and the curved surface is segmented on the refracted and reflected light to obtain the optimal annular step structure parameters;

[0090] (6) Based on the optimal annular step structure parameters, the wavefront of the refracted and reflected light is modulated by a Fresnel lens to obtain concentric annular steps.

[0091] Specifically, the propagation path of the imaging light in space is sampled by angle. Angle sampling involves measuring the propagation direction of the light at different spatial positions. These directions can be represented by the change of the spatial coordinates of the light. Assume that in the spatial coordinate system, the light is at position The propagation direction is and ,in Indicates that the light The azimuth in the plane, Represents the light relative to The elevation angle of the axis. By sampling the angle of the light at multiple positions, a set of angle sampling data is obtained. Based on the angle sampling data, a spatial angle vector model of the imaging light is established. The spatial angle vector model describes the propagation direction and change law of the light in space, which can be specifically represented by a vector. Assume that the light is at position The direction of propagation at is the vector , then the angle vector model can be expressed as:

[0092] ;

[0093] in, Indicates that the light is at position The direction vector, Represents the arc length parameter of light propagation. By fitting and interpolating the angle sampling data, a spatial angle vector model of light is established. Through the spatial angle vector model, the angle change gradient of the imaging light is calculated. The angle change gradient describes the rate of change of the light propagation direction with the spatial position, which can be achieved by vector gradient calculation. Assume that the light propagation direction vector is , then the angle change gradient can be expressed as:

[0094] ;

[0095] in, Represents the angle change gradient matrix, and each element represents the partial derivative of the light direction component in different spatial coordinate directions. Angle error analysis is performed through angle change gradient. Angle error analysis aims to determine the error distribution of the light propagation direction, which is achieved by calculating the difference between the actual propagation direction of the light and the expected direction. By statistically analyzing the angle errors at multiple positions, the angle adjustment residual distribution is obtained. According to the angle adjustment residual distribution, the reflection angle of the imaging light is adjusted. The reflection angle adjustment aims to correct the propagation direction of the light by adjusting the incident angle of the light on the reflection surface so that it points to the preset direction. The wavefront phase distribution of the adjusted reflected light is sampled to obtain wavefront phase sampling data. The wavefront phase distribution describes the change of the phase of the light during the propagation process. According to the wavefront phase sampling data, the wavefront phase of the reflected light is reconstructed. Wavefront phase reconstruction aims to reconstruct the phase distribution of the light in space by mathematical methods. According to the reconstructed continuous wavefront phase distribution and Fresnel lens, the wavefront phase of the reflected light is modulated step by step and the surface is segmented to obtain the optimal optical characteristics. The Fresnel lens is a lens with multiple concentric annular steps, each of which modulates the phase of the light in a specific way. Assume that the phase modulation function of the Fresnel lens is ,in represents the radial distance, then the phase distribution of the lens can be expressed as:

[0096] ;

[0097] in, represents the wavelength of light, Represents the focal length of the lens. By adjusting and dividing the step structure of the Fresnel lens, the wavefront phase distribution of the light is optimized to obtain the optimal annular step structure parameters. According to the optimal annular step structure parameters, the wavefront of the refracted and reflected light is modulated by the Fresnel lens to obtain concentric annular steps. The concentric annular steps can achieve efficient light focusing and imaging through graded phase modulation. For example, in a holographic projection system, this method can accurately control the propagation and focusing of light to achieve high-resolution and high-contrast holographic image display.

[0098] In a specific embodiment, the process of executing step S104 may specifically include the following steps:

[0099] (1) Extract the geometric parameters of the concentric annular steps, and perform ray tracing on the refracted and reflected light incident on the concentric annular steps according to the geometric parameters to obtain the reflected light path distribution of the refracted and reflected light on the step structure;

[0100] (2) Calculate the wavefront deformation of the refracted and reflected light through the distribution of the reflected light path to obtain wavefront deformation data, and perform reflection focusing through the wavefront deformation data to obtain a convergent imaging beam;

[0101] (3) Analyze the focusing characteristics of the convergent imaging beam to obtain the focal spot size of the convergent imaging beam;

[0102] (4) Calculate the point spread function of the converged imaging beam according to the focal spot size to obtain PSF data, and perform spatial convolution on the converged imaging beam through the PSF data to obtain the initial light intensity distribution of the beam;

[0103] (5) Sampling the initial light intensity distribution of the light beam to obtain discrete light intensity data, and performing energy normalization processing on the converged imaging light beam according to the discrete light intensity data to obtain a normalized discrete light intensity distribution;

[0104] (6) Based on the normalized discrete light intensity distribution, the converged imaging light beam is reconstructed and amplified to obtain an amplified light field image.

[0105] Specifically, the geometric parameters of the concentric annular steps are extracted. These geometric parameters include the height, width, curvature and position of each step, which determine the reflection path of the incident light on each step. Assume that the step parameters are (step height), (step width), and the center position of each step According to these geometric parameters, ray tracing is performed on the refracted and reflected light incident on the concentric annular steps. The purpose of ray tracing is to simulate the propagation path of light on the step structure and calculate the distribution of the reflected light path on each step. Assume that the initial direction of the incident light is , the reflection path of the light on each step is calculated by geometric optics. Each reflection path can be described by the law of reflection, that is, the angle of incidence is equal to the angle of reflection. For each step, the law of reflection formula is used: ,in represents the reflection angle, represents the incident angle. By calculating the reflection path on each step step by step, the reflection light path distribution of the refracted light on the step structure is obtained. The wavefront deformation of the refracted light is calculated based on the reflection light path distribution. The wavefront deformation describes the phase change of the light during the reflection process. Assume that the light is on the step The phase change on , then the wavefront deformation can be expressed as:

[0106] ;

[0107] in represents the wavelength of light, Indicates the step height, represents the incident angle. By calculating the phase change on each step, the wavefront deformation data of the entire step structure is obtained. Reflection focusing is performed based on the wavefront deformation data to obtain a convergent imaging beam. The purpose of reflection focusing is to adjust the step structure so that the reflected light converges at a predetermined focus, thereby forming a clear imaging beam. Assume that the focal length of the convergent imaging beam is , then the wavefront of the focused beam can be expressed by the phase function of the Fresnel lens as:

[0108] ;

[0109] in represents the radial distance, represents the focal length, and λ represents the wavelength. By adjusting the geometric parameters of the step, the wavefront deformation data is matched with the focusing phase function to achieve reflective focusing. The focusing characteristics of the convergent imaging beam are analyzed to determine the focal spot size of the beam at the focus. The focal spot size is an important parameter to measure the focusing quality of the beam. Assume that the light intensity distribution at the focus is , then the focal spot size It can be calculated by the beam propagation equation:

[0110] ;

[0111] in represents the radius of the incident beam, represents the wavelength, Represents the focal length. The point spread function of the converged imaging beam is calculated according to the focal spot size to obtain the spread function data. The spread function describes the light intensity distribution of a point light source in the imaging system. Assume that the point spread function is , can be expressed by the following formula:

[0112] ;

[0113] in and represents the spatial coordinates, represents the focal spot size. The spatial convolution of the convergent imaging beam is performed by the diffusion function data to obtain the initial intensity distribution of the beam. Assume that the intensity distribution of the input beam is , then the initial light intensity distribution It can be expressed by convolution operation as:

[0114] ;

[0115] The symbol * indicates the convolution operation. The initial intensity distribution of the beam is sampled to obtain discrete intensity data. The continuous intensity distribution is converted into discrete data points for subsequent processing and analysis. Assume that the sampling interval is and , then the discrete light intensity data can be expressed as ,in and Respectively represent the index of the sampling point. According to the discrete light intensity data, the converged imaging beam is energy normalized to obtain the normalized discrete light intensity distribution. The total energy of the light intensity data is standardized for comparison and analysis. According to the normalized discrete light intensity distribution, the converged imaging beam is image reconstructed and amplified to obtain an amplified light field image. The purpose of image reconstruction is to reconstruct a continuous image from discrete light intensity data, and the amplification process is to enlarge the image to a predetermined size.

[0116] In a specific embodiment, the process of executing step S105 may specifically include the following steps:

[0117] (1) Perform spatial coordinate mapping and spatial feature extraction on the magnified light field image to obtain spatial distribution characteristics;

[0118] (2) Estimate the spatial position of the user's observation eye point based on the spatial distribution characteristics to obtain the spatial coordinates of the user's observation eye point;

[0119] (3) Taking the user's observation eye point as the starting point, tracing rays is performed on the field of view of the magnified light field image to obtain the ray angle distribution at the edge of the field of view, and the horizontal field of view angle and vertical field of view angle at the user's observation eye point are calculated based on the ray angle distribution at the edge of the field of view to obtain the field of view angle parameters;

[0120] (4) Optimizing the position of the optical element according to the field angle parameter to obtain the optimal optical element position parameter, and optimizing the angle of the optical element to obtain the optimal optical element angle parameter;

[0121] (5) Imaging is performed using optimal optical element position parameters and optimal optical element angle parameters to obtain an initial light field display image corresponding to the user's observation eye point.

[0122] Specifically, the magnified light field image is mapped to spatial coordinates. Assume that the resolution of the magnified light field image is ,in Indicates the width of the image. Represents the height of the image. By converting the two-dimensional coordinate system of the image into a three-dimensional space coordinate system, the position of each pixel in the image in three-dimensional space is obtained. Assume that the two-dimensional coordinates of each pixel in the image are , and its corresponding three-dimensional space coordinates can be expressed as , the conversion formula is:

[0123] ;

[0124] in and Respectively represent the width and height of the three-dimensional space, Represents the depth position of the image plane in three-dimensional space. According to the spatial coordinate mapping, spatial feature extraction is performed to extract key geometric and brightness features from the image. Common spatial features include corners, edges, and textures. These features can be obtained by calculating the gradient of the image, corner detection algorithms (such as Harris corner detection) and edge detection algorithms (such as Canny edge detection). Assume that the extracted spatial feature set is , each feature Include Location and brightness value According to the extracted spatial distribution features, the spatial position of the user's observation eye point is estimated. The user's observation eye point is the visual focus position of the user when viewing the image, which can be estimated by analyzing the distribution of spatial features. Assume that the position of the user's observation eye point is , can be estimated by the following formula:

[0125] ;

[0126] in, The brightness value of the feature point is represented by the weighted average method to obtain the spatial coordinates of the user's eye point. Taking the user's eye point as the starting point, ray tracing is performed on the field of view of the magnified light field image. The propagation path of the light from the user's eye point within the field of view is simulated. Assume that the angle of the field of view is (horizontal field of view) and (vertical field of view angle), the angle distribution of light at the edge of the field of view can be calculated using the geometric optics formula. The propagation direction at , then the angle distribution formula is:

[0127] ;

[0128] in and Represent the horizontal and vertical angles respectively. According to the light angle distribution at the edge of the field of view, the horizontal and vertical field of view angles at the user's eye point are calculated. The field of view angle parameter describes the user's field of view when observing an image. The field of view angle parameter is obtained by calculating the maximum and minimum angle differences at the edge of the field of view. According to the field of view angle parameter, the position of the optical element is optimized. The position optimization of the optical element aims to adjust the position of the optical element so that the light can form the best imaging effect at the user's eye point. Assume that the position parameter of the optical element is , can be optimized by the following optimization algorithm:

[0129] ;

[0130] The objective function is to minimize the position deviation of the optical element so that the light can be accurately focused at the user's eye point. At the same time, the angle of the optical element is optimized. The angle optimization of the optical element can be achieved by adjusting the tilt angle of the element. To achieve this, the optimization algorithm is as follows:

[0131] ;

[0132] The objective function is to minimize the angle deviation of the light so that the light can form the best field of view at the user's eye point. and optimal optical element angle parameters The imaging process is to focus the light from the optical element to the user's eye point to form the initial light field display. Assume that the propagation path of the light after passing through the optical element is , can be expressed by the following formula:

[0133] ;

[0134] in Indicates the propagation distance of light in space, by adjusting The value of is used to realize accurate focusing of light and form the corresponding initial light field display image at the user's observation eye point.

[0135] In a specific embodiment, the process of executing step S106 may specifically include the following steps:

[0136] (1) Extracting light direction information from the initial light field display image to obtain light direction vector distribution, and calculating light energy of the initial light field display image based on the light direction vector distribution to obtain light energy distribution data;

[0137] (2) Based on the light energy distribution data, the brightness information of the initial light field display image is reconstructed and the dynamic range is mapped to obtain the target brightness data;

[0138] (3) extracting depth information from the initial light field display image to obtain depth data of the initial light field display image, and reconstructing disparity information of the initial light field display image based on the depth data to obtain target disparity data;

[0139] (4) fusing the target brightness data and the target parallax data to obtain fused light field data, and reconstructing the light field image of the initial light field display screen according to the fused light field data to obtain the target light field display screen;

[0140] (5) Obtaining spatial position and posture data of the user's head, determining the user's head movement range based on the spatial position and posture data, and determining corresponding real-time display range parameters based on the user's head movement range;

[0141] (6) Cropping and spatial mapping the target light field display image according to the real-time display range parameters, and outputting the dynamic light field display image.

[0142] Specifically, the direction vector distribution of the light is obtained. The light direction information describes the propagation direction of the light in space and is obtained by optical measurement or calculation methods. Assume that each pixel in the initial light field display screen The direction of the light at , its direction vector can be expressed as ,in , and Respectively represent the light , and Component in the direction. According to the light direction vector distribution, the light energy is calculated for the initial light field display. The light energy distribution describes the energy density of light at different positions and is obtained through radiometry calculation. Assume that the light is at position The energy density at , can be calculated by the following formula:

[0143] ;

[0144] in Indicates location The light intensity at Represents the light direction vector The angle between the light energy distribution data and the normal direction. According to the obtained light energy distribution data, the initial light field display screen is reconstructed for brightness information and dynamic range mapping. Brightness information reconstruction reconstructs the brightness value of the image through light energy distribution data, while dynamic range mapping maps the reconstructed brightness value to the dynamic range of the display device. Assume that the reconstructed brightness value is , dynamic range mapping can be achieved by the following formula:

[0145] ;

[0146] in Represents the brightness value after mapping, and Denote the minimum and maximum brightness values ​​in the light field display respectively. Depth information is extracted from the initial light field display. The depth information describes the distance from each pixel in the image to the observer and is obtained through stereo vision or depth sensing technology. Assume that each pixel in the initial light field display is The depth value at , then the depth information extraction can be achieved through binocular stereo matching algorithm or time-of-flight measurement technology. The disparity information of the initial light field display is reconstructed according to the depth data. The disparity of the image is reconstructed through the depth data, so that the image has a three-dimensional sense. Assume that the reconstructed disparity value is , the parallax can be calculated by the following formula

[0147] ;

[0148] in represents the baseline distance of the binocular camera, represents the focal length of the camera, Represents the depth value. Data fusion is performed on the target brightness data and the target disparity data to obtain fused light field data. The brightness and disparity information are combined to form complete light field data. The initial light field display screen is reconstructed according to the fused light field data. A high-quality light field image is generated by fusing the light field data. Assume that the reconstructed light field image is , which can be achieved through interpolation and image reconstruction algorithms. The spatial position and posture data of the user's head are obtained, and the movement range of the user's head is determined based on these data. The spatial position and posture data of the user's head can be obtained through head tracking technology. Assuming that the position of the user's head is and the attitude angle is , obtained through sensor measurement or computer vision technology. According to the spatial position and posture data of the user's head, the user's head movement range is determined. Assume that the user's head movement range is , can be calculated by the following formula:

[0149] ;

[0150] in Indicates the initial position. The corresponding real-time display range parameters are determined according to the user's head movement range. The real-time display range parameters describe the adjustment parameters of the light field display image within the user's head movement range. Assume that the real-time display range parameters are , can be calculated by the following formula:

[0151] ;

[0152] ;

[0153] in Indicates the initial distance from the display device to the user's head. The target light field display is cropped and spatially mapped according to the real-time display range parameters to output a dynamic light field display. The purpose of cropping is to adjust the display range of the light field image according to the real-time display range parameters, while spatial mapping is to map the cropped image onto the display device.

[0154] The light field display method in the embodiment of the present application is described above. The light field display device in the embodiment of the present application is described below. Figure 2 In the embodiments of the present application, an embodiment of the light field display device includes:

[0155] The input module 201 is used to input the image signal to be displayed into the LCoS optical machine, generate a driving signal, and deflect and modulate the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information;

[0156] The separation module 202 is used to separate the polarization state of the reflected light to obtain reflected polarized light and transmitted polarized light, and generate corresponding imaging light according to the reflected polarized light;

[0157] The segmentation module 203 is used to adjust the reflection angle of the imaging light to obtain the refracted light, and perform surface segmentation of the refracted light on the Fresnel lens to obtain concentric annular steps;

[0158] The processing module 204 is used to reflect and focus the concentric annular steps to obtain a converged imaging light beam, and use the converged imaging light beam to perform image amplification processing to obtain an amplified light field image;

[0159] The optimization module 205 is used to determine the spatial coordinates of the user's observation eye point according to the amplified light field image, calculate the field angle of the spatial coordinates, obtain the field angle parameters, and optimize the position and angle of the optical element according to the field angle parameters to obtain the corresponding initial light field display image at the user's observation eye point;

[0160] The output module 206 is used to reconstruct the light field information of the initial light field display picture to obtain the target light field display picture, obtain the user's head movement range to dynamically adjust the display range of the target light field display picture, and output the dynamic light field display picture.

[0161] Through the cooperation of the above components, the LCoS optical machine is used to generate high-resolution images. By deflecting the liquid crystal molecules to achieve polarization modulation, high-quality reflected light can be obtained. The polarization state of the reflected light is separated by the beam splitter to obtain reflected polarized light and transmitted polarized light, and the corresponding imaging light is generated according to the reflected polarized light, so as to achieve full utilization of light energy and precise control of light. By adjusting the reflection angle of the imaging light and dividing the Fresnel lens surface, concentric annular steps are obtained, which effectively realizes the convergence and imaging of light. The image is magnified by the converged imaging light beam to obtain an enlarged light field image, which improves the visual effect and immersion of the light field display. The spatial coordinates of the user's observation eye point are determined according to the enlarged light field image, and the optimal initial light field display picture is obtained at the user's observation position through the field of view angle calculation and the optimization of the position angle of the optical element, so as to achieve dynamic adaptation. The light field information of the initial light field display picture is reconstructed to obtain the target light field display picture, and the display range is dynamically adjusted according to the user's head movement range, and the dynamic light field display picture is output, providing continuous viewing angle changes and stable display effects. By extracting and reconstructing multi-dimensional information, holographic light field display is realized, which brings realistic three-dimensional perception and natural interactive experience to users. The present invention uses LCoS optical machine, Fresnel lens, spectroscopic element, etc. to modulate the light field and reconstruct information, which can reduce the complexity of the optical system, realize the miniaturization and lightweight of the equipment, and has the advantages of high imaging quality, large viewing angle range, and simple equipment structure, thereby realizing large-scale light field display, improving user experience, and protecting eyesight.

[0162] See also Figure 3 The present application also provides a light field display device, the light field display device includes a Fresnel lens, a beam splitter wave plate, a beam splitter lens and an LCoS optical machine; one side of the Fresnel lens is a Fresnel structure, and the other side is a metal reflective film layer, and the Fresnel lens is used to generate a reflective focal length and magnification; the beam splitter wave plate includes a semi-reflective and semi-transmissive wave plate and a polarized beam splitter, and the beam splitter wave plate is used to achieve light transmission and reflection; the beam splitter lens includes a reflector and a metal reflective film layer, and the beam splitter lens is used to achieve light refraction; the LCoS optical machine is a module that uses LCOS display technology to generate images; the user's observation eye point is the use observation position of the light field display device, so that the light field display device performs the steps of the light field display method in the above embodiments.

[0163] The present application also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are executed on a computer, the computer executes the steps of the light field display method.

[0164] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, systems and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0165] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.

[0166] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A light field display method, characterized in that: The light field display method comprises: Inputting the image signal to be displayed into the LCoS optical machine, generating a driving signal, and deflecting and modulating the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information; specifically including: mapping the image signal to be displayed to spatial coordinates to obtain the pixel dot matrix distribution of the LCoS optical machine, and resampling the image signal to be displayed according to the pixel dot matrix distribution to obtain the driving signal of the LCoS optical machine; applying voltage to the liquid crystal box of the LCoS optical machine to obtain the voltage distribution of the driving signal, and calculating the deflection angle of the liquid crystal molecules according to the voltage distribution to obtain the deflection angle distribution; modulating the polarization state of the incident light according to the deflection angle distribution to obtain the polarization state distribution, and performing Fourier transform on the polarization state distribution to obtain the spatial frequency distribution; filtering the spatial frequency distribution to obtain the target frequency component carrying the image information, and performing inverse Fourier transform on the target frequency component to obtain the wavefront distribution of the reflected light carrying the image information; calculating the propagation direction of the reflected light and spatial filtering according to the wavefront distribution of the reflected light to obtain the reflected light carrying the image information; Separating the polarization state of the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light; The reflection angle of the imaging light is adjusted to obtain a refracted light, and the refracted light is segmented by a Fresnel lens to obtain concentric annular steps; specifically, the method includes: performing angle sampling on the imaging light to obtain angle sampling data, and establishing a spatial angle vector model of the imaging light according to the angle sampling data; calculating the angle change gradient of the imaging light through the spatial angle vector model; performing angle error analysis through the angle change gradient to obtain an angle adjustment residual distribution, and adjusting the reflection angle of the imaging light according to the angle adjustment residual distribution to obtain a refracted light pointing in a preset direction; performing wavefront phase distribution sampling on the refracted light to obtain wavefront phase sampling data; performing wavefront phase reconstruction on the refracted light according to the wavefront phase sampling data to obtain a continuous wavefront phase distribution; performing step-by-step wavefront phase modulation and surface segmentation on the refracted light according to the continuous wavefront phase distribution and the Fresnel lens to obtain optimal annular step structure parameters; performing wavefront modulation on the refracted light through the Fresnel lens according to the optimal annular step structure parameters to obtain concentric annular steps; Reflecting and focusing the concentric annular steps to obtain a convergent imaging light beam, and performing image amplification processing using the convergent imaging light beam to obtain an amplified light field image; Determine the spatial coordinates of the user's observation eye point according to the amplified light field image, calculate the field angle of the spatial coordinates to obtain field angle parameters, and optimize the position and angle of the optical element according to the field angle parameters to obtain the corresponding initial light field display image at the user's observation eye point; wherein the optical element includes: a Fresnel lens, a beam splitter wave plate and a beam splitter lens; The initial light field display picture is reconstructed with light field information to obtain a target light field display picture, and the user's head movement range is obtained to dynamically adjust the display range of the target light field display picture, and a dynamic light field display picture is output.

2. The light field display method according to claim 1, characterized in that: The polarization state separation of the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light, includes: Extracting polarization state parameters of the reflected light to obtain polarization ellipse parameters, and calculating a first Stokes vector of the reflected light according to the polarization ellipse parameters; Acquire the material property of the beam splitter wave plate and perform matrix transformation on the first Stokes vector to obtain a second Stokes vector; Calculating the energy ratio of the second Stokes vector to obtain a light splitting efficiency parameter; Dynamically proportioning the light splitting efficiency parameters to obtain reflected polarized light and transmitted polarized light, and performing polarization state detection on the reflected polarized light and the transmitted polarized light to obtain a polarization state feedback signal; Reversely tracing the propagation direction of the reflected polarized light according to the polarization state feedback signal to obtain a spatial angle distribution; The focusing characteristics of the imaging light are simulated and calculated through the spatial angle distribution to generate the corresponding imaging light.

3. The light field display method according to claim 1, characterized in that: The concentric annular steps are reflected and focused to obtain a converged imaging light beam, and the converged imaging light beam is used to perform image amplification processing to obtain an amplified light field image, including: Extracting geometric parameters of the concentric annular steps, and performing ray tracing on the refracted and reflected light incident on the concentric annular steps according to the geometric parameters to obtain a reflection light path distribution of the refracted and reflected light on the step structure; Performing wavefront deformation calculation on the refracted and reflected light through the reflected light path distribution to obtain wavefront deformation data, and performing reflection focusing through the wavefront deformation data to obtain a converged imaging light beam; Performing focusing characteristic analysis on the convergent imaging light beam to obtain a focal spot size of the convergent imaging light beam; Performing point spread function calculation on the converged imaging light beam according to the focal spot size to obtain PSF data, and performing spatial convolution on the converged imaging light beam through the PSF data to obtain an initial light intensity distribution of the light beam; Sampling the initial light intensity distribution of the light beam to obtain discrete light intensity data, and performing energy normalization processing on the converged imaging light beam according to the discrete light intensity data to obtain a normalized discrete light intensity distribution; According to the normalized discrete light intensity distribution, the converged imaging light beam is subjected to image reconstruction and amplification processing to obtain an amplified light field image.

4. The light field display method according to claim 1, characterized in that: The method of determining the spatial coordinates of the user's observation eye point according to the amplified light field image, calculating the field angle of the spatial coordinates to obtain field angle parameters, and optimizing the position and angle of the optical element according to the field angle parameters to obtain the corresponding initial light field display image at the user's observation eye point includes: Performing spatial coordinate mapping and spatial feature extraction on the amplified light field image to obtain spatial distribution features; Estimating the spatial position of the user's observation eye point according to the spatial distribution characteristics to obtain the spatial coordinates of the user's observation eye point; Taking the user's observation eye point as the starting point, tracing rays on the field of view of the amplified light field image to obtain the ray angle distribution at the edge of the field of view, and calculating the horizontal field angle and the vertical field angle at the user's observation eye point according to the ray angle distribution at the edge of the field of view to obtain the field angle parameter; Optimizing the position of the optical element according to the field angle parameter to obtain the optimal optical element position parameter, and optimizing the angle of the optical element to obtain the optimal optical element angle parameter; Imaging is performed using the optimal optical element position parameters and the optimal optical element angle parameters to obtain an initial light field display image corresponding to the user's observation eye point.

5. The light field display method according to claim 1, characterized in that: The reconstructing the light field information of the initial light field display picture to obtain a target light field display picture, and dynamically adjusting the display range of the target light field display picture by obtaining the user head movement range, and outputting a dynamic light field display picture, comprises: Extracting light direction information from the initial light field display picture to obtain light direction vector distribution, and calculating light energy of the initial light field display picture according to the light direction vector distribution to obtain light energy distribution data; According to the light energy distribution data, reconstructing brightness information and performing dynamic range mapping on the initial light field display picture to obtain target brightness data; Extracting depth information from the initial light field display picture to obtain depth data of the initial light field display picture, and reconstructing disparity information of the initial light field display picture according to the depth data to obtain target disparity data; Performing data fusion on the target brightness data and the target parallax data to obtain fused light field data, and performing light field image reconstruction on the initial light field display picture according to the fused light field data to obtain a target light field display picture; Acquire spatial position and posture data of the user's head, determine the user's head movement range according to the spatial position and posture data, and determine corresponding real-time display range parameters according to the user's head movement range; The target light field display picture is cropped and spatially mapped according to the real-time display range parameters to output a dynamic light field display picture.

6. A light field display device, used to perform the light field display method according to any one of claims 1 to 5, characterized in that: The light field display device comprises: An input module, used to input the image signal to be displayed into the LCoS optical machine, generate a driving signal, and deflect and modulate the liquid crystal molecules of the LCoS optical machine according to the driving signal to obtain reflected light carrying image information; A separation module, used for performing polarization state separation on the reflected light to obtain reflected polarized light and transmitted polarized light, and generating corresponding imaging light according to the reflected polarized light; A segmentation module, used for adjusting the reflection angle of the imaging light to obtain a refracted light, and performing surface segmentation of the refracted light by a Fresnel lens to obtain concentric annular steps; A processing module, used for reflecting and focusing the concentric annular steps to obtain a convergent imaging light beam, and performing image amplification processing using the convergent imaging light beam to obtain an amplified light field image; an optimization module, configured to determine the spatial coordinates of the user's observation eye point according to the amplified light field image, calculate the field angle of the spatial coordinates to obtain field angle parameters, and optimize the position and angle of the optical element according to the field angle parameters to obtain a corresponding initial light field display image at the user's observation eye point; The output module is used to reconstruct the light field information of the initial light field display picture to obtain a target light field display picture, obtain the user's head movement range to dynamically adjust the display range of the target light field display picture, and output a dynamic light field display picture.

7. A light field display device, used to perform the light field display method according to any one of claims 1 to 5, characterized in that: The light field display device includes: a Fresnel lens, a beam splitter wave plate, a beam splitter lens and an LCoS optical machine; one side of the Fresnel lens is a Fresnel structure, and the other side is a metal reflective film layer, and the Fresnel lens is used to generate a reflective focal length and magnification; the beam splitter wave plate includes a semi-reflective and semi-transmissive wave plate and a polarized beam splitter, and the beam splitter wave plate is used to achieve light transmission and reflection; the beam splitter lens includes a reflector and a metal reflective film layer, and the beam splitter lens is used to achieve light refraction; the LCoS optical machine is a module that uses LCOS display technology to generate images; the user's observation eye point is the observation position of the light field display device.

8. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instructions are executed by a processor, the light field display method according to any one of claims 1 to 5 is implemented.

Images