Three-dimensional light field display method and device and displayer

Abstract

The invention provides a three-dimensional light field display method, a three-dimensional light field display device and a display. The method comprises the following steps: acquiring a motion state signal of a controlled mobile device; the motion state signal is used for representing the moving direction of the three-dimensional light field display driven by the controlled moving device and the position of the three-dimensional light field display; according to the operation state signal, the display content of the three-dimensional light field display is synchronized with the position of the three-dimensional light field display, and the space scanning direction of the display content is opposite to the operation direction of the three-dimensional light field display, so that the display content of the observation time period is integrated into a three-dimensional light field display image under the visual residual effect. According to the invention, the redundancy of the time information is distributed to the spatial information through spatial scanning and the visual residual effect of human eyes, so that the resolution and depth of field of the three-dimensional light field display can be improved, and the light field naked-eye three-dimensional display with a large visual angle is realized.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a three-dimensional light field display method, device and display. Background Art

[0002] Current display technology is undergoing a revolutionary shift from two-dimensional to three-dimensional. With the rapid development of multimedia and human-computer interaction technologies, there is a growing demand for display technologies that can provide a more realistic and immersive experience. Against this backdrop, light field three-dimensional display technology has emerged.

[0003] Light field 3D display technology manipulates the distribution of light in space to create a three-dimensional image of an object. This technology enables stereoscopic viewing without the need for any auxiliary equipment, providing users with a realistic 3D visual experience. Compared to traditional 2D displays, 3D displays add depth information and can realistically reproduce 3D objects and scenes. This holds great promise for applications in a variety of fields, including medical imaging, military command, intelligent manufacturing, and distance education.

[0004] To further enhance light field 3D displays, existing technologies are focusing on increasing the resolution, viewing angle, and number of viewpoints. Viewpoints refer to the number of different disparity maps a viewer can observe during a viewing cycle. While existing technologies can improve the viewing angle and increase the number of viewpoints to a certain extent, this often results in a significant reduction in 3D image resolution, posing a technical challenge that needs to be addressed. Summary of the Invention

[0005] The present invention provides a 3D light field display method, device, and display to address the low resolution drawback of existing 3D light field displays. By leveraging spatial scanning and the human eye's residual visual effect, the present invention distributes the redundancy of temporal information to spatial information, improving the resolution and depth of field of 3D light field displays, enabling naked-eye 3D light field displays with a wide viewing angle.

[0006] The present invention provides a three-dimensional light field display method, comprising: obtaining a motion state signal of a controlled mobile device; the motion state signal is used to represent the running direction of a three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; based on the running state signal, synchronizing the display content of the three-dimensional light field display with the position of the three-dimensional light field display, and the spatial scanning direction of the display content is opposite to the running direction of the three-dimensional light field display, so as to integrate the display content of an observation time period into a three-dimensional light field display image under the visual persistence effect.

[0007] According to a three-dimensional light field display method provided by the present invention, the three-dimensional light field display includes a display panel, a deflection plate, an inverted cylindrical lens grating and a mask grating arranged in sequence along an optical path; the display panel is used to emit light; the deflection plate is used to refract the light emitted by the display panel; the inverted cylindrical lens grating is used to convert the light refracted by the deflection plate into parallel light; the inverted cylindrical lens grating has a first surface and a second surface arranged opposite to each other; the first surface includes a plurality of cylindrical lens convex surfaces, and the first surface is arranged toward the deflection plate; the second surface is arranged toward the mask grating; the mask grating is used to limit the light aperture of the inverted cylindrical lens grating and refract the light sent by the inverted cylindrical lens grating.

[0008] According to a three-dimensional light field display method provided by the present invention, the ratio of the intercept of the inverted cylindrical lens grating to the pixel of the display panel is proportional to the angular resolution and inversely proportional to the spatial resolution.

[0009] According to a three-dimensional light field display method provided by the present invention, the mask grating is arranged at the optical center position of the inverted cylindrical lens grating; the distance between the optical center of the inverted cylindrical lens grating and the display panel is equal to the focal length of the inverted cylindrical lens grating.

[0010] According to a three-dimensional light field display method provided by the present invention, the movement speed of the controlled mobile device is determined based on the product of the intercept of the inverted cylindrical lens grating and the time-division multiplexing ratio; the time-division multiplexing ratio is equal to the ratio of the frame rate of the display panel of the three-dimensional light field display to the actual three-dimensional display frame rate.

[0011] According to a three-dimensional light field display method provided by the present invention, the display content of the three-dimensional light field display is obtained using a dense viewpoint rendering algorithm; the dense viewpoint rendering algorithm specifically includes: using three-dimensional modeling software to parametrically model a three-dimensional scene; based on the three-dimensional modeled scene, using a virtual camera array to perform dense viewpoint image acquisition to calculate image information to be displayed; and performing light field rearrangement calculation based on the image information to be displayed to obtain the display content of the three-dimensional light field display.

[0012] According to a three-dimensional light field display method provided by the present invention, the method further includes: estimating human visual system imaging based on the display content and the point spread function to obtain an imaging estimation value; performing an error calculation between the imaging estimation value and a target display value to obtain an error result; and optimizing the three-dimensional light field display image using a backpropagation method based on the error result.

[0013] According to a three-dimensional light field display method provided by the present invention, estimating human visual system imaging based on the display content and the point spread function to obtain an imaging estimation value includes: obtaining the relative position of pixels of a display panel relative to a cylindrical lens grating; calculating intensity weights of different sampling points based on the relative position and the display content; and estimating human visual system imaging based on the intensity weights and the point spread function to obtain the imaging estimation value.

[0014] The present invention also provides a three-dimensional light field display device, comprising: a signal acquisition module for acquiring a motion state signal of a controlled mobile device; the motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; a synchronization module for synchronizing the display content of the three-dimensional light field display with the position of the three-dimensional light field display according to the running state signal, wherein the spatial scanning direction of the display content is opposite to the running direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual aftereffect.

[0015] The present invention further provides a three-dimensional light field display, which uses the above-mentioned three-dimensional light field display method to perform three-dimensional light field display.

[0016] The present invention also provides a three-dimensional light field display system, comprising the above-mentioned three-dimensional light field display.

[0017] The present invention provides a three-dimensional light field display method, device, and display. The method includes: obtaining a motion state signal from a controlled mobile device; the motion state signal is used to represent the direction of movement of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; based on the motion state signal, synchronizing the display content of the three-dimensional light field display with the position of the three-dimensional light field display, and spatially scanning the display content in a direction opposite to the direction of movement of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual persistence effect. By utilizing spatial scanning and the visual persistence effect of the human eye, the present invention distributes the redundancy of temporal information to spatial information, thereby improving the resolution and depth of field of the three-dimensional light field display and realizing a wide viewing angle of light field naked-eye three-dimensional display. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1It is a flow chart of a three-dimensional light field display method provided by the present invention.

[0020] Figure 2 This is one of the principle schematic diagrams of a three-dimensional light field display method provided by the present invention.

[0021] Figure 3 It is a schematic diagram of the principle of a three-dimensional light field display provided by the present invention.

[0022] Figure 4 This is the second principle schematic diagram of a three-dimensional light field display method provided by the present invention.

[0023] Figure 5 Schematic diagram of the three-dimensional light field display effect at different angles provided by the present invention.

[0024] Figure 6 This is a comparison diagram of the three-dimensional light field display effects of the present invention and the prior art.

[0025] Figure 7 It is a structural schematic diagram of a three-dimensional light field display device provided by the present invention.

[0026] Figure 8 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0027] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0028] In today's rapidly evolving technological landscape, traditional two-dimensional (2D) display technology is struggling to meet the growing demand for depth information and spatial depth across various industries. Numerous fields, including medical imaging, scientific research, space exploration, critical remote conferencing, and the military, urgently require technologies that can realistically reproduce three-dimensional scenes, enabling viewers to more accurately capture information and make precise on-site judgments. The emergence of 3D light field display technology allows viewers to experience realistic 3D visuals directly with the naked eye, resulting in a more realistic presentation of images and significantly enhancing the intuitiveness and accuracy of information.

[0029] Please refer to Figure 1 , Figure 1 A schematic flow chart of a three-dimensional light field display method provided by the present invention.

[0030] Please refer to Figure 2 , Figure 2 This is one of the principle schematic diagrams of a three-dimensional light field display method provided by the present invention.

[0031] The present invention provides a three-dimensional light field display method, comprising: 101: Acquire a motion state signal of a controlled mobile device; the motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; 102: Synchronize the display content of the three-dimensional light field display with the position of the three-dimensional light field display according to the operation status signal, and adjust the spatial scanning direction of the display content to be opposite to the operation direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual aftereffect.

[0032] To optimize the three-dimensional light field display effect, the present invention provides a three-dimensional light field display method. A controlled motion device drives a three-dimensional light field display to move. The controlled motion device can be a servo linear motor, and the motion mode can be back-and-forth uniform linear motion (for example, a motion speed of 161 mm / s, a period of 1 second, with non-uniform motion intervals of approximately 10 ms at both ends). The controller of the controlled motion device sends a synchronization signal (motion status signal) to the controller of the three-dimensional light field display. During the motion process, the content displayed by the three-dimensional light field display needs to be adjusted according to the position of the three-dimensional light field display, so that the three-dimensional light field display displays different images at different times and locations. The cylindrical lens array in the three-dimensional light field display can be an inverted array or an upright array. Due to the smooth tracking effect of the human eye, although the image of the three-dimensional light field display is scanned at high speed, the spatial scanning direction of the displayed content is opposite to the direction of movement of the three-dimensional light field display, and the human eye retina always remains relatively stationary with the low-frequency spatial display image. Furthermore, due to the visual persistence effect, different images displayed at different times and locations on the three-dimensional light field display are integrated into a single high-definition image (the three-dimensional light field display image) in the human eye, ensuring the stability of the three-dimensional light field display image from the observer's perspective.

[0033] The present invention distributes the redundancy of temporal information to spatial information through spatial scanning and the visual aftereffect of the human eye, while achieving high resolution and large depth of field; simultaneous scanning mixes spatially separated colors together, achieving a high-definition, low rainbow effect display effect.

[0034] As a preferred embodiment, a three-dimensional light field display includes a display panel 1, a deflection plate 2, an inverted cylindrical lens grating 3 and a mask grating 4 arranged in sequence along an optical path; the display panel 1 is used to emit light; the deflection plate 2 is used to refract the light emitted by the display panel 1; the inverted cylindrical lens grating 3 is used to convert the light refracted by the deflection plate 2 into parallel light; the inverted cylindrical lens grating 3 has a first surface and a second surface arranged opposite to each other; the first surface includes a plurality of cylindrical lens convex surfaces, the first surface is arranged toward the deflection plate 2; the second surface is arranged toward the mask grating 4; the mask grating 4 is used to limit the light aperture of the inverted cylindrical lens grating 3 and refract the light sent by the inverted cylindrical lens grating 3.

[0035] Please refer to Figure 3 , Figure 3 A schematic diagram of the principle of a three-dimensional light field display provided by the present invention.

[0036] Please refer to Figure 4 , Figure 4 This is the second principle schematic diagram of a three-dimensional light field display method provided by the present invention.

[0037] In this embodiment, a three-dimensional light field display includes a display panel 1, a deflector plate 2, an inverted cylindrical lens grating 3, and a mask grating 4, arranged sequentially along an optical path. The three-dimensional light field display design utilizes double refraction at the film-air interface (refraction occurs at the rear surface of the deflector plate 2 and the rear surface of the mask grating 4, respectively) to map the same pixel position to a more peripheral viewpoint, thereby further expanding the field of view coverage, achieving low angular crosstalk at wide viewing angles, extending the field of view to over 150°, and offsetting coma. Simultaneously, the mask grating 4, positioned behind the inverted cylindrical lens grating 3, reduces the amplified spot size of the inverted cylindrical lens grating 3 to one-third of its original size, thereby reducing spatial crosstalk and further improving spatial resolution, while limiting the additional spherical aberration caused by the inverted cylindrical lens grating 3. Furthermore, light efficiency can be compensated by modulating the backlight brightness and elemental image. The three-dimensional light field display design of the present invention optimizes display performance at wide-angle peripheral viewpoints.

[0038] The display panel 1 may include, but is not limited to, any one of a liquid crystal display (LCD) panel, an organic light emitting diode (OLED) display panel, a light emitting diode (LED) display panel, a quantum dot light emitting diode (QLED) display panel, and a digital light processing (DLP) display panel. Of course, the display panel may also be other display panels, such as a micro light emitting diode (MicroLED) display panel, a sub-millimeter light emitting diode (Mini LED) display panel, a micro organic light emitting diode (MicroOLED) display panel, or a liquid crystal on silicon (LCOS) display panel. This embodiment does not limit the type of display panel, and any setting is possible. The refresh rate of the display panel 1 is, for example, 360Hz.

[0039] Under the visual persistence effect, the display contents of the observation time periods (eg, 0ms, 3ms, 6ms, 9ms, 12ms) are integrated (totaled) into a three-dimensional light field display image.

[0040] It should be noted that: The spatial information flux of a three-dimensional display = (spatial resolution × display area) × (angular resolution × viewing angle), where the angular resolution is proportional to the depth of field.

[0041] Therefore, the present invention improves the viewing angle by increasing the intercept of the inverted cylindrical lens grating 3 and then improves the spatial resolution by means of horizontal scanning, thereby achieving a large viewing angle and high-resolution light field naked-eye three-dimensional display.

[0042] As a preferred embodiment, the ratio of the intercept of the inverted cylindrical lens grating 3 to the pixels of the display panel 1 is proportional to the angular resolution and inversely proportional to the spatial resolution.

[0043] In this embodiment, the distribution of spatial resolution and angular resolution is adjusted by adjusting the intercept of the inverted lenticular lens grating 3. The ratio of the intercept of the inverted lenticular lens grating 3 to the pixel of the display panel 1 is about 4 to 30 times, and can be flexibly adjusted according to the requirements of spatial resolution and angular resolution.

[0044] Furthermore, during the scanning process, the matching relationship between adjacent lenticular lenses and pixels is preferably staggered. This allows for staggered distribution of pixels in the vertical direction, improving vertical resolution. Therefore, when (inverted lenticular lens grating intercept = (N + 0.5) × display panel pixel size), vertical resolution can be doubled; when (inverted lenticular lens grating intercept = (N ± 0.33) × display panel pixel size), vertical resolution can be tripled, and so on, where N is a positive integer.

[0045] As a preferred embodiment, the mask grating 4 is arranged at the optical center of the inverted cylindrical lens grating 3 ; the distance between the optical center of the inverted cylindrical lens grating 3 and the display panel 1 is equal to the focal length of the inverted cylindrical lens grating 3 .

[0046] In this embodiment, the intercept of the light-transmitting portion of the mask grating 4 is related to the intercept and focal length of the inverted cylindrical lens grating 3. This parameter is related to spatial resolution, angular resolution, and display brightness, and can be flexibly adjusted based on demand. The intercept of the light-transmitting portion of the mask grating 4 determines the aperture of the lens, thereby eliminating lens spherical aberration. The smaller the intercept of the light-transmitting portion of the mask grating 4, the stronger the ability to eliminate spherical aberration. An intercept of the light-transmitting portion of the mask grating 4 between 0.1 and 0.3 times the intercept of the inverted cylindrical lens grating 3 can most effectively eliminate aberrations while maintaining light transmittance.

[0047] The location of the mask grating 4 needs to be optimized and designed based on the simulation of different display panels 1 and microlens parameters. The inverted cylindrical lens grating 3 designed in this way will have the characteristics of large viewing angle, low coma and low spherical aberration.

[0048] When the distance between the optical center of the inverted cylindrical lens grating 3 and the display panel 1 is equal to the focal length of the inverted cylindrical lens grating 3 , the light emitted by the display panel 1 can be converted into parallel light and projected to infinity to obtain a maximum depth of field effect.

[0049] When the mask grating 4 is located at the optical center of the inverted cylindrical lens grating 3, since the optical center is where the main beams at various angles converge, placing the mask grating 4 here can simultaneously limit the aperture of all beams, thereby eliminating spherical aberration.

[0050] As a preferred embodiment, the movement speed of the controlled mobile device is determined based on the product of the intercept of the inverted cylindrical lens grating 3 and the time division multiplexing ratio; the time division multiplexing ratio is equal to the ratio of the frame rate of the display panel of the three-dimensional light field display to the actual three-dimensional display frame rate.

[0051] In this embodiment, the controlled motion device can be a servo linear motor. During display, the motor performs controlled lateral motion, which can be either reciprocating uniform linear motion or variable speed motion. During variable speed motion, the uneven integration of light intensity on the retina may cause subtle flicker interference. Therefore, flicker can be suppressed by inserting black frames at appropriate locations.

[0052] The motor's speed is related to the display's frame rate, pixel size, and the cylindrical lens intercept, ranging from 0.2 to 2 times the intercept per frame. Motor speed = cylindrical lens intercept × time-division multiplexing ratio.

[0053] Due to time-division multiplexing, the time-division multiplexing ratio = 3D light field display frame rate / 3D display frame rate. For example, the time-division multiplexing ratio could be 9. Due to the persistence of vision effect, the human eye can fuse adjacent frames starting at 25 frames per second, but cannot distinguish adjacent frames around 70 frames per second. Therefore, the 3D display frame rate can be adjusted based on the display content requirements. A higher 3D display frame rate improves visual coherence, while a lower 3D display frame rate increases resolution. A range of 25-70 frames is possible, for example, 40 frames per second.

[0054] As a preferred embodiment, the display content of the three-dimensional light field display is obtained using a dense viewpoint rendering algorithm; the dense viewpoint rendering algorithm specifically includes: using three-dimensional modeling software to parametrically model the three-dimensional scene; based on the three-dimensional modeled scene, using a virtual camera array to perform dense viewpoint image acquisition and calculate the image information to be displayed; based on the image information to be displayed, performing light field rearrangement calculation to obtain the display content of the three-dimensional light field display.

[0055] In this embodiment, the dense viewpoint rendering algorithm is mainly based on camera array modeling and light field rearrangement technology, and the specific steps are as follows: First, the geometric model of the scene is obtained through 3D scanning or CAD modeling, including the vertex coordinates of the object surface, the topological relationship of the triangle facets and the texture map.

[0056] Then, a virtual camera array is evenly distributed in front of the display space. The camera spacing is determined by the angular resolution and is required to be greater than twice the angular resolution. The cameras are arranged in a horizontal straight line to ensure uniform sampling of the viewpoint in the horizontal and vertical directions. After collecting the information, the imaging content needs to be transformed in perspective according to the angle between the camera and the screen to calculate the image that actually needs to be displayed on the screen. .in, is the angle, is the color, ( , ) is the corresponding position in the 3D scene at that time frame.

[0057] Based on the matching relationship between the specific cylindrical lens and the three-dimensional light field display, the angle and position of the light beam emitted by each sub-pixel after passing through the optical structure can be calculated.

[0058] in, There is no analytical solution and it needs to be obtained through numerical calculation. The distance between the sub-pixel and the central axis of the lens dx and lens refractive index n 1Calculation: , , , in, L 1 is the distance from the display to the microlens, L 2 is the thickness of the microlens, L 3 is the distance from the microlens to the mask.

[0059] Similarly, the position of the light beam emitted by each sub-pixel after passing through the optical structure is determined by the projection point between the sub-pixel and the central axis of the lens.

[0060] Given the time of the current frame, the scanning motion position of the 3D light field display in the time frame can be calculated. According to the pixel position on the 3D light field display ( x p , y p ) and the motion position of the 3D light field display can be used to determine the corresponding position in the 3D scene at that time frame ( , ). The pixel value of the display content of the 3D light field display is: , in dx and c and( x p , y p ) related.

[0061] As a preferred embodiment, the method further includes: estimating the imaging of the human visual system based on the display content and the point spread function to obtain an imaging estimation value; performing error calculation between the imaging estimation value and the target display value to obtain an error result; and optimizing the three-dimensional light field display image using a back propagation method based on the error result.

[0062] As a preferred embodiment, the imaging of the human visual system is estimated based on the display content and the point spread function to obtain an imaging estimation value, including: obtaining the relative position of the pixels of the display panel with respect to the cylindrical lens grating; calculating the intensity weights of different sampling points based on the relative position and the display content; and estimating the imaging of the human visual system based on the intensity weights and the point spread function to obtain an imaging estimation value.

[0063] During the display process, the image information transmission process from the display to the human brain is considered as a complete process. The human visual system has a large amount of information loss in space and time. By modeling the information loss, more effective application of limited information can be achieved. The modeling of information loss in the human visual system can be divided into two parts: the critical flicker fusion frequency CFF (Critical Flicker-Fusion) in time and the minimum noticeable error JND (Just Noticeable Distortion) in space. Both can effectively evaluate the corresponding characteristics of the human visual system for visual information. The minimum noticeable error is the minimum amount of stimulus intensity that must be changed to produce a noticeable change in sensory experience. First consider the brightness adaptation effect (LA), in which the visual threshold of the human eye changes according to different levels of background brightness. Then, contrast masking (CM ), Pattern Masking (PM ) and edge protection (EP ) is combined to estimate the masking effect. Using visual saliency to adaptively adjust the masking effect is conducive to more accurate calculation of the visual masking effect (VMS ).

[0064] The excitement left in the eye by light stimulation does not disappear with the end of the stimulation, but persists for a certain period of time. The sensation left after the stimulation ceases is called a visual afterimage, or residual vision. Therefore, the retinal reaction does not begin or end with the onset of the flash, nor does it end with the end of the flash. Based on the human eye's response to information of different frequencies, information at different time points can be fused through calculation to calculate the human eye's response to image information at a specific time, that is, the image information actually received by the human brain. This can then be used to further optimize the 3D light field display image through backpropagation.

[0065] In this embodiment, the light field display principle and the characteristics of the human visual system are combined to directly calculate the image perception effect in the human brain and optimize it to achieve a display effect closer to the actual user experience. Specifically, according to the point spread function and the content displayed on the display panel 1 To predict the observation results at various angles. This process requires predetermining the correspondence between the cylindrical lens and the pixels of the display panel 1 to obtain the relative position of each pixel relative to its corresponding cylindrical lens: , Need to be converted to intensity weights at different sampling points : .

[0066] Among them, Δ dx express dx The sampling interval.

[0067] When a pixel falls between two sampling points, linear interpolation is used to assign its brightness value to the value between the two viewing angles. , observation image Can be achieved through and Perform a 2D convolution and then sum to generate: .

[0068] Then, the multiple frames are combined into the current view using the frequency response characteristics of human visual persistence. This is usually done by averaging the most recent N frames or by using a time exponential decay method.

[0069] The synthesized image needs to be compared with the target display image for error calculation, usually using MSE (minimum mean square error) or JND.

[0070] By transferring the error back to the primitive image (3D light field display image), the primitive image can be optimized to obtain a display content that is clearer and more informative for the human visual system.

[0071] Please refer to Figure 5 , Figure 5 Schematic diagram of the three-dimensional light field display effect at different angles provided by the present invention.

[0072] In order to test the three-dimensional light field display effect of the method of the present invention, a three-dimensional virtual scene was constructed. This three-dimensional virtual scene includes three wavy tracks and three small balls. The entire track is tilted 30° relative to the horizontal plane. It can be observed from the display content captured from different angles that as the observation angle increases from 0° to 75°, the three-dimensional light field display image shows a smooth transition, strictly following the perspective rules. The three-dimensional light field display image appears clearer when it is close to the IDP=0 plane, and the depth of field gradually decreases as the observation angle moves away from the center. When the observation angle exceeds 30°, the projection of the three-dimensional light field display image exceeds the edge of the display panel 1, resulting in part of the content being cropped. This once again verifies that the edge viewing angle does not require excessive depth of field to achieve. During the visual observation process, the display content shows a strong 3D effect, with both parts protruding from the screen and parts penetrating into the screen.

[0073] Please refer to Figure 6 , Figure 6 A comparison diagram of the three-dimensional light field display effects of the present invention and the prior art.

[0074] Comparing magnified details with and without spatial scanning at 0° and 45° viewing angles, the present invention significantly improves the spatial resolution of 3D light field displays through spatial scanning. Details on the IDP=0 plane remain clear and continuous, and checkerboard rainbow artifacts are reduced.

[0075] The three-dimensional content is rendered by the simulation iterative optimization method of this embodiment to ensure the sharpness of the image.

[0076] The three-dimensional light field display device provided by the present invention is described below. The three-dimensional light field display device described below and the three-dimensional light field display method described above can be referenced to each other.

[0077] Please refer to Figure 7 , Figure 7 This is a schematic structural diagram of a three-dimensional light field display device provided by the present invention.

[0078] The present invention also provides a three-dimensional light field display device, including: a signal acquisition module 701, used to obtain a motion state signal of a controlled mobile device; the motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; a synchronization module 702, used to synchronize the display content of the three-dimensional light field display with the position of the three-dimensional light field display based on the running state signal, and the spatial scanning direction of the display content is opposite to the running direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual afterimage effect.

[0079] The three-dimensional light field display provided by the present invention is described below. The three-dimensional light field display described below and the three-dimensional light field display method described above can be referred to in correspondence with each other.

[0080] The present invention also provides a three-dimensional light field display, which uses the above-mentioned three-dimensional light field display method to perform three-dimensional light field display.

[0081] The three-dimensional light field display system provided by the present invention is described below. The three-dimensional light field display system described below and the three-dimensional light field display method described above can be referenced to each other.

[0082] The present invention also provides a three-dimensional light field display system, comprising the above-mentioned three-dimensional light field display.

[0083] Figure 8 An example of a physical structure diagram of an electronic device is shown below. Figure 8 As shown, the electronic device may include: a processor 801, a communications interface 802, a memory 803, and a communications bus 804. The processor 801, the communications interface 802, and the memory 803 communicate with each other via the communications bus 804. The processor 801 may invoke logic instructions in the memory 803 to execute a three-dimensional light field display method, which includes: obtaining a motion state signal of a controlled mobile device; the motion state signal is used to represent the direction of movement of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; based on the motion state signal, synchronizing the display content of the three-dimensional light field display with the position of the three-dimensional light field display, such that the spatial scanning direction of the display content is opposite to the direction of movement of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual persistence effect.

[0084] Furthermore, the logic instructions in the aforementioned memory 803 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product, stored in a storage medium, includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0085] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the three-dimensional light field display method provided by the above methods, the method including: obtaining a motion state signal of a controlled mobile device; the motion state signal is used to characterize the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; according to the running state signal, the display content of the three-dimensional light field display is synchronized with the position of the three-dimensional light field display, and the spatial scanning direction of the display content is opposite to the running direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual residual effect.

[0086] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the three-dimensional light field display method provided by the above-mentioned methods, the method comprising: obtaining a motion state signal of a controlled mobile device; the motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; based on the running state signal, synchronizing the display content of the three-dimensional light field display with the position of the three-dimensional light field display, and the spatial scanning direction of the display content is opposite to the running direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual aftereffect.

[0087] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0088] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A three-dimensional light field display method, characterized in that: include: Acquiring a motion state signal of a controlled mobile device; The motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; Based on the operating status signal, the display content of the three-dimensional light field display is synchronized with the position of the three-dimensional light field display, and the spatial scanning direction of the display content is opposite to the operating direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual persistence effect.

2. The three-dimensional light field display method according to claim 1, characterized in that: The three-dimensional light field display comprises a display panel, a deflection plate, an inverted cylindrical lens grating and a mask grating arranged in sequence along the light path; The display panel is used to emit light; The deflecting plate is used to refract the light emitted by the display panel; The inverted cylindrical lens grating is used to convert the light refracted by the deflection plate into parallel light; the inverted cylindrical lens grating has a first surface and a second surface arranged opposite to each other; the first surface includes a plurality of cylindrical lens convex surfaces, and the first surface is arranged toward the deflection plate; the second surface is arranged toward the mask grating; The mask grating is used to limit the light aperture of the inverted cylindrical lens grating and refract the light sent by the inverted cylindrical lens grating.

3. The three-dimensional light field display method according to claim 2, characterized in that: The ratio of the intercept of the inverted cylindrical lens grating to the pixel of the display panel is proportional to the angular resolution and inversely proportional to the spatial resolution.

4. The three-dimensional light field display method according to claim 2, characterized in that: The mask grating is arranged at the optical center position of the inverted cylindrical lens grating; the distance between the optical center of the inverted cylindrical lens grating and the display panel is equal to the focal length of the inverted cylindrical lens grating.

5. The three-dimensional light field display method according to claim 3, characterized in that: The movement speed of the controlled moving device is determined according to the product of the intercept of the inverted cylindrical lens grating and the time division multiplexing ratio; the time division multiplexing ratio is equal to the ratio of the frame rate of the display panel of the three-dimensional light field display to the actual three-dimensional display frame rate.

6. The three-dimensional light field display method according to claim 1, characterized in that: The display content of the three-dimensional light field display is obtained by using a dense viewpoint rendering algorithm; the dense viewpoint rendering algorithm specifically includes: Use 3D modeling software to parametrically model the 3D scene; Based on the 3D modeling scene, a virtual camera array is used to collect dense viewpoint images and calculate the image information to be displayed; A light field rearrangement calculation is performed according to the image information to be displayed to obtain display content of the three-dimensional light field display.

7. The three-dimensional light field display method according to any one of claims 2 to 6, characterized in that: Also includes: estimating human visual system imaging according to the display content and the point spread function to obtain an imaging estimation value; Performing error calculation on the imaging estimation value and the target display value to obtain an error result; According to the error result, the three-dimensional light field display image is optimized by adopting a back-propagation method.

8. The three-dimensional light field display method according to claim 7, characterized in that: The estimating the human visual system imaging according to the display content and the point spread function to obtain an imaging estimation value includes: Obtaining the relative position of the pixels of the display panel with respect to the cylindrical lens grating; Calculating intensity weights of different sampling points according to the relative positions and the display content; The imaging of the human visual system is estimated according to the intensity weight and the point spread function to obtain the imaging estimation value.

9. A three-dimensional light field display device, characterized in that: include: A signal acquisition module, used to acquire a motion state signal of a controlled mobile device; The motion state signal is used to represent the running direction of the three-dimensional light field display driven by the controlled mobile device and the position of the three-dimensional light field display; A synchronization module is configured to synchronize the display content of the three-dimensional light field display with the position of the three-dimensional light field display according to the operating status signal, wherein the spatial scanning direction of the display content is opposite to the operating direction of the three-dimensional light field display, so as to integrate the display content of the observation time period into a three-dimensional light field display image under the visual persistence effect.

10. A three-dimensional light field display, characterized in that: The three-dimensional light field display adopts the three-dimensional light field display method according to any one of claims 1 to 8 to perform three-dimensional light field display.

Images