Adaptive holographic functional screen modulation method

Abstract

The present invention provides an adaptive holographic functional screen modulation method, comprising the following steps: obtaining the coordinates of the intersections of each light vector of a real light vector field of a three-dimensional light field display system to be modulated, with a viewing plane, and with a preset holographic functional screen plane; obtaining an overall modulation function of the holographic functional screen based on the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and with the preset holographic functional screen plane; and obtaining a holographic functional screen having the overall modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated. The present invention adapts the holographic functional screen to the light reconstruction error of the three-dimensional light field display system, enabling adaptive modulation of the holographic functional screen to address the uneven light distribution of the three-dimensional light field display system to be modulated, significantly improving the three-dimensional display quality without introducing crosstalk.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional light field display, and in particular to an adaptive holographic functional screen modulation method. Background Art

[0002] Three-dimensional light field display technology is considered one of the most promising technologies in the field of three-dimensional display because it creates a realistic and significant naked-eye stereoscopic effect and can process images in real time. In three-dimensional light field display, a three-dimensional light field display system based on a holographic functional screen is often used for three-dimensional imaging. A three-dimensional light field display system based on a holographic functional screen includes a flat-panel display, a light control device, and a holographic functional screen arranged in parallel and spaced order. The holographic functional screen is an optical information multiplexing device that can remodulate the light field reconstructed by the flat-panel display and the light control device, thereby increasing the number of reconstructed light rays, thereby improving single-eye resolution and three-dimensional stereoscopic perception.

[0003] However, the optical control devices in three-dimensional light field display systems are typically lens arrays, cylindrical lens arrays, slit gratings, and other optical control devices. During the manufacturing and assembly process of these optical devices, manufacturing errors and assembly errors may occur, resulting in errors such as surface damage, axial deviation, and lateral deviation of the optical control devices. These errors can lead to light reconstruction errors, which in turn lead to localized uneven light in the reconstructed light field. Existing holographic functional screens have a uniform and consistent modulation function. When they perform optical information multiplexing on a locally uneven light field, they diffuse the unevenly distributed light at the same angle. This will result in a poor optical information multiplexing effect and even significant crosstalk, which will seriously degrade the display quality. Summary of the Invention

[0004] In view of the problems existing in the prior art, the present invention provides an adaptive holographic functional screen modulation method.

[0005] The present invention provides an adaptive holographic functional screen modulation method, comprising the following steps:

[0006] Obtaining the coordinates of intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane;

[0007] Obtaining an overall modulation function of the holographic functional screen according to the coordinates of intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane;

[0008] A holographic functional screen having the overall modulation function is obtained as the holographic functional screen of the three-dimensional light field display system to be modulated.

[0009] According to an adaptive holographic functional screen modulation method provided by the present invention, the step of obtaining the coordinates of the intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane specifically includes:

[0010] Acquire a calibration restoration image array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated;

[0011] Obtaining the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration image array;

[0012] The intersection coordinates of each light vector of the real light vector field, the viewing plane and the preset holographic functional screen plane are determined.

[0013] According to an adaptive holographic functional screen modulation method provided by the present invention, the step of obtaining a calibration restoration image array corresponding to an original elementary image array of an object to be imaged in a three-dimensional light field display system to be modulated comprises:

[0014] The original primitive image array of the object to be imaged is input into the pre-trained convolutional neural network to obtain the calibrated restoration image array.

[0015] According to an adaptive holographic functional screen modulation method provided by the present invention, the convolutional neural network includes a calibration convolutional neural network unit and a point spread function unit. The original primitive image array input to the convolutional neural network is processed by the calibration convolutional neural network unit and then convolved with the point spread function unit to obtain a calibration restoration image array. The point spread function unit is the point spread function array of the light control device of the three-dimensional light field display system to be modulated.

[0016] According to an adaptive holographic functional screen modulation method provided by the present invention, the convolutional neural network training steps include:

[0017] Acquiring a plurality of side images of a three-dimensional image of the object as a control set;

[0018] Input the original primitive image array of the object into the convolutional neural network to obtain the calibration restoration image array;

[0019] The data in the calibration restoration image array and the control set are fast Fourier transformed respectively, and the loss function operation is performed on the fast Fourier transformed data of the control set and the fast Fourier transformed data of the calibration restoration image array to complete the training and calibration of the convolutional neural network parameters.

[0020] According to an adaptive holographic functional screen modulation method provided by the present invention, the step of obtaining the light vector of the real light vector field of the three-dimensional light field display system to be modulated based on the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration image array includes:

[0021] The pixel coordinates of the calibrated restoration image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated are subtracted from the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.

[0022] According to an adaptive holographic functional screen modulation method provided by the present invention, the step of obtaining the overall modulation function of the holographic functional screen according to the intersection coordinates of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane includes:

[0023] Obtaining a modulation function of each point on the holographic functional screen according to the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane;

[0024] The overall modulation function of the holographic functional screen is obtained according to the modulation function of each point on the holographic functional screen.

[0025] According to the adaptive holographic functional screen modulation method provided by the present invention, point A on the holographic functional screen k i The calculation formula of the modulation function at includes:

[0026]

[0027] Among them, A k i is the intersection coordinate of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the holographic functional screen, (x, y) is the coordinate of any point on the holographic functional screen, and k is the intersection coordinate of the real light vector field passing through the i-th light control device unit and the holographic functional screen. k i The light channel of the light vector of the real light vector field, i is the light channel passing through point A k i The number of the light control device unit of the real light vector field, (x k i ,y k i ) is point A k i The coordinates of is the point modulation function parameter;

[0028] The formula of the point modulation function parameter is:

[0029]

[0030] Where num is the number of light vectors in ray channel k that contain the real light vector field, is the intersection point V of the light vector in ray channel k and the viewing plane k i 、V k j The distance between k i is the intersection of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the viewing plane, V k ji is the intersection point of the light vector of the real light vector field passing through the j-th light control device unit in the light channel k and the viewing plane.

[0031] According to an adaptive holographic functional screen modulation method provided by the present invention, the calculation formula of the overall modulation function is:

[0032]

[0033] Among them, F model (x,y) is the overall modulation function, (x,y) is the coordinate of any point on the holographic functional screen, (x i ,y i ) is the coordinate of any discrete point on the functional screen, f(x,y) is the modulation function of point (x,y) on the holographic functional screen, and b is the overall modulation function parameter.

[0034] According to an adaptive holographic functional screen modulation method provided by the present invention, the step of obtaining a holographic functional screen having the overall modulation function comprises:

[0035] A directional laser speckle method, an extrusion method or a coating method is adopted to obtain a holographic functional screen having the overall modulation function.

[0036] The present invention provides an adaptive holographic functional screen modulation method. By obtaining the coordinates of the intersections of each light vector of a real light vector field of a three-dimensional light field display system to be modulated, a viewing plane, and a preset holographic functional screen plane, an overall modulation function of a holographic functional screen compatible with the three-dimensional light field display system to be modulated is determined. The holographic functional screen having the overall modulation function is used as the holographic functional screen of the three-dimensional light field display system to be modulated, so that the holographic functional screen is adapted to the light reconstruction error of the three-dimensional light field display system. The holographic functional screen can be adaptively modulated according to the uneven light distribution of the three-dimensional light field display system to be modulated, thereby significantly improving the three-dimensional display quality without introducing crosstalk. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0038] Figure 1 This is a flow chart of an adaptive holographic functional screen modulation method provided by the present invention;

[0039] Figure 2 This is a schematic structural diagram of a three-dimensional light field display system based on a holographic functional screen provided by the present invention;

[0040] Figure 3 This is a schematic diagram of the principle of a three-dimensional light field display system based on a holographic functional screen provided by the present invention;

[0041] Figure 4 A schematic diagram of the training process of the convolutional neural network provided by the present invention;

[0042] Figure 5 It is a structural diagram of a calibration convolutional neural network unit of the convolutional neural network provided by the present invention;

[0043] Figure 6 Schematic diagram of the spatial position of the calibration restoration image array provided by the present invention;

[0044] Figure 7 This is a schematic diagram of the principle of the directional laser speckle method provided by the present invention;

[0045] Figure 8 It is a structural schematic diagram of the adaptive holographic functional screen modulation device provided by the present invention;

[0046] Figure 9 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0047] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0048] Three-dimensional light field display technology often uses a three-dimensional light field display system based on a holographic functional screen for display, which includes a flat-panel display, a light control device, and a holographic functional screen arranged in parallel and spaced order. The holographic functional screen is an optical information multiplexing device that can re-modulate the light field light reconstructed by the flat-panel display and the light control device, thereby increasing the number of reconstructed lights, thereby improving the single-eye resolution and three-dimensional stereoscopic sense.

[0049] However, the optical control devices in 3D light field display systems are typically lens arrays, cylindrical lens arrays, slit gratings, and other optical control devices. During the manufacturing and assembly of these optical devices, manufacturing and assembly errors can occur, resulting in surface damage, axial deviation, lateral deviation, and other errors. These errors can lead to errors in light reconstruction, which in turn can cause localized unevenness in the reconstructed light field.

[0050] In order to solve the above problems, an embodiment of the present invention provides an adaptive holographic functional screen modulation method.

[0051] First, regarding the three-dimensional light field display system based on the holographic functional screen, further, as Figure 2 As shown in FIG, it is a schematic diagram of its structure, including a flat panel display 201, a light control device 202, and a holographic function screen 203 arranged in parallel and spaced apart. Taking the lens array as the light control device 202 as an example, Figure 3 As shown, light emitted by pixels on the flat panel display 201 passes through the lens array to construct light in a specific direction. The holographic functional screen can reuse the constructed light, multiplexing continuous light within the range of angle θ, thereby increasing the constructed light density, enhancing single-eye resolution and 3D stereoscopic perception. The angle θ of the holographic functional screen is the diffusion angle of the holographic functional screen, which is determined by the modulation function f(x,y) of the holographic functional screen:

[0052] f(x,y)=θ

[0053] Wherein, x and y are the horizontal and vertical coordinates of the holographic functional screen plane where the holographic functional screen is placed.

[0054] like Figure 1 As shown, the steps of the present invention specifically include:

[0055] S1: Obtaining the coordinates of intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane.

[0056] S2: Obtaining an overall modulation function of the holographic functional screen according to the coordinates of intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane.

[0057] S3: Obtain a holographic functional screen having the overall modulation function as a holographic functional screen of the three-dimensional light field display system to be modulated.

[0058] Specifically, the three-dimensional light field display system to be modulated of the present invention includes a plane display and a light control device that are spaced apart, and a holographic functional screen plane for placing the holographic functional screen is preset in the three-dimensional light field display system to be modulated.

[0059] The light control device of the present invention is a light control device such as a lens array, a cylindrical lens array, or a slit grating, which can realize three-dimensional imaging.

[0060] Furthermore, in one embodiment, S1 specifically includes:

[0061] S11: Acquire a calibration restoration image array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated;

[0062] S12: Obtaining a light vector of a real light vector field of the three-dimensional light field display system to be modulated according to the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration image array;

[0063] S13: confirming the intersection coordinates of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane.

[0064] In S11, the object to be imaged can be an object specifically used to obtain a calibration restoration image array. The original primitive image array of the object can be obtained using the camera array and then used as the object to be imaged in the present invention. The center coordinates of the light control device unit in S12 are the center coordinates of the light control device unit. For example, if the light control device is a lens array, the light control device unit is each lens in the lens array.

[0065] The present invention obtains a calibration restoration image array of a modulated three-dimensional light field display system. The pixel information stored in the calibration restoration image array contains three-dimensional imaging error information caused by light reconstruction errors. Based on the calibration restoration image array, the light vectors of the real light vector field can be obtained, and then the intersection coordinates of each light vector with the viewing plane and the preset holographic functional screen plane are obtained, thereby improving the accuracy and reliability of the real light vector field, thereby improving modulation reliability and enhancing the three-dimensional display quality.

[0066] Furthermore, in one embodiment, S11 specifically includes:

[0067] The original primitive image array of the object to be imaged is input into the pre-trained convolutional neural network to obtain the calibrated restoration image array.

[0068] The present invention adopts convolutional neural network to acquire the calibration restoration image array, which can effectively improve the accuracy of the calibration restoration image and improve processing efficiency.

[0069] Furthermore, in one embodiment, the convolutional neural network includes a calibration convolutional neural network unit and a point spread function unit. The original primitive image array input into the convolutional neural network is processed by the calibration convolutional neural network unit and then convolved with the point spread function unit to obtain a calibration restoration image array. The point spread function unit is a point spread function array of the light control device of the three-dimensional light field display system to be modulated.

[0070] The convolutional neural network processes the primitive image array through the calibration convolutional neural network unit, and introduces the point spread function unit. The point spread function unit is used to simulate the influence of the light control device in the modulated three-dimensional light field display system on the calibration restoration image, thereby improving the accuracy of the calibration restoration image output by the convolutional neural network.

[0071] The present invention adopts calibrated convolutional neural network units and superimposes single convolutional feature layers to construct a deep network architecture with multiple feature extraction channels. While achieving high-precision fitting of high-order nonlinear optical decoding functions, it enables the training process to converge quickly and have strong generalization.

[0072] Specifically, the network architecture of the calibration convolutional neural network unit of the present invention includes but is not limited to convolutional neural network architectures such as feature pyramid network, VGGet network, ResNet network, etc. Figure 5 As shown, taking the feature pyramid network as an example, the calibration convolutional neural network unit includes channel 1, channel 2, channel 3, and channel 4 respectively. The primitive image array input to the calibration convolutional neural network unit is processed by channel 1, and step by step from top to bottom, and after downsampling, it is convolved through channels 2, 3, and 4. Then, the outputs of channels 2, 3, and 4 are step by step from bottom to top, and after upsampling and splicing, they are spliced ​​with the output of channel 1 to output the calibration restoration image array.

[0073] Taking the full parallax display with M×N viewpoints as an example, the calibration restoration image array is on the viewing plane, representing the spatial position of the actual reconstructed light passing through the viewing plane, such as Figure 6 The resolution of the calibration restoration images in the calibration restoration image array is n×m, and their spatial arrangement order on the viewing plane is as follows: Figure 6 As shown, the center position of the calibrated restoration image on the viewing plane is coaxial with the center position of the camera array used in the light vector field acquisition process. Before calibration, the camera array arranged according to the camera center position acquires disparity images of the object to be imaged. The disparity images are then synthesized into the original primitive image array using a synthesis algorithm.

[0074] Furthermore, in one embodiment, Figure 4 As shown, the training steps of the convolutional neural network include:

[0075] Acquiring a plurality of side images of a three-dimensional image of the object as a control set;

[0076] Input the original primitive image array of the object into the convolutional neural network to obtain the calibration restoration image array;

[0077] The data in the calibration restoration image array and the control set are fast Fourier transformed respectively, and the loss function operation is performed on the fast Fourier transformed data of the control set and the fast Fourier transformed data of the calibration restoration image array to complete the training and calibration of the convolutional neural network parameters.

[0078] Furthermore, in one embodiment, step S12 specifically includes:

[0079] The pixel coordinates of the calibrated restoration image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated are subtracted from the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.

[0080] The light vector obtained by subtracting the pixel coordinates of the calibration restoration image array from the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated can effectively reflect the real light vector field of the three-dimensional light field display system to be modulated, thereby facilitating the elimination of light reconstruction errors during the modulation process.

[0081] Specifically, taking the light control device as a lens array as an example, the formula for the real light vector is:

[0082]

[0083] in, is the real light vector corresponding to the pixel (p,q) in the original primitive image array, (s′ (p,q) ,t′ (p,q) ,z2) DPI is the pixel coordinate of the calibration restoration image array corresponding to the pixel (p,q) in the original primitive image array, (α i ,β i ,z4) MP is the center coordinate of the i-th light control device unit of the three-dimensional light field display system to be modulated corresponding to the pixel (p, q) in the original primitive image array, z2 is the plane where the flat panel display is located, and z4 is the plane where the light control device is located.

[0084] The above formula of the real light vector is illustrated using the lens array in this embodiment as an example. When the light control device is a cylindrical lens array, a slit grating, or other light control device that can achieve three-dimensional imaging, those skilled in the art can also obtain the light vector of the corresponding real light vector field based on step S12.

[0085] Furthermore, in one embodiment, the intersection coordinates of each light vector of the real light vector field confirmed in step S13 and the viewing plane are V ki , represents the intersection of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the viewing plane; the coordinates of the intersection of each light vector of the real light vector field and the preset holographic functional screen plane are A k i , represents the coordinates of the intersection of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the holographic functional screen.

[0086] A light channel is a collection of light vectors that form a specific viewpoint. Forming a specific viewpoint in a given direction is the principle of naked-eye 3D display: at a microscopic level, each viewpoint is composed of light vectors with a specific directional angle range. That is, the directions of these light vectors are concentrated within a certain angle. When the human eye sees these light vectors, it sees a certain viewpoint, which is a side of the 3D image. Therefore, a viewpoint can be considered a light channel, or a bundle (cluster) of light vectors with a certain directional angle range. The light channel is determined during the system design phase and is determined by the arrangement of pixels in the primitive image array on the flat panel display and the position of the light control device. In other words, each light vector has a unique corresponding light channel, and each light channel corresponds to multiple light vectors.

[0087] Furthermore, in one embodiment, step S2 specifically includes:

[0088] S21: Obtaining a modulation function of each point on the holographic functional screen according to the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane;

[0089] S22: Obtaining the overall modulation function of the holographic functional screen according to the modulation function of each point on the holographic functional screen.

[0090] The present invention obtains the local modulation function of each point of the holographic functional screen through the real light vector field, realizes adaptive light information multiplexing for the actual reconstruction deviation of the light field, and obtains the overall modulation function based on the modulation function of each point, thereby obtaining an adaptive holographic functional screen compatible with the three-dimensional light field display system to be modulated, effectively overcoming the light reconstruction error of the three-dimensional light field display system and improving the display effect.

[0091] Furthermore, in one embodiment, point A on the holographic functional screen k i The calculation formula of the modulation function at includes:

[0092]

[0093] Among them, A k iis the intersection coordinate of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the holographic functional screen, (x, y) is the coordinate of any point on the holographic functional screen, and k is the intersection coordinate of the real light vector field passing through the i-th light control device unit and the holographic functional screen. k i The light channel of the light vector of the real light vector field, i is the light channel passing through point A k i The number of the light control device unit of the real light vector field, (x k i ,y k i ) is point A k i The coordinates of is the point modulation function parameter;

[0094] The formula for the point modulation function parameters is:

[0095]

[0096] Where num is the number of light vectors in ray channel k that contain the real light vector field, is the intersection point V of the light vector in ray channel k and the viewing plane k i 、V k j The distance between k i is the intersection of the light vector of the real light vector field passing through the i-th light control device unit in the light channel k and the viewing plane, V k ji is the intersection point of the light vector of the real light vector field passing through the j-th light control device unit in the light channel k and the viewing plane.

[0097] Furthermore, in one embodiment, the calculation formula of the overall modulation function is:

[0098]

[0099] Among them, F model (x,y) is the overall modulation function, (x,y) is the coordinate of any point on the holographic functional screen, (x i ,y i ) is the coordinate of any discrete point on the functional screen, f(x,y) is the modulation function of point (x,y) on the holographic functional screen, and b is the overall modulation function parameter.

[0100] Furthermore, in one embodiment, the method for obtaining the holographic functional screen having the overall modulation function is a directional laser speckle method, an extrusion method, or a coating method. The method for obtaining the holographic functional screen having the overall modulation function of the present invention is not limited to the above three methods.

[0101] In the present invention, the directional laser speckle method is taken as an example. Figure 7 The figure shows the principle diagram of the directional laser speckle method. The photoresist plate is placed on the stepper motor, and the overall modulation function F model The control signal (x, y) after grayscale encoding and quantization can be used by the driver to quantitatively control the position and posture of the shutter, diffuse reflection screen, aperture and stepping mobile platform, so that each part of the optical device works together to perform local precise exposure at different positions of the photoresist plate, so that each holographic speckle formed has the required diffusion angle, thereby obtaining an adaptive overall modulation function F model (x,y) The surface shape of the holographic functional screen.

[0102] The modulated one has the overall modulation function F model The (x, y) holographic functional screen is placed on the holographic functional screen plane, and the modulation of the holographic functional screen of the modulated three-dimensional light field display system can be completed.

[0103] The adaptive holographic functional screen modulation device provided by the present invention is described below. The adaptive holographic functional screen modulation device described below and the adaptive holographic functional screen modulation method described above can be referred to each other.

[0104] The adaptive holographic functional screen modulation device provided by the present invention is as follows: Figure 8 As shown, including:

[0105] The intersection coordinate acquisition module 801 is used to obtain the intersection coordinates of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane;

[0106] A modulation function acquisition module 802 is configured to acquire an overall modulation function of the holographic functional screen based on the coordinates of intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane;

[0107] The modulation module 803 is configured to obtain a holographic functional screen having the overall modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated.

[0108] Figure 9 An example of a physical structure diagram of an electronic device is shown below. Figure 9As shown, the electronic device may include: a processor 910, a communication interface 920, a memory 930, and a communication bus 940, wherein the processor 910, the communication interface 920, and the memory 930 communicate with each other via the communication bus 940. The processor 910 may call logic instructions in the memory 930 to execute an adaptive holographic functional screen modulation method, which includes: obtaining the coordinates of the intersections of each light vector of a real light vector field of a three-dimensional light field display system to be modulated with a viewing plane and a preset holographic functional screen plane; obtaining an overall modulation function of the holographic functional screen based on the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane; and obtaining a holographic functional screen having the overall modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated.

[0109] In addition, the logic instructions in the above-mentioned memory 830 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0110] On the other hand, the present invention also provides a computer program product, which includes a computer program, and the computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute an adaptive holographic functional screen modulation method provided by the above methods, the method including: obtaining the intersection coordinates of each light vector of the real light vector field of the three-dimensional light field display system to be modulated with the viewing plane and the preset holographic functional screen plane; obtaining the overall modulation function of the holographic functional screen according to the intersection coordinates of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane; obtaining the holographic functional screen with the overall modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated.

[0111] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute an adaptive holographic functional screen modulation method provided by the above-mentioned methods, the method comprising: obtaining the coordinates of the intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated with the viewing plane and the preset holographic functional screen plane; obtaining an overall modulation function of the holographic functional screen based on the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane; and obtaining a holographic functional screen having the overall modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated.

[0112] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0113] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0114] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. An adaptive holographic functional screen modulation method, characterized in that: The following steps are involved: Obtaining the coordinates of intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane; Obtaining an overall modulation function of the holographic functional screen according to the coordinates of intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane, including: Obtaining a modulation function of each point on the holographic functional screen according to the coordinates of the intersections of each light vector of the real light vector field with the viewing plane and the preset holographic functional screen plane; Obtaining an overall modulation function of the holographic functional screen according to the modulation function of each point on the holographic functional screen; A holographic functional screen having the overall modulation function is obtained as the holographic functional screen of the three-dimensional light field display system to be modulated.

2. The adaptive holographic functional screen modulation method according to claim 1, characterized in that: The step of obtaining the coordinates of the intersections of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane, and the preset holographic functional screen plane specifically includes: Acquire a calibration restoration image array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated; Obtaining the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration image array; The intersection coordinates of each light vector of the real light vector field, the viewing plane and the preset holographic functional screen plane are determined.

3. The adaptive holographic functional screen modulation method according to claim 2, characterized in that: The step of obtaining a calibration restoration image array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated comprises: The original primitive image array of the object to be imaged is input into the pre-trained convolutional neural network to obtain the calibrated restoration image array.

4. The adaptive holographic functional screen modulation method according to claim 3, characterized in that: The convolutional neural network includes a calibration convolutional neural network unit and a point spread function unit. The original primitive image array input into the convolutional neural network is processed by the calibration convolutional neural network unit and then convolved with the point spread function unit to obtain a calibration restoration image array. The point spread function unit is the point spread function array of the light control device of the three-dimensional light field display system to be modulated.

5. The adaptive holographic functional screen modulation method according to claim 3, characterized in that: The training steps of the convolutional neural network include: Acquiring a plurality of side images of a three-dimensional image of the object as a control set; Input the original primitive image array of the object into the convolutional neural network to obtain the calibration restoration image array; The data in the calibration restoration image array and the control set are fast Fourier transformed respectively, and the loss function operation is performed on the fast Fourier transformed data of the control set and the fast Fourier transformed data of the calibration restoration image array to complete the training and calibration of the convolutional neural network parameters.

6. The adaptive holographic functional screen modulation method according to claim 2, characterized in that: The step of obtaining the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration image array includes: The pixel coordinates of the calibrated restoration image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated are subtracted from the center coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.

7. The adaptive holographic functional screen modulation method according to claim 1, characterized in that: The step of obtaining the holographic functional screen having the overall modulation function comprises: A directional laser speckle method, an extrusion method or a coating method is adopted to obtain a holographic functional screen having the overall modulation function.

Images