Three-dimensional light field enhanced display processing method, device and system and electronic equipment

Abstract

The invention provides a three-dimensional light field enhanced display processing method, device and system and electronic equipment. The method comprises the following steps: acquiring a to-be-processed two-dimensional picture; fast translation scanning processing is carried out on the two-dimensional picture to be processed, multiple frames of pictures after translation scanning are obtained, the same pixel position of each frame of picture after translation scanning has a preset offset relative to the previous frame of picture after translation scanning, and the multiple frames of pictures after translation scanning are obtained; the sum of the preset offsets of the multiple frames of images after translation scanning covers all areas corresponding to pixel positions in the target three-dimensional display content; and performing superposition processing on the multiple frames of images after translation scanning in a time domain, and performing projection display to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed. On the premise that the number of viewpoints is guaranteed, the three-dimensional display resolution in each viewpoint can be improved.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional display technology, and in particular, to a three-dimensional light field enhanced display processing method, device, system and electronic device. Background Art

[0002] As an important development direction of future display technology, the core advantage of three-dimensional light field display technology is that it can use light control devices to modulate multiple two-dimensional display contents and display them at different angles in three-dimensional space, thus creating an extremely realistic stereoscopic visual effect.

[0003] However, traditional three-dimensional display technology faces a significant challenge, namely the contradiction between display resolution and angular resolution. This defect limits the clarity and detail performance of the picture and affects the overall viewing experience. Therefore, how to improve the resolution of each viewing area while maintaining the number of viewpoints has become an urgent problem to be solved in the current three-dimensional light field display technology. Summary of the Invention

[0004] The present invention provides a three-dimensional light field enhanced display processing method, device, system and electronic device, which realizes improving the three-dimensional display resolution within each viewpoint while ensuring the number of viewpoints.

[0005] The present invention provides a three-dimensional light field enhanced display processing method, the method comprising: acquiring a two-dimensional picture to be processed; performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of translated and scanned pictures, wherein the same pixel position of each frame of the translated and scanned pictures has a preset offset relative to the previous frame of the translated and scanned pictures, and the sum of the preset offsets of the multiple frames of the translated and scanned pictures covers the entire area of the corresponding pixel position in the target three-dimensional display content; performing superposition processing on the multiple frames of the translated and scanned pictures in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0006] According to the three-dimensional light field enhanced display processing method provided by the present invention, the performing superposition processing on the multiple frames of the translated and scanned pictures in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed specifically comprises: performing superposition processing on the multiple frames of the translated and scanned pictures in the time domain to obtain a target superposed picture; performing projection display on the target superposed picture based on a lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0007] A three-dimensional light field enhanced display processing method provided by the present invention. Before the target superimposed image is projected and displayed based on a lenticular grating, the method further includes: determining a target pixel value at a pixel position of an ideal resolution image; based on the target pixel value at the pixel position of the ideal resolution image, performing optimization processing on the target superimposed image to obtain an optimized target superimposed image, so that the difference between the pixel value at the pixel position of the optimized target superimposed image and the target pixel value meets a preset requirement; the projecting and displaying the target superimposed image based on the lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed specifically includes: projecting and displaying the optimized target superimposed image based on the lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed.

[0008] A three-dimensional light field enhanced display processing method provided by the present invention. The performing optimization processing on the target superimposed image based on the target pixel value at the pixel position of the ideal resolution image to obtain an optimized target superimposed image specifically includes: obtaining a superimposed pixel value at the pixel position of the target superimposed image; constructing a loss function based on the superimposed pixel value at the pixel position of the target superimposed image and the target pixel value at the pixel position of the ideal resolution image; based on the loss function, iteratively adjusting the pixel value at the corresponding pixel position of each frame of the translated and scanned image through gradient descent to obtain multiple frames of adjusted translated and scanned images, so that the function value of the loss function meets a preset requirement; performing superimposition processing on multiple frames of adjusted translated and scanned images in the time domain to obtain an optimized target superimposed image.

[0009] A three-dimensional light field enhanced display processing method provided by the present invention. The superimposed pixel value at the pixel position of the target superimposed image is determined by the following method: determining the pixel value at the corresponding pixel position of multiple frames of translated and scanned images; performing superimposition in the time domain on the pixel values at the corresponding pixel positions of multiple frames of translated and scanned images to obtain the superimposed pixel value at the pixel position of the target superimposed image.

[0010] A three-dimensional light field enhanced display processing method provided by the present invention. The performing fast translation scanning processing on the two-dimensional image to be processed to obtain multiple frames of translated and scanned images specifically includes: calling a galvanometer device, and performing fast translation scanning processing on the two-dimensional image to be processed based on the galvanometer device through high-speed vibration to obtain multiple frames of translated and scanned images, wherein the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's visual persistence.

[0011] The present invention also provides a three-dimensional light field enhanced display processing device, which includes: an acquisition module for acquiring a two-dimensional picture to be processed; a processing module for performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning, wherein the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; a display module for performing superposition processing on the multiple frames of pictures after translation scanning in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0012] The present invention also provides a three-dimensional light field enhanced display processing system, which includes: a galvanometer device for performing the three-dimensional light field enhanced display processing method according to any one of the above; a lenticular grating for working in cooperation with the galvanometer device to project and display the target superimposed picture to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0013] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the three-dimensional light field enhanced display processing method according to any one of the above is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the three-dimensional light field enhanced display processing method according to any one of the above is implemented.

[0015] The present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, the three-dimensional light field enhanced display processing method according to any one of the above is implemented.

[0016] A three-dimensional light field enhanced display processing method, device, system, and electronic device provided by the present invention acquire a two-dimensional picture to be processed; perform fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning, wherein the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; perform superposition processing on the multiple frames of pictures after translation scanning in the time domain and display them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed. It realizes improving the three-dimensional display resolution within each viewing point while ensuring the number of viewing points. Description of the Drawings

[0017] To more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0018] Figure 1 It is one of the flow schematic diagrams of the three-dimensional light field enhancement display processing method provided by the present invention.

[0019] Figure 2 It is the flow schematic diagram of the present invention for performing projection display on the target superimposed image based on a cylindrical lens grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed.

[0020] Figure 3 It is the flow schematic diagram of the present invention for optimizing the target superimposed image based on the target pixel value at the pixel position of the ideal resolution image to obtain an optimized target superimposed image.

[0021] Figure 4 It is the structural schematic diagram of the three-dimensional light field enhancement display processing device provided by the present invention.

[0022] Figure 5 It is the structural schematic diagram of the electronic device provided by the present invention. Detailed implementation manners

[0023] To make the objectives, technical solutions and advantages of the present invention clearer, the following will clearly and completely describe the technical solutions in the present invention with reference to the drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art without creative efforts based on the embodiments in the present invention belong to the scope of protection of the present invention.

[0024] The three-dimensional light field enhancement display processing method provided by the present invention uses a galvanometer for fast translational scanning. By quickly superimposing multiple images in a short time and optimizing the image content, higher-resolution display content is obtained. Compared with displaying different perspective contents in a short time, this method can greatly increase the number of pixels used for three-dimensional display. When displaying, the number of viewpoints can be increased and the viewing resolution can be increased within a small range. This method mainly relies on the superposition fitting optimization method of multiple images. With higher resolution as the optimization goal, multiple misaligned images are superimposed and calculated, and the final result is obtained through the gradient descent method.

[0025] Figure 1 It is one of the flow schematic diagrams of the three-dimensional light field enhancement display processing method provided by the present invention.

[0026] The following will combine Figure 1 to describe the process of the three-dimensional light field enhancement display processing method provided by the present invention.

[0027] In an exemplary embodiment of the present invention, in combination with Figure 1 it can be known that the three-dimensional light field enhancement display processing method may include step 110 to step 130, and each step will be introduced separately below.

[0028] In step 110, obtain the two-dimensional picture to be processed.

[0029] In step 120, perform fast translational scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translational scanning. Among them, the same pixel position of each frame of the picture after translational scanning has a preset offset relative to the previous frame of the picture after translational scanning, and the sum of the preset offsets of the multiple frames of pictures after translational scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content.

[0030] In step 130, perform superposition processing on the multiple frames of pictures after translational scanning in the time domain and display them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0031] In one embodiment, the two-dimensional picture to be processed can be obtained. Among them, the two-dimensional picture to be processed can be considered as the two-dimensional picture that needs to be three-dimensionally displayed.

[0032] In another embodiment, fast translational scanning processing can be performed on the two-dimensional picture to be processed, so that multiple frames of pictures after translational scanning can be obtained. This processing process simulates the slight movement of an object relative to an observer in the actual space, aiming to construct three-dimensional information by continuously capturing pictures at different offset positions.

[0033] Among them, the same pixel position of each frame of the picture after translational scanning has a preset offset relative to the previous frame of the picture after translational scanning, and the sum of the preset offsets of the multiple frames of pictures after translational scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content. It can be understood that the corresponding pixel position is the same pixel position as the same pixel position in the previous text.

[0034] During the application process, a preset offset can be set. This offset can be a tiny displacement at the pixel level. Then, according to this preset offset, the original two-dimensional image is subjected to continuous multiple translation scans. After each scan, a new image that is slightly offset is obtained. Importantly, it is ensured that the same pixel position in the image after each frame of translation scan has this preset offset relative to the previous frame. In this way, after multiple scans, a series of translation-scanned images with different offsets can be obtained. Suppose we perform 10 translation scans, and the preset offset for each scan is 1 / 10 of a pixel (this is only an example, and the actual offset may be adjusted according to display requirements and hardware performance). Then, finally, 10 frames of translation-scanned images will be obtained. In these images, the pixel points at the same pixel position will come from different parts of the original image, thus covering all possible viewing angles of the corresponding pixel position in the target three-dimensional display content, and further laying a foundation for improving the three-dimensional display resolution in a single viewing angle.

[0035] In another embodiment, the images after multiple frames of translation scans can be superimposed in the time domain, so that the target three-dimensional display content corresponding to the two-dimensional image to be processed can be obtained. During the application process, these images can be quickly switched and displayed within a short time, enabling the observer to visually perceive the three-dimensional effect generated by the superposition of these images. In this embodiment, through steps such as obtaining the two-dimensional image to be processed, performing fast translation scan processing, and time-domain superposition display, the three-dimensional light field enhanced display of the two-dimensional image to be processed is successfully realized, achieving the improvement of the three-dimensional display resolution within each viewing angle while ensuring the number of viewpoints.

[0036] A three-dimensional light field enhanced display processing method provided by the present invention includes: obtaining a two-dimensional image to be processed; performing fast translation scan processing on the two-dimensional image to be processed to obtain multiple frames of translated scanned images, where the same pixel position in each frame of the translated scanned image has a preset offset relative to the previous frame of the translated scanned image, and the sum of the preset offsets of the multiple frames of translated scanned images covers the entire area of the corresponding pixel position in the target three-dimensional display content; superimposing the multiple frames of translated scanned images in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed. It realizes the improvement of the three-dimensional display resolution within each viewing angle while ensuring the number of viewpoints.

[0037] In another exemplary embodiment of the present invention, the images after multiple frames of translation scans are superimposed in the time domain and displayed through projection to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed, which can be achieved in the following manner: Superimpose the images after multiple frames of translation scans in the time domain to obtain a target superimposed image; Based on a cylindrical lens grating, the target superimposed image is projected and displayed to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed.

[0038] In one embodiment, the multi-frame translated and scanned images can be superimposed in the time domain to obtain the target superimposed image. This means that these images are quickly switched and synthesized within a short time to form a target superimposed image. This superimposition process can be achieved through image processing software or a dedicated hardware platform, ensuring that the information of each frame of the image is effectively integrated into the target superimposed image.

[0039] In another embodiment, the multi-frame translated and scanned images are superimposed in the time domain, and the obtained target superimposed image can be expressed by the following formula (1): (1) where N is the number of frames of the translated and scanned images superimposed in the time domain; i represents the frame number of the translated and scanned images superimposed in the time domain; represents the pixel position; represents the pixel position is the pixel value of; represents the number of pixels translated by the galvanometer mirror in the i-th frame; )represents the pixel value of the translated and scanned image of the i-th frame. It can also be considered as the pixel value corresponding to the pixel position (such as pixel position x) of the translated and scanned image below. It can be understood that the pixel value at the position of is the superposition of the pixel values at multiple related positions, which can correspond to the superimposed pixel value at the pixel position (such as pixel position x) of the target superimposed image below. is the superposition of multiple related positions, which can correspond to the superimposed pixel value of the target superimposed image at the pixel position (such as pixel position x).

[0040] Further, based on the lenticular grating, the target superimposed image is projected and displayed, so as to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed. Among them, the lenticular grating is a special optical element, which can refract and focus light in a specific direction, so as to achieve the three-dimensional display effect. In this embodiment, the target superimposed image is input into a projector equipped with a lenticular grating, and the display effect is optimized by adjusting the parameters of the projector and the angle of the lenticular grating. When the projector projects light onto the screen, the lenticular grating will refract and focus the light, so that the observer can visually perceive the three-dimensional effect generated by the target superimposed image. Due to the superimposition processing of the multi-frame translation-scanned images in the time domain and the projection display of the lenticular grating, the observer will see a three-dimensional display content that integrates all the image information and has a sense of depth. That is, by using the principle of persistence of vision, dense viewpoint content can be obtained in space. Since the new viewpoints are denser than the previous original viewpoints, within a small angle, not only the number of viewpoints increases, but also the display resolution is improved.

[0041] Figure 2 FIG. is a schematic flowchart of the method provided by the present invention for projecting and displaying the target superimposed image based on a lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed.

[0042] Next, in conjunction with Figure 2 the process of projecting and displaying the target superimposed image based on a lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed will be described.

[0043] In an exemplary embodiment of the present invention, in conjunction with Figure 2 it can be seen that projecting and displaying the target superimposed image based on a lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed may include steps 210 to 230, and each step will be introduced separately below.

[0044] In step 210, determine the target pixel value at the pixel position of the ideal resolution image.

[0045] In one embodiment, an ideal resolution image can be determined according to user requirements, such as display requirements and hardware performance, and the target pixel value at each pixel position of the image can be calculated. These target pixel values represent the image parameters such as brightness and chromaticity that the final displayed three-dimensional content should have at each pixel position.

[0046] In step 220, based on the target pixel value at the pixel position of the ideal resolution image, the target superimposed image is optimized to obtain an optimized target superimposed image, so that the difference between the pixel value of the optimized target superimposed image at the pixel position and the target pixel value meets the preset requirements.

[0047] In step 230, based on the lenticular grating, the optimized target superimposed image is projected and displayed to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed.

[0048] In another embodiment, based on the determined target pixel value, the target superimposed image can be optimized to obtain an optimized target superimposed image, so that the difference between the pixel value of the optimized target superimposed image at the pixel position and the target pixel value meets the preset requirements. Among them, the preset requirements can be adjusted according to the actual situation, and in this embodiment, no specific limitation is made on the preset requirements. In other words, the optimized target superimposed image can be infinitely close to the ideal resolution image.

[0049] Furthermore, based on the lenticular grating, the optimized target superimposed image can be projected and displayed, so that the target three-dimensional display content corresponding to the two-dimensional image to be processed can be obtained. In this embodiment, a projector or other display device equipped with a lenticular grating is used to project and display the optimized target superimposed image. Since the optimization process has been carried out, the difference between the pixel value of the optimized target superimposed image at the pixel position and the target pixel value of the ideal resolution image has met the preset requirements, so the finally displayed three-dimensional content will have higher resolution and better image quality.

[0050] Figure 3 It is a schematic flow chart of the present invention for optimizing the target superimposed image based on the target pixel value at the pixel position of the ideal resolution image to obtain an optimized target superimposed image.

[0051] Next, in conjunction with Figure 3 the process of optimizing the target superimposed image based on the target pixel value at the pixel position of the ideal resolution image to obtain an optimized target superimposed image will be described.

[0052] In an exemplary embodiment of the present invention, in conjunction with Figure 3 it can be seen that optimizing the target superimposed image based on the target pixel value at the pixel position of the ideal resolution image to obtain an optimized target superimposed image may include steps 310 to 340, and each step will be introduced separately below.

[0053] In step 310, the superimposed pixel value of the target superimposed image at the pixel position is obtained.

[0054] In one embodiment, the superimposed pixel value at the pixel position of the target superimposed image can be obtained, where the superimposed pixel value can be determined using formula (1), and formula (1) gives the superimposed pixel value of the target superimposed image at pixel position x. For ease of explanation, hereinafter, the superimposed pixel value of the target superimposed image at pixel position x will be taken as an example for illustration.

[0055] In step 320, a loss function is constructed based on the superimposed pixel value at the pixel position of the target superimposed image and the target pixel value at the pixel position of the ideal resolution image.

[0056] In step 330, based on the loss function, the pixel values at the corresponding pixel positions of each frame of the translated and scanned image are iteratively adjusted through gradient descent to obtain multiple frames of adjusted translated and scanned images, such that the function value of the loss function meets a preset requirement.

[0057] In another embodiment, a loss function can be constructed based on the superimposed pixel value at the pixel position of the target superimposed image and the target pixel value at the pixel position of the ideal resolution image. This loss function is used to measure the degree of difference between the target superimposed image and the ideal resolution image. The specific form of the loss function can be selected according to actual needs, such as mean squared error (MSE), mean absolute error (MAE), or it can also be the 1-norm. For ease of explanation, hereinafter, the 1-norm will be taken as an example for illustration.

[0058] In another embodiment, the loss function can be represented by the following formula (2): (2) Wherein, represents the loss function; represents the superimposed pixel value of the target superimposed image at pixel position x; represents the target pixel value of the corresponding ideal resolution image at pixel position x.

[0059] Furthermore, based on the constructed loss function above, the pixel values at the corresponding pixel positions of each frame of the translated and scanned image can be iteratively adjusted through the gradient descent algorithm. In each iteration, the gradient of the loss function with respect to the pixel values at the corresponding pixel positions of each frame of the translated and scanned image is calculated, and the pixel values are updated according to the gradient direction. The purpose of this step is to gradually reduce the function value of the loss function until it meets the preset requirement, where the preset requirement can be adjusted according to the actual situation and is not specifically limited in this embodiment. After multiple iterative adjustments, multiple frames of adjusted translated and scanned images are obtained. The pixel values of these adjusted images at the pixel positions are already closer to the target pixel values of the ideal resolution image.

[0060] In step 340, the multi-frame adjusted and translated scanned images are superimposed in the time domain to obtain the superimposed image of the optimized target.

[0061] In another embodiment, the multi-frame adjusted and translated scanned images obtained above can be superimposed in the time domain, so as to obtain a superimposed image of the optimized target. The difference between the pixel value of the superimposed image of the optimized target at the pixel position and the target pixel value of the ideal resolution image has met the preset requirements, so it has higher image quality and resolution.

[0062] In the foregoing embodiment, the superimposed image of the target is optimized by constructing a loss function and iteratively adjusting the pixel values through gradient descent, and a superimposed image of the optimized target with higher image quality and resolution is obtained. This method can effectively improve the display effect and user experience of the three-dimensional light field enhancement display processing method.

[0063] In another exemplary embodiment of the present invention, the superimposed pixel value of the superimposed image of the target at the pixel position can be determined in the following manner: Determine the pixel values of the corresponding pixel positions of the multi-frame translated scanned images; Superimpose the pixel values of the corresponding pixel positions of the multi-frame translated scanned images in the time domain to obtain the superimposed pixel value of the superimposed image of the target at the pixel position.

[0064] In one embodiment, for each frame of the translated scanned image, the pixel value at each pixel position can be determined. These pixel values are the basis for subsequent superimposition processing. Further, the pixel values of the corresponding pixel positions of the multi-frame translated scanned images are superimposed in the time domain. Specifically, the pixel values of the multi-frame images at the same pixel position are accumulated to obtain the superimposed pixel value at this pixel position.

[0065] It can be understood that the superimposed pixel value of the superimposed image of the target at the pixel position can be implemented by formula (1), where formula (1) gives the method for determining the superimposed pixel value of the superimposed image of the target at pixel position x.

[0066] In an exemplary embodiment of the present invention, the fast translation scanning process of the two-dimensional image to be processed is performed to obtain multi-frame translated scanned images, which can be implemented in the following manner: Call the galvanometer device, and perform a fast translation scanning process on the two-dimensional image to be processed based on the galvanometer device through high-speed vibration, so as to obtain multi-frame translated scanned images, where the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's visual persistence.

[0067] In one embodiment, a galvanometer device can be called. Among them, the galvanometer device is an optical device that uses electromagnetic force or piezoelectric effect to drive the lens to vibrate at high speed, and can be used to quickly change the direction of the light beam. In this embodiment, based on the galvanometer device, the two-dimensional image to be processed can be quickly translated and scanned by high-speed vibration to obtain multiple frames of translated and scanned images. Among them, the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's visual persistence. In this embodiment, by setting the vibration frequency of the galvanometer device for high-speed vibration to be greater than the perception threshold of the human eye's visual persistence, it can be ensured that the multiple frames of translated and scanned images obtained can produce deflections that are imperceptible to the human eye, thus laying a foundation for obtaining enhanced three-dimensional display subsequently.

[0068] It can be understood that there is a contradiction between the single-viewpoint resolution and the number of viewpoints in the current three-dimensional projection light field display. The three-dimensional light field enhancement display processing method proposed by the present invention makes full use of the fast scanning function of the galvanometer and multiplexes the time-domain information of multiple frames, thereby improving the number of viewpoints and the viewing resolution of the three-dimensional light field display. This method is an optimization method for three-dimensional display that explores the time-domain multiplexing of multiple frames, laying a foundation for the wide application of future three-dimensional displays.

[0069] Based on the same inventive concept, a three-dimensional light field enhancement display processing method provided by the present invention includes: obtaining a two-dimensional image to be processed; performing a fast translation and scan processing on the two-dimensional image to be processed to obtain multiple frames of translated and scanned images, wherein the same pixel position of each frame of translated and scanned image has a preset offset relative to the previous frame of translated and scanned image, and the sum of the preset offsets of the multiple frames of translated and scanned images covers the entire area of the corresponding pixel position in the target three-dimensional display content; performing a superposition processing on the multiple frames of translated and scanned images in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional image to be processed. It realizes improving the three-dimensional display resolution within each viewpoint while ensuring the number of viewpoints.

[0070] The three-dimensional light field enhancement display processing device provided by the present invention will be described below. The three-dimensional light field enhancement display processing device described below can be mutually referred to with the three-dimensional light field enhancement display processing method described above.

[0071] Figure 4 It is a schematic structural diagram of the three-dimensional light field enhancement display processing device provided by the present invention.

[0072] The following will be combined with Figure 4 to illustrate the structure of the three-dimensional light field enhancement display processing device provided by the present invention.

[0073] In an exemplary embodiment of the present invention, in combination with Figure 4It can be known that the three-dimensional light field enhanced display processing device may include an acquisition module 410, a processing module 420, and a display module 430. Each module will be introduced separately below.

[0074] The acquisition module 410 can be configured to acquire a two-dimensional picture to be processed; The processing module 420 can be configured to perform fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning. Among them, the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; The display module 430 can be configured to perform superposition processing on multiple frames of pictures after translation scanning in the time domain and display them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0075] In an exemplary embodiment of the present invention, the display module 430 can implement superposition processing on multiple frames of pictures after translation scanning in the time domain and display them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed in the following manner: Perform superposition processing on multiple frames of pictures after translation scanning in the time domain to obtain a target superposed picture; Based on the cylindrical lens grating, project and display the target superposed picture to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0076] In an exemplary embodiment of the present invention, the display module 430 can also be configured to: Determine the target pixel value at the pixel position of the ideal resolution picture; Based on the target pixel value at the pixel position of the ideal resolution picture, perform optimization processing on the target superposed picture to obtain an optimized target superposed picture, so that the difference between the pixel value at the pixel position of the optimized target superposed picture and the target pixel value meets the preset requirements; The display module 430 can also implement projection display of the target superposed picture based on the cylindrical lens grating to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed in the following manner: Based on the cylindrical lens grating, project and display the optimized target superposed picture to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0077] In an exemplary embodiment of the present invention, the display module 430 can also implement optimization processing on the target superposed picture based on the target pixel value at the pixel position of the ideal resolution picture to obtain an optimized target superposed picture in the following manner: Obtain the superimposed pixel value of the target superimposed image at the pixel position; Based on the superimposed pixel value of the target superimposed image at the pixel position and the target pixel value of the ideal resolution image at the pixel position, construct a loss function; Based on the loss function, iteratively adjust the pixel values at the corresponding pixel positions of each frame of the translated and scanned image through gradient descent to obtain multiple frames of adjusted translated and scanned images, so that the function value of the loss function meets the preset requirements; Perform superimposition processing on multiple frames of adjusted translated and scanned images in the time domain to obtain an optimized target superimposed image.

[0078] In an exemplary embodiment of the present invention, the display module 430 can also determine the superimposed pixel value of the target superimposed image at the pixel position in the following manner: Determine the pixel values at the corresponding pixel positions of multiple frames of translated and scanned images; Perform superimposition on the pixel values at the corresponding pixel positions of multiple frames of translated and scanned images in the time domain to obtain the superimposed pixel value of the target superimposed image at the pixel position.

[0079] In an exemplary embodiment of the present invention, the processing module 420 can perform fast translation and scanning processing on the to-be-processed two-dimensional image in the following manner to obtain multiple frames of translated and scanned images: Call the galvanometer device, and based on the galvanometer device, perform fast translation and scanning processing on the to-be-processed two-dimensional image through high-speed vibration to obtain multiple frames of translated and scanned images, wherein the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's visual persistence.

[0080] Based on the same inventive concept, the present invention also provides a three-dimensional light field enhanced display processing system, which will be described below in conjunction with the following embodiments.

[0081] In an exemplary embodiment of the present invention, the three-dimensional light field enhanced display processing system may include a galvanometer device and a cylindrical lens grating. The galvanometer device is used to execute the three-dimensional light field enhanced display processing method described in any one of the previous embodiments; the cylindrical lens grating is used to cooperate with the galvanometer device to project and display the target superimposed image to obtain the target three-dimensional display content corresponding to the to-be-processed two-dimensional image. In this embodiment, by utilizing the principle of visual persistence, dense viewpoint content can be obtained in space. Since the new viewpoints are finer than the previous original viewpoints, within a small angle, not only the number of viewpoints increases, but also the display resolution correspondingly improves. It realizes improving the three-dimensional display resolution within each viewpoint while ensuring the number of viewpoints.

[0082] Figure 5Illustrates a schematic diagram of the physical structure of an electronic device, as follows Figure 5 As shown, the electronic device may include: a processor 510, a communications interface 520, a memory 530, and a communication bus 540. Among them, the processor 510, the communications interface 520, and the memory 530 complete communication with each other through the communication bus 540. The processor 510 may call the logical instructions in the memory 530 to execute a three-dimensional light field enhancement display processing method, which includes: obtaining a two-dimensional picture to be processed; performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning. Among them, the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of multiple frames of the pictures after translation scanning covers all areas of the corresponding pixel positions in the target three-dimensional display content; performing superposition processing on multiple frames of the pictures after translation scanning in the time domain and displaying through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0083] In addition, when the logical instructions in the above-mentioned memory 530 can be implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0084] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the three-dimensional light field enhanced display processing method provided by each of the above methods. The method includes: obtaining a two-dimensional picture to be processed; performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning, wherein the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; performing superposition processing on the multiple frames of pictures after translation scanning in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0085] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the three-dimensional light field enhanced display processing method provided by each of the above methods. The method includes: obtaining a two-dimensional picture to be processed; performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning, wherein the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; performing superposition processing on the multiple frames of pictures after translation scanning in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

[0086] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0087] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0088] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A three-dimensional light field enhanced display processing method, characterized in that The method includes: Obtaining a two-dimensional picture to be processed; Performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning, wherein the same pixel position of each frame of the picture after translation scanning has a preset offset relative to the previous frame of the picture after translation scanning, and the sum of the preset offsets of the multiple frames of pictures after translation scanning covers the entire area of the corresponding pixel position in the target three-dimensional display content; Performing superposition processing on the multiple frames of pictures after translation scanning in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

2. The three-dimensional light field enhancement display processing method according to claim 1, wherein The performing superposition processing on the multiple frames of pictures after translation scanning in the time domain and displaying them through projection to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed specifically includes: Performing superposition processing on the multiple frames of pictures after translation scanning in the time domain to obtain a target superposed picture; Performing projection display on the target superposed picture based on a lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

3. The three-dimensional light field enhancement display processing method according to claim 2, wherein Before performing projection display on the target superposed picture based on the lenticular grating, the method further includes: Determining the target pixel value of the ideal resolution picture at the pixel position; Based on the target pixel value of the ideal resolution picture at the pixel position, performing optimization processing on the target superposed picture to obtain an optimized target superposed picture, so that the difference between the pixel value of the optimized target superposed picture at the pixel position and the target pixel value meets the preset requirements; The performing projection display on the target superposed picture based on the lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed specifically includes: Performing projection display on the optimized target superposed picture based on the lenticular grating to obtain the target three-dimensional display content corresponding to the two-dimensional picture to be processed.

4. The three-dimensional light field enhancement display processing method according to claim 3, wherein, The performing optimization processing on the target superposed picture based on the target pixel value of the ideal resolution picture at the pixel position to obtain an optimized target superposed picture specifically includes: Obtaining the superposed pixel value of the target superposed picture at the pixel position; Based on the superposed pixel value of the target superposed picture at the pixel position and the target pixel value of the ideal resolution picture at the pixel position, constructing a loss function; Based on the loss function, iteratively adjusting the pixel value of the corresponding pixel position of each frame of the picture after translation scanning through gradient descent to obtain multiple frames of pictures after adjusted translation scanning, so that the function value of the loss function meets the preset requirements; Performing superposition processing on the multiple frames of pictures after adjusted translation scanning in the time domain to obtain an optimized target superposed picture.

5. The three-dimensional light field enhancement display processing method according to claim 4, wherein The superposed pixel value of the target superposed picture at the pixel position is determined by the following method: Determining the pixel value of the corresponding pixel position of multiple frames of pictures after translation scanning; Performing superposition on the pixel values of the corresponding pixel positions of multiple frames of pictures after translation scanning in the time domain to obtain the superposed pixel value of the target superposed picture at the pixel position.

6. The three-dimensional light field enhancement display processing method according to any one of claims 1 to 5, characterized in that The performing fast translation scanning processing on the two-dimensional picture to be processed to obtain multiple frames of pictures after translation scanning specifically includes: Invoke the galvanometer device, and based on the galvanometer device, perform fast translation scanning processing on the to-be-processed two-dimensional image by high-speed vibration to obtain multiple frames of translated and scanned images. Among them, the vibration frequency of the high-speed vibration of the galvanometer device is greater than the perception threshold of the human eye's visual persistence.

7. A three-dimensional light field enhanced display processing device, characterized in that, The device includes: An acquisition module, configured to acquire a to-be-processed two-dimensional image; A processing module, configured to perform fast translation scanning processing on the to-be-processed two-dimensional image to obtain multiple frames of translated and scanned images. Among them, the same pixel position of each frame of the translated and scanned image has a preset offset relative to the previous frame of the translated and scanned image, and the sum of the preset offsets of the multiple frames of the translated and scanned images covers the entire area of the corresponding pixel position in the target three-dimensional display content; A display module, configured to perform superposition processing on multiple frames of translated and scanned images in the time domain and display them through projection to obtain the target three-dimensional display content corresponding to the to-be-processed two-dimensional image.

8. A three-dimensional light field enhanced display processing system, characterized in that, The system includes: A galvanometer device, configured to execute the three-dimensional light field enhancement display processing method according to any one of claims 1 to 6; A lenticular grating, configured to work in cooperation with the galvanometer device to project and display the target superimposed image to obtain the target three-dimensional display content corresponding to the to-be-processed two-dimensional image.

9. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the three-dimensional light field enhancement display processing method according to any one of claims 1 to 6.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the three-dimensional light field enhancement display processing method according to any one of claims 1 to 6.

Images