Three-dimensional light field display processing method, device and system and electronic equipment

Abstract

The invention provides a three-dimensional light field display processing method, device and system and electronic equipment. The method comprises the following steps: acquiring a to-be-processed two-dimensional picture; the to-be-processed two-dimensional image is subjected to fast translation scanning projection processing, a plurality of translation scanning projection images are obtained, and the translation scanning frequency of fast translation scanning is larger than a perception threshold value of human vision persistence; and performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed. The display resolution of the single viewpoint of the light field can be effectively improved in the three-dimensional light field display process.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional display technology, and particularly to a three-dimensional light field display processing method, device, system and electronic device. Background Art

[0002] As an important part of future display technology, three-dimensional light field display technology shows great application potential. Its core lies in using advanced light control devices to project the image content originally limited to a two-dimensional plane at a specific angle into three-dimensional space, thereby creating a realistic three-dimensional light field display effect. This technology not only provides users with a more immersive visual experience, but also greatly expands the application field of display technology.

[0003] However, in the process of pursuing high-quality display effects, traditional three-dimensional display technology faces an irreconcilable contradiction: the conflict between display resolution and angular resolution. Specifically, when pursuing high resolution for a single viewing point, the number of display viewpoints is often sacrificed, resulting in limited viewing angles and affecting the user's all-round viewing experience. On the contrary, if the number of display viewpoints is increased to enhance the diversity of viewing angles, it often comes at the cost of reducing the resolution of a single viewing point, thereby affecting the clarity of the image.

[0004] Therefore, finding a three-dimensional light field display processing method that can effectively improve the display resolution of a single viewing point has become a current research hotspot. Summary of the Invention

[0005] The present invention provides a three-dimensional light field display processing method, device, system and electronic device, which realizes effectively improving the display resolution of a single viewing point in the process of three-dimensional light field display.

[0006] The present invention provides a three-dimensional light field display processing method, the method includes: obtaining a two-dimensional picture to be processed; performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures, wherein the translation scanning frequency of the fast translation scanning is greater than the perception threshold of human eye visual persistence; performing superposition processing on the plurality of translation scanning projection pictures in the same viewing point area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0007] According to the three-dimensional light field display processing method provided by the present invention, the performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: calling a galvanometer device, and performing fast translation scanning projection processing on the two-dimensional picture to be processed through high-speed vibration of the galvanometer device to obtain a plurality of translation scanning projection pictures, wherein the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of human eye visual persistence.

[0008] A three-dimensional light field display processing method provided by the present invention, the step of performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures with picture translation within a single pixel; the step of performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: performing superposition processing on the plurality of translation scanning projection pictures with picture translation within a single pixel to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0009] A three-dimensional light field display processing method provided by the present invention, the step of performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: in the scenario of three-dimensional light field display based on pixel multiplexing coding, performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures under missing pixel blocks, where the missing pixel blocks are the pixel blocks missing during the three-dimensional light field display based on pixel multiplexing coding; the step of performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: performing pixel multiplexing coding processing on the two-dimensional picture to be processed to obtain a coded picture; performing superposition filling processing on the coded picture and the plurality of translation scanning projection pictures under missing pixel blocks in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0010] A three-dimensional light field display processing method provided by the present invention, the step of performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures with picture translation within a single pixel, and performing pixel multiplexing coding processing on the two-dimensional picture to be processed to obtain a coded picture; the step of performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: performing superposition processing on the plurality of translation scanning projection pictures with picture translation within a single pixel and the coded picture in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0011] A three-dimensional light field display processing method provided by the present invention, before performing superposition processing of multiple translation scan projection images with image translation within a single pixel and the encoded image in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed, the method further includes: performing fast translation scan projection processing on the two-dimensional image to be processed to obtain multiple translation scan projection images under missing pixel blocks, where the multiple translation scan projection images under the missing pixel blocks are the missing images in the encoded image; the superposition processing of multiple translation scan projection images with image translation within a single pixel and the encoded image in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed specifically includes: performing superposition processing of multiple translation scan projection images with image translation within a single pixel in the same viewpoint area, and performing superposition filling processing of the encoded image and the multiple translation scan projection images under the missing pixel blocks in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0012] The present invention also provides a three-dimensional light field display processing device, the device includes: an acquisition module, configured to acquire a two-dimensional image to be processed; a processing module, configured to perform fast translation scan projection processing on the two-dimensional image to be processed to obtain multiple translation scan projection images, where the translation scan frequency of the fast translation scan is greater than the perception threshold of the human eye's visual persistence; a generation module, configured to perform superposition processing of the multiple translation scan projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0013] The present invention also provides a three-dimensional light field display processing system, the system includes: a galvanometer device, configured to execute the three-dimensional light field display processing method of any one of the above; a light control device, configured to cooperate with the galvanometer device to project the image content after superposition processing of multiple translation scan projection images in the same viewpoint area to space at multiple angles to form a three-dimensional light field display result.

[0014] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where when the processor executes the computer program, it implements the three-dimensional light field display processing method as described in any one of the above.

[0015] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the three-dimensional light field display processing method as described in any one of the above.

[0016] The present invention also provides a computer program product, including a computer program which, when executed by a processor, implements the three-dimensional light field display processing method as described in any one of the above.

[0017] The three-dimensional light field display processing method, device, system and electronic device provided by the present invention obtain a two-dimensional picture to be processed; perform fast translational scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translational scanning projection pictures, wherein the translational scanning frequency of the fast translational scanning is greater than the perception threshold of the human eye's visual persistence; perform superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed. It realizes the effective improvement of the display resolution of a single viewpoint of the light field during the three-dimensional light field display process. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0019] Figure 1 is one of the flow diagrams of the three-dimensional light field display processing method provided by the present invention.

[0020] Figure 2 is the flow diagram of performing superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed provided by the present invention.

[0021] Figure 3 is the flow diagram of performing superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed provided by the present invention.

[0022] Figure 4 is the flow diagram of performing superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed provided by the present invention.

[0023] Figure 5 is the flow diagram of performing superposition processing on the plurality of translational scanning projection pictures with picture translation in a single pixel and the encoded picture in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed provided by the present invention.

[0024] Figure 6 is the structural diagram of the three-dimensional light field display processing device provided by the present invention.

[0025] Figure 7 It is a schematic structural diagram of the electronic device provided by the present invention. Specific embodiments

[0026] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Apparently, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without making creative efforts shall fall within the protection scope of the present invention.

[0027] A three-dimensional light field display processing method provided by the present invention can use a galvanometer to perform rapid translational scanning, so that multiple contents are displayed within the same viewing point interval in a short time. Due to the persistence of vision effect, the contents displayed by the multiple scans of the galvanometer can be effectively superimposed to improve the image resolution and enhance the image quality.

[0028] Figure 1 It is one of the schematic flowcharts of the three-dimensional light field display processing method provided by the present invention.

[0029] The following will be combined with Figure 1 to illustrate the process of the three-dimensional light field display processing method provided by the present invention.

[0030] In an exemplary embodiment of the present invention, in combination with Figure 1 it can be seen that the three-dimensional light field display processing method may include steps 110 to 130, and each step will be introduced separately below.

[0031] In step 110, a two-dimensional picture to be processed is obtained.

[0032] In step 120, rapid translational scanning projection processing is performed on the two-dimensional picture to be processed to obtain a plurality of translational scanning projection pictures, wherein the translational scanning frequency of the rapid translational scanning is greater than the perception threshold of the persistence of vision of the human eye.

[0033] In step 130, superimposing processing of the plurality of translational scanning projection pictures in the same viewing point area is performed to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0034] In one embodiment, a two-dimensional picture to be processed can be obtained. This two-dimensional picture can be any image that needs to be converted into a three-dimensional light field display, for example, a static picture, a video frame or other types of two-dimensional image data.

[0035] Furthermore, the two-dimensional image to be processed can be subjected to fast translational scanning projection processing to generate multiple translational scanning projection images. Among them, the translational scanning frequency of the fast translational scanning is set to be greater than the perception threshold of the human eye's persistence of vision. This means that the scanning speed is fast enough that the human eye cannot distinguish individual scanning actions but perceives a continuous light field effect.

[0036] In another embodiment, after obtaining multiple translational scanning projection images, these images can be subjected to superposition processing. Thus, a three-dimensional light field display result corresponding to the two-dimensional image to be processed can be obtained. Among them, the superposition is performed within the same viewing point area, that is, all projection images correspond to the same position in the observer's eyes. In this embodiment, the combination of fast translational scanning projection processing and superposition processing within the same viewing point area enables the observer to perceive a more delicate and realistic three-dimensional image, achieving an effective improvement in the display resolution of the light field at a single viewing point during the three-dimensional light field display process.

[0037] The three-dimensional light field display processing method provided by the present invention includes: obtaining a two-dimensional image to be processed; performing fast translational scanning projection processing on the two-dimensional image to be processed to obtain multiple translational scanning projection images, where the translational scanning frequency of the fast translational scanning is greater than the perception threshold of the human eye's persistence of vision; performing superposition processing on the multiple translational scanning projection images within the same viewing point area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed. It realizes an effective improvement in the display resolution of the light field at a single viewing point during the three-dimensional light field display process.

[0038] In another exemplary embodiment of the present invention, the fast translational scanning projection processing of the two-dimensional image to be processed to obtain multiple translational scanning projection images can be implemented in the following manner: Call a galvanometer device, and based on the galvanometer device, perform fast translational scanning projection processing on the two-dimensional image to be processed through high-speed vibration to obtain multiple translational scanning projection images, where the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's persistence of vision.

[0039] In one embodiment, the galvanometer device can be an optical element capable of high-speed vibration, and it realizes fast scanning by changing the direction of light. In this embodiment, the galvanometer device is configured to perform scanning projection on the two-dimensional image to be processed through high-speed vibration. Among them, the vibration frequency of the galvanometer device is set to be greater than the perception threshold of the human eye's persistence of vision to ensure that the scanning speed is fast enough, so that the observer cannot distinguish individual scanning actions but perceives a continuous light field effect.

[0040] During the application process, with the high-speed vibration of the galvanometer device, the two-dimensional image to be processed is projected to different positions, forming multiple slightly offset projection images (corresponding to the translation-scanned projection images), and by performing superposition processing on the multiple translation-scanned projection images in the same viewing area, a three-dimensional light field display result corresponding to the two-dimensional image to be processed can be obtained.

[0041] In this embodiment, by invoking the galvanometer device to perform fast translation-scanned projection processing and combining with the superposition processing in the same viewing area, the display resolution of a single viewing point of the light field can be effectively improved during the three-dimensional light field display process.

[0042] Figure 2 It is a schematic flowchart of the present invention for performing superposition processing on the multiple translation-scanned projection images in the same viewing area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0043] The following will be combined with Figure 2 The process of performing superposition processing on the multiple translation-scanned projection images in the same viewing area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed will be described.

[0044] In an exemplary embodiment of the present invention, combined with Figure 2 It can be known that performing superposition processing on the multiple translation-scanned projection images in the same viewing area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed may include step 210 and step 220, and each step will be introduced separately below.

[0045] In step 210, perform fast translation-scanned projection processing on the two-dimensional image to be processed to obtain multiple translation-scanned projection images with image translation within a single pixel.

[0046] In step 220, perform superposition processing on the multiple translation-scanned projection images with image translation within a single pixel in the same viewing area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0047] In one embodiment, when performing fast translation-scanned projection processing on the two-dimensional image to be processed, special attention is paid to achieving image translation within a single pixel. In an example, fast translation-scanned projection processing can be performed on the two-dimensional image to be processed to obtain multiple translation-scanned projection images with image translation within a single pixel. Further, perform superposition processing on the multiple translation-scanned projection images with image translation within a single pixel, thereby a three-dimensional light field display result corresponding to the two-dimensional image to be processed can be obtained. In this embodiment, by achieving image translation within a single pixel and combining with the superposition processing in the same viewing area, the single-viewing-point resolution of the three-dimensional light field display is effectively improved.

[0048] In the foregoing embodiments, a galvanometer is used to translate the image content. By utilizing the persistence of vision effect, the human eye can perceive more pixel information, improving the display resolution. Additionally, the jagged problems caused by sampling can be effectively eliminated, thereby enhancing the display quality of a single viewpoint.

[0049] Figure 3 FIG. is a schematic flowchart of the present invention for performing superposition processing on multiple translated scan projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image.

[0050] The following will be combined with Figure 3 Another process of performing superposition processing on multiple translated scan projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image will be described.

[0051] In an exemplary embodiment of the present invention, in combination with Figure 3 it can be known that performing superposition processing on multiple translated scan projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image may include steps 310 to 330. Each step will be introduced separately below.

[0052] In step 310, in a scenario of three-dimensional light field display based on pixel multiplexing coding, the to-be-processed two-dimensional image is subjected to fast translated scan projection processing to obtain multiple translated scan projection images under missing pixel blocks, where the missing pixel blocks are pixel blocks missing during the three-dimensional light field display based on pixel multiplexing coding.

[0053] In step 320, the to-be-processed two-dimensional image is subjected to pixel multiplexing coding processing to obtain an encoded image.

[0054] In step 330, superposition filling processing is performed on the encoded image and multiple translated scan projection images under missing pixel blocks in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image.

[0055] In one embodiment, in order to improve the efficiency and resolution of three-dimensional light field display, the to-be-processed two-dimensional image can be subjected to pixel multiplexing coding processing. Pixel multiplexing coding is a technology that rearranges and combines the pixel information of the original image through an encoding algorithm to reduce the number of pixels required by the display device or improve the display resolution. In three-dimensional light field display, it can be used to process pixel missing problems caused by limitations of projection devices or display technologies. Among them, after pixel multiplexing coding processing, an encoded image is obtained, and this image contains rearranged and combined pixel information.

[0056] In another embodiment, in the scenario of three-dimensional light field display based on pixel multiplexing coding, due to pixel recombination and multiplexing during the coding process, some pixel blocks may be missing during the final display. To solve this problem, the encoded image can be processed by fast translational scanning projection. During the projection process, by precisely controlling the scanning speed and direction of the projection device, the image has a slight translation during each projection.

[0057] After multiple projections, each pixel will be projected multiple times, but some pixel blocks may be missing due to multiplexing coding during each projection. Multiple translational scanning projection images under these missing pixel blocks will be recorded. In one example, after obtaining multiple translational scanning projection images under the missing pixel blocks, these images can also be subjected to superposition filling processing with the encoded image. Among them, the superposition filling processing is carried out within the same viewing area, that is, all projection images correspond to the same position in the observer's eyes. Through image synthesis algorithms or optical techniques, the translational scanning projection images under these missing pixel blocks are correctly aligned and fused with the encoded image. During the superposition filling process, special attention is paid to matching the positions of the missing pixel blocks with the corresponding translational scanning projection images to ensure the integrity and accuracy of the final display result.

[0058] In this embodiment, through the combination of pixel multiplexing coding processing and fast translational scanning projection technology, the problem of missing pixel blocks during the three-dimensional light field display based on pixel multiplexing coding is effectively solved, filling the image holes and supplementing the image resolution.

[0059] When pixel multiplexing coding is adopted, the three-dimensional display will sacrifice the vertical resolution (or horizontal resolution) to supplement the number of horizontal viewpoints. At this time, during the three-dimensional display, there will be holes in the space of the image, and there is a great lack of resolution. For this reason, a galvanometer scanning device can be used to quickly translate the image content, fill the image holes, and supplement the image resolution. During the application process, the image content can be re-encoded according to the translation distance each time to ensure that the viewing area is basically the same while filling the image information. At this time, the content of multiple frames of images can fill each other, supplementing the loss of vertical resolution caused by multiplexing coding. Based on this, the image content is more complete, and the resolution of a single-viewpoint image is improved.

[0060] Figure 4 It is a schematic flowchart of the process provided by the present invention for performing superposition processing of multiple said translational scanning projection images in the same viewing area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0061] The following will be combined with Figure 4A process of performing superposition processing on multiple of the translated scanning projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed will be described.

[0062] In an exemplary embodiment of the present invention, in combination with Figure 4 it can be seen that performing superposition processing on multiple of the translated scanning projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed may include steps 410 to 430. Each step will be introduced separately below.

[0063] In step 410, perform fast translated scanning projection processing on the two-dimensional image to be processed to obtain multiple translated scanning projection images with image translation within a single pixel.

[0064] In one embodiment, fast translated scanning projection processing can be performed on the two-dimensional image to be processed, so that multiple translated scanning projection images with image translation within a single pixel can be obtained. In this embodiment, it can be achieved by precisely controlling the scanning speed and direction of the projection device, such that there is a slight translation of the image during each projection. After multiple projections, multiple slightly offset projection images will be accumulated within each pixel, and these images together constitute the three-dimensional light field information within that pixel. This processing method ensures that image translation can be achieved even within a single pixel, thereby increasing the fineness of the three-dimensional display.

[0065] In step 420, perform pixel multiplexing coding processing on the two-dimensional image to be processed to obtain a coded image.

[0066] In step 430, perform superposition processing on multiple translated scanning projection images with image translation within a single pixel and the coded image in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0067] In yet another embodiment, pixel multiplexing coding processing can be performed on the two-dimensional image to be processed to obtain a coded image. Further, the multiple translated scanning projection images with image translation within a single pixel obtained and the coded image after pixel multiplexing coding processing are superposed in the same viewpoint area, so that a three-dimensional light field display result corresponding to the two-dimensional image to be processed can be obtained. In this embodiment, by combining the advantages of fast translated scanning projection processing and pixel multiplexing coding processing, the obtained three-dimensional light field display result corresponding to the two-dimensional image to be processed can have higher resolution and a more delicate three-dimensional effect.

[0068] Figure 5It is a schematic flowchart of the process provided by the present invention for performing superposition processing in the same viewpoint area on multiple translation-scanned projection images with image translation within a single pixel and the encoded images, to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0069] Next, in conjunction with Figure 5 the process provided by the present invention for performing superposition processing in the same viewpoint area on multiple translation-scanned projection images with image translation within a single pixel and the encoded images, to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed will be described.

[0070] In an exemplary embodiment of the present invention, in conjunction with Figure 5 it can be seen that the process provided by the present invention for performing superposition processing in the same viewpoint area on multiple translation-scanned projection images with image translation within a single pixel and the encoded images, to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed may include steps 510 to 530. Each step will be introduced separately below.

[0071] In step 510, perform fast translation-scanned projection processing on the two-dimensional image to be processed to obtain multiple translation-scanned projection images under missing pixel blocks, where the multiple translation-scanned projection images under missing pixel blocks are the missing images in the encoded image.

[0072] In step 520, perform superposition processing in the same viewpoint area on multiple translation-scanned projection images with image translation within a single pixel.

[0073] In step 530, perform superposition filling processing in the same viewpoint area on the encoded image and the multiple translation-scanned projection images under missing pixel blocks to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0074] It should be noted that during the encoding process, due to algorithm limitations or hardware conditions, information of some pixel blocks may be missing. Therefore, after encoding, the two-dimensional image to be processed can be subjected to fast translation-scanned projection processing again, but this time the processing focuses on identifying and generating multiple translation-scanned projection images under those pixel blocks missing in the encoded image. These images can be specifically used to fill the missing parts in the encoded image. During application, fast translation-scanned projection processing can be performed on the two-dimensional image to be processed to obtain multiple translation-scanned projection images under missing pixel blocks, where the multiple translation-scanned projection images under missing pixel blocks are the missing images in the encoded image.

[0075] Furthermore, multiple translation scan projection images with picture translation within a single pixel can be subjected to superposition processing in the same viewpoint area; then, superposition filling processing is performed on the encoded image and multiple translation scan projection images under the missing pixel blocks in the same viewpoint area, so as to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed. In this embodiment, it is ensured that the missing part in the encoded image is filled correctly and with high quality, thereby further improving the three-dimensional light field display effect.

[0076] In the foregoing embodiment, after using a galvanometer to quickly scan and translate the image content, not only can finer pixels be provided by superposing pixels, but also the resolution under the missing pixel blocks can be compensated by spatially filling pixels, thereby further improving the image resolution.

[0077] As can be known from the foregoing description, the three-dimensional light field display processing method provided by the present invention uses a galvanometer to quickly scan and translate the image content, superposes pixel information in a small range, and fills the image holes, thereby completing the improvement of the image resolution. It has laid a solid foundation for the wide application of three-dimensional light field display in the future.

[0078] The three-dimensional light field display processing device provided by the present invention will be described below. The three-dimensional light field display processing device described below can be correspondingly referred to the three-dimensional light field display processing method described above.

[0079] Figure 6 It is a schematic structural diagram of the three-dimensional light field display processing device provided by the present invention.

[0080] In an exemplary embodiment of the present invention, in combination with Figure 6 it can be known that the three-dimensional light field display processing device may include an acquisition module 610, a processing module 620, and a generation module 630. Each module will be introduced separately below.

[0081] The acquisition module 610 can be configured to acquire a two-dimensional image to be processed; The processing module 620 can be configured to perform fast translation scan projection processing on the two-dimensional image to be processed to obtain multiple translation scan projection images, wherein the translation scan frequency of the fast translation scan is greater than the perception threshold of the human eye's visual persistence; The generation module 630 can be configured to perform superposition processing on the multiple translation scan projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

[0082] In an exemplary embodiment of the present invention, the processing module 620 can implement fast translation scan projection processing on the two-dimensional image to be processed to obtain multiple translation scan projection images in the following manner: Call the galvanometer device, and based on the galvanometer device, perform fast translation scanning projection processing on the to-be-processed two-dimensional image by high-speed vibration to obtain multiple translation scanning projection images, where the vibration frequency of the galvanometer device for high-speed vibration is greater than the perception threshold of the human eye's visual persistence.

[0083] In an exemplary embodiment of the present invention, the processing module 620 can implement fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images in the following manner: Perform fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images with image translation within a single pixel; The generation module 630 can implement the superposition processing of multiple translation scanning projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image in the following manner: Perform superposition processing of multiple translation scanning projection images with image translation within a single pixel in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image.

[0084] In an exemplary embodiment of the present invention, the processing module 620 can implement fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images in the following manner: In the scenario of three-dimensional light field display based on pixel multiplexing coding, perform fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images under missing pixel blocks, where the missing pixel blocks are pixel blocks missing during the three-dimensional light field display based on pixel multiplexing coding; The generation module 630 can implement the superposition processing of multiple translation scanning projection images in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image in the following manner: Perform pixel multiplexing coding processing on the to-be-processed two-dimensional image to obtain a coded image; Perform superposition filling processing on the coded image and multiple translation scanning projection images under missing pixel blocks in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the to-be-processed two-dimensional image.

[0085] In an exemplary embodiment of the present invention, the processing module 620 can implement fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images in the following manner: Perform fast translation scanning projection processing on the to-be-processed two-dimensional image to obtain multiple translation scanning projection images with image translation within a single pixel, and Perform pixel multiplexing encoding processing on the two-dimensional picture to be processed to obtain an encoded picture; The generating module 630 may implement the superposition processing of multiple translation scan projection pictures in the same viewpoint area in the following manner to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed: Perform superposition processing in the same viewpoint area on multiple translation scan projection pictures with picture translation within a single pixel, and the encoded picture, to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0086] In an exemplary embodiment of the present invention, the generating module 630 may further be configured to: Perform fast translation scan projection processing on the two-dimensional picture to be processed to obtain multiple translation scan projection pictures under missing pixel blocks, where the multiple translation scan projection pictures under the missing pixel blocks are the missing pictures in the encoded picture; The generating module 630 may also implement the superposition processing in the same viewpoint area on multiple translation scan projection pictures with picture translation within a single pixel, and the encoded picture, in the following manner to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed: Perform superposition processing in the same viewpoint area on multiple translation scan projection pictures with picture translation within a single pixel, and Perform superposition filling processing in the same viewpoint area on the encoded picture and the multiple translation scan projection pictures under the missing pixel blocks to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0087] Based on the same inventive concept, the present invention also provides a three-dimensional light field display processing system, which will be described below in conjunction with the following embodiments.

[0088] In an exemplary embodiment of the present invention, the three-dimensional light field display processing system may include a galvanometer device and a light control device. Among them, the galvanometer device is used to execute the three-dimensional light field display processing method described in any one of the foregoing embodiments; the light control device is used to cooperate with the galvanometer device to project the picture content after superposition processing of multiple translation scan projection pictures in the same viewpoint area at multiple angles into space to form a three-dimensional light field display result. Through this embodiment, the display resolution of a single viewpoint of the light field can be effectively improved during the three-dimensional light field display process.

[0089] Figure 7 Illustrates a schematic physical structure diagram of an electronic device, such as Figure 7As shown in the figure, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740. Among them, the processor 710, the communications interface 720, and the memory 730 complete communication with each other through the communication bus 740. The processor 710 may call the logic instructions in the memory 730 to execute a three-dimensional light field display processing method, and the method includes: obtaining a two-dimensional picture to be processed; performing fast translational scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translational scanning projection pictures, where the translational scanning frequency of the fast translational scanning is greater than the perception threshold of the human eye's persistence of vision; performing superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0090] In addition, when the logic instructions in the above-mentioned memory 730 can be implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0091] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the three-dimensional light field display processing method provided by the above-mentioned various methods. The method includes: obtaining a two-dimensional picture to be processed; performing fast translational scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translational scanning projection pictures, where the translational scanning frequency of the fast translational scanning is greater than the perception threshold of the human eye's persistence of vision; performing superposition processing on the plurality of translational scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0092] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements a three-dimensional light field display processing method provided by the above various methods. The method includes: obtaining a two-dimensional picture to be processed; performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures, wherein the translation scanning frequency of the fast translation scanning is greater than the perception threshold of the human eye's visual persistence; performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

[0093] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0094] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solutions, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0095] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of each embodiment of the present invention.

Claims

1. A three-dimensional light field display processing method, characterized in that The method includes: Obtaining a two-dimensional picture to be processed; Performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures, wherein the translation scanning frequency of the fast translation scanning is greater than the perception threshold of the human eye's visual persistence; Performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

2. The three-dimensional light field display processing method according to claim 1, wherein The performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: Invoking a galvanometer device, and performing fast translation scanning projection processing on the two-dimensional picture to be processed based on the galvanometer device through high-speed vibration to obtain a plurality of translation scanning projection pictures, wherein the vibration frequency of the high-speed vibration of the galvanometer device is greater than the perception threshold of the human eye's visual persistence.

3. The three-dimensional light field display processing method according to claim 1 or 2, characterized in that, The performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: Performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures with picture translation within a single pixel; The performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: Performing superposition processing on the plurality of translation scanning projection pictures with picture translation within a single pixel in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

4. The three-dimensional light field display processing method according to claim 1 or 2, characterized in that The performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: In a scenario of three-dimensional light field display based on pixel multiplexing coding, performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures under missing pixel blocks, wherein the missing pixel blocks are pixel blocks missing during the three-dimensional light field display based on pixel multiplexing coding; The performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: Performing pixel multiplexing coding processing on the two-dimensional picture to be processed to obtain a coded picture; Performing superposition filling processing on the coded picture and the plurality of translation scanning projection pictures under missing pixel blocks in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed.

5. The three-dimensional light field display processing method according to claim 1 or 2, characterized in that The performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures specifically includes: Performing fast translation scanning projection processing on the two-dimensional picture to be processed to obtain a plurality of translation scanning projection pictures with picture translation within a single pixel, and Performing pixel multiplexing coding processing on the two-dimensional picture to be processed to obtain a coded picture; The performing superposition processing on the plurality of translation scanning projection pictures in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional picture to be processed specifically includes: For multiple translation-scanned projection images with image translation within a single pixel, and the encoded image, perform superposition processing in the same viewpoint area to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

6. The three-dimensional light field display processing method according to claim 5, wherein Before performing the superposition processing in the same viewpoint area on the multiple translation-scanned projection images with image translation within a single pixel and the encoded image to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed, the method further includes: Perform fast translation-scanned projection processing on the two-dimensional image to be processed to obtain multiple translation-scanned projection images under missing pixel blocks, where the multiple translation-scanned projection images under the missing pixel blocks are the missing images in the encoded image; The step of performing superposition processing in the same viewpoint area on the multiple translation-scanned projection images with image translation within a single pixel and the encoded image to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed specifically includes: Perform superposition processing in the same viewpoint area on the multiple translation-scanned projection images with image translation within a single pixel, and Perform superposition filling processing in the same viewpoint area on the encoded image and the multiple translation-scanned projection images under the missing pixel blocks to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

7. A three-dimensional light field display processing device, characterized in that The device includes: An acquisition module for acquiring a two-dimensional image to be processed; A processing module for performing fast translation-scanned projection processing on the two-dimensional image to be processed to obtain multiple translation-scanned projection images, where the translation scanning frequency of the fast translation scanning is greater than the perception threshold of the human eye's visual persistence; A generation module for performing superposition processing in the same viewpoint area on the multiple translation-scanned projection images to obtain a three-dimensional light field display result corresponding to the two-dimensional image to be processed.

8. A three-dimensional light field display processing system, characterized in that, The system includes: A galvanometer device for performing the three-dimensional light field display processing method according to any one of claims 1 to 6; A light control device for working in cooperation with the galvanometer device to project the image content after performing superposition processing on the multiple translation-scanned projection images in the same viewpoint area to space at multiple angles to form a three-dimensional light field display result.

9. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the three-dimensional light field display processing method according to any one of claims 1 to 6.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the three-dimensional light field display processing method according to any one of claims 1 to 6.

Images