2D Image Depth Mapping for Fast Multi-View 3D Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating three-dimensional videos from two-dimensional images are computationally complex and time-consuming, making them unsuitable for low-latency online applications.
Innovation Solution
A method and apparatus that perform perspective transformation on two-dimensional images to generate migration images from multiple perspectives, reducing the need for three-dimensional scene modeling and minimizing computational and time costs while maintaining accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If three-dimensional modeling based on multi-angle camera is used to generate three-dimensional video, then the quality and accuracy of three-dimensional video is improved, but the computational cost and time cost increase significantly
Solution Approach 1:
The patent uses depth map as a simplified copy or representation of the three-dimensional scene information, avoiding the need for complex multi-angle camera modeling. The depth map contains essential depth cues that can be used to generate three-dimensional video effects without reconstructing the full three-dimensional scene geometry
Solution Approach 2:
The patent extracts only the necessary depth information from the two-dimensional image to create a depth map, separating the essential three-dimensional cues from the complete scene reconstruction process. This extraction approach focuses computational resources on generating depth information rather than full scene modeling
2Measurement precision
If three-dimensional modeling based on multi-angle camera is used to generate three-dimensional video, then the quality and accuracy of three-dimensional video is improved, but the computational cost increases
Solution Approach 1:
The depth map serves as a lightweight computational proxy that captures three-dimensional scene information without requiring full scene reconstruction. This copying approach dramatically reduces computational cost while maintaining the ability to generate three-dimensional video effects
Solution Approach 2:
The patent changes the representation parameters from complex multi-view geometry to a simplified depth map format. This parameter transformation reduces the dimensional complexity from multiple camera views to a single depth channel, lowering computational requirements
3Reliability
If traditional three-dimensional scene modeling process is used, then comprehensive scene reconstruction is achieved, but the processing complexity and time consumption increase
Solution Approach 1:
The patent extracts only the depth information necessary for three-dimensional video generation, removing the need for complete scene reconstruction. This selective extraction maintains reliability for the specific application while reducing processing complexity
Solution Approach 2:
The patent segments the three-dimensional video generation process into independent steps: depth map generation, view synthesis, and video assembly. This segmentation allows each component to be optimized independently, reducing overall processing complexity
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
This application provides a three-dimensionalization method and apparatus for a two-dimensional image, an electronic device, and a computer-readable storage medium. The method includes: performing depth perception processing on a two-dimensional image, to obtain a depth value of each pixel in the two-dimensional image; performing migration processing on each pixel in the two-dimensional image from multiple perspectives, to obtain a migration result of the two-dimensional image corresponding to each perspective; determining a color value of each pixel in a migration image corresponding to each perspective, based on the depth value of each pixel in the two-dimensional image and the migration result of the two-dimensional image corresponding to each perspective; generating, based on the color value of each pixel in the migration image of each perspective, the migration image corresponding to the perspective; and encapsulating the migration images of the multiple perspectives in an order, to obtain a three-dimensional video. This application can quickly and accurately generate the three-dimensional video based on the two-dimensional image.