Polyhedral Mapping for 3D Panoramic Video Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Most spherical panoramic video content is presented in a two-dimensional format, lacking the three-dimensional experience despite advancements in technology, necessitating a method to transform 2D content into 3D for enhanced visualization, particularly in virtual reality applications.
Innovation Solution
A method and apparatus that project frames of a panoramic video onto a polyhedron, calculate pixel displacements to create parallax, and shift pixels to generate 3D images by combining shifted frames with original frames, encoding them into a 3D panoramic video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 2D spherical panoramic video is presented, then the video can be displayed on standard devices, but the three-dimensional immersive experience is lost
Solution Approach 1:
The patent transforms 2D spherical panoramic video into 3D by projecting frames onto a polyhedral structure (cube or octahedron), calculating pixel displacements to create parallax effects, and generating multiple views that simulate three-dimensional depth perception while maintaining compatibility with standard display devices
2Measurement precision
If pixel displacement calculation is performed on spherical coordinates, then the mathematical complexity is high, but the processing efficiency decreases
Solution Approach 1:
The patent converts spherical coordinate calculations into polyhedral projections, where pixel displacements are calculated based on planar geometric relationships rather than complex spherical trigonometry, significantly improving processing efficiency while maintaining displacement accuracy
Solution Approach 2:
The patent divides the spherical panorama into multiple polyhedral faces (cube faces or octahedron faces), allowing independent and parallel processing of each face, which improves overall processing throughput while maintaining precision through localized calculations
3Illumination intensity
If polyhedral projection is used to generate 3D panoramic video, then the three-dimensional effect is achieved, but the device complexity increases
Solution Approach 1:
The patent uses polyhedral projection as an intermediate representation to simplify the generation of 3D panoramic video, transforming the complex spherical-to-3D conversion into manageable planar projections that can be processed using standard image processing techniques
Solution Approach 2:
The patent creates multiple copied views of the panoramic content from different virtual camera positions around the polyhedron, generating the necessary parallax pairs for 3D display without requiring complex real-time rendering or multiple physical cameras
Data Source
AI summary
A method and an apparatus for generating 3D panoramic video are provided. In the method, plural frames are captured from a panoramic video. Each frame is transformed into a polyhedral mapping projection comprising side planes, a top plane and a bottom plane. Displacements of pixels in the side planes are calculated by using the side planes of each frame, and displacements of pixels in the top plane and the bottom plane are calculated by using the displacements of the side planes. Then, the pixels in the side planes, the top plane and the bottom plane of each frame are shifted according the displacements of the polyhedral mapping projection to generate a shifted polyhedral mapping projection. The shifted polyhedral mapping projection is transformed into a shifted frame with 2D space format. The shifted frames and corresponding frames construct 3D images and the 3D images are encoded into a 3D panoramic video.