Stereoscopic Volumetric Video Processing via Depth Layer Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D video content requires higher processing resources and bandwidth compared to 2D video content, making it challenging to provide an efficient and high-quality stereoscopic volumetric video experience.
Innovation Solution
A computer-implemented method and system that synchronizes multiple imaging devices to capture video and depth data, combining and processing this data to generate stereoscopic volumetric video, with a virtual imaging device capturing high-resolution portions of the scene and providing it in real-time to user devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If 3D video content is used to provide enhanced viewing experience, then viewing quality is improved, but processing resources and bandwidth requirements increase
Solution Approach 1:
The patent segments the 3D video content into multiple depth layers, where each layer represents objects at a specific depth range. This segmentation allows the system to process and transmit only the necessary depth information for each layer rather than handling complete 3D data, reducing processing resources while maintaining viewing quality.
Solution Approach 2:
The patent extracts depth information from 3D video content and separates it from standard video data. By using depth-sensing cameras to capture depth maps and extracting only the essential depth layers, the system reduces the amount of data that needs to be processed and transmitted, thereby lowering processing resource requirements while preserving the enhanced viewing experience.
2Manufacturing precision
If 3D video content is used to provide enhanced viewing experience, then viewing quality is improved, but bandwidth requirements increase
Solution Approach 1:
The patent extracts and transmits only the essential depth layer information rather than complete 3D video data. By separating depth information from full 3D content and transmitting only the necessary depth maps, the system reduces bandwidth requirements while maintaining the enhanced viewing experience through selective data transmission.
Solution Approach 2:
The patent segments 3D video content into multiple depth layers and transmits them separately. This segmentation allows the system to optimize bandwidth usage by transmitting only the relevant depth information for each layer, reducing the total quantity of data that needs to be transmitted while preserving viewing quality.
3Measurement precision
If high-resolution video data is captured from all portions of the scene, then image resolution is improved, but processing resources increase
Solution Approach 1:
The patent applies local quality by capturing and processing high-resolution video data only for specific portions of the scene that are identified as important, rather than uniformly high resolution across the entire scene. The system determines which depth layers or scene portions require higher resolution and allocates processing resources accordingly, reducing overall processing requirements while maintaining image resolution where it matters most.
Data Source
AI summary
Stereoscopic volumetric video is provided using a processor-implemented method comprising: receiving captured video data of a scene from a first imaging device and a second imaging device; receiving captured depth data of the scene from a third imaging device and a fourth imaging device; combining the captured video data and the captured depth data to generate a first atlas frame sequence comprising multiple atlas frames; processing each atlas frame of the first atlas frame sequence to generate a reconstructed scene in a virtual environment; capturing each frame of the reconstructed scene using a virtual imaging device to generate a second atlas frame sequence comprising multiple atlas frames, wherein each atlas frame of the second atlas frame sequence includes virtual video data and virtual depth data of the reconstructed scene; and providing the stereoscopic volumetric video of the scene based on the virtual video data and the virtual depth data.