360-Degree Video Streaming via Scene Segmentation and Adaptive Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in streaming 360-degree stereoscopic content efficiently due to data transmission constraints, limiting the ability to provide a fully immersive viewing experience with 360-degree viewing capabilities, especially when users can turn their heads to change their perspective.
Innovation Solution
The method involves partitioning 360-degree video content into multiple portions, encoding each portion at different data rates to accommodate varying quality levels and resolutions, and using multiple encoders in parallel to support real-time streaming, allowing users to receive different streams based on their head position and available data rate, thereby optimizing bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If full 360 degree view is streamed in full high definition video, then viewing quality is improved, but data transmission bandwidth is excessive and cannot be supported by network constraints
Solution Approach 1:
The patent divides the 360-degree scene into multiple discrete portions (e.g., front view, rear left view, rear right view) that can be independently encoded and streamed. This segmentation allows the system to transmit only the specific scene portions needed for the current viewing angle rather than the entire 360-degree scene, significantly reducing bandwidth requirements while maintaining high definition quality for the transmitted portions.
Solution Approach 2:
The patent applies different quality levels to different scene portions based on their importance and the user's current viewing direction. The front scene portion (which corresponds to the user's forward view) is transmitted at high definition quality, while rear scene portions are transmitted at lower resolutions or frame rates. This local quality differentiation optimizes bandwidth usage by allocating more data resources to the most important viewing areas.
2Loss of energy
If multiple scene portions are encoded and streamed at different data rates, then bandwidth efficiency is improved, but system complexity increases due to multiple encoders and stream management
Solution Approach 1:
The patent separates the encoding process into independent encoders for different scene portions (front, rear left, rear right). Each encoder operates independently on its assigned scene portion, which simplifies the overall system architecture compared to a single complex encoder handling the entire 360-degree scene. This segmentation of encoding tasks makes the system more manageable and allows for parallel processing.
Solution Approach 2:
The patent implements dynamic stream selection and switching based on the user's current head position and viewing angle. The system dynamically determines which scene portions are needed and switches between different encoded streams in real-time, optimizing bandwidth efficiency without requiring the client device to decode and re-encode content. This dynamic adaptation reduces the computational burden on client devices.
3Adaptability or versatility
If stereoscopic content is streamed to support 3D viewing effect, then immersive experience is improved, but data transmission requirements increase significantly
Solution Approach 1:
The patent divides the stereoscopic 360-degree content into multiple scene portions, each encoded with its own left and right eye views. By segmenting the content this way, the system can transmit only the relevant scene portions for the current viewing angle rather than the entire 360-degree stereoscopic scene, significantly reducing data transmission requirements while maintaining the 3D immersive experience for the transmitted content.
Data Source
AI summary
Methods and apparatus for streaming content corresponding to a 360 degree field of view are described. The methods and apparatus of the present invention are well suited for use with 3D immersion systems and/or head mounted display which allow a user to turn his or her head and see a corresponding scene portion. The methods and apparatus can support real or near real time streaming of 3D image content corresponding to a 360 degree field of view.