Blended 2D and 3D Media Streams for Unified Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies do not support the transmission and rendering of 2D and 3D media streams in combined media streams, requiring separate transmission and rendering of these media types.
Innovation Solution
A system and method for combining 2D and 3D media streams into a single combined media stream by interleaving frames of different types, using initialization segments with sample descriptions for rendering, and employing scene analysis to adapt encoding based on image parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If 2D and 3D media streams are transmitted in individual separate streams, then each media type can be transmitted with dedicated resources and processing, but the system complexity increases and resource allocation becomes inefficient
Solution Approach 1:
The patent combines multiple media streams (2D and 3D) into a single unified media stream structure. The media stream contains multiple representations of the same content with different characteristics (e.g., different view angles, resolutions, or encodings) that can be selectively decoded and rendered. This merging approach allows efficient resource sharing and simplifies the transmission infrastructure while maintaining the ability to handle diverse media types.
Solution Approach 2:
The unified media stream structure serves multiple functions simultaneously - it can carry both 2D and 3D content, support different rendering modes, and accommodate various media characteristics within a single stream container. This multi-functionality eliminates the need for separate dedicated streams for different media types, thereby reducing system complexity while improving transmission efficiency.
2Productivity
If 2D and 3D media streams are rendered separately in individual content streams, then each stream can be processed independently, but the rendering time increases and playback experience is fragmented
Solution Approach 1:
The system performs preliminary organization of media data into a unified stream structure with proper timing information and synchronization markers before rendering. The media stream is pre-structured with multiple representations that are ready for selective decoding, allowing the rendering system to process all content types concurrently rather than sequentially, thereby reducing total rendering time while maintaining independent processing capability.
Solution Approach 2:
The unified media stream enables continuous rendering operation where 2D and 3D content can be decoded and rendered in an interleaved or concurrent manner. The stream structure maintains temporal continuity and synchronization information that allows the rendering system to process different media types without interruption or waiting time, eliminating the fragmented playback experience while reducing total rendering time.
3Adaptability or versatility
If separate 2D and 3D media streams are used, then each stream can be optimized for its specific type, but the overall system adaptability decreases
Solution Approach 1:
The unified media stream structure allows different local segments or representations to have optimized characteristics for their specific purposes. Each representation within the stream can be encoded with appropriate parameters for 2D or 3D content, and the system can selectively decode and render only the necessary representations based on the current playback requirements. This local optimization within a unified structure provides both adaptability and efficiency without requiring complete system redesign for each media type.
Data Source
AI summary
Streaming media includes generating an initialization segment having a first sample description for a first set of image parameters and a second sample description for a second set of image parameters. The method also includes transmitting a media stream including the initialization segment, a first set of frames referencing the first sample description, and a second set of frames referencing the second sample description.