Composite Video Stream Encoding for Transparency Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video editing and content creation systems require two separate video streams for key and fill elements, doubling resource requirements and increasing performance and bandwidth needs, especially in systems with limited processing resources.
Innovation Solution
A system and method that encodes key and fill video streams into a single composite stream, using a database to store video data with alpha transparency levels, and a renderer with a single decoder to apply transparency levels to pixel values, reducing resource consumption and bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If two separate video streams (key and fill) are used to render transparent video elements, then transparency rendering capability is achieved, but resource requirements and bandwidth consumption double
Solution Approach 1:
The patent combines the key stream and fill stream into a single composite video stream by encoding them together in one video track. The key portion contains transparency information while the fill portion contains the actual video content, both multiplexed within the same encoded stream using standard video compression formats like H.264 or H.265. This merging eliminates the need for two separate decoders and reduces bandwidth consumption while maintaining full transparency rendering capability.
2Adaptability or versatility
If two separate video streams are used for key and fill elements, then transparency rendering is enabled, but decoder availability and processing resources are doubled
Solution Approach 1:
The patent merges key and fill streams into a single encoded video stream that can be decoded by a single decoder. The encoded stream contains both the key portion (transparency data) and fill portion (video content) multiplexed together. During decoding, a single decoder processes the entire stream and outputs both portions, which are then separated and combined by a renderer to produce the final transparent video output. This approach maintains transparency rendering while reducing decoder requirements from two to one.
3Productivity
If real-time rendering of still image sequences is performed, then dynamic content is achieved, but performance and bandwidth requirements increase significantly
Solution Approach 1:
The patent combines key and fill streams into a single encoded video stream for real-time rendering applications. By encoding both transparency information and video content together in one stream, the system reduces bandwidth consumption compared to transmitting two separate streams. The single stream can be decoded in real-time and rendered dynamically, enabling real-time productivity while minimizing energy loss through reduced bandwidth requirements.
Data Source
AI summary
A system and method is provided for rendering key and fill video streams for video processing. The system includes a database that stores video data including a video stream of a sequence of images and alpha data defining transparency levels for each portion of each image. An encoder encodes each frame of the sequence of images to generate encoded composite frames that each contain a fill portion and a key portion, such that each encoded composite frame includes both the fill and key portions that are disposed horizontally and side-by side with respect to each other. A renderer having a single decoder decodes each encoded composite frame to extract pixel values from the fill portion and respective transparency levels from the key portion and in order to generate a proxy of the respective frame to be displayed by a video processing device.