Encoded Video Stream Mixer Using Segmentation to Reduce Processing Power
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for mixing encoded video streams require complete decoding and re-encoding of all streams, even for small areas, which is inefficient and consumes excessive processing power, especially in applications like video conferencing where multiple streams are mixed in various combinations.
Innovation Solution
The proposed method splits the primary video stream into an unmixed and a complementary sub-stream, decodes and mixes only the complementary sub-stream with secondary streams, and then encodes the mixed signal, combining it with the unmixed sub-stream, thereby reducing processing power requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complete decoding and re-encoding of all video streams is performed, then mixing quality is maintained, but processing power consumption increases excessively
Solution Approach 1:
The primary video stream is divided into two separate sub-streams: a first sub-stream containing picture data for a first area of the picture, and a second sub-stream containing picture data for a second area of the picture. This segmentation allows selective processing where only the second sub-stream (corresponding to the area to be mixed) is decoded and re-encoded, while the first sub-stream is directly combined with the mixed content, thereby reducing processing power consumption while maintaining mixing quality.
2Manufacturing precision
If complete decoding and re-encoding of all video streams is performed, then mixing accuracy is ensured, but processing time increases
Solution Approach 1:
The video stream is segmented into first and second sub-streams corresponding to different picture areas. By identifying that only the second area requires mixing operations, the system decodes and processes only the second sub-stream, while the first sub-stream is directly combined with the mixed content. This selective processing approach maintains mixing accuracy for the relevant area while significantly reducing overall processing time.
3Adaptability or versatility
If full video streams are decoded and re-encoded, then mixing completeness is achieved, but device complexity increases
Solution Approach 1:
The system segments the primary video stream into first and second sub-streams and processes them differently based on their intended use. The first sub-stream is directly combined with mixed content without full decoding/re-encoding, while the second sub-stream undergoes selective decoding and re-encoding. This approach achieves mixing completeness for the necessary areas while reducing device complexity through optimized processing paths.
4Productivity
If selective processing of video sub-streams is implemented, then processing efficiency improves, but system complexity increases
Solution Approach 1:
The video stream is segmented into first and second sub-streams that can be processed through different pathways. The system implements selective processing by decoding only the second sub-stream for mixing operations while directly combining the first sub-stream with mixed content. This segmentation-based approach improves processing efficiency by avoiding redundant operations while managing system complexity through a structured processing framework.
Data Source
AI summary
Describe is a video stream mixer (60) for generating a mixed encoded video stream from an encoded primary video stream associated with a primary window, and at least one encoded secondary video stream, each associated with a corresponding secondary window that is smaller than the primary window. The mixer includes the following elements: A video stream splitter (20) configured to split the encoded primary video stream into an encoded unmixed sub-stream associated with a sub-window in the primary window and not involved in mixing, and an encoded complementary sub-stream associated with a sub-window complementary to the other sub-window in the primary window and involved in mixing; A video stream decoder (22) configured to decode the complementary sub-stream and each secondary video stream; A video signal mixer (24) configured to mix the decoded complementary sub-stream with each decoded secondary video stream to form a mixed video signal; A video encoder (26) configured to encode the mixed video signal into an encoded mixed sub-stream; A video stream combiner (28) configured to combine the encoded unmixed sub-stream with the encoded mixed sub-stream.