Multiplexed Video Stream Decoding for Mobile Power Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video decoding technologies face challenges in efficiently handling multiple concurrent video streams on mobile devices, particularly when specialized hardware decoders are insufficient, leading to increased CPU usage and power consumption, which can result in sluggish user experiences and higher battery drain.
Innovation Solution
A method and system that combine multiple encoded video streams into a single output stream, allowing them to be decoded by a single video decoder, with frames arranged vertically or in a grid to fit within hardware limitations, enabling concurrent display of multiple videos while minimizing software decoding reliance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple video streams are decoded using software decoders on general purpose processors, then decoding capability is provided, but CPU usage increases and power consumption rises
Solution Approach 1:
The patent combines multiple encoded video streams into a single multiplexed data stream that can be decoded by a single hardware video decoder. The encoder multiplexes multiple video bitstreams with appropriate timing information, allowing the hardware decoder to process multiple videos concurrently without requiring multiple separate decoder instances, thereby reducing power consumption while maintaining decoding capability.
Solution Approach 2:
The hardware video decoder is made multi-functional by enabling it to decode multiple different video streams through the multiplexed data stream approach. Instead of requiring dedicated hardware decoders for each video stream, a single hardware decoder can handle multiple videos by processing the time-multiplexed input, increasing adaptability without additional hardware resources.
2Use of energy by moving object
If multiple video streams are decoded using hardware decoders, then power consumption is reduced, but the number of concurrent videos is limited by hardware capabilities
Solution Approach 1:
The system dynamically multiplexes multiple video streams in time, allowing the hardware decoder to switch between different video streams based on timing information embedded in the multiplexed data stream. This dynamic time-division approach enables a single hardware decoder to handle more concurrent videos than its static capability would normally allow, as videos are decoded in sequential time slots rather than requiring simultaneous processing.
Solution Approach 2:
The patent introduces the time dimension to the decoding process by multiplexing video streams temporally. Instead of attempting to decode multiple videos simultaneously in space (requiring multiple hardware decoders), the system encodes videos in sequence through time, allowing a single hardware decoder to process multiple streams by adding the time dimension to the decoding workflow.
3Productivity
If software decoding is used for multiple videos, then concurrent video processing is possible, but processor utilization increases leading to sluggish user experience
Solution Approach 1:
The patent replaces the mechanical system of software-based CPU decoding with a hardware-based video decoder system. By substituting general purpose processor software execution with dedicated hardware decoding circuits, the system achieves concurrent video processing without the high CPU utilization that degrades user experience responsiveness, as hardware decoders operate independently of the main processor.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods and systems described herein provide for decoding multiple video streams using a single decoder. An example method may include receiving a first data stream that represents encoded frames of a first video and receiving one or more additional data streams that each represent encoded frames of a respective video. For each encoded frame of the received first data stream, the method may also include, combining a respective frame of each of the one or more additional data streams with the encoded first frame such that each encoded frame of the first video includes a respective frame of the first video and a respective frame of each of the one or more additional data streams. The method may then include decoding each combined frame of the first data stream. The method may also include providing for display the decoded frames.