Latency-Aware Multi-Channel Video Decoder Scheduling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video decoders face challenges in managing decoding latency across multiple channels, leading to inconsistent display of decoded pictures due to fixed processing order, which is not adaptable to varying latency priorities of incoming streams.
Innovation Solution
A latency aware priority based decoding system that modifies the processing order of input streams based on their latency priorities, using a decoder input scheduler to adjust the decoding order and ensure real-time processing across multiple channels, allowing for time-sharing of decoding capabilities and coordinating frame display with estimated maximum decoding latencies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a fixed processing order is used for multiple channels, then the decoder operation is simple, but the decoding latency varies inconsistently across channels
Solution Approach 1:
The patent implements a dynamic processing order that adapts to the latency requirements of different channels. The decoder switches between fixed and priority-based processing modes, making the processing order flexible rather than static. This allows the system to optimize decoding latency for time-sensitive channels while maintaining simple fixed-order processing for channels with less stringent requirements.
2Loss of time
If priority-based processing order is implemented, then decoding latency is reduced for priority channels, but the decoder operation becomes complex
Solution Approach 1:
The patent segments channels into different priority groups (high priority and low priority channels). This segmentation allows the decoder to apply different processing strategies to different channel groups, managing complexity by treating channels differently based on their requirements rather than implementing a completely complex dynamic scheduling system for all channels.
Solution Approach 2:
The patent applies priority-based processing selectively to specific channels that have latency requirements, rather than applying it uniformly to all channels. This local quality approach ensures that the complex priority-based processing is only used where necessary, keeping the overall system complexity manageable while still achieving latency reduction for time-sensitive channels.
3Productivity
If multiple channels are decoded simultaneously, then processing efficiency increases, but latency management becomes difficult
Solution Approach 1:
The patent implements dynamic channel switching that allows the decoder to interleave processing between multiple channels based on their latency requirements. Instead of processing all frames of one channel before moving to the next, the decoder dynamically switches between channels, ensuring that time-sensitive channels receive timely processing while maintaining overall processing efficiency across multiple channels.
Data Source
AI summary
Various methods and systems are provided for latency aware priority based decoding. In one embodiment, among others, a method includes providing coded frames of a first input stream to a multiple channel (multi-channel) decoder for decoding. A second input stream is obtained and a latency priority associated with the second input stream is determined. Coded frames from the first and second input streams are provided to the multi-channel decoder for decoding in an order based upon the latency priorities associated with the first and second input streams. In another embodiment, a multi-channel decoding system includes a multi-channel decoder configured to decode coded frames and a decoder input scheduler configured to provide coded frames from a plurality of input streams to the multi-channel decoder for decoding. The coded frames are provided to the multi-channel decoder in an order based at least in part upon latency priorities associated with the input streams.