Intelligent Video Frame Dropping for Wireless Congestion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wireless communication devices drop video frames without considering their importance, leading to poor video playback quality during network congestion, as they treat all frame types equally and drop frames randomly, resulting in equal proportional loss of I, P, and B frames.
Innovation Solution
Implementing a system where wireless communication devices intelligently drop frames based on their contextual importance, prioritizing the transmission of more important frames like I or IDR frames and dropping less important frames like B frames at a higher rate, using metrics such as frame type, previous packet drop rates, and temporal order to manage network congestion while maintaining video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If frames are dropped randomly without considering importance, then network congestion is relieved and transmission rate is maintained, but video playback quality deteriorates due to loss of important frames
Solution Approach 1:
The patent applies local quality by treating different video frames differently based on their importance. I-frames (intra-coded frames) are assigned high importance and protected from dropping, while B-frames (bidirectional predicted frames) are assigned low importance and more likely to be dropped. This selective treatment based on local frame characteristics resolves the contradiction by maintaining transmission throughput while preserving critical video quality information.
Solution Approach 2:
The patent changes the parameter of frame selection by introducing contextual importance levels as a new criterion. Instead of uniform random dropping, the system evaluates each frame's importance based on its type (I, P, or B frame) and temporal context, dynamically adjusting which frames to transmit or drop. This parameter change enables differentiated frame handling that maintains both transmission rate and video quality.
2Device complexity
If all frame types are treated equally during congestion, then transmission control is simple, but video quality suffers due to proportional loss of important I-frames
Solution Approach 1:
The patent implements local quality by assigning different importance weights to different frame types. I-frames receive high importance weights since they contain complete image information, P-frames receive medium weights, and B-frames receive low weights. This localized differentiation in frame treatment improves video quality without requiring complex overall system changes, as each frame is evaluated and handled according to its specific characteristics.
3Productivity
If frames are dropped to reduce data volume during congestion, then network flow control is improved, but information loss increases reducing video fidelity
Solution Approach 1:
The patent applies local quality by selectively preserving important video information while dropping less important data. I-frames containing complete image information are protected from dropping, while B-frames containing only predictive differences are more readily dropped. This localized information preservation strategy improves network flow control by reducing total data volume while minimizing loss of critical video information.
Solution Approach 2:
The patent changes the parameter of frame selection by introducing contextual importance levels as a new criterion. Instead of uniform random dropping, the system evaluates each frame's importance based on its type (I, P, or B frame) and temporal context, dynamically adjusting which frames to transmit or drop. This parameter change enables differentiated frame handling that maintains both transmission rate and video quality.
Data Source
AI summary
A device, system and method for intelligently dropping frames in a congested wireless network. Video frames from a video encoder may be received and queued in an ordered sequence of outgoing video frames in a transmission queue to be transmitted as data packets by a wireless communication circuit. When network congestion is detected, a relative contextual importance level of an incoming frame received from the video input channel may be compared relative to at least one frame in the transmission queue. The compared frame that has a lower relative contextual importance level may be dropped or omitted from the transmission queue, thereby transmitting data packets of the frames in the transmission queue without the dropped or omitted frames.