Bit Stream Management for Video Communication Over Poor Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Establishing a stable and quick video connection between devices over networks with poor quality of service, such as limited bandwidth and high packet loss, is challenging due to the discard of reference frames during packet loss, which affects inter prediction and decoding processes.
Innovation Solution
Adaptive bit stream management through encoding frames with different parameters in multiple bit streams, allowing for interleaving transmission and separate buffering to prevent frame discard until feedback is received, enabling the sender to determine optimal encoding parameters based on receiver feedback and ensuring reference frames are preserved for future use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If packet loss occurs during transmission, then the current frame can be discarded to compensate for loss, but this causes problems for decoding subsequent frames and establishing video connections
Solution Approach 1:
The patent changes the parameter of reference frame management by introducing a timer mechanism that tracks the duration since the last acknowledged frame. Instead of immediately discarding frames upon packet loss, the system maintains frames in the reference frame list for a predetermined time period, allowing for potential recovery while eventually discarding them if not needed. This parameter change resolves the contradiction by balancing packet loss compensation with reference frame preservation.
2Productivity
If I frames are transmitted over networks with poor service quality, then video connection can be established, but the large size of I frames increases probability of packet loss
Solution Approach 1:
The patent applies preliminary action by maintaining reference frames for a predetermined time period after transmission, before they would normally be discarded. This creates a buffer period during which lost I frames can potentially be recovered or retransmitted, allowing the system to establish connections more reliably over poor quality networks without significantly delaying the process.
Solution Approach 2:
The system provides beforehand cushioning by keeping backup reference frames available in the reference frame list for a predetermined duration. This cushioning mechanism protects against packet loss of large I frames by having alternative reference data available, thus maintaining connection establishment productivity while compensating for reliability issues in poor network conditions.
3Productivity
If traditional reference frame management is used, then decoding can proceed efficiently, but frame discard during packet loss prevents quick connection establishment
Solution Approach 1:
The patent introduces dynamics to reference frame management by making the frame retention period adaptive rather than static. Frames are maintained for a predetermined time period that can be adjusted based on network conditions and connection establishment progress. This dynamic approach allows the system to optimize between decoding efficiency and connection establishment speed by extending frame retention when connection establishment is still in progress.
Data Source
AI summary
A device is disclosed. The device includes: an encoder configured to encode a first bit stream and a second bit stream, the first bit stream comprising a first plurality of frames, the second bit stream comprising a second plurality of frames; a processor configured to determine a first encoding parameter of the first bit stream and a second encoding parameter of the second bit stream, the first encoding parameter different from the second encoding parameter; and a communication module configured to transmit the first bit stream and the second bit stream over a network. The first plurality of frames and the second plurality of frames are transmitted in an interleaving fashion.