Real-Time Video Streaming Control with Adaptive Frame Skip Levels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image transmission technologies experience delays due to network degradation, leading to accumulation of delays and potential service quality degradation, especially in real-time streaming services, where GOP settings can cause either image quality degradation or content discontinuity.
Innovation Solution
An electronic device that transmits and receives images through a wireless network, utilizing a processor to identify skip levels for frames based on transmission delay information and content characteristics, encoding the content accordingly to allow skippable frames to be skipped at the receiver, and transmitting skip level information to optimize decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If GOP size is increased to reduce frame skipping, then image quality is improved, but delay accumulation occurs and service quality degrades
Solution Approach 1:
The patent applies dynamics by making the GOP size adjustable rather than fixed. The system dynamically changes GOP size based on network conditions (loss rate, delay) and content characteristics. When network conditions are good, larger GOP sizes are used to improve image quality. When delays occur, the system switches to smaller GOP sizes or increases frame skipping to prevent delay accumulation, thus resolving the contradiction between image quality and delay accumulation.
Solution Approach 2:
The patent changes key parameters (GOP size, frame skipping rate, encoding resolution) based on network conditions and content type. By adjusting these parameters dynamically, the system can optimize the balance between image quality and delay prevention. For example, increasing frame skipping ratio or reducing GOP size when delays are detected, while maintaining higher quality settings when network conditions are stable.
2Loss of time
If GOP size is decreased to prevent delay accumulation, then delay is reduced, but image quality degrades due to frequent intra frames
Solution Approach 1:
The system dynamically adjusts GOP size based on real-time network conditions. When network conditions are poor or delays are detected, smaller GOP sizes are used to prevent delay accumulation. When conditions improve, the system transitions to larger GOP sizes to restore image quality. This dynamic adjustment resolves the contradiction by allowing temporary quality reduction only when necessary.
Solution Approach 2:
The system performs preliminary actions by proactively adjusting encoding parameters before severe delays occur. When network degradation is detected, the system preemptively reduces GOP size or increases frame skipping to prevent delay accumulation, rather than waiting for delays to become critical. This preliminary action maintains service quality while preventing the need for more drastic quality reductions later.
3Productivity
If frame skipping is increased to reduce delays, then transmission speed is improved, but content discontinuity occurs
Solution Approach 1:
The patent applies local quality by differentiating frame importance and applying selective skipping. Not all frames are treated equally - the system identifies key frames (I-frames, key P-frames) that maintain content continuity and protects them from skipping, while allowing non-critical frames to be skipped or compressed. This selective approach maintains transmission speed while preventing content discontinuity.
Solution Approach 2:
The system uses feedback from network conditions and decoding status to adjust frame skipping rates. When delays are detected, the system increases skipping temporarily but monitors for content discontinuity. If discontinuity occurs, the feedback mechanism reduces skipping rate or adjusts GOP structure to restore continuity. This closed-loop control resolves the contradiction between speed and reliability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An electronic device includes a communication interface connected with a wireless network, a memory storing at least one instruction, and at least one processor that is connected with the communication interface and the memory and controls the electronic device. The at least one processor is configured to, by executing the at least one instruction, transmit a content to an external device in real time through the communication interface, and based on receiving transmission delay information from the external device, identify skip levels for each of a plurality of frames included in the content based on the received transmission delay information and characteristics of the content, encode the content based on the identified skip levels for each of the plurality of frames, and transmit the skip level information for each of the plurality of frames and the encoded content to the external device through the communication interface.