Video Frame Group Reference Strategy for Transmission Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video transmission over the Internet is unreliable, leading to lag and delay in video playback due to packet loss and the inefficiency of using I frames, which results in poor real-time performance and increased bandwidth and network load.

Innovation Solution

The method involves generating consecutive frame groups with a long-term reference frame that uses a previous frame as a reference, replacing multiple I frames, and using predictive coding to transmit difference values and motion vectors, thereby reducing data size and transmission time while maintaining image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If I frames are used for video transmission, then video reliability is improved, but transmission delay increases and bandwidth consumption increases

Engineering Contradiction:
Improvevideo transmission reliabilityVSAvoidtransmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the video stream into frame groups with different reference frame types. Instead of uniformly using I frames for every frame group, the system divides frame groups into those that use I frames as reference and those that use P frames as reference, allowing selective use of compressed reference frames to reduce overall transmission delay while maintaining reliability through periodic I frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter of reference frame type from always using I frames to dynamically selecting between I frames and P frames based on frame group position. This parameter change allows the system to use compressed P frames (with smaller data size) for most frame groups while periodically inserting I frames for reliability, thereby reducing average transmission delay.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If I frames are used for video transmission, then video reliability is improved, but network load increases

Engineering Contradiction:
Improvevideo transmission reliabilityVSAvoidnetwork load
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the video stream into frame groups with different reference frame types. Instead of uniformly using I frames for every frame group, the system divides frame groups into those that use I frames as reference and those that use P frames as reference, allowing selective use of compressed reference frames to reduce overall transmission delay while maintaining reliability through periodic I frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter of reference frame type from always using I frames to dynamically selecting between I frames and P frames based on frame group position. This parameter change allows the system to use compressed P frames (with smaller data size) for most frame groups while periodically inserting I frames for reliability, thereby reducing average transmission delay.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple I frames are sent to ensure delivery, then video reliability is improved, but transmission time increases

Engineering Contradiction:
Improvevideo frame delivery reliabilityVSAvoidtransmission time
Core Design Contradiction:
ReliabilityVSDuration of action of moving object

Solution Approach 1:

The patent changes the parameter of reference frame type from always using I frames to dynamically selecting between I frames and P frames based on frame group position. This parameter change allows the system to use compressed P frames (with smaller data size) for most frame groups while periodically inserting I frames for reliability, thereby reducing average transmission delay.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses P frames as compressed copies that reference previous frames. Instead of sending full I frames for every frame group, the system sends P frames that contain only the differences from previous frames, significantly reducing data size and transmission time while maintaining the ability to reconstruct the video stream.

Inventive Principle:
Principle #26Copying

4Loss of time

If P frames are used instead of I frames, then transmission delay is reduced, but reliability deteriorates due to reference dependency

Engineering Contradiction:
Improvetransmission delayVSAvoiddecoding reliability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent segments the video stream into frame groups with different reference frame types. Instead of uniformly using I frames for every frame group, the system divides frame groups into those that use I frames as reference and those that use P frames as reference, allowing selective use of compressed reference frames to reduce overall transmission delay while maintaining reliability through periodic I frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter of reference frame type from always using I frames to dynamically selecting between I frames and P frames based on frame group position. This parameter change allows the system to use compressed P frames (with smaller data size) for most frame groups while periodically inserting I frames for reliability, thereby reducing average transmission delay.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11172227B2Video sending and receiving method, apparatus, and terminal thereof
Publication Date: 2021.11.09 BIGO TECH PTE LTD
  • US11172227B2 patent drawing
  • US11172227B2 patent drawing
  • US11172227B2 patent drawing

AI summary

The video sending method includes: acquiring a video stream to be transmitted; generating consecutive frame groups from the video stream, wherein setting a first frame in the current frame group to be a long-term reference frame that uses a first frame in a previous frame group as a reference during generation of at least one of the current frame group, wherein the long-term reference frame is a predictive coded frame configured to transmit a difference and a motion vector obtained by performing a comparison against the first frame in the previous frame group, the current frame group is a frame group other than the first frame group; and sending the frame groups to a receiving terminal. The video receiving method comprises: receiving the frame groups sent by a sending terminal; and restoring the frame groups to obtain the transmitted video stream.