Video Encoding GOP Structure with GF Frames for Packet Loss

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding methods are inefficient for storage and transmission, leading to weak packet-loss resistance, especially under low network speeds, resulting in delayed playback or frame freezing due to the large size of I frames and reliance on sequential decoding of GOPs.

Innovation Solution

The method involves encoding video data into sequentially arranged groups-of-pictures (GOPs) where the first frame of each GOP is an I frame, and subsequent frames are GF frames, which record changes relative to I or GF frames in previous GOPs, allowing for quicker decoding and improved packet-loss resistance by using intra- and inter-frame prediction algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional video encoding methods are used with large I frames and sequential GOP decoding, then complete video data can be transmitted, but packet-loss resistance deteriorates and playback is delayed under low network speeds

Engineering Contradiction:
Improvepacket-loss resistanceVSAvoidplayback delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides the video stream into groups of pictures (GOPs) where each GOP is an independent decoding unit. The first frame of each GOP is an I-frame that can be decoded independently, while subsequent frames reference previous frames. This segmentation allows the decoder to process and display video data in smaller, manageable chunks, improving packet-loss resistance and reducing playback delay under low network conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces GF-frames that contain predictive information about future frames based on previous frames. By pre-computing and transmitting this predictive data in advance, the system can reduce the amount of actual video data that needs to be transmitted in real-time, improving packet-loss resistance and enabling smoother playback under varying network conditions.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If I frames are transmitted to enable random access and decoding, then decoding flexibility is improved, but transmission size increases and packet-loss resistance deteriorates

Engineering Contradiction:
Improvedecoding flexibilityVSAvoidtransmission size
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments the video into GOPs with I-frames at regular intervals, creating a structure where each GOP can be independently decoded. This segmentation provides decoding flexibility while controlling the frequency and size of I-frames, balancing random access capability with transmission efficiency and packet-loss resistance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent modifies the traditional frame structure by introducing GF-frames with predictive coding parameters that reference previous frames. This changes the encoding parameters to reduce the amount of data that needs to be transmitted for each frame while maintaining decoding flexibility through the GOP structure.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If sequential decoding of GOPs is used, then decoding simplicity is maintained, but packet-loss resistance deteriorates when network speed is low

Engineering Contradiction:
Improvedecoding simplicityVSAvoidpacket-loss resistance
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent segments the video stream into independent GOPs where each GOP contains an I-frame that can serve as a starting point for decoding. This segmentation allows the decoder to handle packet loss more effectively by recovering from lost data in one GOP without affecting subsequent GOPs, improving packet-loss resistance while maintaining relatively simple sequential decoding logic.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent incorporates predictive coding in GF-frames that prepares information about future frames in advance. This preliminary action allows the decoder to have forward knowledge of upcoming frames, improving packet-loss resistance by enabling better prediction and recovery mechanisms while maintaining sequential decoding simplicity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11202066B2Video data encoding and decoding method, device, and system, and storage medium
Publication Date: 2021.12.14 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11202066B2 patent drawing
  • US11202066B2 patent drawing
  • US11202066B2 patent drawing

AI summary

A video data encoding method is provided for an encoding device. The method includes obtaining first video data, and encoding the first video data to generate a plurality of sequentially arranged groups-of-pictures. A frame type of a first frame of an initial group-of-pictures in the plurality of groups-of-pictures is an I frame, frame types of first frames of the other groups-of-pictures are GF frames, and each GF frame is configured to record change information of a current frame of a corresponding group-of-pictures relative to an I frame or a GF frame in a previous group-of-pictures. The method also includes successively outputting the plurality of groups-of-pictures according to a sequence of the plurality of groups-of-pictures, to obtain second video data.