HPP Video Encoding with Layered FEC Redundancy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video data processing technologies, such as HPP coding methods, fail to ensure successful decoding of all frames during packet loss in video transmission, leading to video lag and quality issues.

Innovation Solution

The method combines Hierarchical P-frame Prediction (HPP) coding with Forward Error Correction (FEC) redundancy coding, where more redundancy packets are added to frames in lower temporal layers, and dynamically adjusts redundancy levels based on network conditions to improve decoding success rates and reduce video lag.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If HPP coding method is used to reduce reference coupling between frames, then decoding flexibility is improved, but decoding success rate deteriorates when packet loss occurs in lower temporal layers

Engineering Contradiction:
Improvedecoding flexibilityVSAvoiddecoding success rate
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies forward error correction (FEC) coding to encode video data before transmission, creating redundancy packets in advance. When packet loss occurs during transmission, the decoder can use these pre-prepared redundancy packets to recover lost data and successfully decode frames that would otherwise fail, thus improving decoding success rate without sacrificing the decoding flexibility provided by HPP coding

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces redundancy packets as a protective buffer against packet loss. By encoding additional protective data in advance and transmitting it along with the video data, the system creates a cushion that absorbs the impact of packet loss, allowing the decoder to maintain high success rates even when packets are lost during transmission

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Reliability

If more redundancy packets are added to lower temporal layers, then decoding success rate is improved, but transmission bandwidth consumption increases

Engineering Contradiction:
Improvedecoding success rateVSAvoidbandwidth consumption
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies different levels of forward error correction coding to different temporal layers based on their importance. Lower temporal layers, which are more critical for decoding success, receive higher levels of redundancy protection. Higher temporal layers receive less redundancy. This localized differentiation improves overall decoding success rate while avoiding unnecessary bandwidth consumption on less critical data

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the redundancy level parameter based on network conditions and frame importance. By changing the redundancy parameter adaptively - using higher redundancy for lower temporal layers and lower redundancy for higher temporal layers - the system optimizes the balance between decoding success rate and bandwidth consumption

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3484155B1Method and device for processing video data
Publication Date: 2023.10.18 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP3484155B1 patent drawingFigure 1~2
  • EP3484155B1 patent drawingFigure 3~4
  • EP3484155B1 patent drawingFigure 5

AI summary

Disclosed are a method and device for processing video data. The method comprises: an encoding end encoding acquired original video data according to Hierarchical P-frame Prediction (HPP) to obtain an HPP code stream; conducting redundant encoding on the HPP code stream according to forward error correction (FEC) encoding, wherein the number of redundant packets of each frame in the HPP code stream progressively decreases according to the time layer where each frame is located in the HPP in the order of lowest to highest; and finally sending each frame in the HPP code stream after the redundant encoding to a decoding end in sequence. The present application combines an HPP encoding structure and FEC redundant encoding, and adds a redundant packet to a HPP code stream encoded according to the HPP encoding structure. In this way, even though some packet loss occurs during data transmission, the decoding end can still perform lost packet recovery through the redundant packet, greatly improving the success rate of decoding, and reducing the stutter time of video.