Video Encoder Macroblock Refresh for Low Latency Error Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression schemes for low bit rate and low latency wireless video communications suffer from temporal error propagation due to interdependency between frames, leading to noticeable quality issues and 'motion jerkiness', especially in low-bandwidth environments.

Innovation Solution

A video communication system that progressively refreshes macroblocks in uniform segments, using a stride back function to identify and refresh macroblocks encoded with data from unrefreshed macroblocks, thereby controlling and halting temporal error propagation without relying on I-frames, employing the progressive group of picture (PGOP) technique and motion vectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If I-frames are used to stop error propagation, then temporal error propagation is halted, but transmission delay increases and bit rate consumption increases

Engineering Contradiction:
Improveerror propagation controlVSAvoidtransmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides the video frame into multiple macroblocks and applies selective intra-coding to only those macroblocks that contain errors or are likely to propagate errors. This segmentation approach allows error containment at the macroblock level rather than requiring complete frame refreshes, thereby reducing the transmission delay and bit rate overhead associated with full I-frame insertion.

Inventive Principle:
Principle #1Segmentation

2Reliability

If I-frames are used to stop error propagation, then temporal error propagation is halted, but bit rate consumption increases

Engineering Contradiction:
Improveerror propagation controlVSAvoidbit rate consumption
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies different coding strategies to different macroblocks within a frame based on their error susceptibility and actual error status. Macroblocks that are intra-coded only when necessary (when errors are detected or predicted) receive full treatment, while others use inter-coding. This local differentiation reduces overall bit rate consumption compared to uniform I-frame insertion while maintaining effective error propagation control.

Inventive Principle:
Principle #3Local quality

3Quantity of substance

If predictive video coding is used to reduce data transmission, then bit rate efficiency improves, but temporal error propagation increases

Engineering Contradiction:
Improvebit rate efficiencyVSAvoidtemporal error propagation
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent incorporates error detection mechanisms that monitor the transmission and reception of macroblocks, providing feedback about error conditions. Based on this feedback, the system dynamically adjusts which macroblocks should be intra-coded versus inter-coded, allowing the predictive coding benefits to be maintained while actively countering error propagation through adaptive refresh strategies.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9237347B2Systems and methods for video compression for low bit rate and low latency video communications
Publication Date: 2016.01.12 RGT UNIV OF CALIFORNIA
  • US9237347B2 patent drawing
  • US9237347B2 patent drawing
  • US9237347B2 patent drawing

AI summary

The field of the invention relates to system and methods for video compression, and more particularly to systems and methods for video compression for low bit rate and low latency video communications. In one embodiment, a video communication system includes a first electronic device enabled to receive and display video data and a second electronic device configured to transmit video data to the first electronic device and be communicatively accessible by the first electronic device. The video data includes a plurality of frames, each frame having a plurality of macroblocks. The second electronic device includes a video encoder having a sub-system configured to progressively refresh the macroblocks of the frames in substantially uniform segments, determine whether there are macroblocks encoded with data from an unrefreshed macroblock in the segment last refreshed, and refresh the macroblocks encoded with data from an unrefreshed macroblock in the segment last refreshed.