MPEG-2 Video Decoder Frame-Missing Concealment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

MPEG-2 video streams are sensitive to bit errors, particularly when frames are missing, leading to severe degradation in video quality due to lack of effective error concealment methods.

Innovation Solution

A method is introduced in an MPEG-2 video decoder to receive a new frame and a 'frame missing' flag, parse the frame to determine its picture type and structure, and apply error concealment techniques based on the assigned picture type and structure of the missing frame, using information from previous frames to recreate the missing frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If video compression is applied to reduce redundancies, then transmission efficiency is improved, but video quality deteriorates and sensitivity to bit errors increases

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidvideo quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by detecting missing frames before they propagate errors through the decoding process. The system uses frame timing information and packet arrival patterns to identify missing frames in advance, then applies error concealment techniques (such as copying data from previous frames or using motion compensation) to reconstruct the missing content before it affects subsequent decoding operations. This prevents error propagation and maintains video quality despite the compressed format's sensitivity to bit errors.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If error concealment algorithms are applied to handle missing frames, then video quality is improved, but decoder complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoiddecoder complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by implementing error concealment selectively rather than universally. The system analyzes each missing frame event and applies appropriate concealment techniques based on local conditions such as the type of missing frame (I-frame, P-frame, or B-frame), the availability of reference frames, and the nature of the error. This selective approach improves video quality where needed while avoiding unnecessary processing in error-free segments, thereby controlling decoder complexity.

Inventive Principle:
Principle #3Local quality

3Loss of information

If multiple slices or entire frames are lost due to TS packet loss, then data integrity is compromised, but simple retransmission is not feasible in real-time streaming

Engineering Contradiction:
Improvedata integrityVSAvoidretransmission delay
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent converts the harm of missing frames into a benefit by using the known structure and timing information of MPEG-2 video streams to detect missing frames and apply intelligent error concealment. Instead of treating missing frames as complete data loss, the system uses the predictable nature of video encoding (frame types, slice structures, motion vectors) to reconstruct missing content from available reference frames and side information. This transforms the harmful effect of packet loss into an opportunity to demonstrate the robustness of the error concealment algorithm, maintaining data integrity without requiring retransmission.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS9510022B2Multi-layer approach for frame-missing concealment in a video decoder
Publication Date: 2016.11.29 INTEL CORP
  • US9510022B2 patent drawing
  • US9510022B2 patent drawing
  • US9510022B2 patent drawing

AI summary

The invention relates to a method of concealing errors attributed to missing frames in a Motion Picture Expert Group-2 video stream, including the steps of: receiving a new frame for decoding and a “frame missing” flag that is set to a value associated with the occurrence of a missing frame, parsing the new frame to recover a picture type and a frame structure of the new frame, retrieving a picture type and a frame structure of a previous frame decoded immediately prior to the new frame, assigning a picture type and a frame structure to the missing frame based on the picture type and frame-structure values of the previous frame and the new frame and then applying an error concealment technique based upon the assigned picture type and frame structure of the missing frame.