Conditional Video Concealment for Lost Frame Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video transmission systems face challenges in determining when to apply concealment algorithms for lost data, often resulting in either visible artefacts or discarding frames, as current methods do not adequately consider the importance of different regions within a frame, such as the face, leading to suboptimal quality in displaying concealed frames.

Innovation Solution

A receiving apparatus dynamically determines whether to apply a concealment algorithm based on an estimate of concealment quality specifically targeted at a region of interest, such as the face, within a lost frame, and applies this decision to the entire frame, potentially including other regions, to minimize artefacts and ensure better frame quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a concealment algorithm is applied to lost data in video frames, then the continuity of video playback is maintained, but visible artefacts may appear that degrade perceived quality

Engineering Contradiction:
Improvevideo playback continuityVSAvoidvisible artefacts
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different quality standards to different regions of the video frame. Regions of interest (such as faces or important objects) receive higher priority for accurate reconstruction, while less important background regions accept lower quality concealment. This is achieved by calculating region-specific quality metrics and applying concealment algorithms selectively based on the estimated impact on perceived video quality.

Inventive Principle:
Principle #3Local quality

2Loss of information

If concealment is applied across the entire lost frame, then all lost data is reconstructed, but processing complexity and potential quality degradation increase

Engineering Contradiction:
Improverecovered data coverageVSAvoidconcealment processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the video frame into multiple regions of interest and non-interest areas. Instead of applying uniform concealment processing across the entire frame, the system segments the frame and applies different processing strategies to different segments. This reduces overall processing complexity by focusing computational resources on critical regions while using simpler methods for less important areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies concealment processing selectively to only those regions where it will have the most beneficial impact on perceived quality, rather than processing the entire frame uniformly. By identifying and prioritizing regions of interest, the system performs partial action on the most critical areas, achieving better quality improvement with reduced processing complexity compared to full-frame concealment.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If concealment is applied without considering region importance, then processing is simplified, but quality in critical regions such as faces is degraded

Engineering Contradiction:
Improveconcealment decision simplicityVSAvoidregion-specific quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent implements region-aware concealment by identifying regions of interest within the video frame and applying quality-sensitive concealment decisions to those specific regions. The system evaluates the importance of different frame regions and adjusts concealment parameters accordingly, ensuring that critical regions maintain higher quality while still providing overall video continuity.

Inventive Principle:
Principle #3Local quality

4Object-affected harmful factors

If the frame is discarded and previous frame is frozen instead of applying concealment, then artefacts are avoided, but video progression is stalled

Engineering Contradiction:
Improveartefact avoidanceVSAvoidframe progression delay
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

The patent implements dynamic frame handling by adaptively selecting between concealment and frame freezing based on real-time assessment of lost data characteristics and region importance. Rather than using a static approach, the system dynamically evaluates whether concealment or freezing will better preserve video quality and progression, making context-dependent decisions that optimize both artefact avoidance and temporal continuity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9609321B2Conditional concealment of lost video data
Publication Date: 2017.03.28 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9609321B2 patent drawing
  • US9609321B2 patent drawing
  • US9609321B2 patent drawing

AI summary

A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.