Video Error Concealment Using Cross-Slice Recovery Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video communications, network jitter leads to packet loss and corruption, causing video artifacts and interruptions, and existing error concealment techniques struggle to effectively restore lost or damaged data, especially in severe network conditions.
Innovation Solution
A method and system for error concealment in video communications that determines recovery data for a current block by using coefficients of discrete transforms and similarity data from blocks in different slices, transmitting this data as out-of-band supplemental enhancement information to aid in decoding and reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If error concealment uses data from the same slice, then decoding simplicity is maintained, but reliability deteriorates due to packet loss and corruption in jittering networks
Solution Approach 1:
The patent divides the picture into multiple slices and allows error concealment to draw from other slices rather than being confined to the same slice. This segmentation approach enables the system to bypass corrupted data in one slice by using data from other slices, thereby improving reliability without significantly increasing decoding complexity since the mechanism follows existing slice-based processing.
Solution Approach 2:
The patent introduces an intermediary mechanism where recovery data from other slices acts as a mediator to restore lost or corrupted blocks. Instead of directly attempting to recover data from the same corrupted slice, the system uses data from other slices as an intermediate source, which improves error resilience while maintaining relatively simple decoding operations.
2Manufacturing precision
If comprehensive recovery data is transmitted for all blocks, then manufacturing precision of video quality is improved, but loss of substance increases due to bandwidth consumption
Solution Approach 1:
The patent applies local quality by transmitting recovery data selectively only for blocks that are lost or corrupted, rather than transmitting recovery data for all blocks. The system identifies specific blocks needing recovery and transmits recovery information only for those locations, thereby maintaining high video quality where needed while minimizing overall bandwidth consumption.
Solution Approach 2:
The patent uses partial action by transmitting recovery data for only a subset of blocks - specifically those that are lost or corrupted - rather than transmitting recovery data for all blocks. This partial approach ensures adequate video quality for affected areas while avoiding the bandwidth overhead of comprehensive recovery data transmission.
Data Source
AI summary
A method, an apparatus, and a system for error concealment of video communications include determining, by a processor in an encoding process, a current block of a current slice of a current picture of a video sequence for error concealment, determining recovery data of the current block, wherein the recovery data comprises at least one of a coefficient of a discrete transform performed to the current block and similarity data associated with a first block similar to the current block, and the first block is in a first slice different from the current slice, and transmitting the current block and the recovery data using a network, wherein the current block is transmitted as in-band data and the recovery data is transmitted as out-of-band data.