Motion Estimation Deblocking for Video Frame Upscaling

Solution Overview

Problem

Low-quality videos captured with cheap cameras and compressed for faster uploads are degraded further when viewed on high-resolution displays, resulting in poor technical quality due to quantization errors and compression artifacts.

Innovation Solution

The method involves using motion estimation to deblock compressed videos, reducing quantization errors, and upsampling to create high-resolution videos that match or exceed the original uncompressed video quality, employing classification upscalers trained with filters generated through deblocking processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If videos are compressed for faster uploads and efficient storage, then upload speed and storage efficiency are improved, but video quality deteriorates due to quantization errors and compression artifacts

Engineering Contradiction:

Improveupload speedVSAvoidvideo quality

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary deblocking processing to video frames before upscaling. By removing blocking artifacts early in the processing chain and estimating original frame details, the system prepares enhanced video data that will maintain higher quality after compression and during display, rather than attempting to fix quality issues after compression has already degraded the video

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary processing stage between compressed video and final display that includes deblocking filtering and motion-compensated frame estimation. This intermediary process reconstructs lost video information by analyzing motion between frames and compensating for blocking artifacts, thereby mediating between the compressed input and the quality requirements of high-resolution displays

Inventive Principle:

Principle #24Intermediary (Mediator)

2Quantity of substance

If videos are compressed for efficient storage, then storage efficiency is improved, but video quality deteriorates due to quantization errors

Engineering Contradiction:

Improvestorage efficiencyVSAvoidvideo quality

Core Design Contradiction:

Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent introduces an intermediary processing stage between compressed video and final display that includes deblocking filtering and motion-compensated frame estimation. This intermediary process reconstructs lost video information by analyzing motion between frames and compensating for blocking artifacts, thereby mediating between the compressed input and the quality requirements of high-resolution displays

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates enhanced copies of compressed video frames by estimating the original uncompressed frame information. Through motion compensation and deblocking filtering, the system generates a high-quality copy of the video content that preserves detail information even though the source was heavily compressed for storage efficiency

Inventive Principle:

Principle #26Copying

3Measurement precision

If low quality videos are viewed on high resolution displays, then display capability is utilized, but video quality appears poorer due to accentuated compression artifacts

Engineering Contradiction:

Improvedisplay resolutionVSAvoidperceived video quality

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies deblocking filtering and motion-compensated estimation selectively to different regions of video frames. By analyzing motion vectors and applying appropriate filtering strength based on local motion characteristics and block boundaries, the system preserves quality where needed while avoiding over-processing in already-clear regions, thereby matching the enhanced detail capability of high-resolution displays

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent applies preliminary deblocking processing to video frames before upscaling. By removing blocking artifacts early in the processing chain and estimating original frame details, the system prepares enhanced video data that will maintain higher quality after compression and during display, rather than attempting to fix quality issues after compression has already degraded the video

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS8582654B1Generating a deblocked version of video frames using motion estimation

Publication Date: 2013.11.12 HEWLETT PACKARD DEVELOPMENT COMPANY LP

AI summary

Compressed frames of a video with associated reduced information about an object are received. The video has unreduced information about an object moving with respect to boundaries that are fixed with in each frame of the video and the compressed frames have reduced information about the object moving with respect to the boundaries that are fixed with in each of the compressed frames. The reduced information has quantization error due to compression. An estimate of the unreduced information is created by transforming the reduced information into the estimate using computer implemented motion estimation. The estimate has less quantization error than the reduced information.