Video Enhancement via Related Image Patch Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Low-resolution videos often lack sufficient information to perform desired enhancements, such as increasing resolution, due to insufficient pixel data.

Innovation Solution

The method involves using related images with similar scenes but higher resolution to enhance video quality through patch matching techniques, identifying regions of interest, and applying these to perform enhancements like denoising, super-resolution, and interpolation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video resolution is increased using only original video data, then resolution is improved, but the enhancement quality deteriorates due to insufficient information

Engineering Contradiction:
Improvevideo resolutionVSAvoidpixel information
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent combines multiple related images (photographs, videos from different cameras or angles) to enhance the target video. By merging information from these multiple sources, the system obtains sufficient pixel data to perform high-quality resolution enhancement and other video improvements that would be impossible using only the original low-resolution video data.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses related images as intermediary materials to transfer useful information to the target video. These related images serve as mediators that contain additional scene information, which is then integrated into the video enhancement process through various processing techniques to produce the final enhanced video output.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If related images are used to enhance video, then video quality is improved, but processing complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the video enhancement process into distinct operational modules: selecting related images based on temporal or spatial criteria, extracting useful information from these images, applying enhancement operations (denoising, super-resolution, interpolation), and combining results. This segmentation allows the complex enhancement task to be managed through systematic, modular processing steps.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9196021B2Video enhancement using related content
Publication Date: 2015.11.24 ADOBE INC
  • US9196021B2 patent drawing
  • US9196021B2 patent drawing
  • US9196021B2 patent drawing

AI summary

A method and systems of enhancing a video using a related image are provided. One or more patches are identified in the video, with each patch identifying a region that is present in one of the frames of the video that can be mapped to a similar region in at least one other frame of the video. For each identified patch in the video, a best matching patch in the related image is found. The video is enhanced using the best matching patch in the related image for each identified patch in the video.