Parallel Upsampling Circuit for Video Frame Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High definition displays struggle to effectively utilize Standard Definition media due to insufficient pixels, resulting in lost detail and information, particularly in older content captured in lower resolution.

Innovation Solution

The implementation of parallel processing techniques for upscaling lower resolution frames to higher resolution, utilizing motion estimation and back projection methods to estimate and enhance frame quality, including motion-compensated and motion-free back projection processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If standard definition media is displayed on high definition displays, then the display resolution is improved, but the image quality and detail are lost due to insufficient pixels

Engineering Contradiction:
Improvedisplay resolutionVSAvoidimage detail
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system performs preliminary actions by capturing multiple low-resolution frames at different time points before the final display. These pre-captured frames are stored and later processed using motion estimation and back projection techniques to reconstruct high-resolution images, thereby preparing the necessary data in advance to avoid information loss during display.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transitions from spatial dimension alone to temporal dimension by capturing frames at multiple time points. By utilizing motion estimation across time and back projection, the system reconstructs high-resolution images from temporal sequences of low-resolution frames, effectively adding a time dimension to the upsampling process.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple low resolution frames are processed to create high resolution frames, then the image quality is improved, but the processing time and computational complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The processing system is divided into specialized modules: motion estimation module, back projection module, and frame combination module. Each module handles specific tasks independently, allowing parallel processing of multiple frames and reducing overall processing time while maintaining high image quality through systematic decomposition of the complex reconstruction task.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts processing parameters based on motion detection. When motion is detected between frames, motion-compensated back projection is applied; when no significant motion occurs, simpler processing methods are used. This dynamic adaptation optimizes processing speed while maintaining image quality across varying scene conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9449367B2Parallel processor for providing high resolution frames from low resolution frames
Publication Date: 2016.09.20 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US9449367B2 patent drawing
  • US9449367B2 patent drawing
  • US9449367B2 patent drawing

AI summary

Presented herein are caching structures and apparatus for use in block based video. In one embodiment, there is described a system receiving lower resolution frames and generating higher resolution frames. The system comprises an upsampling circuit, a first circuit, and a second circuit. The upsampling circuit upsamples a particular lower resolution frame, thereby resulting in an upsampled frame. The first circuit maps frames that are proximate to the particular frame, to the particular frame. The second circuit simultaneously updates the upsampled frame with two or more blocks from at least one of the frames that are proximate to the particular frame.