Image Processing Apparatus Adaptive Subregion Phase Change Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The computation complexity in video magnification increases significantly due to detecting phase changes for all regions of moving image frames, especially with higher resolutions and more frames, leading to increased processing time.

Innovation Solution

An image processing apparatus that detects phase changes in subregions of edge images with specific resolutions, adjusts the change amount, and decides new subregions based on adjusted and unadjusted edge images, using a change detection unit, adjustment unit, and region decision unit to optimize processing by reducing redundant feature detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If phase changes are detected for all regions of moving image frames, then measurement precision of subtle motion change is improved, but computation complexity increases significantly

Engineering Contradiction:
Improvedetection precision of subtle motion changeVSAvoidcomputation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image processing apparatus divides the frame into multiple regions and selectively detects phase changes only in regions where subtle motion changes are present, rather than processing all regions uniformly. This segmentation approach maintains detection precision for subtle motions while reducing overall computation complexity by excluding regions without such changes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The apparatus applies different processing quality levels to different regions: high-precision phase change detection is applied only to regions containing subtle motion changes, while other regions receive reduced or no processing. This local quality differentiation preserves measurement precision where needed while reducing computation complexity in regions where it is not required.

Inventive Principle:
Principle #3Local quality

2Reliability

If phase changes are detected for all regions of moving image frames, then detection completeness is improved, but processing speed decreases

Engineering Contradiction:
Improvedetection completenessVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

By segmenting the frame into multiple regions and identifying only those containing subtle motion changes, the apparatus maintains detection completeness for relevant motions while significantly reducing the number of regions requiring detailed phase change analysis, thereby improving processing speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The apparatus performs partial action by detecting phase changes only in necessary regions rather than all regions. This selective approach maintains sufficient detection completeness for subtle motion changes while reducing overall processing time and computational load.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If image resolution is increased, then measurement precision of phase change is improved, but computation complexity increases

Engineering Contradiction:
Improvephase change detection precisionVSAvoidcomputation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The apparatus processes the image at different resolution levels for different regions. High-resolution phase change detection is applied only to regions containing subtle motion changes, while other regions are processed at lower resolutions or skipped entirely. This segmentation by resolution maintains measurement precision where needed while reducing overall computation complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing qualities (resolution levels) are applied locally to different regions based on their content. Regions with subtle motion changes receive high-resolution processing for precise detection, while regions without such changes receive lower-resolution processing, optimizing the balance between measurement precision and computation complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11734835B2Image processing apparatus, image processing method, and program
Publication Date: 2023.08.22 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11734835B2 patent drawing
  • US11734835B2 patent drawing

AI summary

An image processing apparatus includes a change detection unit configured to detect a phase change having a predetermined amount of change from phase changes in a subregion of an edge image having a predetermined resolution, a change amount adjustment unit configured to adjust the amount of change of the detected phase change, an adjusted image generation unit configured to generate an edge image having the predetermined resolution in which the amount of change of a motion change is adjusted based on the phase change in which the amount of change of the phase change is adjusted, and a region decision unit configured to decide a new subregion of an edge image having a new predetermined resolution based on the edge image having the predetermined resolution in which the amount of change of the motion change is not adjusted and the edge image having the predetermined resolution in which the amount of change of the motion change is adjusted.