Pixel Shifting Super-Resolution Circuit for Moving Object Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques fail to effectively synthesize multiple images to generate a high-resolution composite image, particularly when objects move within the photographing range, leading to incomplete pixel data and reduced synthesis accuracy.

Innovation Solution

An image processing apparatus that aligns and arranges pixels from multiple images in a high-resolution image space, evaluates pixel filling rates, and determines optimal areas for synthesis, using pixel filling rate evaluation values to ensure accurate alignment and interpolation, thereby enhancing the synthesis accuracy of composite images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If pixel shifting super-resolution is used to generate high-resolution composite images, then image resolution is improved, but synthesis accuracy deteriorates when objects move within the photographing range

Engineering Contradiction:
Improveimage resolutionVSAvoidsynthesis accuracy
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The image is divided into multiple evaluation areas, and pixel filling rates are calculated for each area separately. This segmentation allows the system to identify specific regions with moving objects and handle them differently, preventing moving objects from degrading the overall synthesis accuracy while maintaining high resolution in stable areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different evaluation criteria to different regions of the image. By calculating pixel filling rates locally for each evaluation area and comparing them against thresholds, the system adapts its synthesis approach to local conditions, ensuring high accuracy in stable regions while identifying and excluding regions with moving objects.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If multiple images are synthesized to generate high-resolution composite images, then image detail is improved, but pixel data completeness deteriorates in areas with moving objects

Engineering Contradiction:
Improveimage detailVSAvoidpixel data completeness
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The system calculates pixel filling rates as feedback information to assess data completeness in each evaluation area. This feedback mechanism allows the system to identify areas where moving objects cause data loss and adjust the synthesis process accordingly, preventing incomplete data from degrading the overall image quality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary evaluation of pixel filling rates before final image synthesis. By assessing data completeness in advance and identifying areas with insufficient pixel data due to moving objects, the system can prepare appropriate handling strategies, such as excluding problematic areas or applying specialized interpolation methods.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10861135B2Image processing apparatus, non-transitory computer-readable recording medium storing computer program, and image processing method
Publication Date: 2020.12.08 OLYMPUS CORPORATION(JP)
  • US10861135B2 patent drawing
  • US10861135B2 patent drawing
  • US10861135B2 patent drawing

AI summary

An image processing apparatus including a pixel shifting super-resolution image generation circuit configured to generate a high-resolution composite image from a plurality of images, an evaluation area setting circuit configured to set a plurality of evaluation areas within an area extraction range of the composite image, a synthesis accuracy evaluation circuit configured to evaluate, for each of the plurality of evaluation areas, a pixel filling rate for the evaluation area and calculate a plurality of pixel filling rate evaluation values, and a determination circuit configured to determine a determination area from among the plurality of evaluation areas based on the plurality of pixel filling rate evaluation values.