Image Processing Apparatus Optical Zoom Scale Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When a subject is scaled up using digital zoom followed by optical zoom, the resolution of the foreground image in a synthesis image is lowered, leading to a deteriorated image quality.

Innovation Solution

An image processing apparatus that performs scale transformation using optical zoom to maintain the resolution of the actual image in the synthesis image, by adjusting the scale transformation to prevent image clipping and using a scale transformation adjustment unit to determine the optimal optical scale component, ensuring that the optical zoom does not cause resolution deterioration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If digital zoom is used to scale up the subject, then the scaling operation can be performed quickly, but the resolution of the foreground image is lowered

Engineering Contradiction:
Improvescaling speedVSAvoidimage resolution
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent divides the scaling operation into two distinct segments: optical zoom scaling (which maintains resolution) and digital zoom scaling (which provides additional magnification). By segmenting the scaling function between these two methods, the system achieves both high resolution and scaling capability, resolving the contradiction between speed and resolution.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If optical zoom is used to scale up the subject, then the resolution is maintained, but image clipping may occur and the scaling is slower

Engineering Contradiction:
Improveimage resolutionVSAvoidscaling flexibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent dynamically adjusts the scaling parameters by calculating optimal optical scale components based on the desired zoom level and image dimensions. This dynamic adjustment allows the system to maximize optical zoom usage while preventing image clipping, providing both resolution maintenance and operational flexibility.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If only one image pickup unit is used, then the device complexity is reduced, but it is difficult to achieve both high resolution and prevent image clipping

Engineering Contradiction:
Improvenumber of image pickup unitsVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent changes the parameters of the single image pickup unit by dynamically adjusting optical scale components, zoom levels, and coordinate transformation parameters. By optimizing these parameters, the system achieves high-quality image synthesis with a single pickup unit, avoiding the need for multiple units while maintaining manufacturing precision.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10867365B2Image processing apparatus, image processing method, and image processing system for synthesizing an image
Publication Date: 2020.12.15 SONY GROUP CORP
  • US10867365B2 patent drawing
  • US10867365B2 patent drawing
  • US10867365B2 patent drawing

AI summary

A scale transformation adjustment unit performs a scale transformation corresponding to a change of an image range with respect to an actual image by using a scale transformation by an optical zoom of an image pickup unit that generates the actual image, and generates a coordinate transformation matrix including the scale transformation.