Wide-Angle Image Synthesis Using Third Camera Region Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wide-angle images generated from multiple-lens cameras often suffer from double images of subjects due to varying amounts of shift between images, leading to decreased visibility, especially when subjects at different distances are imaged.

Innovation Solution

An image processing apparatus that includes a synthesis processing unit to adjust the positional shift between images from overlapping imaging units, using a third imaging unit to extract a region of interest and apply pattern matching techniques to generate a high-definition wide-angle image, thereby reducing the likelihood of double images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a wide-angle image is generated by shifting images captured by multiple-lens cameras so that specific subjects overlap, then the imaging range is expanded, but other subjects appear as double images reducing visibility

Engineering Contradiction:
Improveimaging rangeVSAvoidvisibility of wide-angle image
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent applies local quality by differentiating the treatment of different regions in the synthesized image. The synthesis processing unit identifies a region of interest (where the third imaging unit captures images) and applies different shift adjustment strategies: in the region of interest, shifts are adjusted to prevent double images of important subjects, while in other regions, shifts are adjusted to maximize imaging range expansion. This localized differentiation resolves the contradiction between expanding imaging range and maintaining visibility.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If images with different amounts of shift are synthesized to make specific subjects overlap, then subject alignment is improved, but other subjects at different distances appear as double images

Engineering Contradiction:
Improvesubject alignment accuracyVSAvoiddouble images of other subjects
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent implements local quality by applying different shift adjustment criteria to different spatial regions. For the region of interest (identified via the third imaging unit), the synthesis processing prioritizes preventing double images of important subjects by adjusting shifts based on that region's characteristics. For other regions, the system allows greater shift variation to maintain subject alignment accuracy where it matters most, thereby reducing double images of other subjects while preserving overall alignment precision.

Inventive Principle:
Principle #3Local quality

3Reliability

If a third imaging unit is added to extract region of interest and adjust positional shifts, then image quality and visibility are improved, but device complexity increases

Engineering Contradiction:
Improveimage quality and visibilityVSAvoidnumber of imaging units
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The third imaging unit serves as an intermediary device that captures images of important subjects to define the region of interest. This intermediary information is then used by the synthesis processing unit to guide the shift adjustment of images from the first and second imaging units. The third imaging unit doesn't directly contribute to the final wide-angle image but mediates the synthesis process by providing reference information, thereby improving image quality while maintaining a manageable device complexity through functional specialization.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11301955B2Image processing apparatus, imaging apparatus, method for controlling image processing apparatus and recording medium
Publication Date: 2022.04.12 CANON KK
  • US11301955B2 patent drawing
  • US11301955B2 patent drawing
  • US11301955B2 patent drawing

AI summary

Provided are a synthesis processing configured to that synthesize a first image acquired by a first imaging unit and a second image acquired by a second imaging unit of which an imaging range overlaps a part of an imaging range of the first imaging unit and generates a wide-angle image and an extraction unit configured to extract a region of interest within an imaging range in which the first imaging unit and the second imaging unit perform overlapping imaging on the basis of at least one of a third image, acquired by a third imaging unit, which includes at least a part of the imaging range in which the first imaging unit and the second imaging unit perform overlapping imaging in an imaging range thereof and a state of the third imaging unit when the third image is captured. The synthesis processing unit adjusts an amount of positional shift between the first image and the second image in the region of interest, and generates the wide-angle image.