Image Processing Apparatus Depth Combining In-Focus Sorting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in correctly sorting images for depth combining, especially when information about the order of picked-up images is not correctly recorded or lost, leading to issues like perspective conflicts where rear objects are seen through front objects due to incorrect in-focus positional relationships.

Innovation Solution

An image processing apparatus that acquires images with overlapping angles of view and varying in-focus positions, determines a rearrangement method based on recorded information, and sorts images to generate a combined image by extracting in-focus areas and applying a composite ratio to prevent perspective conflicts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If depth combining is performed using existing technology, then combined image quality can be improved, but perspective conflicts occur when image order information is lost or incorrectly recorded

Engineering Contradiction:
Improvecombined image qualityVSAvoidimage sorting accuracy
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by determining the in-focus position of each image immediately after acquisition and storing this information in association with the image data. This preliminary determination of in-focus positions enables subsequent correct sorting even when the original pickup order information is lost or incorrect, preventing perspective conflicts in the final combined image.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If multiple images are acquired for depth combining, then focusing coverage can be improved, but device complexity increases due to image management requirements

Engineering Contradiction:
Improvefocusing coverageVSAvoidimage management complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by using in-focus position information as a key parameter for image management. Instead of managing multiple images based on complex temporal sequences or metadata, the system transforms the management approach to use in-focus position (a physical parameter) as the organizing principle, simplifying the sorting and combining process while maintaining comprehensive focusing coverage.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11127118B2Image processing apparatus, image pickup apparatus, control method to control an image processing apparatus, and storage medium
Publication Date: 2021.09.21 CANON KK
  • US11127118B2 patent drawing
  • US11127118B2 patent drawing
  • US11127118B2 patent drawing

AI summary

An image processing apparatus includes at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: acquire a plurality of images having angles of view that at least partially overlap each other and varying in in-focus positions, and information corresponding to each of the plurality of images; determine a rearrangement method for rearranging the plurality of images in order of the in-focus positions based on the information; rearrange the plurality of images using the rearrangement method; and generate a combined image by extracting areas in focus from the plurality of images and performing the combining based on the extracted areas.