Imaging Apparatus Refocusability Determination Using Distance and Pupil Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems, such as single lens reflex cameras and light-field cameras, require significant time and data to determine if an object is at a refocusable position, necessitating a mirror-up action and surplus time for focus determination, which can delay image capture.

Innovation Solution

An imaging apparatus with multiple photoelectric converting units and a determining unit that uses distance information to assess whether an object is within a refocusable range, allowing for controlled image pickup without the need for mirror-up operations, utilizing a combination of pupil division construction and image processing to determine refocusability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a mirror-up action is performed to input light into the image pickup device for video image, then the refocusability determination can be made, but the time required for image capture increases due to the surplus time needed for mirror-up operation

Engineering Contradiction:
Improverefocusability determination accuracyVSAvoidtime required for image capture
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs refocusability determination in advance before the actual image capture by using distance information from the TOF sensor and pupil division data from the image pickup device. This preliminary determination allows the system to decide whether to proceed with image capture without waiting for mirror-up operations, thereby reducing the time required for image capture while maintaining accurate refocusability assessment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical mirror-up action with an information-based determination system. Instead of physically moving the mirror to redirect light, the system uses distance information from the TOF sensor and optical data from the image pickup device to calculate and determine refocusability, eliminating the time-consuming mechanical operation while maintaining measurement accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If refocus processing is performed after shooting to determine if the object exists at a refocusable position, then the determination can be made using light-field camera data, but significant time and data processing resources are required

Engineering Contradiction:
Improverefocusability determination accuracyVSAvoiddata processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent performs refocusability determination before the actual image capture by calculating the maximum refocus amount in advance using distance information from the TOF sensor and pupil division data. This preliminary calculation determines whether the object is within the refocusable range without requiring time-consuming post-shot refocus processing, significantly improving data processing efficiency while maintaining determination accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the essential information needed for refocusability determination from the complete light-field data. Instead of processing all the data from refocus processing after shooting, the system extracts only the critical distance information from the TOF sensor and key optical parameters from the image pickup device to make the determination, reducing data processing requirements while maintaining accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If distance information is obtained from the output of the image pickup device for video image, then the refocusability can be determined, but the complexity of the system increases due to the need for additional processing units and data handling

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the image pickup device serve multiple functions: it not only captures video images but also provides distance information for refocusability determination through its pupil division construction. The same optical path and sensor array are used for both imaging and distance measurement, eliminating the need for separate dedicated distance measurement devices and reducing overall system complexity while maintaining measurement accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the distance measurement function with the image pickup function by using the same optical system and sensor array. The TOF sensor and image pickup device work together to provide both distance information and optical data from the same captured light, merging what would traditionally be separate systems into a unified apparatus that reduces complexity while maintaining precision.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution reduces the time required for image capture by eliminating the need for mirror-up operations and enables immediate determination of refocusability, enhancing the efficiency of image pickup and focus adjustment.

Implementation Method 1

an image pickup unit having a plurality of photoelectric converting units for receiving light fluxes from an object that has passed through different pupil areas

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 2

there is a Time-of-Flight (TOF) method whereby, after an object is irradiated with light pulses, a time that is required until reflection light from the object is received by an image pickup device is measured, and a distance is calculated

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS9967451B2Imaging apparatus and imaging method that determine whether an object exists in a refocusable range on the basis of distance information and pupil division of photoelectric converters
Publication Date: 2018.05.08 CANON KK
  • US9967451B2 patent drawing
  • US9967451B2 patent drawing
  • US9967451B2 patent drawing

AI summary

An imaging apparatus includes an image pickup device having a plurality of photoelectric converters that receive light fluxes from an object that have passed through different pupil areas. A distance information generator detects light from the object and generates distance information regarding a distance of the object. The distance information generator is different from the image pickup device. A determining unit determines whether or not the object exists in a refocusable range in a process to an image signal obtained by an image pickup of the image pickup device, after the image pickup, on the basis of the distance information and a pupil division construction of the plurality of photoelectric converters. A control unit controls the image pickup of the object by the image pickup device in accordance with a result of the determination by the determining unit.