Dynamic Focus Control in Light Field Reconstruction Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing techniques fail to easily adjust the focused state of a reconstruction image after enlargement or reduction operations, leading to inconsistencies with user intentions regarding subject sharpness and depth of field.

Innovation Solution

An image processing apparatus and method that allows dynamic control of the focused state during display operations by generating and managing reconstruction images based on user inputs for enlarged or reduced displays, using light field data to adjust the subject distance focus accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a reconstruction image is enlarged for checking subject details, then the ability to view subject sharpness is improved, but the focused state becomes inconsistent with user intention

Engineering Contradiction:
Improvesubject sharpnessVSAvoidfocused state control
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies dynamics by enabling the focal plane to move dynamically in response to user interactions. When a user enlarges a specific region, the system automatically adjusts the focal plane position to maintain focus on the desired subject, making the focused state adaptable rather than fixed. This resolves the contradiction by allowing the system to dynamically preserve user intention while enabling enlargement for detail inspection.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback by detecting user operations (enlargement/reduction) and automatically adjusting the focal plane position accordingly. The control unit monitors user actions and modifies the reconstruction image's focused state in real-time, providing feedback that maintains consistency between user intention and displayed focus state. This feedback mechanism ensures that enlargement operations do not lose the intended focused state.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the focused state is changed during enlarged display to match user intention, then the visual recognition accuracy is improved, but the operation complexity increases

Engineering Contradiction:
Improvevisual recognition accuracyVSAvoidcontrol processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies self-service by automatically adjusting the focal plane position based on detected user operations without requiring manual intervention. The control unit autonomously determines when and how to shift focus based on enlargement/reduction actions, eliminating the need for users to manually control focus adjustments. This self-adjusting mechanism improves visual recognition accuracy while avoiding the complexity of additional manual control interfaces.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If multiple reconstruction images with different focused states are managed, then the adaptability to user needs is improved, but the data management complexity increases

Engineering Contradiction:
Improvefocused state adjustmentVSAvoidimage management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies universality by enabling a single reconstruction image to serve multiple focused states through dynamic focal plane adjustment. Rather than managing multiple separate images, the system allows one image to adaptively change its focused state based on user operations. This multi-functional approach provides adaptability to different user needs while avoiding the complexity of managing multiple image files.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to easily view reconstruction images in desired focused states, maintaining intended sharpness and depth of field settings even after display magnification changes, ensuring consistent user experience.

Implementation Method 1

light flux, that has passed through different divided pupil regions of an imaging lens, into an image on pixels (photoelectric conversion elements) of an imaging element

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentEP3570533B1Image processing apparatus, control method, program, and recording medium
Publication Date: 2024.12.11 CANON KK
  • EP3570533B1 patent drawingFigure 1
  • EP3570533B1 patent drawingFigure 2~3
  • EP3570533B1 patent drawingFigure 4A~5

AI summary

An image processing apparatus includes a determining means that determines a subject distance of one of reconstruction images to be generated as a subject distance in which a subject in a region where enlarged display is to be performed is focused in a case where an instruction related to enlarged display is received, and display control means that causes a displaying medium to display one of the reconstruction images generated by a generating means based on the subject distance that is determined by the determining means.