Event-Based Imaging with Periodic Optical Motion for Image Confirmation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Event-based sensors do not output event signals in cases where no luminance change occurs, preventing users from confirming the image.

Innovation Solution

An image processing apparatus that includes an image sensor to detect luminance changes exceeding a threshold, a drive unit to manipulate optical members, and a processor to process event signals while controlling focus lenses, ensuring event signals are generated even in the absence of luminance changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If an event-based sensor is used to detect luminance changes, then latency is reduced and time resolution is improved, but no event signal is output when no luminance change occurs, preventing users from confirming the image

Engineering Contradiction:

ImprovelatencyVSAvoidimage confirmation capability

Core Design Contradiction:

Loss of timeVSLoss of information

Solution Approach 1:

The drive unit performs periodic driving of the optical member at a predetermined frequency to generate luminance changes, which triggers the event-based sensor to output event signals at regular intervals, enabling image confirmation while maintaining low latency

Inventive Principle:

Principle #19Periodic action

2Measurement precision

If an event-based sensor is used to detect luminance changes, then time resolution is improved, but the sensor does not output event signals in static conditions, making image confirmation impossible

Engineering Contradiction:

Improvetime resolutionVSAvoidimage confirmation

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The drive unit performs preliminary periodic driving of the optical member to proactively generate luminance changes before the user needs to confirm the image, ensuring that event signals are always available for output regardless of scene static conditions

Inventive Principle:

Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of event images at desired timings, allowing users to confirm images and perform operations while ensuring low latency and high time resolution.

Implementation Method 1

An image sensor configured to detect an event in a case where a luminance change for each pixel exceeds a predetermined threshold value

Methodology Applied

Scientific EffectLuminance change detection: Photoelectric Effect

Implementation Method 2

a drive unit configured to drive at least one of an optical member constituting at least a part of an imaging optical system and the image sensor so that the luminance change exceeds the predetermined threshold value

Methodology Applied

Scientific EffectOptical imaging: Lens

Data Source

PatentUS20250227385A1Image processing apparatus, image pickup apparatus, image processing method, and storage medium

Publication Date: 2025.07.10 CANON KK

AI summary

An image processing apparatus includes an image sensor configured to detect an event in a case where a luminance change for each pixel exceeds a predetermined threshold value, and to output an event signal including information on a time of the event and a pixel position at which the event has occurred, a drive unit configured to drive at least one of an optical member constituting at least a part of an imaging optical system and the image sensor so that the luminance change exceeds the predetermined threshold value, and a processor configured to process the event signal output from the image sensor while the drive unit drives the at least one of the optical member or the image sensor, and control a focus lens in the imaging optical system based on a processed image.