Event-Based Sensor Luminance Change Direction Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In applications where event-based sensors detect periodic motion at high speeds, distinguishing between normal and abnormal operations is challenging due to small differences in luminance changes, making it difficult for users to visually identify abnormalities.

Innovation Solution

An information processing apparatus that acquires and processes address event signals to determine the position and time of luminance changes, generates images indicating the direction of changes, and controls display based on evaluation values, allowing for the differentiation between normal and abnormal operations by canceling superimposed displays for high-frequency pixels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If event-based sensors detect periodic motion at high speeds, then motion detection capability is improved, but the ability to distinguish between normal and abnormal operations deteriorates due to small differences in luminance changes

Engineering Contradiction:
Improvemotion detection speedVSAvoidability to distinguish normal and abnormal operations
Core Design Contradiction:
SpeedVSDifficulty of detecting and measuring

Solution Approach 1:

The patent changes the parameter of luminance change direction (positive/negative) and frequency (evaluation value) to create distinct visual patterns. By displaying different colors for positive and negative luminance changes and using frequency thresholds to differentiate normal from abnormal operations, the system transforms subtle luminance variations into clearly distinguishable visual signals that enable users to easily identify abnormalities even during high-speed motion.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If all luminance changes are displayed equally, then complete motion information is preserved, but abnormal operations become difficult to identify due to visual clutter from frequent normal operations

Engineering Contradiction:
Improvemotion information completenessVSAvoidabnormal operation identification
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by differentiating the display characteristics based on the evaluation value (frequency of luminance changes in the same direction). Pixels with high evaluation values (normal operations) are displayed with one characteristic (suppressed display), while pixels with low evaluation values (abnormal operations) are displayed with another characteristic (highlighted display). This localized differentiation allows the system to maintain information completeness while making abnormalities visually distinct.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of highlighting normal operations and suppressing abnormal ones (conventional approach), the patent inverts the approach by suppressing frequent normal operations and highlighting rare abnormal operations. This inversion makes abnormalities stand out more prominently against the background of normal motion, solving the identification problem.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS11735140B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2023.08.22 CANON KK
  • US11735140B2 patent drawing
  • US11735140B2 patent drawing
  • US11735140B2 patent drawing

AI summary

An apparatus includes an acquisition unit configured to acquire a signal that indicates a position of a pixel where a change in luminance has occurred and a time when the change in luminance has occurred, a determination unit configured to determine, on a pixel-by-pixel basis, an evaluation value corresponding to a frequency at which a change in luminance in a predetermined direction has occurred, based on the signal, a generation unit configured to generate an image indicating a direction of the change in luminance at the position of the pixel where the change in luminance has occurred, and a control unit configured to control display of the generated image based on the evaluation value.