Motion Detection in Images Using Intensity Ratios to Suppress Flicker Noise

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in accurately detecting motion in images captured under fluorescent lighting, as flicker noise often leads to erroneous detection due to periodic brightness variations, and previous methods either introduce latency or restrict exposure settings, failing to effectively cope with spatial light source variations.

Innovation Solution

An image processing device that calculates an intensity ratio of signal values under different exposure conditions to distinguish between motion and periodic noise, using a conversion coefficient to convert flicker noise from one image to another, allowing for accurate motion detection without frame memory and flexible exposure settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion detection is performed using conventional methods in images captured under fluorescent lighting, then motion detection can be performed, but flicker noise causes erroneous detection and reduces measurement precision

Engineering Contradiction:
Improvemotion detection accuracyVSAvoidflicker noise influence
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent segments the image into multiple regions and performs motion detection independently in each region. By dividing the image processing into smaller units, the system can identify and exclude flicker-affected regions from motion detection, thereby improving overall detection accuracy while mitigating the harmful effects of flicker noise.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If frame memory is used to hold previous frames for motion detection, then motion detection can be performed, but device complexity and latency increase

Engineering Contradiction:
Improvemotion detection capabilityVSAvoidframe memory requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary information (motion detection data) from the image processing pipeline without requiring storage of complete previous frames. By extracting and processing only relevant motion information in real-time, the system achieves motion detection capability while eliminating the need for complex frame memory structures.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If exposure is controlled to be an integral multiple of flicker period, then flicker influence is reduced, but exposure flexibility is restricted

Engineering Contradiction:
Improveflicker suppressionVSAvoidexposure setting flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies different processing strategies to different regions of the image based on their flicker characteristics. Rather than uniformly controlling exposure across the entire image, the system identifies regions affected by flicker and applies targeted correction methods, thereby maintaining exposure flexibility while achieving flicker suppression where needed.

Inventive Principle:
Principle #3Local quality

4Measurement precision

If multiple frames with equal flicker phases are used for motion detection, then flicker influence is reduced, but latency increases due to frame holding

Engineering Contradiction:
Improvemotion detection accuracyVSAvoiddetection latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary identification of flicker-affected regions and applies correction factors in advance during the image processing pipeline. By pre-processing the image data to compensate for flicker effects before motion detection, the system achieves accurate motion detection without needing to wait for multiple frames with equal flicker phases, thereby reducing latency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10298843B2Image processing device, image processing method, and electronic apparatus for motion detection in image
Publication Date: 2019.05.21 SONY SEMICON SOLUTIONS CORP
  • US10298843B2 patent drawing
  • US10298843B2 patent drawing
  • US10298843B2 patent drawing

AI summary

The present technology relates to an image processing device, image processing method, electronic apparatus, and program, capable of performing motion detection allowing the effects by periodic noise such as flicker to be reduced. An image processing device includes an intensity ratio calculation unit configured to calculate a ratio relating to an intensity of a signal value at a predetermined position in an image captured under different exposure conditions, and a contribution calculation unit configured to calculate a contribution indicating whether an intensity ratio calculated by the intensity ratio calculation unit is derived from a periodic noise component or is derived from motion. The periodic noise is, for example, flicker. The intensity ratio calculation unit calculates the intensity ratio from one image captured using an image sensor in which pixels for which the different exposure conditions are set exist together. The present technology is applicable to an imaging device.