Image Processor Motion-Based Luminance Histogram Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies struggle to enhance the contrast of moving objects, such as people and cars, making them difficult to distinguish in surveillance systems, especially when they are in environments with varying luminance levels.

Innovation Solution

An image processing apparatus that determines the amount of motion and high-frequency component levels within an image, generates a weighted luminance histogram, and adjusts the tone curve to prioritize contrast enhancement for moving objects with high motion and high-frequency components, thereby increasing their visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If luminance tones are preferentially allocated to regions with high luminance frequency (large area), then the overall image luminance distribution is improved, but the contrast of moving objects with small area is lowered

Engineering Contradiction:
Improveluminance distributionVSAvoidobject contrast
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by differentiating treatment between regions based on their characteristics. It identifies moving objects through motion detection and frequency analysis, then applies enhanced luminance allocation specifically to these identified regions rather than uniformly across the entire image. This ensures that small moving objects receive appropriate luminance attention despite their limited area.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by making the luminance allocation strategy adaptive rather than static. It continuously monitors motion information and frequency characteristics to dynamically adjust which regions receive preferential luminance treatment. This allows the system to respond to changing scene conditions and maintain optimal contrast for moving objects throughout the video sequence.

Inventive Principle:
Principle #15Dynamics

2Quantity of substance

If a tone curve with steep slope is used in the middle luminance portion, then luminance tones are concentrated in the middle portion, but the image becomes unclear with small brightness difference

Engineering Contradiction:
Improveluminance concentrationVSAvoidimage clarity
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting tone curve characteristics based on detected motion and frequency information. Instead of using a fixed steep-slope tone curve, it modifies the tone curve parameters (slope, curvature, distribution) according to the specific characteristics of moving objects in each scene, thereby maintaining image clarity while concentrating luminance tones where needed.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11310440B2Image processing apparatus, surveillance camera system, and image processing method
Publication Date: 2022.04.19 SONY GROUP CORP
  • US11310440B2 patent drawing
  • US11310440B2 patent drawing
  • US11310440B2 patent drawing

AI summary

An image processing apparatus includes an image processor. The image processor inputs image data, determines an amount of motion within an image on the basis of the image data, and corrects and outputs a luminance of the image data such that a contrast of an object whose amount of motion is large increases.