Luminance Correction Circuit Weighted Frame Averaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video signal processing techniques fail to effectively suppress luminance changes in video signals with temporal changes, leading to issues like flicker and unnatural motion blur.

Innovation Solution

A video signal processing apparatus that uses a luminance correction circuit to multiply and average video signals of sequential frames with individually set weight coefficients, where the weight coefficient for the reference frame is maximum, and coefficients for other frames decrease with distance, allowing for customizable weight coefficient sets and motion-based adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If video signals of multiple sequential frames are added and averaged with equal weights to suppress luminance changes, then flicker correction is achieved, but motion blur becomes unnatural and uniform across all frames

Engineering Contradiction:
ImproveflickerVSAvoidmotion blur naturalness
Core Design Contradiction:
Object-affected harmful factorsVSShape

Solution Approach 1:

The patent applies different weight coefficients to different frames in the averaging process. Specifically, frames closer to the reference frame are given higher weights while frames farther away receive lower weights. This creates a non-uniform weighting scheme that preserves natural motion blur characteristics in regions closer to the reference frame while still suppressing flicker through the averaging of multiple frames with varying weights.

Inventive Principle:
Principle #3Local quality

2Device complexity

If a fixed number of frames M is used for averaging, then processing simplicity is maintained, but adaptability to different motion speeds and lighting conditions is reduced

Engineering Contradiction:
Improveprocessing complexityVSAvoidadaptability to motion and lighting conditions
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic weight coefficient adjustment based on motion detection. The system detects motion between frames and automatically adjusts the weight coefficients accordingly. When motion is detected, frames with larger temporal distances from the reference frame are assigned smaller weights, while in static scenes, equal weighting can be used. This dynamic adaptation allows the same processing framework to handle both static and moving subjects effectively without increasing fundamental processing complexity.

Inventive Principle:
Principle #15Dynamics

3Productivity

If equal weight coefficients are applied to all frames, then the processing is simple and fast, but the correction intensity is uniform and cannot be tailored to different frames

Engineering Contradiction:
Improveprocessing speedVSAvoidcorrection intensity variation
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent changes the parameter of weight coefficients from uniform to variable based on frame position. The weight coefficient for each frame is determined by its temporal distance from the reference frame, creating a gradient where closer frames have higher weights and farther frames have lower weights. This parameter variation enables tailored correction intensity for different frames while maintaining computational efficiency through a systematic weighting scheme rather than frame-by-frame analysis.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10412336B2Video signal processing apparatus, video signal processing method, and program for video signal correction
Publication Date: 2019.09.10 SONY GROUP CORP
  • US10412336B2 patent drawing
  • US10412336B2 patent drawing
  • US10412336B2 patent drawing

AI summary

This video signal processing apparatus includes a luminance correction circuit that multiplies video signals of M sequential frames by weight coefficients individually set for frames respectively ordered in the M frames, M being plural, and adds and averages results, to generate a correction video signal of a frame in a predetermined order in the M frames, a value of a weight coefficient set for the frame in the predetermined order being set to be maximum among values of the weight coefficients individually set for the frames respectively ordered in the M frames.