Stable Shake Correction for Frame-Sequential RGB Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies for frame-sequential moving images struggle with accurate shake correction across multiple color channels, leading to color shifts and inaccuracies in generating stable and synchronized RGB-format moving-image frames.

Innovation Solution

A frame-sequential-type image processing device and method that calculates movement amounts and shake correction amounts for each color channel, using a stable-shake-correction-amount calculating unit to combine shake correction data across channels, reducing positional differences and color shifts by weighting shake correction amounts from different channels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If shake correction processing is performed separately for each color channel based on individual movement amounts, then shake correction can be applied to each channel, but color shifts occur due to positional differences between channels

Engineering Contradiction:
Improveshake correction accuracyVSAvoidcolor alignment precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent combines shake correction amounts from multiple color channels (R, G, B) into a single integrated correction value. The stable shake correction amount calculation unit merges the shake correction amounts calculated for each channel, using weighted averaging or median selection to produce a unified correction value that is applied to all channels, thereby eliminating color shifts caused by independent channel corrections.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The stable shake correction amount calculation unit acts as an intermediary between the individual channel shake correction calculations and the final composite image generation. It receives shake correction amounts from each color channel, processes them to determine a stable correction value, and outputs this unified correction amount to be applied consistently across all channels, mediating the conflict between channel-specific correction and color alignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If movement amounts are calculated from latest frame and past frame in the same color channel, then accurate channel-specific motion detection is achieved, but synchronization errors occur between color channels

Engineering Contradiction:
Improvemovement amount accuracyVSAvoidframe synchronization reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements a universal shake correction amount that serves all color channels simultaneously. Instead of maintaining separate correction amounts for each channel, the stable shake correction amount calculation unit produces a single correction value that is universally applied to R, G, and B frames, ensuring that the same correction is used across all channels to maintain synchronization while still benefiting from accurate per-channel movement detection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If shake correction amounts are calculated independently for each color channel, then processing can be simplified, but color shifts and instability increase

Engineering Contradiction:
Improveprocessing complexityVSAvoidshake correction stability
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The patent performs preliminary calculation of shake correction amounts for each color channel before combining them. The movement amount calculation unit and shake correction amount calculation unit compute channel-specific values in advance, which are then fed to the stable shake correction amount calculation unit for integration. This preliminary per-channel processing maintains accuracy while the subsequent combination step ensures stability and reduces complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10567658B2Image processing device, image processing method, image processing program
Publication Date: 2020.02.18 OLYMPUS CORPORATION(JP)
  • US10567658B2 patent drawing
  • US10567658B2 patent drawing
  • US10567658B2 patent drawing

AI summary

An image processing device includes: a movement-amount calculating unit that calculates a movement amount of an object image between a latest frame and a past frame in the same color channel; a shake-correction-amount calculating unit that calculates a shake correction amount for the latest frame on the basis of the movement amount; a stable-shake-correction-amount calculating unit that calculates a stable shake-correction amount for the latest frame; a shake correcting unit that performs shake correction processing on the latest frame on the basis of the stable shake-correction amount; and a storage unit that stores the stable shake-correction amount, wherein the stable-shake-correction-amount calculating unit calculates the stable shake-correction amount for the latest frame on the basis of the shake correction amount for the latest frame and a stable shake-correction amount for a frame in a different color channel from the latest frame, stored in the storage unit.