Image Processing Device Shake Section Specification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in efficiently editing and playing back high-resolution moving images, such as 8K and 4K, due to memory constraints and the need for repeated encoding and decoding processes, making it difficult to real-time edit and display shake correction information effectively.

Innovation Solution

An image processing device and method that specifies sections of a moving image with significant shake amounts and outputs this information, using a graphical user interface to display a shake amount graph and allowing users to identify and playback these sections, enabling easier shake correction analysis without requiring extensive memory or repeated encoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If high-resolution moving images are stored in RAM for real-time playback, then playback speed is improved, but memory requirements increase significantly

Engineering Contradiction:
Improveplayback speedVSAvoidmemory capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments the moving image data by dividing it into multiple sections and calculating shake amounts for each section separately. This allows the system to process and analyze shake information in manageable portions rather than loading the entire high-resolution video into memory, enabling real-time analysis with reduced memory requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the essential shake information from the moving image data by calculating shake amounts based on motion vectors between frames. Instead of processing the complete high-resolution video data, the system extracts and analyzes only the motion-related parameters needed for shake detection, significantly reducing memory usage while maintaining analysis accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

2Speed

If encoded content is decoded and displayed in dedicated hardware, then real-time playback is enabled, but repeated encoding and decoding is required for parameter adjustment

Engineering Contradiction:
Improvereal-time playback capabilityVSAvoidtime for repeated encoding and decoding
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent performs preliminary calculation of shake amounts during the encoding phase by computing motion vectors and shake information from the original moving image data before final encoding. This preliminary analysis stores essential shake information in a compressed form that can be quickly accessed during playback without requiring repeated full decoding operations, saving time during parameter adjustments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the traditional mechanical approach of fully decoding video streams for analysis with a computational method that uses motion vector-based shake calculation. Instead of decoding entire video frames for shake analysis, the system substitutes this with efficient motion compensation and motion vector calculation algorithms that operate on compressed data, eliminating the need for repeated encoding/decoding cycles.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If users playback the entire moving image to confirm shake sections, then accurate shake identification is achieved, but processing time increases

Engineering Contradiction:
Improveshake detection accuracyVSAvoidplayback time for shake analysis
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and highlights only the sections with large shake amounts by comparing calculated shake values against threshold criteria. Instead of requiring users to review the entire moving image, the system extracts and presents only the problematic sections where shake exceeds acceptable levels, enabling rapid identification of issues while maintaining accurate shake detection through the same motion vector analysis.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements a skip-function that allows users to quickly navigate through sections with small or acceptable shake amounts by directly jumping to sections where large shake is detected. The system identifies and marks problematic sections in advance, enabling users to skip through normal portions of the video and focus only on the sections requiring attention, dramatically reducing the time needed to locate and analyze shake issues.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS11838631B2Image processing device, image processing method, non-transitory computer-readable storage medium
Publication Date: 2023.12.05 CANON KK
  • US11838631B2 patent drawing
  • US11838631B2 patent drawing
  • US11838631B2 patent drawing

AI summary

An image processing device comprises a specification unit configured to specify, among a plurality of frames constituting a moving image, a section in the moving image of frames corresponding to a scene whose shake amount is larger, based on the plurality of frames, and an output unit configured to output information representing the section.