Image Processing Device Loop Moving Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating loop moving images often result in unsuitable connections between the starting and ending edges, leading to poor quality loop moving images, requiring users to reshoot material or manually adjust parameters.

Innovation Solution

An image processing device and method that determines pairs of frames with high similarity within a video, applies cross-fading blending techniques, and performs projective transformation to correct camera motion, ensuring smooth transitions and high-quality loop moving image generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If cross-fading processing is performed to blend frames at starting and ending edges, then smooth linking between edges is improved, but processing complexity increases and may still fail when no suitable similar frames exist

Engineering Contradiction:
Improvesmooth linking between starting and ending edgesVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary evaluation of frame similarity and suitability for loop moving image generation before executing cross-fading processing. By pre-assessing whether suitable frame pairs exist and whether the video content is appropriate for loop processing, the system avoids unnecessary complex processing when failure is likely, thus resolving the contradiction between achieving smooth linking and reducing processing complexity

Inventive Principle:
Principle #10Preliminary action

2Reliability

If manual parameter adjustment or reshooting is required to obtain suitable frame pairs, then loop moving image quality is improved, but user operation time and complexity increase

Engineering Contradiction:
Improveloop moving image qualityVSAvoiduser operation time
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements automatic evaluation and selection of suitable frame pairs for loop moving image generation. The system autonomously assesses frame similarity, identifies appropriate starting and ending frames, and determines whether the video content is suitable for loop processing without requiring manual parameter adjustment. This self-service capability eliminates the need for user intervention while maintaining high loop moving image quality, thus resolving the contradiction between quality and ease of operation

Inventive Principle:
Principle #25Self-service

3Reliability

If frame similarity evaluation and selection processing is performed, then loop moving image quality is improved, but processing time increases

Engineering Contradiction:
Improveloop moving image qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent employs efficient similarity evaluation metrics and optimized processing parameters to assess frame similarity and identify suitable frame pairs for loop moving image generation. By changing and optimizing processing parameters such as similarity thresholds and evaluation criteria, the system achieves high-quality loop moving images while minimizing processing time, thus resolving the contradiction between quality and processing time

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2557773B1Image processing device, method and program
Publication Date: 2019.05.08 SONY GROUP CORP
  • EP2557773B1 patent drawingFigure 1
  • EP2557773B1 patent drawingFigure 2
  • EP2557773B1 patent drawingFigure 3

AI summary

The present technology relates to an image processing device and method, and program, whereby a high-quality loop moving image can be obtained more easily. Upon continuous shot images of multiple frames serving as material of a loop moving image being input, the continuous shot images are divided into multiple segments including motion segments including a moving subject and a still segment including a subject with no motion. An image of the motion segment region of the continuous shot images is formed into a loop moving image, and a segment loop moving image is generated. Also, an image of a still segment region of the continuous shot images is clipped out, and a segment image which is a still image is generated. Further, these segment loop moving image and segment image are integrated, to form one loop moving image. The present invention can be applied to an image processing device.