Composite Image Generation for Moving-Image Browsing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to effectively maintain viewer interest in moving images by not providing sufficient detail about the central subject, leading to disengagement over long playback times.

Innovation Solution

An image processing apparatus that calculates transformation information between successive frames of a moving image, allowing for the transformation and combination of history and current images to generate composite images, which are then sequentially output to enhance viewer understanding and engagement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video indices (still images) are displayed alongside a moving image to maintain viewer interest, then viewer engagement is improved, but the displayed still images may be substantially the same as the current moving image, reducing their effectiveness

Engineering Contradiction:
Improveviewer engagementVSAvoidimage detail diversity
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent segments the moving image into multiple still images at different time points and selectively displays them as video indices. By dividing the continuous moving image into discrete temporal segments, the system can choose representative still images that show different scenes or subjects, ensuring diversity in the displayed indices rather than showing redundant frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary analysis of the moving image to identify and extract key still images that represent different scenes or subjects before display. By pre-processing the moving image to detect scene changes or subject transitions, the system prepares a set of diverse still images in advance, ensuring that the displayed video indices provide meaningful variety and detail about different aspects of the moving image content.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the same moving image is played for a long duration to provide complete information, then information completeness is improved, but viewer interest decreases over time

Engineering Contradiction:
Improveinformation completenessVSAvoidviewer engagement
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent implements periodic updates of the displayed video indices during moving image playback. By periodically refreshing the still images shown alongside the moving image, the system maintains viewer interest through varied visual content while continuing to provide access to complete information about the moving image through the sequence of displayed indices.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent uses viewer interaction feedback to dynamically adjust which still images are displayed as video indices. By monitoring viewer preferences or attention patterns, the system can adaptively select and display still images that are most relevant or interesting to the current viewer, maintaining engagement while preserving information completeness through selective presentation.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If transformation information is calculated between successive frames to generate composite images, then image detail and understanding are improved, but processing complexity increases

Engineering Contradiction:
Improveimage detail accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies transformation information calculation selectively to specific regions or key areas of the moving image rather than processing the entire image uniformly. By focusing computational resources on locally important regions that contain significant visual information or subject matter, the system achieves high image detail accuracy in critical areas while reducing overall processing complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the level of transformation information calculation based on image content characteristics. By changing processing parameters such as transformation accuracy, resolution, or computational intensity according to the complexity or importance of different image regions, the system optimizes the balance between image detail accuracy and processing complexity, applying high precision only where necessary.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8963951B2Image processing apparatus, moving-image playing apparatus, and processing method and program therefor to allow browsing of a sequence of images
Publication Date: 2015.02.24 SONY GROUP CORP
  • US8963951B2 patent drawing
  • US8963951B2 patent drawing
  • US8963951B2 patent drawing

AI summary

To allow a viewer to easily understand the details of a moving image shot by an image capturing apparatus in the case where the moving image is browsed. A camerawork detecting unit 120 detects the amount of movement of an image capturing apparatus at the time of shooting a moving image input from a moving-image input unit 110, and, on the basis of the amount of movement of the image capturing apparatus, calculates affine transformation parameters for transforming an image on a frame-by-frame basis. An image transforming unit 160 performs an affine transformation of at least one of the captured image and a history image held in an image memory 170, on the basis of the calculated affine transformation parameters. An image combining unit 180 combines, on a frame-by-frame basis, the captured image and the history image, at least one of which has been transformed, and causes the image memory 170 to hold a composite image. The composite image generated by the image combining unit 180 is displayed on a display unit 191.