Image Selection by Playback Time and Evaluation Score

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies face challenges in efficiently selecting and combining images to create a summarized moving image within a specified total playback time, often resulting in lengthy browsing times and ineffective image representation.

Innovation Solution

An image processing apparatus that acquires and evaluates multiple images, sets individual playback times, and selects a predetermined number of images based on evaluation results and total playback time, incorporating features like optimization by score, dissimilarity improvement, and key-point synchronization to create a highlight moving image that aligns with musical rhythm and prioritizes high-ranked images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple images are selected to create a summarized moving image, then the representation of key moments is improved, but the playback time is exceeded

Engineering Contradiction:
Improveimage representation qualityVSAvoidplayback time
Core Design Contradiction:
Loss of informationVSDuration of action of moving object

Solution Approach 1:

The system changes the playback time parameter for each image based on its evaluation score. High-scoring images are allocated longer playback times to better represent key moments, while lower-scoring images receive shorter durations. This dynamic parameter adjustment allows the system to fit more meaningful images within the total playback time constraint while maintaining information quality.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If image selection is performed without evaluation, then the processing speed is improved, but the selection accuracy deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidimage selection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary evaluation of all candidate images before the actual selection process. Evaluation scores are calculated in advance based on image quality, content importance, and other criteria. This preliminary action enables the subsequent selection to be performed quickly by simply comparing pre-computed scores, thus maintaining both high processing speed and accurate selection.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If individual playback times are set for each image, then the playback quality is improved, but the complexity of time management increases

Engineering Contradiction:
Improveplayback qualityVSAvoidtime management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses an iterative feedback mechanism to adjust individual playback times. Initially, equal or default times are assigned to each selected image. The system then calculates the total playback time and compares it with the target duration. Based on this feedback, it redistributes the time allocation according to image evaluation scores, repeating the process until the total time matches the target while maintaining optimal individual durations for each image.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10658006B2Image processing apparatus that selects images according to total playback time of image data, image selection method, and computer-readable medium
Publication Date: 2020.05.19 CASIO COMPUTER CO LTD
  • US10658006B2 patent drawing
  • US10658006B2 patent drawing
  • US10658006B2 patent drawing

AI summary

To make it possible to select images for generating a moving image even when individual playback times of images which are targeted for selection differ from each other. The image acquisition unit acquires a plurality of images. The feature amount calculation unit evaluates the plurality of images acquired. The moving image playback time setting unit sets a total playback time of data composed of the plurality of images. The image playback time setting unit sets individual playback times for each of the plurality of images. The image selection unit selects a predetermined number of images according to the total playback time from the plurality of images, based on (i) evaluation results of the plurality of images which have been evaluated, and (ii) the individual playback times which have been set, and (iii) the total playback time which has been set.