Video Timeline Thumbnail Display for Scene Detail Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for retrieving and analyzing video content are inefficient, making it difficult for users to easily find specific scenes or compare time ratios of image displays, especially in long content, and complicating the recognition of details in timeline displays.

Innovation Solution

A content processing apparatus and method that extracts metadata to generate timeline displays with representative images and scene change information, allowing users to visualize content details through thumbnail displays associated with time positions, enabling easier navigation and understanding of video content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If timeline display shows only numerical values or simple images, then display is simple, but user cannot easily grasp content details without replay time

Engineering Contradiction:
Improveease of grasping content detailsVSAvoidreplay time required
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent creates a visual copy of the timeline display by extracting representative images from the moving image content and displaying them as thumbnails on the timeline. This allows users to view content details through static image representations rather than requiring time-consuming replay, effectively resolving the contradiction between ease of grasping details and time loss.

Inventive Principle:
Principle #26Copying

2Ease of operation

If timeline display shows leading frame images of all scenes, then content retrieval is possible, but display becomes complicated in temporally long content

Engineering Contradiction:
Improvecontent recognition easeVSAvoiddisplay complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary representative images from the moving image content and displays them as thumbnails on the timeline. This selective extraction approach maintains content recognizability while avoiding the complexity of displaying all frame images, thus resolving the contradiction between content recognition ease and display complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Loss of information

If index images are displayed on multi-screens or index moving images are replayed, then some content information is provided, but user cannot grasp what images exist at which time positions

Engineering Contradiction:
Improvetime position informationVSAvoidcontent detail grasping
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent merges the timeline display with thumbnail images by integrating the visual representation of content directly onto the timeline structure. This combination allows users to simultaneously view time position information and image content details in a unified display, resolving the contradiction between information completeness and ease of grasping content details.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9325946B2Content processing apparatus and method, and program
Publication Date: 2016.04.26 SONY GROUP CORP
  • US9325946B2 patent drawing
  • US9325946B2 patent drawing
  • US9325946B2 patent drawing

AI summary

Metadata including information identifying scene change points is extracted from a moving image. Representative images, which are still images corresponding to the identified scene change points of the content, are extracted from the moving image. A timeline of the content is displayed, and indications of the locations and durations of scenes identified by the scene change points are displayed. Thumbnails of the representative images are displayed at time positions associated with the content timeline; and the location in a scene of a representative image is displayed with an identifying characteristic that identifies the corresponding thumbnail.