Video Object Thumbnail Extraction for Scene Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in quickly and accurately finding desired scenes while fast forwarding or rewinding through moving image content on devices like personal digital assistants, as images are played in sequence, making it time-consuming and hard to locate specific scenes.

Innovation Solution

A content information processing device and method that includes a reproduction unit, memory for object identification, and a processor to extract frames with object images, generating reduced images for display alongside a progress bar, allowing users to select and move to specific frames within the video content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If fast forwarding or fast rewinding playback is used to find desired scenes, then playback speed is improved, but the user cannot readily view display images and often overlooks desired scenes

Engineering Contradiction:
Improveplayback speedVSAvoidscene information
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The video content is segmented into multiple thumbnail images representing different time points. These thumbnails are displayed simultaneously during fast forwarding or fast rewinding playback, allowing users to visually scan through content segments without missing desired scenes. This segmentation approach divides the continuous video stream into discrete, viewable units that can be processed and reviewed independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a spatial dimension to the playback interface by displaying multiple thumbnail images across the screen width during fast forwarding or fast rewinding. Instead of showing a single sequential frame, thumbnails are arranged horizontally, enabling users to scan through multiple time points simultaneously. This dimensional transformation converts a time-based sequential view into a space-based parallel view, preventing users from overlooking desired scenes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If thumbnails are displayed during fast forwarding playback, then scene visibility is improved, but device complexity increases

Engineering Contradiction:
Improvescene informationVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Instead of processing and displaying every frame during fast forwarding or fast rewinding playback, the patent selectively extracts and displays only key thumbnail images at predetermined time intervals. This partial action approach processes a subset of frames rather than all frames, reducing computational complexity while still providing sufficient visual information for users to identify desired scenes. The selective thumbnail generation balances information completeness with processing efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10706887B2Apparatus and method for displaying times at which an object appears in frames of video
Publication Date: 2020.07.07 SONY GROUP CORP
  • US10706887B2 patent drawing
  • US10706887B2 patent drawing
  • US10706887B2 patent drawing

AI summary

An information processing apparatus comprising that includes a reproduction unit to reproduce video content comprising a plurality of frames; a memory to store a table including object identification information identifying an object image, and frame identification information identifying a frame of the plurality of frames that includes the object image; and a processor to extract the frame including the object image from the video content and generate display data of a reduced image corresponding to the frame for display.