Smart Search Module for Video Scene Change Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video content search functionalities, such as SKIP and SEEK, are cumbersome for users to locate desired points-of-interest, particularly scene changes, due to lack of precision and user effort required, especially in longer content or smaller display formats, leading to inaccuracies and frustration.
Innovation Solution
Implementing a smart search method that utilizes a playback device with a scene change detection module and smart search module to detect key scene changes within a defined time window, predicting user intent and shifting playback to the nearest key scene change, thereby improving navigation and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If traditional SKIP functionality is used to advance playback position, then user can quickly move through video content, but user may inadvertently advance beyond the desired scene change
Solution Approach 1:
The system performs preliminary detection of scene changes within a time window before the user actually seeks to that position. By pre-identifying scene change locations and preparing this information, the system can quickly present accurate scene options to the user without requiring them to manually navigate through content, thus achieving both speed and precision.
Solution Approach 2:
The system provides feedback to the user by displaying detected scene changes and their locations during the seeking process. This feedback mechanism allows users to see what scenes they are approaching and select the desired one, preventing inadvertent advancement beyond the target scene while maintaining quick navigation capability.
2Ease of operation
If trick mode SEEK functionality is used to locate scene changes, then user can search through video content, but user must pay exceedingly close attention to identify scene changes
Solution Approach 1:
The system performs the complex task of scene change detection automatically without requiring user involvement. The scene change detection module continuously analyzes video content and identifies scene boundaries, then presents this information to the user. This self-service approach eliminates the need for users to manually monitor and identify scene changes during fast-forward playback.
Solution Approach 2:
The system introduces an intermediary scene change detection module that acts as a mediator between the video content and the user. This module processes the raw video stream, extracts scene change information, and presents it in a user-friendly format, thereby simplifying the user's task while maintaining search capability.
3Measurement precision
If slide bar-based SEEK functionality is used for precise seeking, then user control is improved, but loss of granularity occurs for longer video content or smaller display areas
Solution Approach 1:
The system transitions from a one-dimensional slide bar interface to a two-dimensional presentation by displaying thumbnail images alongside or instead of the slide bar. These thumbnails provide visual context and scene identification, allowing users to locate desired positions more accurately without requiring a large display area, thus maintaining precision while adapting to smaller screens.
Solution Approach 2:
The system segments the video content into discrete scene units and presents these as distinct selectable options to the user. Instead of requiring continuous positioning along a slide bar, users can select from pre-identified scene segments, which maintains precision for locating specific points of interest while being adaptable to various display sizes.
4Measurement precision
If thumbnail images are presented alongside slide bar to assist searching, then user can identify scenes better, but thumbnails may be relatively small in size on smartphones
Solution Approach 1:
The system dynamically adjusts the presentation of thumbnails based on available display space and user interaction. When a user shows interest in a particular thumbnail or time range, the system can expand that thumbnail or provide a larger preview, ensuring that scene identification remains accurate while adapting to the constraints of mobile display screens.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems, methods, and devices are disclosed enabling smart search functionalities utilizing key scene changes appearing in video content. In various embodiments, the method includes the step or process of, while engaged in playback of the video content, receiving a user command at a playback device to shift a current playback position of the video content to a default search playback position (PPDS). In response to receipt of the user command, the playback device searches a time window encompassing the default search playback position (PPDS) for a key scene change in the video content. If locating a key scene change within the time window, the playback device shifts playback of the video content to a playback position corresponding to the key scene change (PPST). Otherwise, the playback device shifts playback of the video content to the default search playback position (PPDS).