Automated Video Summary Generation via Interest Curve Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual generation of video summaries is time-consuming and discourages users from creating them, as existing video applications lack efficient automated solutions for summarizing video content.

Innovation Solution

A system and method that utilize machine-readable instructions and computer program components to analyze video frames, determine interest weights, generate interest curves, and select relevant frames for a video summary, allowing for automated generation of summaries based on threshold values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual generation of video summaries is used, then users can create customized summaries, but the process is time-consuming and discourages users from generating summaries

Engineering Contradiction:
Improveease of generating video summaryVSAvoidtime required for manual summary generation
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs automatic video summary generation without requiring user intervention. The processor autonomously analyzes video frames, determines interest weights, generates interest curves, and selects key frames to create summaries, allowing the system to serve itself rather than requiring manual user operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of summary creation with an automated computational system. The processor uses algorithmic analysis of video parameters and interest curve generation to substitute human manual selection and curation processes, dramatically reducing time requirements while maintaining summary quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated video summary generation is implemented, then user effort is reduced, but the system complexity increases

Engineering Contradiction:
Improveautomation of video summary generationVSAvoidsystem complexity for automated analysis
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The automated summary generation system is divided into distinct functional modules: video frame analysis, parameter determination, interest weight calculation, interest curve generation, and key frame selection. Each module performs a specific task, making the complex overall system manageable through functional segmentation and modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The interest curve serves as an intermediary data structure that bridges video analysis and summary generation. The processor generates interest curves based on video parameters, which then serve as the basis for selecting key frames. This intermediary representation simplifies the complexity by providing a standardized intermediate format for processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11508154B2Systems and methods for generating a video summary
Publication Date: 2022.11.22 GOPRO INC
  • US11508154B2 patent drawing
  • US11508154B2 patent drawing
  • US11508154B2 patent drawing

AI summary

Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.