Audiovisual Summarization via Segment Rating and Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Long audiovisual presentations, such as movies and television programs, often exceed the time available for viewing, leading to incomplete consumption and challenges in media distribution due to lengthy file sizes and download times, with existing methods failing to adequately shorten content while preserving essential information.

Innovation Solution

A system and method for automatically summarizing audiovisual presentations by segmenting them into dialogue, non-dialogue, and shot segments, rating their significance, and removing less significant parts to create a shorter version that maintains the storyline and entertainment value, using user preferences and machine learning for customization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the audiovisual presentation is kept in full length to preserve all content, then the completeness of information is maintained, but the viewing time and file size become excessive for modern consumption patterns

Engineering Contradiction:
Improvecontent completenessVSAvoidviewing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts and removes less significant segments from the audiovisual presentation while retaining key content. The system identifies and eliminates redundant dialogue, repetitive scenes, and non-essential elements, creating a condensed version that preserves core information while reducing overall length by 50% or more.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards less significant segments during the summarization process while recovering and preserving the essential storyline and entertainment value. The system selectively removes content that can be discarded without losing the core narrative, then reconstructs a coherent shortened version that recovers the main story arc.

Inventive Principle:
Principle #34Discarding and recovering

2Stability of the object's composition

If the audiovisual presentation is kept in full length to maintain storyline integrity, then the narrative coherence is preserved, but the file size and download time increase significantly

Engineering Contradiction:
Improvestoryline integrityVSAvoidfile size
Core Design Contradiction:
Stability of the object's compositionVSQuantity of substance

Solution Approach 1:

The patent extracts and removes redundant visual and audio segments that do not contribute to storyline integrity. The system identifies repetitive shots, unnecessary dialogue exchanges, and non-essential scenes, eliminating them to reduce file size while maintaining the core narrative structure and plot development.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the audiovisual presentation into distinct units (shots, dialogue segments, scenes) and selectively processes them. By dividing the content into manageable segments, the system can identify and remove redundant portions while preserving the essential storyline elements, thereby reducing overall file size without compromising narrative coherence.

Inventive Principle:
Principle #1Segmentation

3Quantity of substance

If traditional editing methods are used to shorten audiovisual presentations, then the file size is reduced, but the process is time-consuming and requires manual intervention

Engineering Contradiction:
Improvefile sizeVSAvoidprocessing speed
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent implements an automated system that performs the summarization process without manual intervention. The computer automatically analyzes the audiovisual content, identifies significant and less significant segments, and creates the shortened version independently, eliminating the need for human editors and dramatically increasing processing speed and productivity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual editing processes with automated computer-based analysis and processing. The system uses algorithmic segment identification and automated decision-making to determine which content to retain or remove, substituting mechanical human labor with computational processes that are faster and more consistent.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Loss of time

If segments are removed to create a shorter version, then the viewing time is reduced, but there is a risk of losing important information or entertainment value

Engineering Contradiction:
Improveviewing timeVSAvoidinformation preservation
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent applies different quality standards to different segments of the audiovisual presentation. Highly significant segments containing critical plot points, character development, or entertainment value are preserved in full quality, while less significant segments are removed. This local differentiation ensures that important information is maintained while reducing overall length.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent incorporates feedback mechanisms where the system evaluates the significance of each segment based on multiple criteria (dialogue importance, visual interest, narrative function) and adjusts the summarization process accordingly. The automated analysis provides feedback on what content to retain to maintain both information integrity and entertainment value while achieving the desired length reduction.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8818803B2Character-based automated text summarization
Publication Date: 2014.08.26 NUTSHELL MEDIA
  • US8818803B2 patent drawing
  • US8818803B2 patent drawing
  • US8818803B2 patent drawing

AI summary

Methods, devices, systems and tools are presented that allow the summarization of text, audio, and audiovisual presentations, such as movies, into less lengthy forms. High-content media files are shortened in a manner that preserves important details, by splitting the files into segments, rating the segments, and reassembling preferred segments into a final abridged piece. Summarization of media can be customized by user selection of criteria, and opens new possibilities for delivering entertainment, news, and information in the form of dense, information-rich content that can be viewed by means of broadcast or cable distribution, “on-demand” distribution, internet and cell phone digital video streaming, or can be downloaded onto an iPod™ and other portable video playback devices.