Video Memorability Analysis System Using Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video editing tools fail to enhance the memorability of video content, making it difficult for creators to produce videos that stand out in a vast and competitive landscape, as they do not provide effective methods to predict or improve the memorability of video features.

Innovation Solution

A system that analyzes video content using spatio-temporal, salience, and deep neural network algorithms to determine memorability scores for video and text features, providing recommendations on image styles and edits to improve memorability, allowing creators to focus on memorable content and exclude less memorable parts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video creators use existing video editing tools to improve technical quality, then the technical quality of the video is improved, but the memorability of the video content does not improve

Engineering Contradiction:
Improvetechnical qualityVSAvoidmemorability
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The system changes the evaluation parameters from traditional technical quality metrics to memorability-based metrics. It analyzes video features such as scene changes, object movements, and visual salience to compute a memorability score, enabling creators to optimize for memorability rather than just technical quality.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system provides feedback to video creators by identifying which specific video features contribute to memorability and offering recommendations for improvement. This feedback loop allows creators to iteratively enhance their videos' memorability based on objective analysis rather than subjective judgment.

Inventive Principle:
Principle #23Feedback

2Productivity

If video creators produce more video content to increase visibility, then the quantity of video content increases, but the difficulty of producing memorable content increases

Engineering Contradiction:
Improvevideo content outputVSAvoidmemorability prediction
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The system enables video content to evaluate itself by automatically analyzing its own features and computing memorability scores. This self-service capability eliminates the need for external expert evaluation, making memorability assessment scalable to large volumes of video content.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replaces manual, subjective memorability assessment with automated computational analysis. By using algorithms to detect and measure video features objectively, it substitutes human judgment with a scalable mechanical system that can evaluate countless videos efficiently.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If video editors manually analyze and edit video to improve memorability, then the memorability may improve, but the time and complexity of the editing process increases

Engineering Contradiction:
ImprovememorabilityVSAvoidediting time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of video memorability features before the final editing decision is made. By pre-identifying which features contribute to memorability, it guides the editing process and reduces the time needed for trial-and-error editing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system acts as an intermediary between the raw video and the final edited product. It provides objective memorability analysis that mediates the editing decisions, reducing the need for extensive manual trial-and-error editing while still achieving memorability improvement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10380428B2Techniques for enhancing content memorability of user generated video content
Publication Date: 2019.08.13 ADOBE INC
  • US10380428B2 patent drawing
  • US10380428B2 patent drawing
  • US10380428B2 patent drawing

AI summary

Techniques are described for analyzing a video for memorability, identifying content features of the video that are likely to be memorable, and scoring specific content features within the video for memorability. The techniques can be optionally applied to selected features in the video, thus improving the memorability of the selected features. The features may be organic features of the originally captured video or add-in features provided using an editing tool. The memorability of video features, text features, or both can be improved by analyzing the effects of applying different styles or edits (e.g., sepia tone, image sharpen, image blur, annotation, addition of object) to the content features or to the video in general. Recommendations can then be provided regarding memorability score caused by application of the image styles to the video features.