Multimedia Duration Manipulation via Inter-Frame Luminosity Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for manipulating the duration of multimedia content, such as television programs, often result in noticeable visible and audible artifacts, are time-consuming, or produce suboptimal results, making it difficult to subtly adjust content to fit predetermined timeslots.

Innovation Solution

The technique calculates inter-frame distances (IFD) based on average pixel luminosity for each frame, optimizes frame removal using numerical methods to maintain a minimum time gap, and crossfades audio to subtly reduce or increase content duration without introducing noticeable artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of moving object

If traditional duration manipulation techniques are used, then the duration of multimedia content can be adjusted, but visible and audible artifacts are introduced that are easily noticed by consumers

Engineering Contradiction:
Improvecontent durationVSAvoidvisible and audible artifacts
Core Design Contradiction:
Duration of action of moving objectVSObject-affected harmful factors

Solution Approach 1:

The patent changes the parameter of frame selection by using inter-frame distance (IFD) analysis to identify frames with minimal visual impact for removal. By calculating luminosity differences between consecutive frames and selecting frames with IFD values below thresholds, the system removes frames while maintaining visual continuity and avoiding noticeable artifacts in the manipulated content

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces manual frame-by-frame analysis with an automated numerical optimization system that calculates IFD values and determines optimal frame removal positions algorithmically. This substitution of mechanical/manual processes with computational methods enables precise control over artifact generation while achieving the desired duration adjustment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual frame selection and content manipulation is performed, then quality control can be maintained, but the process becomes time-consuming and expensive

Engineering Contradiction:
Improvequality controlVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs self-service by automatically analyzing the multimedia content, calculating IFD values for all frames, and determining the optimal set of frames to remove without requiring manual intervention. The numerical optimization algorithm independently identifies frames that minimize visual artifacts while achieving the target duration, eliminating the need for time-consuming manual review and adjustment

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary analysis of the entire content item by calculating IFD values for all frames before making any removal decisions. This advance computation of frame differences and optimization of removal positions allows the system to plan the entire manipulation process in advance, ensuring quality control while significantly reducing the time required for actual execution

Inventive Principle:
Principle #10Preliminary action

3Productivity

If existing automated algorithms are used to identify frames for removal, then processing speed is improved, but the algorithms fail to efficiently identify frames that can be removed subtly

Engineering Contradiction:
Improveprocessing speedVSAvoidsubtlety of frame removal
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent introduces the inter-frame distance (IFD) parameter based on luminosity differences as the critical metric for frame selection. By changing from simple frame counting or uniform sampling to IFD-based selection with configurable thresholds, the system automatically identifies frames that are visually similar to their neighbors, ensuring subtle removals while maintaining high processing speed through efficient numerical computation

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10262694B2Multimedia content duration manipulation
Publication Date: 2019.04.16 ADOBE INC
  • US10262694B2 patent drawing
  • US10262694B2 patent drawing
  • US10262694B2 patent drawing

AI summary

Average pixel luminosity is calculated for each frame comprising a content item. For each pair of adjacent frames, an IFD is calculated. The IFD represents the difference between a baseline pixel luminosity associated with each of the two frames. An initial set of cut frames is selected based on IFD values that are less than a minimum value IFDmin, or that are greater than a maximum value IFDmax. The positions of these initial cut frames are optimized using a numerical optimization technique that favors removal of frames corresponding to IFD extrema, but that also attempts to maintain a minimum time gap between cut frames. Selecting frames for removal is approached as a constraint minimization problem. Once an optimized set of cut frames is established, audio is cut and crossfaded in a temporal window surrounding cut frame positions.