Video Frame Insertion for Multi-Effect Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video production, adding special effects to source videos with uneven quality can result in playback issues, such as slowed or stuck effects, due to frame rate mismatches between the source and special effect sequences.

Innovation Solution

A method and apparatus that acquire source and special effect video sequences, insert frames into the source sequence based on the special effect sequence's frame rate, and align timestamps to ensure smooth playback, even when multiple special effect sequences with different frame rates are combined.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the special effect sequence is superimposed directly according to frame number, then the superimposition process is simple, but the special effect playback is slowed down and the effect is not good when the frame rate of the special effect sequence is greater than the frame rate of the source video

Engineering Contradiction:
Improvesuperimposition process simplicityVSAvoidspecial effect playback speed
Core Design Contradiction:
Ease of manufactureVSSpeed

Solution Approach 1:

The patent applies preliminary action by inserting required video frames into the source video sequence before superimposition. The system calculates the frame rate difference between the source video and special effect sequence, then pre-inserts frames to ensure the source video's frame rate matches the special effect sequence's frame rate. This preliminary frame insertion prevents playback slowdown while maintaining simple superimposition processing.

Inventive Principle:
Principle #10Preliminary action

2Speed

If part of the video frame of the special effect sequence is removed to match the frame rate, then the frame rate matches the source video, but the special effect may be stuck when being played

Engineering Contradiction:
Improveframe rate matchingVSAvoidspecial effect playback smoothness
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

Instead of removing frames from the special effect sequence to match the source video frame rate, the patent inverts the approach by inserting frames into the source video sequence to match the special effect sequence frame rate. This inversion ensures the source video adapts to the special effect requirements rather than the special effect adapting to the source video, preventing playback stuttering while achieving frame rate synchronization.

Inventive Principle:
Principle #13The other way round (Inversion)

3Adaptability or versatility

If multiple special effect sequences with different frame rates are superimposed, then diverse special effects can be added, but frame rate synchronization becomes complex

Engineering Contradiction:
Improvenumber of special effect sequencesVSAvoidframe rate synchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by handling each special effect sequence independently. For each special effect sequence with a different frame rate, the system separately calculates the required frame insertion quantity and performs independent frame insertion into the source video sequence. This segmentation approach allows multiple special effects with different frame rates to be superimposed without complex inter-dependent synchronization, reducing overall system complexity while maintaining versatility.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11553240B2Method, device and apparatus for adding video special effects and storage medium
Publication Date: 2023.01.10 BIGO TECH PTE LTD
  • US11553240B2 patent drawing
  • US11553240B2 patent drawing

AI summary

Provided are a method, apparatus and device for adding a video special effect and a storage medium. The method includes: acquiring a source video sequence and at least one special effect video sequence; in the case where frame rates of the two or more than two special effect video sequences are same, inserting a frame into the source video sequence and superimposing the two or more than two special effect video sequences on the source video sequence at the same time; and in the case where frame rates of the two or more than two special effect video sequences are different, determining a target frame rate from the frame rates of the two or more than two special effect video sequences inserting frames into the source video sequence and then superimposing the two or more than two special effect video sequences on the source video sequence.