Virtual Audio Sticker Placement via Beat Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current tools for adding virtual audio stickers to videos are complex, expensive, and cumbersome, requiring expert knowledge and substantial time, as they necessitate manipulating a video timeline to select frames and add audio clips, discouraging users from easily enhancing their videos.

Innovation Solution

A lightweight video editing tool that allows users to add virtual audio stickers while the video plays, eliminating the need for a timeline, enabling users to drag and drop stickers at chosen times and locations, with options to loop videos, modify audio, and display stickers in a panel, reducing complexity and editing time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional video editing tools are used to add virtual audio stickers, then precise control over video frames and audio clips is achieved, but the device complexity and ease of operation deteriorate due to requiring timeline manipulation and expert knowledge

Engineering Contradiction:
Improveframe selection precisionVSAvoidediting operation ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical timeline manipulation system with an audio-driven automatic synchronization system. Instead of manually dragging stickers along a timeline to precise frames, the system automatically synchronizes virtual audio stickers to video frames based on audio beat detection and tempo analysis, eliminating complex mechanical interactions while maintaining precise temporal alignment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service by automatically detecting audio beats, calculating tempo, and determining optimal sticker placement times without user intervention. The video editing tool autonomously analyzes the audio track, identifies rhythmic patterns, and places virtual audio stickers at appropriate moments based on the detected beat structure, freeing the user from manual frame-by-frame positioning

Inventive Principle:
Principle #25Self-service

2Measurement precision

If traditional video editing tools with timeline manipulation are used, then precise audio clip placement is achieved, but the loss of time and productivity worsen due to substantial editing time requirements

Engineering Contradiction:
Improveaudio clip placement precisionVSAvoidediting time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-analyzing the entire audio track to detect beats and calculate tempo before placing any stickers. This advance preparation creates a temporal framework that guides automatic sticker placement, eliminating the need for time-consuming manual positioning during the editing process while ensuring precise rhythmic synchronization

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual timeline-based placement mechanics with an automated audio-synchronization system that uses beat detection algorithms to determine sticker placement timing, dramatically reducing the time required to achieve precise audio clip placement while maintaining rhythmic accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If expert knowledge is required to use video editing tools, then manufacturing precision and control are improved, but the ease of operation and adaptability worsen due to excluding novice users

Engineering Contradiction:
Improvevideo editing precisionVSAvoiduser base accessibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system serves itself by automatically performing complex audio analysis, beat detection, and temporal synchronization tasks that previously required expert knowledge. Users simply need to import their video and select virtual audio stickers, while the system handles the sophisticated audio processing and precise timing calculations autonomously, making professional-grade editing accessible to novices

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the complex mechanical system of manual timeline manipulation and frame selection with an automated audio-driven synchronization system that uses algorithms to detect beats and tempo, eliminating the need for expert knowledge while maintaining precise video editing control through scientific audio analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10972682B1System and method for adding virtual audio stickers to videos
Publication Date: 2021.04.06 META PLATFORMS INC
  • US10972682B1 patent drawing
  • US10972682B1 patent drawing
  • US10972682B1 patent drawing

AI summary

Systems and methods for adding virtual audio stickers to videos are disclosed. In general, one aspect disclosed features a method, comprising: editing a video to create an edited video, the editing comprising: playing a video in a video panel of a display screen of an electronic device, while the video is playing in the video panel, receiving user input at a particular time in the video, wherein the user input includes a touch at a particular location in the video panel, and responsive to the user input, adding a virtual audio sticker to the video, wherein the virtual audio sticker comprises: an image, and an audio clip.