Automated Video Processing for Beat Sync Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for creating beat sync videos require users to manually listen to audio and clip videos, resulting in low efficiency and high costs due to the need for repeated audio listening and manual video editing.

Innovation Solution

A video processing method that determines music points in an audio material, extracts corresponding video segments from multiple video materials, splices these segments, and adds the audio to create a synthesized video, automating the process to reduce manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual audio listening and video clipping is used, then the user can create beat sync videos, but the production efficiency is low and time consumption is high

Engineering Contradiction:
Improvevideo production efficiencyVSAvoidtime for manual audio listening and video clipping
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system automatically detects music points from the audio material and extracts corresponding video segments without requiring manual user intervention. The processing unit autonomously completes the entire workflow of identifying beat points, determining music points, and extracting video segments, enabling the system to serve itself in the video production process.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of listening to audio and clipping video is replaced by an automated digital processing system. The processing unit uses algorithmic detection to identify music points and automated extraction to obtain video segments, substituting human manual operations with computational processes that significantly improve efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated processing is used to improve efficiency, then video production speed increases, but the complexity of the processing system increases

Engineering Contradiction:
Improveautomated video processing speedVSAvoidcomplexity of music point detection and video extraction system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The automated processing system is divided into distinct functional modules: a music point detection unit that identifies beat points and determines music points, and a video segment extraction unit that extracts video segments based on the detected music points. This segmentation allows each module to perform its specific function independently, managing system complexity through functional decomposition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processing unit is designed to handle multiple tasks within a unified framework: detecting beat points in audio, determining music points based on those beats, and extracting corresponding video segments. This multi-functional design consolidates what could be separate complex systems into a single integrated processing unit, managing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11978485B2Video processing method and apparatus, and electronic device and storage medium
Publication Date: 2024.05.07 DOUYIN VISION CO LTD
  • US11978485B2 patent drawing
  • US11978485B2 patent drawing
  • US11978485B2 patent drawing

AI summary

The present invention provides a video processing method and apparatus, and an electronic device and a storage medium. The video processing method comprises: obtaining video materials; obtaining an audio material; determining music points of the audio material, and extracting video segments from each of the video materials according to the music points; stitching the extracted video segments to obtain a composite video; and adding the audio material to an audio track of the composite video to obtain a target video. The present invention improves the efficiency of producing a rhythmic video and reduces production costs.