Video Dubbing Timeline Linkage Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video dubbing methods require manual matching of audio recording files with video timelines, leading to complex operations and inaccurate results.

Innovation Solution

A method where audio recording is performed based on a timeline while playing the target video, generating an audio recording file with a linkage relationship to the video clip, eliminating the need for manual timeline matching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual matching of audio recording file with video timeline is performed, then flexibility in editing is maintained, but operation complexity increases and accuracy decreases

Engineering Contradiction:
Improvedubbing accuracyVSAvoidoperation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system automatically performs timeline matching by itself without requiring manual user intervention. The audio recording file is automatically synchronized with the video timeline through automated detection and alignment algorithms, eliminating the need for manual matching operations while maintaining high accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-synchronizing the audio recording file with the video timeline during the recording process. The timeline linkage is established in advance, so that when the dubbing is completed, the synchronization is already in place, eliminating the need for subsequent manual matching.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If manual timeline matching is performed, then customization options are available, but time consumption increases

Engineering Contradiction:
Improvedubbing efficiencyVSAvoidtime for manual matching
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The manual mechanical process of timeline matching is replaced with an automated digital system. The computer automatically detects audio features, analyzes video timeline structure, and performs synchronization through software algorithms, dramatically reducing the time required compared to manual dragging and adjusting of audio files on the timeline.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an automated synchronization mechanism as an intermediary between audio recording and video timeline. This intermediary automatically detects and aligns the audio with the video based on temporal and acoustic features, eliminating the need for users to manually perform the time-consuming matching process.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If separate audio recording window is used, then recording control is independent, but integration with video timeline becomes complex

Engineering Contradiction:
Improverecording flexibilityVSAvoidtimeline integration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system merges the separate audio recording window with the video timeline interface into an integrated workspace. The audio recording function is combined with the timeline visualization, allowing users to record audio while directly viewing and interacting with the video timeline, thereby simplifying the integration process while maintaining recording flexibility.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11817127B2Video dubbing method, apparatus, device, and storage medium
Publication Date: 2023.11.14 DOUYIN VISION CO LTD
  • US11817127B2 patent drawing
  • US11817127B2 patent drawing
  • US11817127B2 patent drawing

AI summary

The present disclosure provides a video dubbing method, an apparatus, a device, and a storage medium. The method includes: when receiving an audio recording start trigger operation for a first time point of a target video and starting from a video picture corresponding to the first time point, playing the target video based on a timeline and receiving audio data based on the timeline; and when receiving an audio recording end trigger operation for a second time point, generating an audio recording file. The audio recording file has a linkage relationship with a timeline of a video clip taking the video picture corresponding to the first time point as a starting frame and taking a video picture corresponding to the second time point as an ending frame.