Audio Segment Matching for Low-Traffic Video Subtitle Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for matching video subtitles require uploading entire video clips to a cloud server for speech recognition, leading to inefficient use of resources and increased traffic consumption.
Innovation Solution
Extract audio clips from integrated video clips, identify and integrate repeating parts, and perform speech recognition on these clips before matching subtitle data with original video clips, reducing redundant processing and optimizing resource utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If entire video clips are uploaded to cloud server for speech recognition, then subtitle matching can be performed, but traffic consumption increases and resource utilization becomes inefficient
Solution Approach 1:
The patent segments the video clips into smaller audio clips before uploading to the cloud server. Instead of uploading entire video clips, the system extracts and transmits only the audio portions that need processing, significantly reducing the amount of data transmitted and thus lowering traffic consumption while maintaining the ability to perform accurate speech recognition and subtitle matching.
Solution Approach 2:
The patent extracts the audio component from the video clips and processes only this extracted audio data on the cloud server. By taking out the essential audio information and separating it from the video data, the system minimizes the data transmission required for speech recognition while preserving the functionality needed for accurate subtitle matching.
2Reliability
If entire video clips are uploaded to cloud server for speech recognition, then subtitle matching can be performed, but processing time increases and productivity decreases
Solution Approach 1:
The patent divides the video clips into smaller audio clips, which reduces the processing load on the cloud server for each individual clip. This segmentation allows for faster processing of each audio clip while maintaining the overall accuracy of subtitle matching, thereby improving productivity without sacrificing reliability.
Solution Approach 2:
The patent performs preliminary extraction of audio clips from video clips before uploading to the cloud server. This preliminary action of separating and preparing only the necessary audio data reduces the amount of data that needs to be processed, thereby decreasing processing time and improving overall productivity while maintaining subtitle matching accuracy.
3Productivity
If repeating parts in video clips are processed separately, then processing can be performed, but redundant processing occurs and resource utilization is inefficient
Solution Approach 1:
The patent merges and integrates repeating parts of audio clips before processing. Instead of processing duplicate segments separately, the system identifies and combines identical or similar audio portions into a single processing unit, which reduces redundant processing operations and improves resource utilization efficiency while maintaining processing speed.
Solution Approach 2:
The patent performs preliminary identification and integration of repeating parts before uploading to the cloud server. By detecting and consolidating duplicate audio segments in advance, the system reduces the amount of data that needs to be processed separately, thereby eliminating redundant processing and improving resource utilization efficiency without sacrificing processing speed.
Data Source
Figure 1~2
Figure 3~5
Figure 6~7
AI summary
A matching method, a terminal (100) and a non-volatile computer-readable storage medium (300). The matching method comprises: (011) extracting audio segments corresponding to all video segments to be combined; (012) uploading the audio segments, and obtaining recognition results; (013) and performing matching of the recognition results with one or more of video segments to be combined, and loading, to the video segments to be combined, subtitle data matching start times and end times of the video segments to be combined.