Text Processing Method for Audio-Text Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When listening to audio text content through a reading-type application, the literal content obtained after text conversion does not accurately correspond to the played audio content, leading to synchronization issues.
Innovation Solution
A method for text processing that involves acquiring two texts for comparison, segmenting them into smaller segments, and applying enhancement processing to match the segments, ensuring accurate synchronization of audio and text during playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If text conversion is carried out on dubbed audio to display literal content, then users can read text content while listening to audio, but the displayed text cannot accurately correspond to the played audio content
Solution Approach 1:
The patent segments both the first text (from AI text conversion) and the second text (original script) into multiple text segments. By comparing segments rather than entire texts, the system can identify corresponding portions more accurately and establish precise mapping relationships between audio and text segments, resolving the synchronization accuracy issue while maintaining text display functionality.
Solution Approach 2:
The patent employs enhancement processing that adjusts parameters of text segments including position, length, and content. By dynamically modifying these parameters based on similarity comparisons and mapping relationships, the system achieves accurate text-audio synchronization while preserving the ability to display text content during audio playback.
2Measurement precision
If the first text is segmented into smaller segments for comparison, then matching precision can be improved, but the processing complexity increases
Solution Approach 1:
The patent divides both texts into segments and performs enhancement processing on each segment independently. This segmentation approach improves matching precision by focusing on smaller, more comparable units while managing complexity through systematic processing of individual segments rather than attempting to match entire texts at once.
Solution Approach 2:
The patent performs enhancement processing on text segments in advance, adjusting their positions and lengths before the actual matching operation. This preliminary action simplifies the subsequent matching process by pre-processing segments to optimal states, reducing the computational complexity during the matching phase while maintaining high precision.
3Measurement precision
If enhancement processing is applied to text segments to improve matching, then synchronization accuracy improves, but the processing time increases
Solution Approach 1:
The patent performs enhancement processing on text segments as a preliminary step before matching. By pre-adjusting segment positions, lengths, and contents, the system improves subsequent matching accuracy while managing processing time through efficient pre-processing rather than iterative adjustments during matching.
Solution Approach 2:
The patent applies enhancement processing selectively to text segments that require adjustment rather than uniformly processing all segments. This partial action approach improves synchronization accuracy for critical segments while reducing overall processing time by focusing computational resources where most needed.
Data Source
AI summary
A method for text processing, a computer device, and a storage medium are provided. The method includes: acquiring a first text and a second text which are to be compared, the first text being a text obtained after text conversion processing is carried out on a dubbed audio corresponding to the second text by an artificial intelligence model; segmenting the first text to obtain a plurality of first text segments; segmenting the second text to obtain a plurality of initial second text segments; for each first text segment in the first text, sequentially determining a target second text segment that is subjected to an enhancement processing and matched with the first text segment; and based on a plurality of target second text segments respectively matched with the plurality of first text segments in the first text, determining a text matching result of the first text and the second text.