Audio Data Processing for Authentic Harmonic Simulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio data editing methods fail to authentically simulate harmonic sound effects as they apply harmonization to the entire audio data duration, deviating from real-world harmony.
Innovation Solution
An audio data processing method that segments audio data based on lyric files, extracts data corresponding to end syllables, and performs harmonic processing only on these segments, mimicking real-world harmony by applying the harmonic sound effect only to the end syllables.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If harmonic sound effect is added to the entire original sound throughout the entire time period, then the harmonic effect is consistently applied, but the authenticity of harmonic simulation deteriorates because it deviates from real-world harmony patterns
Solution Approach 1:
The audio data is segmented into multiple audio data segments based on lyric file information, where each segment corresponds to a specific syllable or word. This segmentation enables selective application of harmonic effects only to relevant segments (those containing end syllables), rather than applying the effect uniformly across the entire audio data, thereby improving simulation authenticity while maintaining operational simplicity through automated processing.
Solution Approach 2:
The harmonic sound effect is applied locally only to specific audio data segments that contain end syllables, rather than uniformly across the entire audio data. This local quality approach ensures that the harmonic effect is applied authentically only where needed (at the end of syllables according to lyric timing), improving the realism of the simulation while keeping the processing targeted and efficient.
2Productivity
If harmonic processing is applied to the entire audio data, then comprehensive coverage is achieved, but processing efficiency deteriorates due to unnecessary computation on non-relevant segments
Solution Approach 1:
The method extracts only the necessary audio data segments that contain end syllables based on lyric file timing information, rather than processing the entire audio data. This extraction approach improves processing efficiency by focusing computational resources only on relevant segments while maintaining complete coverage of all areas where harmonic effects are needed, as determined by the lyric structure.
3Reliability
If the entire audio data is processed for harmony, then no parts are missed, but the computational resources are wasted on segments that do not require harmonic effects
Solution Approach 1:
The processing approach dynamically adjusts based on the content of the audio data and corresponding lyric file. By identifying which audio data segments contain end syllables (using timing information from the lyric file), the system dynamically applies harmonic effects only to those specific segments rather than statically processing the entire audio data, thereby maintaining complete coverage where needed while reducing computational resource consumption on non-relevant segments.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
An audio data processing method and an audio data processing device. The method comprises: acquiring a corresponding lyric file according to to-be-processed audio data (210); partitioning audio data according to sentences in the lyric file, thus obtaining audio data segments (230); extracting data corresponding to end syllables in the audio data segments (250); and performing harmony processing on the data corresponding to the end syllables (270). The audio data processing method and device can prevent a harmony sound effect from being added to whole audio data in a whole time period, thereby increasing reality of harmony simulation.