Audio Track Extension by Similar-Segment Joining
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio playback systems introduce discontinuities when switching between audio tracks, disrupting desired mental states such as focus, sleep, or relaxation, and looping a single track often results in discontinuities due to differences in audio characteristics.
Innovation Solution
The technique involves extending an audio track by seamlessly joining different portions based on similarity analysis of amplitude modulation characteristics, using methods like Hilbert transform and Fast Fourier Transforms to determine the sound envelope, and cross-correlating segments to minimize perceptible gaps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio tracks are switched sequentially to present variety, then user engagement is maintained, but audio discontinuities are introduced that disrupt desired mental states
Solution Approach 1:
The audio track is divided into multiple segments that can be independently analyzed and selected. The system segments the audio into portions with similar amplitude modulation characteristics, allowing seamless transitions between segments while maintaining the desired mental state continuity.
Solution Approach 2:
Multiple audio segments with similar characteristics are merged together to create an extended audio track. By combining segments that have matching amplitude modulation patterns, the system achieves continuous playback without perceptible discontinuities, resolving the conflict between variety and continuity.
2Duration of action of stationary object
If a single audio track is looped to extend playback duration, then audio continuity is maintained, but discontinuities occur due to differences between outro and intro portions
Solution Approach 1:
The system performs preliminary analysis of the audio track to identify segments with similar amplitude modulation characteristics before creating the extended version. By pre-segmenting and analyzing the audio, the system can select appropriate segments for joining that ensure seamless transitions and maintain acoustic continuity throughout the extended playback.
Solution Approach 2:
The system changes the parameter of audio selection from using the original fixed track structure to using dynamically selected segments based on amplitude modulation characteristics. This parameter change allows the system to extend playback duration while maintaining continuity by selecting segments with matching acoustic parameters.
3Duration of action of stationary object
If audio segments are joined to extend track length, then continuous playback is achieved, but complex analysis and processing are required
Solution Approach 1:
The system creates a simplified representation or copy of the audio track's amplitude modulation characteristics to guide the segment selection and joining process. By working with a simplified model of the audio properties rather than the full complex audio data, the system reduces processing complexity while still achieving accurate segment matching for continuous playback.
Data Source
AI summary
Embodiments disclosed herein extending an audio track by joining similar portions. Audio features (e.g., spectral features, modulation features) may be extracted from the audio track. The audio track may be segmented, e.g., based on the audio features, and each segment may be slid through the audio track using a timestep. In each timestep, the sliding segment may be compared to the underlying portion of the audio track and a similarity score (e.g., a cross-correlation) may be generated. A self-similarity matrix may be generated based on the comparisons involving all the segments. The self-similarity matrix may be analyzed for peak values and segments corresponding to the peak values may be joined to extend the audio track. The embodiments may be applied to any kind of audio including music, ambient noise, speech, etc.