Audio Mixing Beat Feature Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio mixing methods often result in songs that are significantly different from the original, losing the target song's rhythm due to re-sorting audio segments based on chord sequences from musical instrumental materials.

Innovation Solution

The method involves acquiring an audio material, determining the beat feature of the target audio, performing beat-type adjustment on the audio material, and optionally performing chord adjustment to ensure the audio material aligns with the target audio's rhythm and chord features, thereby maintaining the original rhythm during mixing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio segments are resorted according to the sequence of chords in the musical instrumental material, then the audio mixing can be performed, but the original rhythm of the target song is lost and the mixed song becomes greatly different from the target song

Engineering Contradiction:
Improveaudio mixing capabilityVSAvoidoriginal rhythm
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The target audio is segmented into multiple audio segments based on beat features, and the musical instrumental material is segmented into material segments based on chord features. This segmentation allows independent processing of each segment while maintaining the overall rhythm structure through beat-based organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different segments are processed with different characteristics: audio segments are organized by beat features to preserve rhythm, while material segments are organized by chord features for harmonic compatibility. This local differentiation allows the mixed audio to maintain both rhythmic integrity and harmonic suitability.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If audio segments are selected and combined based on chord correspondence, then the musical instrumental material can be integrated, but the rhythm and temporal structure of the target song deteriorates

Engineering Contradiction:
Improvemusical material integrationVSAvoidrhythm accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The target audio is pre-segmented into audio segments based on beat features before the mixing process. This preliminary organization establishes the rhythmic framework that will guide the subsequent selection and combination of material segments, ensuring rhythm accuracy is maintained throughout the mixing process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Beat features serve as an intermediary between the temporal structure of the target audio and the harmonic structure of the musical instrumental material. This intermediary allows material segments to be selected based on chord compatibility while being aligned with the beat-based temporal structure, thus preserving rhythm accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3618055B1Audio mixing method and terminal, and storage medium
Publication Date: 2023.12.27 GUANGZHOU KUGOU COMP TECH CO LTD
  • EP3618055B1 patent drawingFigure 1~2
  • EP3618055B1 patent drawingFigure 3

AI summary

The present disclosure provides a method, an apparatus and a storage medium for mixing audio, pertaining to the technical field of multimedia. The method includes: after acquiring an audio material to be mixed, determining a beat feature of a target audio, performing beat adjustment on the audio material based on the beat feature of the target audio; and performing audio mixing on the target audio based on the audio material adjusted by the beat adjustment. Since the beat feature refers to a correspondence between a beat used in the target audio and time point information, it can be seen that in the present disclosure, a beat adjustment is performed on the audio material based on the correspondence between a beat used in the target audio and time point information, instead of re-sorting the audio segments obtained by segmenting a target song based on a chord sequence in a musical instrumental material. In this way, by performing audio mixing on the target audio based on the audio material being adjusted by the beat adjustment, the original rhythm of the target audio could be retained, which is favorable to the promotion of the method for mixing audio according to the present disclosure.