Audio Spectral Formant Processing for Natural Sampler Transposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional audio samplers produce unnatural tonal impressions due to static loudness variation with strike force and audible transitions between samples, failing to accurately replicate the dynamic tone color and formant structure of natural instruments.

Innovation Solution

The method involves removing and impressing specific spectral properties from audio data to dynamically manipulate tone color and pitch, using filter banks and spectral analysis to create a natural tonal impression by filtering out and reintroducing formant resonances, and employing normalization and denormalization filters for precise tone color transformation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If cross-fading is used between samples to prevent audible transitions, then the transition smoothness is improved, but beat frequencies occur causing unnatural tonal impression

Engineering Contradiction:
Improvetransition smoothnessVSAvoidbeat frequencies
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent extracts the spectral properties (formant structure, tone color) from individual samples and separates them from the fundamental frequency and amplitude information. By removing the spectral fingerprint from each sample and treating it as an independent component, the system can manipulate tone color without the harmful interactions that occur during cross-fading of complete samples.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent dynamically adjusts spectral properties in real-time based on strike force and pitch variations. Instead of using static samples or pre-defined cross-fade transitions, the system continuously modifies the spectral fingerprint to match the natural behavior of acoustic instruments, creating smooth transitions without beat frequencies.

Inventive Principle:
Principle #15Dynamics

2Reliability

If formant correction is applied to equalize formant resonances before transposition, then natural tonal results are achieved, but processing complexity increases

Engineering Contradiction:
Improvetonal naturalnessVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary analysis of spectral properties from reference samples at the beginning, extracting formant structures and tone color characteristics before actual audio processing. This pre-computed spectral fingerprint information is then reused during real-time processing, avoiding the need for complex repeated calculations and reducing overall processing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a simplified spectral model (spectral fingerprint) that copies the essential formant structure and tone color properties of the original instrument samples. This copied spectral information is then applied to synthesized tones, achieving natural tonal results without requiring complex real-time analysis of complete waveforms.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If multiple samples are used for different strike forces, then tone color variation is improved, but audible transitions and beat frequencies occur

Engineering Contradiction:
Improvetone color variationVSAvoidbeat frequencies
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The patent changes the spectral parameters (formant frequencies, bandwidths, amplitudes) dynamically based on strike force intensity. Instead of switching between discrete samples, the system continuously adjusts spectral fingerprint parameters to reflect the natural progression of tone color with varying strike force, eliminating the discontinuities that cause beat frequencies.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system transitions from static multiple-sample selection to dynamic spectral parameter adjustment. The spectral fingerprint is continuously modified in real-time according to the instantaneous strike force and pitch, creating smooth, natural-sounding variations without the abrupt transitions and interference patterns that occur with discrete sample switching.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for a natural tonal impression by accurately varying tone color and pitch without generating beat frequencies, providing a precise formant correction and real-time processing capability, surpassing conventional methods in handling harmonics and tone transitions.

Implementation Method 1

removing with the method for processing audio data according to the invention from the spectrum of the audio data at least a first spectrum with at least one first spectral property

Methodology Applied
Scientific EffectSpectral filtering: Filter (electronic)

Implementation Method 2

A part of this method uses the filter bank composed of EQ (equalizer) filters

Methodology Applied
Scientific EffectFilter bank processing: Filter (electronic)

Implementation Method 3

If a tone is directly transposed inside a sampler, then the formant structure is transposed with it

Methodology Applied
Scientific EffectFrequency transposition:

Data Source

PatentUS8750530B2Method and arrangement for processing audio data, and a corresponding corresponding computer-readable storage medium
Publication Date: 2014.06.10 NATIVE INSTRUMENTS
  • US8750530B2 patent drawing
  • US8750530B2 patent drawing
  • US8750530B2 patent drawing

AI summary

A method and an arrangement for processing audio data, and a corresponding computer program and a corresponding computer-readable storage medium, which can be used, in particular, in the field of audio software and sampling. At least a first spectrum with at least one first spectral property is removed from the spectrum of the audio data, the resulting spectrum of the audio data is transformed after removal of the at least one first spectrum, and the at least one first spectrum or at least one of the first spectrum and/or at least one second spectrum with at least one second spectral property are impressed on the transformed spectrum.