Audio Pitch-Shifting Apparatus for Doppler Effect Reproduction

Solution Overview

Problem

Conventional pitch-shifting algorithms for audio signals require high computational complexity, limiting their use in devices with limited processing capabilities, especially when reproducing the Doppler effect in multi-channel audio services.

Innovation Solution

The method involves an apparatus that performs stepwise stretching or pulling of audio signal frequency components based on the distance between an audio object and a listener, allowing for the reproduction of the Doppler effect with reduced computational complexity by deleting and duplicating frequency components according to specific intervals and positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional pitch-shifting algorithms are used to reproduce the Doppler effect, then the audio quality and Doppler effect accuracy are improved, but the computational complexity increases significantly

Engineering Contradiction:
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the pitch-shifting process into discrete frequency bin operations. Instead of applying complex algorithms to the entire audio signal, it divides the spectrum into individual frequency bins and processes each bin independently based on its frequency position, significantly reducing computational complexity while maintaining Doppler effect accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter being manipulated from time-domain signal processing to frequency-domain bin indexing. By using frequency-based parameter changes where each bin is shifted according to its frequency position relative to the center frequency, the system achieves accurate Doppler reproduction with minimal computation.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If time stretching or resampling algorithms are applied to pitch-shift audio signals, then the pitch-shifting effect is achieved, but the computational complexity and processing time increase

Engineering Contradiction:
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the essential characteristic of pitch-shifting by removing frequency components above the Nyquist frequency after shifting. This extraction approach eliminates the need for complex time-stretching or resampling algorithms, achieving pitch-shifting with minimal computational overhead.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses frequency bin copying where bins are replicated and repositioned according to the Doppler shift calculation. This copying method in the frequency domain replaces complex time-domain interpolation and resampling operations, dramatically simplifying the algorithm while maintaining audio quality.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the reproduction of the Doppler effect with low computational complexity, maintaining the number of frequency components and bandwidth, thus supporting real-time Doppler effect reproduction for multiple audio objects in various terminals, such as 6DOF audio rendering systems.

Implementation Method 1

there is a pitch-shifting algorithm that occurs in the Doppler phenomenon during sound processing based on a moving speed of the audio object

Methodology Applied
Scientific EffectDoppler effect: Doppler Effect

Data Source

PatentUS11778376B2Apparatus and method for pitch-shifting audio signal with low complexity
Publication Date: 2023.10.03
  • US11778376B2 patent drawing
  • US11778376B2 patent drawing
  • US11778376B2 patent drawing

AI summary

An apparatus and method for pitch-shifting an audio signal with low complexity are disclosed. The method includes identifying a distance between an audio object included in the audio signal and a listener, checking whether the distance between the audio object and the listener decreases, and performing stepwise stretching pitch-shifting of repeatedly using at least one of frequency components of the audio signal when the distance between the audio object and the listener decreases.