3D Audio Synthesis With Real-Time Spatialization and Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current digital audio synthesizers lack immersivity, direct multidimensional reproduction, and user-interactivity, and are limited in generating innovative sounds and user-rulable parameters, restricting their application in immersive and interactive audio environments.
Innovation Solution
A method and system that spatializes and filters digital audio signals at audio rate using spatial commands and filter instructions, incorporating techniques like Vector Base Amplitude Panning, Ambisonics, and digital filters to enhance immersivity, interactivity, and parameter control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If current synthetisers are used to generate synthetised audio signals, then basic sound synthesis is achieved, but immersivity effect on listeners is low or limited
Solution Approach 1:
The patent transitions from traditional two-dimensional stereo audio to three-dimensional spatial audio by introducing height and depth dimensions. The system uses multiple loudspeakers arranged in a three-dimensional configuration and applies spatialization methods that calculate audio signal distribution across these dimensions, enabling listeners to perceive sound sources in immersive 3D space rather than flat stereo fields.
Solution Approach 2:
The synthetiser is designed to perform multiple functions: traditional sound synthesis, spatialization in three-dimensional space, digital filtering, and real-time user interaction. The system can adapt to different spatial configurations of loudspeakers and support various spatialization methods, making it universally applicable to different audio reproduction environments while maintaining core synthesis capabilities.
2Adaptability or versatility
If current synthetisers are used, then sound synthesis is possible, but direct reproduction by multidimensional reproduction systems is not achieved
Solution Approach 1:
The audio signal processing is divided into distinct functional modules: sound synthesis module, spatialization module, digital filtering module, and output control module. Each module handles a specific aspect of audio processing, allowing the system to generate multidimensional audio signals that can be directly reproduced by compatible reproduction systems without requiring complex integrated processing.
Solution Approach 2:
The system explicitly designs audio signals with three-dimensional spatial information embedded, including position, distance, and elevation data. This multidimensional signal structure directly matches the requirements of multidimensional reproduction systems, enabling seamless compatibility without additional conversion or adaptation layers.
3Ease of operation
If current synthetisers are used, then sound synthesis is achieved, but instant or near instant interactivity with ongoing sound is not provided
Solution Approach 1:
The system implements real-time feedback loops where user inputs (via keys, knobs, sliders, or other controls) are immediately processed and reflected in the ongoing sound generation. The feedback mechanism ensures that parameter changes are instantly applied to the synthesis engine, providing users with near-instantaneous interactivity and allowing dynamic control of spatial and spectral parameters during sound reproduction.
Solution Approach 2:
The synthetiser pre-configures multiple controllable parameters and spatial settings that can be instantly modified by users. Control interfaces are designed with pre-mapped parameters that respond immediately to user actions, eliminating processing delays and enabling real-time manipulation of sound characteristics without requiring complex computation or signal re-generation.
4Adaptability or versatility
If current synthetisers are used, then basic sound generation is possible, but performance in generation of new sounds over spectral and spatial sound-domains is reduced or limited
Solution Approach 1:
The patent merges spectral processing and spatial processing into a unified synthesis architecture. Both spectral parameters (frequency, timbre) and spatial parameters (position, distance, elevation) are processed simultaneously and integrated in the signal generation stage, allowing users to create novel sounds by combining spectral effects with spatial positioning in ways that enhance creative productivity and sound exploration.
5Ease of operation
If current synthetisers are used, then limited range of user-rulable parameters is provided, but this restricts user capacity of generating sounds
Solution Approach 1:
The control interface is designed with universal parameters that can be applied across multiple synthesis dimensions. Users can control spectral characteristics, spatial positioning, temporal evolution, and filtering effects through a unified set of controllable parameters, expanding the range of generatable sounds while maintaining ease of operation through consistent control mechanisms.
Data Source
Figure 1
Figure 2
AI summary
Methods are provided of three dimensionally synthetizing a digital audio signal depending on spatial commands and filter instructions. Such methods comprise: performing, depending on the spatial commands, a spatialization method at audio rate on the digital audio signal to spatialize it and therefore produce a spatialized audio signal whose reproduction implements, in a three dimensional, 3D, audible space, spatialized virtual sound sources defined by spatial parameters; performing, depending on the filter instructions, digital filtering on the spatialized audio signal to produce an evolved or synthetised audio signal whose reproduction implements, in the 3D audible space, evolved virtual sound sources; and providing the evolved audio signal to a plurality of loudspeakers or headphones to reproduce the evolved audio signal and, therefore, implement the evolved virtual sound sources in the 3D audible space. Systems, computer systems and computer programs that are suitable for performing such methods are also provided.