Synthesizer Spatial Metadata Generation from Control Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing synthesizers require a separate spatialization process after sound generation, limiting creative options and making it laborious to integrate spatialization into the sound-design process, especially in object-based productions like Dolby Atmos, where internal modulation signals used for sound shaping are not available for spatial metadata generation.
Innovation Solution
An apparatus and method that generate spatial metadata directly from control signals used for sound shaping, allowing for integrated spatialization within the synthesizer architecture, enabling the simultaneous output of audio signals and spatial metadata, which can then be used for object-based rendering without an intermediate rendering step.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If spatialization is performed as a separate process after sound generation, then existing synthesizer architecture is maintained, but creative options are limited and spatial integration is laborious
Solution Approach 1:
The patent merges the spatialization process with the sound generation process by integrating a spatial metadata generator into the synthesizer architecture. The spatial metadata generator receives control signals from the same modulators (LFOs, envelopes) that shape the audio signal, allowing spatial parameters to be defined alongside sound parameters in a unified workflow.
Solution Approach 2:
The control signals generated by modulators serve dual purposes: they simultaneously shape the audio signal characteristics and generate spatial metadata. This multi-functionality allows the same modulation architecture to control both sound shaping and spatial positioning, eliminating the need for separate spatialization processing.
2Loss of information
If spatialization is performed separately using rendered audio, then existing workflows are followed, but internal modulation signals are unavailable for spatial metadata generation
Solution Approach 1:
The spatial metadata is generated in advance during the sound generation process, using the control signals that are already available and being used for audio shaping. This preliminary generation of spatial metadata eliminates the need for later processing steps where control signals would no longer be accessible.
Solution Approach 2:
The control signals act as intermediaries that bridge the sound generation process and spatial metadata generation. By using these existing control signals to drive both audio modulation and spatial parameter generation, the system maintains information flow without requiring separate processing chains.
3Manufacturing precision
If laborious editing of spatial metadata is performed manually, then precision can be achieved, but time consumption increases significantly
Solution Approach 1:
The system performs spatial metadata generation automatically through the synthesizer's own control signals, without requiring manual intervention. The modulators that naturally shape the sound automatically generate the corresponding spatial metadata, making the system self-sufficient and eliminating time-consuming manual editing while preserving accuracy through the direct relationship between sound shaping and spatial positioning.
Data Source
AI summary
Described are apparatus for generating and/or processing audio signals. One apparatus includes: a first stage for obtaining an audio signal; a second stage for modifying the audio signal based on one or more control signals for shaping sound represented by the audio signal; a third stage for generating spatial metadata related to the modified audio signal, based at least in part on the one or more control signals; and an output stage for outputting the modified audio signal together with the generated spatial metadata. Also described are corresponding methods, as well as corresponding programs and computer-readable storage media.