Multidimensional audio synthesizer and method for generating spatialized sound waves
The multidimensional audio synthesizer addresses the lack of spatialization in traditional synthesizers by generating spatialized sound waves through spatial coordinate integration and decorrelation, enhancing immersive audio experiences.
Patent Information
- Application Number
- FR2023008482
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2023-05-05
- Filing Date
- 2023-08-04
- Publication Date
- 2025-08-15
- Estimated Expiration
- 2043-08-04
AI Technical Summary
Existing musical production techniques using instruments like synthesizers primarily generate mono or stereo sounds without effective spatialization, failing to integrate immersive sound experiences.
A multidimensional audio synthesizer that generates spatialized sound waves by incorporating spatialization into its operation, utilizing elements like VCO, VCF, VCA, LFO, and EG, with spatial coordinate generation and decorrelation methods to create spatially distributed audio instances.
Enables the generation of spatialized sounds that enhance immersive audio experiences, aligning with classic synthesizer operations while integrating spatial coordinates for dynamic and temporal variations.
Smart Images

Figure 00000049_0000 
Figure 00000049_0001 
Figure 00000049_0002
Abstract
Description
Title of the invention: Multidimensional audio synthesizer and method for generating spatialized sound waves TECHNICAL FIELD OF THE INVENTION
[0001] The invention relates to the generation of spatialized sound waves. In particular, the present invention relates to a sound wave generation method and a multidimensional audio synthesizer. STATE OF THE ART
[0002] With the advent of 3D audio, many studios are equipping themselves with listening systems compatible with this type of new format, and more and more terminals such as mobile phones, tablets, computers, televisions, etc., accept at least one 3D audio format.
[0003] As far as content creation is concerned, sound recording techniques are already very advanced, particularly through techniques from 5.1 sound recording and techniques linked to virtual reality, particularly with certain microphones and certain formats.
[0004] However, apart from these acoustic sound recordings, the techniques and methods of musical production using instruments such as synthesizers, guitars or any electric or digital instrument remain the same and are based on the creation of sounds, generally mono or stereo, and their spatialization in a second step. In order to address this problem while helping creators become accustomed to immersive sound, the present invention proposes an innovative solution.
[0005] Other objects, features and advantages of the present invention will become apparent from the following description and accompanying drawings. It is understood that other advantages may be incorporated.
[0006] SUMMARY
[0007] The present invention thus relates to a synthesizer-type instrument, which may be virtual, which integrates spatialization in an intuitive and musical manner, while being as in phase as possible with the classic operation of synthesizers.
[0008] The present invention relates to an audio synthesizer configured to generate at least one sound wave distributed according to at least one spatial dimension, said audio synthesizer comprising at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one voice of polyphony, preferably at least 2 voices of po- polyphony, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f, preferably defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a user-defined natural nominal frequency; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. Preferably, at least M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e. Preferably, at least M' ' control instances, each control instance M' ' comprising at least one primary envelope tracking and control module EF; f. At least one VCSO sound wave generator comprising at least two instances of said primary VCO sound wave generator; g. At least one VCSF filter comprising at least two instances of said primary VCF filter; h. At least one VCSA amplifier comprising at least two instances of said primary VCA amplifier, said VCSA amplifier comprising at least one multiplier element; i. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; j. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; k. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; 1. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; m. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or the frequency of at least one VCSO sound wave generator, the phase and / or the frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
[0009] The present invention thus makes it possible to generate spatialized sounds.
[0010] The present invention also relates to a method for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention, said method comprising at least the following steps: a. Input of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI keyboard (Musical Instrument Digital Interface); Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters comprising at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation of at least N audio instances of said set E; c. Generating at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of primary VCO sound wave generators; d. Filtering said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of primary VCF filters; e. Amplification of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of primary VCA amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being configured to control a set of low-level parameters, such as for example frequencies, phases or even the positions in space of the different audio instances; ii. A low-level parameter; iii. A spatial coordinate of said audio instance considered; g. Spatialization of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.
[0011] The present invention also relates to a computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to the present invention.
[0012] The present invention also relates to a non-transitory memory medium comprising a computer program product according to the present invention. BRIEF DESCRIPTION OF THE FIGURES
[0013] The aims, objects, as well as the characteristics and advantages of the invention will emerge more clearly from the detailed description of an embodiment thereof which is illustrated by the following accompanying drawings in which:
[0014] [Fig.l] [Fig.l] schematically represents a synthesizer according to an embodiment of the present invention.
[0015] [Fig.2] [Fig.2] schematically represents the signal path of a synthesizer classic.
[0016] [Fig.3] [Fig.3] schematically represents the multiplication of the elements of a synthesizer into a certain number of instances according to an embodiment of the present invention.
[0017] [Fig.4] [Fig.4] schematically represents the spatial positions of the 4 instances of 4 polyphonic voices according to an embodiment of the present invention.
[0018] [Fig.5] [Fig.5] schematically represents the decorrelation of the instances of a VCSO according to an embodiment of the present invention.
[0019] [Fig.6] [Fig.6] schematically represents the decorrelation of the instances of a VCSF according to an embodiment of the present invention.
[0020] [Fig.7] [Fig.7] schematically represents the decorrelation of the instances of a SEG according to an embodiment of the present invention.
[0021] [Fig.8] [Fig.8] schematically represents the decorrelation of the instances of a VCSA according to an embodiment of the present invention.
[0022] [Fig.9] [Fig.9] schematically represents the decorrelation of the instances of a SEF according to an embodiment of the present invention.
[0023] [Fig. 10] [Fig. 10] schematically represents the control parameters of the VCSS according to an embodiment of the present invention.
[0024] [Fig. 11] [Fig. 11] schematically represents the signal path of a synthesizer according to an embodiment of the present invention.
[0025] [Fig. 12] [Fig. 12] schematically represents examples of waveforms.
[0026] [Fig. 13] [Fig. 13] schematically represents synthesis techniques using several VCSOs according to one embodiment of the present invention.
[0027] [Fig. 14] [Fig. 14] schematically represents the signal path of an SFX within a spatial synthesis chain according to an embodiment of the present invention.
[0028] [Fig. 15] [Fig. 15] schematically represents the signal path of a polyphonic voice according to an embodiment of the present invention.
[0029] [Fig. 16] [Fig. 16] schematically represents the spatial distribution of 16 instances of 4 voices of polyphony according to an embodiment of the present invention.
[0030] [Fig. 16a] [Fig. 16a] schematically represents the case where the Sspd is equal to 0% and where the Dspd is equal to 0% according to an embodiment of the present invention.
[0031] [Fig. 16b] [Fig. 16b] schematically represents the case where the Sspd is equal to 30% and where the Dspd is equal to 0% according to an embodiment of the present invention.
[0032] [Fig. 16c] [Fig. 16c] schematically represents the case where the Sspd is equal to 30% and where the Dspd is equal to 30% according to an embodiment of the present invention.
[0033] [Fig. 17] [Fig. 17] schematically represents the distribution of 16 instances during execution of a trajectory of a polyphonic voice according to an embodiment of the present invention.
[0034] [Fig. 18] [Fig. 18] schematically represents an effect module according to an embodiment of the present invention.
[0035] [Fig. 19] [Fig. 19] schematically represents a method according to an embodiment of the present invention.
[0036] The drawings are given as examples and are not limiting of the invention. They constitute schematic representations of principle intended to facilitate the understanding of the invention and are not necessarily on the scale of practical applications. In particular, the dimensions are not representative of reality. DETAILED DESCRIPTION
[0037] Before beginning a detailed review of embodiments of the invention, optional features which may possibly be used in combination or alternatively are set out below:
[0038] According to one example, the VCSS control module comprises at least one parameter taken from at least: a. A first parameter, preferably called Static Spread (Sspd), said first parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value; b. A second parameter, preferably called Dynamic Spread (Dspd), said second parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value modulated by at least one external source, preferably an envelope generator; c. A third parameter, preferably called Time Spread (Tspd), said third parameter being configured to apply at least one variation of at least one time parameter of the audio synthesizer, preferably of an envelope generator;
[0039] According to one example, the present invention comprises at least one of: a. M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; b. M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; c. M” control instances, each M” control instance comprising at least one primary envelope tracking and EF control module.
[0040] According to one example, the present invention comprises at least one of: a. An LFSO wave generator comprising at least two instances of said primary LFO wave generator; b. A SEG control module comprising at least two instances of said primary EG control module; c. An SEF control module comprising at least two instances of said primary envelope tracking and EF control module.
[0041] According to one example, each oscillator of the primary sound wave generator VCO comprises a frequency, this frequency being configured to be variable, preferably as a function of at least one spatial coordinate.
[0042] According to one example, each oscillator of the primary sound wave generator VCO comprises a phase, this phase being configured to be variable, preferably as a function of at least one spatial coordinate.
[0043] According to an example, the primary sound wave generator VCO is configured to generate sound waves whose shape may be one of: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wavetable.
[0044] According to one example, the primary VCF filter is configured to be a low-pass and / or high-pass and / or band-pass type filter.
[0045] According to one example, the VCA amplifier is configured to apply a predetermined amplitude to at least one sound wave, said amplitude being configured to vary around a predetermined amplitude, called nominal; Advantageously, said multiplier element of the primary VCA amplifier is configured to be a function of at least one spatial coordinate.
[0046] According to one example, the primary LFO wave generator comprises at least one oscillator whose frequency is configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each primary LFO wave generator.
[0047] According to one example, the primary LFO generator comprises at least one phase, said phase being configured to vary around a nominal phase.
[0048] According to one example, said natural nominal frequency is predetermined, advantageously determined by the user.
[0049] According to one example, said nominal frequency is predetermined, advantageously determined by the user.
[0050] According to one example, a sound wave generator may be called a VCSO, an acronym for Voltage Control Spatial Oscillator.
[0051] According to one example, several VCSO sound wave generators can be used simultaneously allowing the creation of complex sound waveforms.
[0052] According to one example, the sound waves generated by each VCSO sound wave generator are configured to be frequency and / or amplitude modulated.
[0053] According to an example, a VCSO comprises N VCO such that VCOn with n=1, ..., N.
[0054] According to one example, said control module EG may be an envelope generator preferably comprising at least 2, advantageously at least 3 adjustable parameters configured to vary around nominal, preferably predetermined, values.
[0055] According to one example, the VCSS control module is configured to apply at least one offset, to at least one frequency in the case of controls of a filter, to at least one frequency in the case of controls of an oscillator, to at least one time parameter in the case of controls of an envelope generator.
[0056] According to one example, the present invention comprises at least one so-called sliding gain that can be used by at least one user to switch from one filter to another filter in the case where several VCSF filters are used.
[0057] According to one example, the SEG can control a so-called sliding gain which can be used to switch from one filter to another filter in the case where several VCSF filters are used.
[0058] According to an example, the present invention comprises at least one effect module configured to generate at least one effect, said effect module comprising at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each summed polyphony voice; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multi-channel audio signal, preferably any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM mixing matrix module configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one ME processing module, said first IM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal from at least one output channel of the first mixing matrix module IM; d. A second OM mixing matrix module configured to distribute the processed audio signals output from said processing module in at least said virtual space and to at least one BR binaural rendering module and / or to at least one SO output module, said second OM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates.
[0059] According to one example, the method according to the present invention comprises a step of controlling, by at least one envelope generator, the spatialization and / or a parameter of the synthesizer. Advantageously, when a note is entered by at least one user, all the envelope generators of the present invention are activated, preferably simultaneously (for example the SEG of the filter, the SEG of the VCSA, etc.).
[0060] According to one example, said N audio instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0061] According to one example, said M control instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), of low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0062] According to one example, said M' control instances are configured to undergo variations of at least one of their parameters (attack and / or decay and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0063] According to one example, said M' control instances are configured to undergo variations of at least one of their parameters (threshold and / or attack and / or sustain and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0064] According to one example, the method according to the present invention comprises at least one step of creating at least one instance associated with said nominal frequency value, said instance comprising at least said set E.
[0065] According to one example, the decorrelation step comprises at least one step of controlling at least said main sound wave generator VCSO by at least said control module VCSS.
[0066] According to one example, the decorrelation step comprises at least one step of controlling at least said VCSF filter by at least said VCSS control module.
[0067] According to one example, the decorrelation step comprises at least one step of controlling at least said VCSA amplifier by at least said VCSS control module.
[0068] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer by at least said SEG control module, preferably said SEG control module comprising at least M' control instances.
[0069] According to one example, the decorrelation step comprises at least one step of controlling at least said SEG control module by at least said VCSS control module.
[0070] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer from at least one other wave generated by the LFSO wave generator, said LFSO wave generator comprising at least M control instances.
[0071] According to one example, the decorrelation step comprises at least one step of controlling at least said LFSO wave generator by at least said VCSS control module.
[0072] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer by at least said module of SEF envelope tracking and control, said SEF envelope tracking and control module comprising at least M” control instances.
[0073] According to one example, the decorrelation step comprises at least one step of controlling at least said envelope tracking and SEF control module by at least said VCSS control module.
[0074] According to an example, the method according to the present invention comprises, before or after the spatialization step, a step of assembling said filtered sound wave with at least one delay line and / or said other wave with at least one other delay line, by the SFX assembly module comprising at least N' audio instances.
[0075] According to one example, the spatialization step comprises at least one step of generating at least one trajectory, by the trajectory generator, by modifying in time, preferably in real time, at least one spatial coordinate of said filtered sound wave.
[0076] According to one example, the method according to the present invention comprises, after the spatialization step, at least one audio rendering step by at least one rendering engine.
[0077] According to one example, the variations that allow the decorrelation of the instances are variations applied via at least one of 3 high-level control parameters taken from: the Static Spread (Sspd), the Dynamic Spread (Dspd) and the Time Spread (Tspd).
[0078] According to one example, these high-level parameters control a set of low-level parameters (e.g. variation of the frequencies / phases / positions in space of the different instances).
[0079] According to one example, the Sspd parameter operates static variations.
[0080] According to one example, the parameter Dspd operates variations dynamically via a external source for example an envelope generator.
[0081] According to one example, the parameter Tspd operates variations of the temporal parameters (for example the parameters of the instances of a SEG).
[0082] It is specified that in the context of the present invention, the following terms have the following definitions: a. VCO (Voltage Controlled Oscillator): sound wave generator, in the audible spectrum (20 Hz to 20,000 Hz). b. VCF (Voltage Controlled Filter): filter allowing only certain frequencies to pass. c. VCA (Voltage Controlled Amplifier): intensity control. Combined with an envelope generator, it allows you to apply these envelopes to a sound. d. EG (Envelope Generator): envelope generator, traditionally with 4 steps: Attack, Decay, Sustain, Release: i. Attack: attack time; ii. Decay: release time just after the attack; ii. Sustain: holding value to which the decay leads; iv. Release: release time. e. MIDI (Music Instrument Digital Interface): protocol for communicating a musical performance through computer data. f. Note ON / OFF: The action of playing a note, then releasing it. In the case of a traditional envelope generator, Note On triggers the Attack and Decay stages, Note Off, the Release. In between, if the user holds down the note, the signal remains constant, at the Sustain value. g. LFO (Low Frequency Oscillator): generator of frequencies below the hearing threshold, allowing other parameters to be controlled. h. EF (Envelope Follower): analysis of the dynamics of a signal in order to control a parameter. i. Threshold: detection threshold during signal analysis; ii. Hold: duration of maintaining a signal; üi. Envelope: curve describing the evolution of a property of a sound (for example its intensity) as a function of time. i. Unison: A function that allows a polyphonic synthesizer to play a number of polyphonic voices at the same time from the same Note On / Off control. j. Audio engine: A computer program that converts audio signals and / or their spatial coordinates to loudspeakers, or to any other audio format.
[0083] The examples and conditional language used in this specification are primarily intended to assist the reader in understanding the principles of the present invention and not to limit its scope to these specifically cited examples and conditions. It will be understood that those skilled in the art can devise various arrangements which, although not explicitly described or shown herein, nevertheless embody the principles of the present invention and are included within its spirit and scope.
[0084] Further, as an aid to understanding, the following description may describe relatively simplified implementations of the present invention. As will be understood by those skilled in the art, various implementations of the present technology may be of greater complexity.
[0085] Furthermore, the following description listing the principles, aspects, and implementations of the present invention, as well as their specific examples, is intended to encompass both their structural and functional equivalents, whether presently known or developed in the future. Thus, for example, it will be appreciated by those skilled in the art that all block diagrams herein represent conceptual views of circuits illustrative diagrams incorporating the principles of the present invention. Similarly, it will be understood that all flowcharts, and the like, depict various processes that may be substantially represented on computer-readable media and thereby executed by a computer or processor, whether or not that computer or processor is explicitly depicted.
[0086] The functions of the various elements shown in the figures, including any functional block referred to as a "processor" or "module", may be provided by the use of dedicated hardware as well as hardware capable of executing software in association with an appropriate computer program or instructions. When provided by a processor, the instructions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. In some embodiments of the present invention, the processor may be a general-purpose processor, such as a central processing unit (CPU), for example.Furthermore, the explicit use of the term "processor" should not be interpreted as referring exclusively to hardware capable of executing software and may implicitly include, but is not limited to, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. Other hardware, conventional and / or custom, may also be included.
[0087] Software modules, or simply modules that are assumed to be software, may be represented herein as any combination of flowchart elements or other elements indicating the execution of process steps and / or a textual description. Such modules may be executed by hardware that is expressly or implicitly represented. Furthermore, it is to be understood that the module may include for example, but not limited to, computer program logic, computer program instructions, software, firmware, hardware circuitry, or a combination thereof that provides the required capabilities.
[0088] The present invention relates to a 3D audio synthesizer. Its description will be made in two phases: the presentation of the concepts of spatial synthesis by decorrelation, and its application in a synthesizer according to the present invention.
[0089] Advantageously, the general principle of the invention is to synthesize sounds and associated spatial coordinates.
[0090] Then, and in order to be listened to, the rendering can be carried out by an audio engine.
[0091] Thus, as can be seen in [Fig.l], the synthesis and coordinate blocks grouped in a gray frame 20 concern spatial synthesis, while the blocks surrounded by the frame 30 are those implemented in a synthesizer, for example that of the present invention. The keyboard 10 represents an input interface for example.
[0092] According to one embodiment, the present invention is a method. This method can be implemented through a computer program product, preferably executable by a computer or at least by a processor. Thus, according to one embodiment, the present invention can be in the form of a computer program, that is to say a series of steps. Advantageously, this computer program can be configured to cooperate with at least one controller, such as an input interface, such as for example a piano keyboard. In addition, and in order to emit sounds, the present invention is preferably configured to cooperate with at least one speaker device and / or an audio headset.
[0093] In order to facilitate the understanding of the present invention, some reminders on the operation of a synthesizer in general follow.
[0094] Generally speaking, and in a manner well known to those skilled in the art (see for example Moog, RA (1977). Electronic music synthesizer. Patent 644,864 - US Patent.), a synthesizer comprises at least the following elements: a. Oscillator (VCO), also called primary sound wave generator; b. Filter (VCF), also called primary filter; c. Amplifier (VCA), also called primary amplifier.
[0095] Thus, VC is the acronym for Controlled Voltage and indicates that each element O (Oscillator), F (Frequency) or A (Amplifier) is controlled in intensity and time.
[0096] Usually, the nominal frequency generated by the VCO is controlled by the user using a piano-type keyboard for example. The VCF and VCA are controlled by a four-step envelope generator (EG) (Attack, Decay, Sustain, Release), triggered by each action on the keyboard, allowing a spectral and temporal envelope to be created for the sound produced by the VCO.
[0097] Each of these elements is multiplied by the number of polyphonic voices, that is to say the number of notes that can be played simultaneously.
[0098] [Fig.2] represents the signal path of a classic synthesizer. We find the VCO, voltage-controlled by a piano keyboard in analog instruments, whose signal is filtered by a VCF, said VCF being able to be a high-pass filter, a low-pass filter or a band-pass filter. Then the signal passes through a VCA amplifier which modifies said signal according to an envelope generator. Thus, the VCA makes it possible to create a temporal envelope to the sound, it is also common for the cutoff frequency of the filter to be modulated by another envelope generator, which makes it possible to produce a spectral envelope to the sound.
[0099] Envelope generators are generally composed of 4 steps: Attack (a), Decay (d), Sustain (s) and Release (r). When the user plays a note, it triggers the Attack and Decay phases, the signal is then maintained at the Sustain value, which generally depends on the velocity, in other words the force with which the note is played, finally when the user releases the note, it triggers the Release phase.
[0100] These elements are multiplied by the number of polyphony voices, that is, the number of notes that can be played at the same time. The polyphony voices are added together and often pass through an effect section, such as: reverb, chorus, Ranger, etc.
[0101] In parallel, most synthesizers have one or more modulation modules, notably of the LFO type, an acronym for Low Frequency Oscillator. From a technical point of view, an LFO differs little from a VCO, except that the LFO works in low frequencies, with wavelengths that can last several minutes. It should be noted that VCOs and LFOs can be made up of any type of waveform (sinusoidal, triangular, square, etc.).
[0102] In the prior art, there are a number of spatialization tools, but very little work has attempted to associate these tools with sound generation. In particular, no element of the prior art has sought to associate signal decorrelations as a function of their spatial positions. Moreover, no prior art uses decorrelation. Finally, the prior art does not carry out any specific work on synthesizer parameters, such as the filter cutoff frequency or the frequency of an oscillator for example, and even less associated with spatial coordinates.
[0103] Advantageously, and as proposed by the present invention for the first time, spatial synthesis by decorrelation preferably consists of multiplying each element of a synthesizer, and this for each voice of polyphony.
[0104] [Fig. 3] schematically represents, and according to an embodiment of the present invention, the multiplication of the elements of a synthesizer into a certain number of instances making it possible to constitute new elements which bear the original names of the elements to which the letter S for Spatial is added to simplify understanding. It being understood that the VCSO is not in itself “spatial”, but that it is part of a whole which is spatial.
[0105] Advantageously, and according to an embodiment of the present invention, each polyphonic voice, i.e. each note that can be played simultaneously, is made up of an equivalent of N audio instances of the VCO / VCF / VCA set of a monophonic synthesizer placed in a space. These N audio instances are controlled by one or more LFO, EG and / or EF of respectively M, M' and M” instances.
[0106] Advantageously, each of the N audio instances of VCO, VCF, VCA and the M, M' and M” instances, respectively, of LFO, EG and EF are provided with slightly different settings with a view to creating variations in phase, spectrum, amplitude and / or time, depending on their positions in space.
[0107] As previously stated, and according to the present invention, each of the VCO, VCF, VCA, EG, EF and LFO elements which now has several instances acquires a new attribute S for “Spatial”: VCSO, VCSF, VCSA, SEG, SEF, LFSO.
[0108] According to one embodiment, these new elements are attached to an audio engine which is driven by an SCS module, an acronym for Spatial Coordinate Synthesis, in which each of the N audio instances of each polyphonic voice is associated with spatial coordinates. In order to better understand the present invention, [Fig.4] represents, according to one embodiment, the spatial positions of the 4 instances of 4 polyphonic voices, here spaced around an original position for example.
[0109] Advantageously, the possible variations within each element are: a. VCSO: the frequency / and / or the phase 0, as represented in [Fig.5]. b. VCSF: the frequency F and / or the quality factor Q (resonance), such that re presented in [Fig.6]. c. SEG: the values ads and r as well as an offset on the triggering of phases a and d, then r, as shown in [Fig.7] (as a reminder s being dependent on the velocity). d. VCSA: the values A and X as shown in [Fig.8]. According to one embodiment, the VCSA may comprise two amplifiers of N audio instances in series. The first amplifier is modulated by a SEG module, preferably it reacts to musical interpretation, nuances, etc.; the second amplifier is preferably modulated directly by the SCS module in order to compensate the levels of each instance according to their spatial positions, for example to avoid too high a gain when the instances are grouped at a single point. e. SEF: the values a, t, h and r as well as an offset on the triggering of each of these values, which corresponds to a global offset, since the analyzed signal varies over time, as represented in [Fig.9]. f. LFSO: the frequency / ' and / or the phase 0', preferably as for a VSO.
[0110] Advantageously, the variations of the parameters of each of the instances of the elements VCSO, VCSF, VCSA, SEG, SEF, LFSO, SCS, which make it possible to decorrelate the signals according to their spatial positions, are preferably controlled by three so-called high-level parameters: a. STATIC SPREAD (Sspd): static variation of parameters; b. DYNAMIC SPREAD (Dspd): dynamic variation of parameters, for example via an envelope generator; c. TIME SPREAD (Tspd): variation of time parameters, for example instances of a SEG module.
[0111] According to the present invention, these three parameters are grouped under the name VCSS, acronym for Voltage Controlled Spatial Spread, and are shown in [Fig. 10].
[0112] For example, [Fig.l 1] represents the signal path of a multi-dimensional audio synthesizer according to an embodiment of the present invention in which the VCSS operates the variations of each instance of each element of the synthesizer.
[0113] Advantageously, a VCSO module can have any waveform, recorded and / or generated in real time, as shown in a non-exhaustive manner in [Fig. 12]. In addition, instances of a VCSO can be modulated in frequency or amplitude, and several VCSOs can be added together (additive synthesis), as shown in [Fig. 13], for example.
[0114] According to one embodiment, each VCSO sound wave generator has N oscillators whose frequencies vary around the nominal frequency of the VCSO, i.e. the note played entered by the user, such as for example the note played on a keyboard by the user.
[0115] According to one embodiment, a VCSO can be expressed in the form:
[0116] [Math.l] x n (t) = sin(© / ; (^)^„(0)
[0117] Preferably, for a VCSO: a. The variation of the frequency / is determined by the values of the VCSS, preferably by the value of the Sspd of the VCSS. b. The variation of 0 is determined by the VCSS values, preferably by the VCSS Dspd value.
[0118] Advantageously, a VCSO can operate with any waveform: whether generic (sinusoidal, sawtooth, square, triangular, pulse width modulation, pink noise) or not (amplitude modulation, frequency modulation, wavetable, granular synthesis, synthesis by physical model, etc.).
[0119] According to one embodiment, several VCSOs can be used simultaneously to create new waveforms, in particular via amplitude or frequency modulation methods, or additive synthesis.
[0120] Preferably, each instance n of a VCSO is configured to cooperate with at least one instance n of a VCSF filter whose frequencies F vary around the nominal value of the VCSF filter.
[0121] Advantageously, for a VCSF: a. The variation of the frequencies F is determined by the Sspd value of the VCSS. b. The variation of the quality factor Q is determined by the Dspd value of the VCSS. c. The nominal value of the VCSF is determined by the user.
[0122] Preferably, each instance n of the VCSO / VCSF pair is configured to cooperate with at least one instance n of a VCSA amplifier whose amplitudes A vary around the nominal value of the VCSA.
[0123] Advantageously, for a VCSA: a. The variation of A is determined by the envelope generator SEG, itself undergoing variations via the values of Tspd and / or Sspd and / or Dspd b. The variation of X (X being related to a position in space) is determined by the values of Tspd and / or Sspd and / or Dspd.
[0124] Preferably, the nominal value of the VCSA is determined by an envelope generator. This envelope generator may have a number of instances M' different from the number of instances N of the VCSO / VCSF / VCSA set.
[0125] As a reminder, a VCSA consists of 2 amplifiers with N audio instances in series. The first (A) is modulated in time by an envelope generator, thus creating a dynamic behavior to a sound. The second (X) allows the volume of each instance to be controlled according to their positions in space.
[0126] According to one embodiment, each LFSO has M oscillators whose frequencies vary around the nominal value of the LFSO.
[0127] Advantageously, for a LFSO: a. The variation of / ' is determined by the Sspd and / or Dspd value of the VCSS. b. The variation of 0' is determined by the Sspd and / or Dspd value of the VCSS.
[0128] Preferably, the LFSO can be addressed to any other value of the present invention, and take control of it in whole or in part. The user preferably chooses how to matrix the m instances of the LFSO with the n and / or n' instances of the target elements.
[0129] Advantageously, just like the VCSO, the LFSO can operate with any waveform.
[0130] Advantageously, the VCSO can operate in low frequencies and in turn be considered entirely as an LFSO.
[0131] Preferably, the nominal value of the LFSO is determined by the user.
[0132] According to one embodiment, each SEG control module comprises M' gé envelope generators so each of the four variables a (attack), d (decay), s (sustain), and r (release) varies around the nominal values of the SEG.
[0133] Advantageously, for a SEG, the variations of a, d, s, and r are determined by the VCSS, preferably by the Tspd function of the VCSS.
[0134] Preferably, each SEG n also has a time offset Of for each of its variables a, d, s, and r such that Of(a) Of(d) Of(s) and Of(r) are advantageously controlled by the VCSS, preferably by the VCSS Tspd.
[0135] According to one embodiment, the SEG control module may be addressed to any other value of the present invention, and take control of it in full or in part. The user preferably chooses to matrix the instances m' of the SEG with the instances n or n' of the target elements.
[0136] Preferably, the nominal values and the triggering of the SEG are determined by the user.
[0137] According to one embodiment, each SEF has M” followed by an envelope, each of the four variables t (threshold), a (attack), h (hold), and r (release) of which varies around the nominal values of the SEF.
[0138] Preferably, the variations of t, a, h, and s are determined by the VCSS, preferably by the Tspd function of the VCSS.
[0139] Advantageously, each SEF n also has a time offset Of for each of its variables t, a, h, and s such that Of(t) Of(a) Of(h) and Of(s) controlled by the VCSS, preferably by the Tspd of the VCSS.
[0140] According to one embodiment, each SEF can follow two types of streams: a. Audio stream; b. Data flow.
[0141] Advantageously, the SEF can be addressed to any other value of the present invention, and take control of it in full or in part. The user preferably chooses how to matrix the instances M' ' of the SEF with the instances M or M' of the target elements.
[0142] Preferably, the nominal values of the SEF are determined by the user.
[0143] According to one embodiment, each of the VCSO / VCSF / VCSA sets is attached to spatial coordinates AED whose azimuth Az, elevation El and distance Di variables vary around one or more origin positions O.
[0144] Preferably, the variations of Az, El and Di are determined by: a. The Sspd value; b. The Dspd value, via an envelope generator; c. The Tspd value, via a SEG envelope generator.
[0145] Advantageously, the original positions O are determined by the user.
[0146] Preferably, the original positions O can vary towards a defined position O' by a trajectory generator or any other element of the invention capable of modifying spatial coordinates.
[0147] Advantageously, all spatial coordinates are controlled by the SCS control module.
[0148] Advantageously, the SFX assembly module is configured to assemble different elements described upstream such as VCSF and VCSA to one or more lines delay. Preferably, the VCSD, acronym for Voltage Controlled Spatial Delay, includes N' voices. Managing the value of these delays, associated with a VCSF filter, a VCSA amplifier and preferably a circuit for re-injecting the output signals into the processing chain, preferably at the input, allows you to recreate many types of effects, such as: Delays, Chorus, Flanger, Freezer, etc.
[0149] Preferably, the VCSD is configured to apply a time delay to the input signal. The VCSD may comprise at least two delay lines, preferably at least N' delay lines. Advantageously, the VCSD is coupled to a filter, preferably to a VCSF, to an LFO, preferably to an LFSO, and to a circuit for reinjecting the output signal at the input of the chain, this makes it possible to create all kinds of effects.
[0150] Advantageously, the variations of the delays dn. and 1 are a function of the Tspd.
[0151] According to one embodiment, the VCSD can be mathematically modeled by the following formula:
[0152] [Math.2]
[0153] Wherein the factor d will control both the volume of the delay and the number of repetitions, andT represents a time delay.
[0154] In a particularly clever way, the decorrelation of the different control and / or processing elements leads to the production of 3D effects.
[0155] Advantageously, the present invention is clever in that it is configured so that the instances of each element present in said synthesizer are multiplied and that variations of at least part of the parameters of these instances are applied in order to create decorrelations of these instances. Preferably, these variations are in particular a function of the position in space of said instances. Hence the advantageous relationship of the variations of the parameters with the spatial coordinates.
[0156] The present invention thus relates to a multidimensional audio synthesizer. Advantageously, said audio synthesizer is configured to generate at least one sound wave distributed according to at least one spatial and / or temporal dimension, i.e. in space and in time.
[0157] According to one embodiment, said audio synthesizer comprises at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one voice of polyphony, preferably at least 2 voices of polyphony, and advantageously at least 4 voices of polyphony, each voice of polyphony being configured to correspond to said at least one nominal frequency f entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user ü. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a user-defined natural nominal frequency; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. Preferably, at least M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e. Preferably, at least M' ' control instances, each control instance M' ' comprising at least one primary envelope tracking and control module EF; f. At least one VCSO sound wave generator comprising at least two instances of said VCO sound wave generator; g. At least one VCSF filter comprising at least two instances of said primary VCF filter; h. At least one VCSA amplifier comprising at least two instances of said primary VCA amplifier, said VCSA amplifier comprising at least one multiplier element; i. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; j. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; k. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; 1. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; m. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
[0158] According to another embodiment, said audio synthesizer may comprise at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value by at least one user; b. At least one polyphony voice, preferably at least 2 polyphony voices, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user ü. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a user-defined natural nominal frequency; iii. A primary amplifier VCA configured to cooperate with at least one at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary amplifier VCA; According to one embodiment, these N audio instances of said set E being controlled by at least one of: i. An LFSO wave generator, preferably below the threshold of human hearing, comprising at least M instances of primary LFO control, preferably the LFSO wave generator comprises at least one voice, this voice comprising at least one waveform; ii. An SEG control module comprising at least M' primary EG control instances, said SEG control module being configured to drive at least a plurality of filters and / or amplifiers, advantageously simultaneously; iii. An envelope tracking and SEF control module comprising at least M” EF primary control instances; iv. At least one VCSO sound wave generator comprising at least two instances of said primary VCO sound wave generator; v. At least one VCSF filter comprising at least two instances of said primary VCF filter; vi. At least one VCSA amplifier comprising at least two instances of said primary VCA amplifier, preferably said VCSA amplifier comprising at least one multiplier element; vii. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; viii. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; ix. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; x. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; xi. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or the frequency of at least one VCSO sound wave generator, the phase and / or the frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance. Advantageously, the VCSS is configured to convert the high-level controls into low-level controls in order to operate said variations.
[0159] According to another embodiment, said audio synthesizer comprises at least: a. A digital input interface, such as for example a MIDI keyboard (Musical Instrument Digital Interface). Said digital input interface is preferably configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least 2 polyphonic voices, and advantageously at least 4 polyphonic voices. Preferably, said polyphonic voice is configured to correspond to said at least one nominal frequency f entered by the user; c. At least one VCSO sound wave generator, preferably in the audible spectrum. Advantageously, said VCSO sound wave generator comprising at least two oscillators whose frequencies f1 and f2 are configured to vary around a nominal frequency f; Advantageously, each oscillator comprises a phase, this phase is configured to be variable, for example this phase can be a function of at least one spatial coordinate; Preferably, said nominal frequency f is predetermined, advantageously determined by the user; A sound wave generator can be called a VCSO from the English Voltage Control Spatial Oscillator; Advantageously, several main VCSO sound wave generators can be used simultaneously allowing the creation of complex sound waveforms;Each main VCSO sound wave generator may be configured to generate sound waves whose shape may be one of: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wavetable; according to one embodiment, each VCSO sound wave generator may be configured to be used as an LFSO by operating in the low frequency range; Preferably, the sound waves generated by each VCSO sound wave generator are configured to be modulated in frequency and / or amplitude; According to one embodiment, a VCSO sound wave generator comprises N VCOs such that VCOn with n=1, ..., N; ; d. At least one VCSF filter, preferably at least two filters VCSF1 and VCSF2. Preferably, said VCSF filter is configured to be a filter of low-pass and / or high-pass and / or band-pass type; According to one embodiment, the audio synthesizer comprises a plurality of VCSF filters. Advantageously, a so-called sliding gain can be used to switch from one filter to another filter in the case where several VCSF filters are used; e. Optionally, at least one SEG control module. Said SEG control module is advantageously configured to drive at least one filter, preferably each of said filters, advantageously simultaneously; Said SEG control module may be an envelope generator preferably comprising at least 2, advantageously at least 4 adjustable parameters configured to vary around nominal values; said nominal values are preferably predetermined. f. At least one VCSA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave. Preferably, each sound wave generator / VCSO / VCSF filter pair is configured to cooperate with at least one amplifier. According to one embodiment, said VCSA amplifier is configured to apply a predetermined amplitude to at least one sound wave, preferably via a SEG, said amplitude being configured to vary around a predetermined amplitude, called nominal. Advantageously, the amplifier comprises a multiplier element; preferably, said multiplier element is configured to be a function of at least one spatial coordinate; g. At least one LFSO wave generator, preferably below the hearing threshold. Preferably the LFSO wave generator comprises at least one voice, this voice comprising at least one waveform. Preferably, said waveform is fixed and advantageously taken from at least: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation. According to one embodiment, each LFSO wave generator comprises at least two oscillators whose frequencies are each configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each wave generator. According to one embodiment, LFSO comprises at least one phase, said phase is configured to vary around a nominal phase; h. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with at least one of said polyphonic voices, preferably with at least one of said sound waves. i. At least one VCSS control module configured to apply a variation of at least one of the following parameters depending on said co spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance. Advantageously, the VCSS is configured to convert high-level controls into low-level controls in order to operate said variations.
[0160] According to one embodiment, the audio synthesizer comprises at least one SFX assembly module configured to assemble elements to at least one time delay line, said elements being taken from at least: i. The VCSO sound wave generator; ii. The VCSF filter; iii. The VCSA amplifier; iv. The LFSO wave generator.
[0161] According to one embodiment, the audio synthesizer comprises at least one trajectory generator configured to modify, preferably in real time, said at least one spatial coordinate and / or any other parameter capable of influencing said at least one spatial coordinate.
[0162] According to one embodiment, the audio synthesizer comprises at least one rendering engine configured to broadcast said sound wave in at least one acoustic environment, preferably via a listening device, such as for example an audio headset, one or more speakers.
[0163] The present invention can be understood according to a mathematical approach. Indeed, any value that can undergo variations, such as those previously described for example, can take the following expression according to the so-called high-level parameters of the VCSS module:
[0164] [Math.3] W) =v0(rb,(n, Tspd, t) ) ^S^n, Sspd)*Dv(n, Dspd> ^.(n, Tspch t) ) *r„(^ r) r„( t) )
[0165] With:
[0166] v Any value (f, F, A, etc.) or its exponential for angular values (0, q>, 0 , etc.)
[0167] 11 varying from 1 to N
[0168] Sxpd STATIC SPREAD
[0169] Sv Static distribution function
[0170] Dspd DYNAMIC SPREAD
[0171]
[0172]
[0173]
[0174]
[0175]
[0176]
[0177]
[0178]
[0179]
[0180]
[0181]
[0182]
[0183]
[0184]
[0185]
[0186]
[0187]
[0188]
[0189]
[0190] Dv Dynamic Distribution Function T,.pd TIME SPREAD Tv Time Distribution Function and Civ Delay functions induced by the TsPd 1 Time Cv Function of variation due to position in space (is equal to 1 when pw( f ) describes spatial coordinates) 0n(t), r„(t) ) Spatial coordinates According to an advantageous embodiment, certain elements of the present invention may have a different number of instances, such as for example: a. N for VCSO, VCSF and VCSA b. M for LFSO c. N' for SFX d. M' and M' ' for SEG and SEF. Furthermore, there may be different ways to apply variations depending on the nature of the parameters. These can be additive, subtractive or multiplicative. Thus, the general expression presented above can be broken down into a more general form. Here K replaces N for clarity: [Math.4] K e [Math.4] Aæ AC [Math.4] l^k^K S.spd -t, 0^ S spd 1 Dspd^ ^,Q^Dspd^ 1 Tspd^ (JL,Q^Tspd^ 1 S (k Static distribution D (k D t\ Dynamic distribution due to an external signal Tv^k T t) Distribution due to time G f ) 3k ( t ) rk( t ) j Distribution due to position in 3D space v(k, Tspd, t) Delay of the reference signal 7"2,v(^ Tspd, t ) External signal delay Concerning the multiplicative form, the formula is thus as follows:
[0191] [Math.5] (t) = T,^ t) ) ■ Sv(k, Sxpd) ■ Dv(k, Dxpd,r^k Tspch t ) ) • T^k, Tt) • C^t), 0k(t), rk(t) )
[0192] Concerning the additive form, the formula is thus as follows:
[0193] [Math.6] vM = 'ïÀUk 0 )+5.¼ 5^) +Dv(k, Dpif '1^ t) ) + Tv(k, 0k{t), rk{t) )
[0194] According to one embodiment, the SFX module, acronym for Spatial FX, which can be inserted at the end of the audio chain, requires a number of instances and spatial positions which can be different from the positions of the N audio instances. To create, for example, a chorus effect reproduced throughout the space while the source comes from a specific location, the present invention makes it possible to create N' channels specific to the SFX module.
[0195] Advantageously, the majority of the effects that the present invention can produce are achieved from delays, filters, feedback (i.e. reinjection of the output signal at the input of the module chain) and sometimes modulations. The VCSD, from the English acronym Voltage Controlled Spatial Delay, has N' instances of delay line. [Fig. 14] represents the signal path of an SFX allowing to recreate a majority of the effects that the present invention can produce.
[0196] According to one embodiment, the present invention may comprise an input matrix. Advantageously, said input matrix makes it possible to adapt the number of channels N, or even to relate them to the spatial positions of the instances N'. According to one embodiment, this input matrix may also be a full-fledged audio engine.
[0197] According to one embodiment, this input matrix may use a binaural engine.
[0198] According to one embodiment, the present invention is configured to cooperate with any type of rendering engine, also called an audio engine, applied at the end of the chain to listen to the rendering.
[0199] We will now describe in detail a preferred non-limiting embodiment of the present invention illustrated in [Fig. 15].
[0200] According to this embodiment the audio synthesizer comprises the following characteristics: a. 4 voices of polyphony: i. Each VCSO, VCSF and VCSA is composed of 16 voices (N = 16) b. 5 VCSO: i. Each VCSO offers the following waveforms: Sine, Sawtooth, Triangle, Square, Pulse Width Modulation, Noise (Pink, White, Other), Wavetable; ii. Each VCSO can operate in LFSO mode (0.01Hz to 25Hz); üi. Each VCSO can be modulated in frequency or amplitude, via the LFSOs or the other VCSOs. c. 3 VCSF i. A low cut, a high cut and a band pass; ii. A sliding gain allows switching from one filter to another; üi. A SEG allows these 3 VCSFs to be controlled simultaneously. d. 1VCSA e. A SEG is attached to the VCSA. f. 2 LFSO i. Each LFSO has 4 instances (M = 4) for each of its 4 waveforms, for a total of 16 voices; ii. Waveforms are fixed: Sine, Sawtooth, Triangle, Square; üi. Synchronization with note On (phase reset). g. 2 SFX i. 1 reverb 12 instances in inputs and 12 voices in output (N' = 12); ii. 1 distortion 64 voices (N x 4 = 64). h. SCS i. 76 voices: 16 (N = 16) x 4 (synthesizer polyphony) + 12 (N' = 12); i. 4 SEGs of 16 voices (M' = 16) allow to control each of the polyphony voices; j. 4 trajectory editors (1 per polyphonic voice). k. Additional functions: i. Detune: allows you to detune the 4 polyphonic voices; ii. Glide: allows you to perform glissandos from one note to another; üi. Unison: Allows you to assign the 4 polyphonic voices simultaneously to each note played, thus accumulating a total of 320 simultaneous oscillation voices: 4 (synthesizer polyphony) x 16 (N) x 5 (number of VCSOs).
[0201] [Fig. 15] shows, according to one embodiment, the signal path through an audio synthesizer according to the present invention. The solid line blocks are replicated for each polyphonic voice, while the dotted line blocks are common to the entire synthesizer according to the present invention.
[0202] As previously indicated, and according to an embodiment of the present invention, each VCSO can be modulated in frequency and / or amplitude by an LFSO and / or by another VCSO. In addition, each VCSO can operate in the low frequency register through an LFSO mode, thus becoming a 16 LFSO instances for example. Thus associated with spatial positions these modulations add further decorrelations between the instances allowing for totally new and previously unheard results.
[0203] According to one embodiment, the Sspd parameter of the VCSS makes it possible in particular to: a. Define the variation of the frequencies / oscillators around the nominal frequency of the VCSO, by multiplication; b. Define the variation of the frequencies F of the filters around the nominal frequency of the VCSF, by adding an exponential ratio; c. Define the frequency / ' and phase 0' variations of the LFSOs. d. Define the spacing of the spatial positions of the N audio instances around the original position of a sound.
[0204] According to one embodiment, the Dspd parameter makes it possible in particular to: a. Define the phase variation 0 of the VCSO oscillators, by adding a fixed ratio; b. Define the variation of the Q factors of the filters around the nominal frequency of the VCSF; c. Define the variation X of the VCSA; d. Define the spacing of the spatial positions of the N audio instances around the original position of a sound.
[0205] According to one embodiment, the Tspd parameter makes it possible in particular to: a. Define the variation of a, d, s and r of the SEGs; b. Define the variation of the offsets of a, d, and r of the SEGs.
[0206] Advantageously, the spacings of the spatial positions of the N audio instances operated by the Sspd and the Dspd are cumulative. According to the present invention, [Fig. 16] illustrates how these spacings can act: a. First drawing on the left, [Fig. 16a]: the polyphonic voices are placed at the 4 cardinal points. b. Middle drawing, [Fig. 16b]: applying an Sspd of 30%, so the 16 instances are proportionally spaced up to + / - 30° around the barycenter of the polyphonic voice. c. Right drawing, [Fig. 16c]: execution of an arpeggio (4 notes played successively) with a Dspd of 30%: i. Voice located to the north of the figure: initial position; ii. Voice located to the south of the figure: at the end of the attack phase; iii. Voice located in the east: during the sustain phase; iv. Voice located in the west: during the release phase.
[0207] According to one embodiment, the trajectory generator makes it possible to independently control each polyphonic voice.
[0208]
[0209]
[0210]
[0211]
[0212]
[0213]
[0214]
[0215]
[0216]
[0217] Trajectories are preferably executed by an envelope generator whose values are a % ratio of the VCSA's SEG values. This makes it easy to match the trajectory duration with the duration of a sound. According to one embodiment, the present invention may comprise at least one trajectory editing module. This module is preferably designed to edit trajectories in two dimensions, but their path is projected onto a half-sphere. [Fig. 17] represents an example of execution of a trajectory, coupled with a value of S spd of 30% and a Dspd of 50%, it can thus be seen that: a. Drawing top left: initial position, instances are spaced + / -30° around an original position, barycenter of the polyphonic voice. b. Drawing bottom left: position of the instances at the end of the attack phase, split at almost 180° around the barycenter of the polyphonic voice. c. Drawing top right: position of the instances during the sustain phase, split at almost 180° around the barycenter of the polyphonic voice. Remember that sustain depends on velocity, so if the note had been played less loudly, the barycenter would have returned a little closer to the original position, and the instances less spaced apart since the Dspd is also driven by an envelope generator. d. Drawing bottom right: position of the instances during the release phase, towards a return to the initial state. According to a preferred embodiment of the present invention, the frequency variations / (?) of the instances of a VCSO can be expressed using the multiplicative form presented above: [Math.7] •> [Math.7] no K [Math.7] 1 nN Sf^Sspd) = l + Qm(-l)n^Sspd Df& = 1 You cf[(pn(t)' ) =1 Ty(n, Tspd, / ) = 1 Tspd, t) = 1
[0218]
[0219]
[0220]
[0221]
[0222]
[0223]
[0224]
[0225]
[0226]
[0227]
[0228]
[0229]
[0230]
[0231]
[0232]
[0233]
[0234]
[0235] The variations of the azimuth tp ( t) of the sets E by the SCS can be expressed using the additive form: [Math. 8] N AC •> [Math. 8] he G [Math. 8] 1 he N p(il) = 2(^(^) + 1)( distribution of indices by pairs ) =90(-1)^5^ Ml». D spJ , t) = j(r) ( -1) / JXP ( ? 0 r~f^ sP& t) - "77" / spd 0,,(1), r„(t) ) =0 the Pip (Hr T spd, C) 0 According to the present invention, the variations induced by the action on the Tspd can be expressed using the following additive form: [Math.9] M 'e AC •> [Math.9] m ' g [Math.9] 1 M' To(m\ Tspd> t) = TA(m', Tspd, t) = TD(m\ Tspd> t) = T^m', Tspd, t) = m'Tspd Sspd) = S^mA Sspd) = S^mA Sspd) = S^vA Sspd}^ Do(m', Dxpd, t) = DA(m', Dsp(P t) = DD[m\Dgpd> r) = D^m', Dspd, t) = 0 MO. MO ) = ^(^(O. ) = cD( (pm\A, sAA)' ^AA ) = >■,„.( i)) =o 7\o(m', Tspd, t) =r}A(m\ Tspd, t) =TtD(m\ Tspd, t) Tspd, t) =0 r2,o(in', Tspd, t) ^r^mA Tspd, t) Tspd, t) ^r2jï(m', Txpd, t) = O According to one embodiment, the present invention may be configured to cooperate with an effect module.
[0236] As a reminder, and as previously indicated, most of the effects are produced from the same processing chain consisting of delays, filters, amplifiers, a feedback chain, and modulation elements, generally an LFO.
[0237] According to one embodiment, the audio synthesizer comprises at least one effect module.
[0238] According to one embodiment, said effect module comprises at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each summed polyphony voice; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multi-channel audio signal, preferably any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM mixing matrix module, also called an input matrix, configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one ME processing module, said first IM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal from at least one output channel of the first mixing matrix module IM; d. A second OM mixing matrix module, also called output matrix, configured to distribute the processed audio signals output from said processing module in at least said virtual space and to at least one BR binaural rendering module and / or to at least one output SO, said second mixing matrix module OM comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates.
[0239] Thus, [Fig. 18] illustrates an embodiment of said effect module. In this figure, and according to one embodiment, said effect module comprises at least: a. An audio input module; Said audio input module being configured to accept at least three types of audio signals; said audio input module advantageously comprises at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each summed polyphony voice; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multi-channel audio signal, preferably any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM mixing matrix module, preferably with "intensity panning"; said IM mixing matrix module being configured to distribute the incoming audio signals into at least one virtual space, preferably to at least one ME processing module; According to one embodiment, the IM mixing matrix module comprises a number C of input channels, the number C being defined by a selection parameter of the input type: i. monophonic (1 channel), ii. stereophonic (2 channels), üi. multichannel - n channels defined by a parameter called "Input Channels". These input channels are considered as points - called "entry" - in said virtual space; Preferably, the number C is equal to N'.
[0240] Preferably, said mixing matrix module IM comprises a predetermined number of virtual output points corresponding to the number of effect channels of the processing module ME; Advantageously, the “Effect Channels” parameter defines said number of virtual output points; According to one embodiment, a first method for distributing the virtual points is described below. a. An ME processing module, also called a multi-voice and multi-channel effect module; Said ME processing module comprises at least one device for storing at least one series of instructions configured to be executed by at least one processor and to transform at least one sound signal at the output of said IM mixing matrix module. Preferably, the ME processing module is configured to apply at least one audio processing to at least one audio signal coming from at least one output channel of the IM mixing matrix module, preferably before leaving said ME processing module; Advantageously, the number of input channels of the ME processing module is equal to the number of output channels of the ME processing module, and preferably of the IM mixing matrix module; b. A second OM mixing matrix module, preferably with "intensity panning"; said second mixing matrix module OM being configured to distribute the processed audio signals entering at least one virtual space, preferably to at least one binaural rendering module BR on the one hand, and at least one output module SO on the other hand; According to one embodiment, the second mixing matrix module OM comprises a number D of input channels, the number D being defined by at least one parameter called "Effect Channels", which also defines the number of effect channels calculated in the processing module ME; Preferably the number D is equal to the number C; Advantageously, these input channels are configured to serve as entry points in said virtual space;Advantageously, a parameter called “Output Channels” is configured to define the number of virtual output points of said second OP mixing matrix module, preferably, said virtual output points correspond to the desired number of loudspeakers; According to one embodiment, a second method of distributing the virtual output points is described below. ; c. A BR binaural rendering module; Advantageously, the virtual output points of the second OM mixing matrix module are also defined in said BR binaural rendering module; said BR binaural rendering module comprises at least one device for storing at least one series of instructions configured to be executed by at least one processor and to synthesize at least one binaural audio signal; Preferably, said binaural rendering module BR is configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates; Advantageously, said binaural rendering module BR is configured to calculate the 3D stereo audio intended for at least one stereo output module HO and / or a digital-to-analog converter (DAC) intended for headphones.
[0241] According to one embodiment, and in order to illustrate an example of application of said effect module, the latter can generate a so-called “chorus” effect.
[0242] The chorus effect is a type of modulation effect used to thicken and color an audio signal enough to give the impression that multiple instruments are playing. The effect is achieved by taking an audio signal and mixing it with one or more modulated copies of itself. The modulations are produced by an LFO (Low Frequency Oscillator) that controls short delay variations of the original signal. A continuous variation in pitch, following the Doppler effect, occurs. When the modulated audio signal is then mixed with the input audio signal, a doubling effect of the sound occurs.
[0243] In the case of a multi-channel chorus consisting, as here, of parallel channels, the principle consists of linearly shifting the phase of the LFO for each effect channel, in order to obtain a set of decorrelated output signals expressed spatially in a space. The decorrelation of the channels thus contributes to the spatiality of the output signal.
[0244] To determine the modulation phase value of each of the effect channels, we divide the maximum limit of a vector [0.1] by the number of effect channels defined by the "Effect Channels" parameter. For 8 effect channels, we will obtain a value of 0.125, for example.
[0245] This value is advantageously multiplied by the index value of each effect voice, from 0 to N-1 (N = number of channels). For example, for 8 channels, we obtain a list of values to apply to each effect voice: 0., 0.125, 0.25, 0.375, 0.5, 0.625, 0.75 and 0.875.
[0246] The value obtained for each channel is then added to the dynamic value of the oscillation produced by the LFO, which oscillates linearly between 0 and 1, then from 1 to 0, before starting a new cycle (LFO called "triangle" type).
[0247] The LFO value added to the calculated offset is then amplified, i.e. multiplied, so that the variation takes place in a time domain, preferably defined in milli seconds. For a variable delay, we will want to vary the delay time between 0ms and 5ms, for example.
[0248] The modulation is then applied to a delay line, thus creating the pitch variations, following the modalities of the Doppler effect.
[0249] Each effect channel being temporally and spatially decorrelated, the sound result obtained is a multi-channel "chorus" effect.
[0250] The Sspd parameter, expressed in percent, allows the phase shift of each effect voice to be linearly multiplied. With an Sspd value of 0, no shift is produced; each voice is in phase. As the Sspd value increases, the phases are shifted, and the effect channels become more and more temporally and spatially decorrelated. At an Sspd value of 100%, the phases are linearly decorrelated, and the chorus effect is at its most immersive.
[0251] According to one embodiment, the present invention makes it possible to apply the phase shift principle to different types of audio processing.
[0252] For example, the phase shift principle previously described can be applied to different types of sound transformations, preferably constituting a set of multi-channel sound effects. Thus, and by way of non-limiting example, the present invention makes it possible to generate the following effects: a. "Tremolo" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading of a sine wave table whose value (y) is applied to the modulation of the intensity of the signals of the output channels of the EM processing module; b. "Phaser" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading of a sine wave table whose value (y) is applied to the frequency sweeps of a cascade of all-pass filters; c. "Freezer" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the playback position of a wavetable whose audio content is captured on the fly and played back in a loop; d. "Flanger" effect: the principle is equivalent to the Chorus effect, using adjustable reinjection (called feedback) of the modulated signal at the input of the EM processing module, for timbral reinforcement. e. "Vibrato" effect: the principle is equivalent to the Chorus effect, with the only difference being that the signal from an output channel of the EM processing module is not added to the modulated signal.
[0253] According to one embodiment, the present invention relates to a first method of distribution, preferably homogeneous, of at least one incoming audio signal towards a virtual space using a three-dimensional orthonormal reference frame whose different axes are defined by X, Y and Z, said method comprising at least the following steps: a. Definition of at least one entry point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi, and Zi; b. Definition of at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculation of at least one Euclidean distance between said entry point PEi and at least said exit point PSj: d. Application of at least one signal attenuation law to the value of said calculated Euclidean distance, preferably said attenuation law being defined as such: the intensity value of said audio signal is divided by two each time the Euclidean distance doubles; e. Deduction of a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;
[0254] This method thus makes it possible to obtain a homogeneous projection of the incoming signals towards a spherical space.
[0255] According to one embodiment, the present invention relates to a second method of distribution, preferably homogeneous, of at least one audio signal leaving said at least one virtual space using a three-dimensional orthonormal reference frame whose different axes are defined by X, Y and Z, said method comprising at least the following steps a. Definition of at least one entry point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi, and Zi; b. Definition of at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculation of at least one Euclidean distance between said entry point PEi and at least said exit point PSj: d. Application of at least one signal attenuation law to the value of said calculated Euclidean distance, preferably said attenuation law being defined as such: the intensity value of said audio signal is divided by two each time the Euclidean distance doubles; e. Deduction of a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;
[0256] This method provides a homogeneous projection of the incoming signals to at least one SO output module and / or a digital-to-analog converter (DAC) intended for physical loudspeakers.
[0257] As illustrated in [Fig. 19], the present invention also relates to a method 100 for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention. Advantageously, said method 100 comprising at least the following steps: a. Input 110 of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI keyboard (Musical Instrument Digital Interface); Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters comprising at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation 120 of at least N audio instances of said set E; c. Generation 130 of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of primary VCO sound wave generators; d. Filtering 140 of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of primary VCF filters; e. Amplification 150 of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of primary VCA amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation 160 by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being configured to control a set of low-level parameters, such as for example frequencies, phases or even the positions in space of the different audio instances; ii. a low-level parameter; iii. a spatial coordinate of said audio instance considered; g. Spatialization 170 of said amplified sound wave by modification of at least minus one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.
[0258] The present invention also relates to another method for generating at least one sound wave and its spatial coordinates. Advantageously, said method comprises at least the following steps: a. At least one decorrelation step taken from: i. A first step of varying at least one sound wave by modifying the first parameter Sspd, said first decorrelation step comprising at least: A. A step of shifting at least one frequency of at least one voice of at least one oscillator, said voice being associated with said sound wave; B. A step of shifting spatial coordinates of said at least one voice, preferably relative to at least one other voice; ii. A second step of varying said at least one sound wave by modifying the second parameter Tspd, said second decorrelation step comprising at least: A. A step of shifting at least one parameter of at least one envelope generator, preferably at least one parameter taken from: a, r, d, t, or h, so as to shift at least one temporal envelope of said at least one sound wave; Advantageously, the second parameter Tspd is positive or zero; According to one embodiment, this shifting step also allows a spatial shift of said at least one sound wave; iii. A third step of varying said at least one sound wave by modifying the third parameter Dspd, said third decorrelation step being carried out by at least one envelope generator, preferably each time a note is played, said third step comprising at least: A. A step of shifting at least one phase of at least one voice of said at least one oscillator; B. A spatial shift step of at least one voice, preferably relative to at least one other voice; iv. A fourth step of variation of said at least one sound wave comprising at least: A. A shift step of at least one quality factor Q of at least one voice of at least one filter, preferably via adjustment of the third parameter Dspd; B. A step of shifting at least one frequency of said at least one voice of said at least one filter, preferably via adjustment of the first parameter Sspd. v. A fifth step of varying the amplitude of said sound wave as a function of at least one spatial coordinate of said sound wave.
[0259] The present invention also relates to a computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to the present invention.
[0260] The present invention also relates to a non-transitory memory medium comprising a computer program product according to the present invention.
[0261] The invention is not limited to the embodiments previously described and extends to all embodiments covered by the claims.
Claims
Claims
1. Audio synthesizer configured to generate at least one sound wave distributed according to at least one spatial dimension, said audio synthesizer comprising at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least 2 polyphonic voices, and advantageously at least 4 polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphonic voice comprising at least N audio instances of a set E of elements comprising at least: i. A primary VCO sound wave generator, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a user-defined natural nominal frequency; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. At least one VCSO sound wave generator comprising at least two instances of said VCO sound wave generator; d. At least one VCSF filter comprising at least two instances of said primary VCF filter; e. At least one VCSA amplifier comprising at least two instances of said primary VCA amplifier, said VCSA amplifier comprising at least one multiplier element; f. At least one spatial coordinate generation module SCS configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; g. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
2. Audio synthesizer according to the preceding claim in which the VCSS control module comprises at least one parameter taken from at least: a. A first parameter, preferably called Static Spread, said first parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value; b. A second parameter, preferably called Dynamic Spread, said second parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer as a function of a predetermined value modulated by at least one external source, preferably an envelope generator; c. A third parameter, preferably called Time Spread, said third parameter being configured to apply at least one variation of at least one time parameter of the audio synthesizer, preferably of an envelope generator.
3. An audio synthesizer according to any preceding claim comprising at least one of: a. M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; b. M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to control at least a plurality of filters or amplifiers, advantageously simultaneously; c. M” control instances, each M” control instance comprising at least one primary envelope tracking and EF control module.
4. An audio synthesizer according to any preceding claim comprising at least one of: a. An LFSO wave generator comprising at least two instances of said primary LFO wave generator; b. A SEG control module comprising at least two instances of said primary EG control module; c. An SEF control module comprising at least two instances of said primary envelope tracking and EF control module.
5. Audio synthesizer according to any one of the preceding claims comprising at least one trajectory generator configured to modify, preferably in real time, said at least one spatial coordinate and / or any other parameter capable of influencing said at least one spatial coordinate.
6. Audio synthesizer according to any one of the preceding claims comprising at least one rendering engine configured to broadcast said sound wave in at least one acoustic environment, preferably via a listening device.
7. Audio synthesizer according to the preceding claim comprising at least one SFX assembly module configured to assemble elements with at least one time delay line, said elements being taken from at least: a. The VCSO sound wave generator; b. The VCSF filter; c. The VCSA amplifier; d. The LFSO wave generator.
8. Audio synthesizer according to any one of the preceding claims comprising at least one effect module configured to generate at least one effect, said effect module comprising at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each summed polyphony voice; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multi-channel audio signal, preferably any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates. b. A first IM mixing matrix module configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one ME processing module, said first IM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal from at least one output channel of the first mixing matrix module IM; d. A second OM mixing matrix module configured to distribute the processed audio signals output from said processing module in at least said virtual space and to at least one BR binaural rendering module and / or to at least one SO output module, said second OM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points in said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates.
9. Method (100) for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to any one of the preceding claims, said method (100) comprising at least the following steps: a. Input (110) of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface; Said nominal frequency value corresponding to a sound wave having predetermined parameters, said parameters comprising at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation (120) of at least N audio instances of said set E; c. Generation (130) of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of primary VCO sound wave generators; d. Filtering (140) said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of primary VCF filters; e. Amplification (150) of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of primary VCA amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation (160) by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being configured to control a set of low-level parameters; ii. a low-level parameter; iii. a spatial coordinate of said audio instance considered; g. Spatialization (170) of said amplified sound wave by modification of at least one spatial coordinate of said voice of Amplified background sound, by the SCS spatial coordinate generation module.
10. Method (100) according to the preceding claim in which the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer from at least one other wave generated by the LFSO wave generator, said LFSO wave generator comprising at least M control instances.
11. Method (100) according to any one of the two preceding claims in which the decorrelation step comprises at least one step of controlling at least said VCSF filter by at least said SEG control module, said SEG control module comprising at least M' control instances.
12. Method (100) according to any one of the three preceding claims comprising, before or after the spatialization step, a step of assembling said filtered sound wave with at least one delay line and / or said other wave with at least one other delay line, by the SFX assembly module comprising at least N' audio instances.
13. Method (100) according to any one of the four preceding claims in which the spatialization step comprises at least one step of generating at least one trajectory, by the trajectory generator, by modifying in time, preferably in real time, at least one spatial coordinate of said filtered sound wave.
14. Method (100) according to any one of the five preceding claims comprising, after the spatialization step, at least one audio rendering step by at least one rendering engine.
15. A computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to any one of the six preceding claims.
16. Non-transitory memory medium comprising a computer program product according to the preceding claim.