Multi-dimensional audio synthesizer and method for generating spatialised sound waves
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-05-03
- Publication Date
- 2026-03-11
AI Technical Summary
Current sound generation techniques, particularly in music production using synthesizers, primarily produce mono or stereo sounds, lacking integration of spatialization, which hinders the creation of immersive audio experiences aligned with advancements in 3D audio technologies.
A multidimensional audio synthesizer that generates spatialized sound waves by incorporating a digital input interface, polyphony voices, primary sound wave generators, filters, amplifiers, and control modules, with a spatial coordinate generation module to apply variations in parameters such as frequency, phase, and amplitude based on spatial coordinates, enabling intuitive and musical spatialization.
Enables the creation of immersive, spatially distributed sound waves that enhance the musical experience by integrating spatialization into the sound generation process, aligning with 3D audio formats and technologies.
Smart Images

Figure EP2024062244_14112024_PF_FP_ABST
Abstract
Description
[0001] Description Title of the invention: Multidimensional audio synthesizer and method for generating spatialized sound waves [1]TECHNICAL FIELD OF THE INVENTION [2]The invention relates to the generation of spatialized sound waves. In particular, the present invention relates to a method for generating sound waves and a multidimensional audio synthesizer. [3]STATE OF THE ART [4] With the advent of 3D audio, many studios are equipping themselves with listening systems compatible with this type of new format, and more and more terminals such as mobile phones, tablets, computers, televisions, etc., accept at least one 3D audio format. [5]With regard to content creation, sound recording techniques are already very advanced, in particular through techniques derived from 5.1 sound recordings and techniques related to virtual reality, in particular with certain microphones and certain formats.[6]However, apart from these acoustic recordings, the techniques and methods of musical production using instruments such as synthesizers, guitars or any electric or digital instrument remain the same and are based on the creation of sounds, generally mono or stereo, and their spatialization in a second step. In order to address this problem while helping creators become accustomed to immersive sound, the present invention proposes an innovative solution. [7]The other objects, characteristics and advantages of the present invention will appear upon examination of the following description and the accompanying drawings. It is understood that other advantages may be incorporated.[8]SUMMARY [9]The present invention thus relates to a synthesizer-type instrument, which may be virtual, which integrates spatialization in an intuitive and musical manner, while being as in phase as possible with the conventional operation of synthesizers.
[0010] The present invention relates to an audio synthesizer configured to generate at least one sound wave distributed according to at least one spatial dimension, said audio synthesizer comprising at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b.At least one polyphony voice, preferably at least 2 polyphony voices, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f, preferably defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a natural nominal frequency defined by the user; iii.A primary amplifier VCA configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary amplifier VCA; c. Preferably, at least M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e.Preferably, at least M'' control instances, each control instance M'' comprising at least one primary envelope tracking and EF control module; f. At least one sound wave generator VCSO comprising at least two instances of said primary sound wave generator VCO; g. At least one filter VCSF comprising at least two instances of said primary filter VCF; h. At least one amplifier VCSA comprising at least two instances of said primary amplifier VCA, said amplifier VCSA comprising at least one multiplier element; i. Preferably, at least one wave generator LFSO comprising at least two instances of said primary wave generator LFO; j. Preferably, at least one control module SEG comprising at least two instances of said primary control module EG; k. Preferably, at least one control module SEF comprising at least two instances of said primary envelope tracking and EF control module; l.At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; m. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or the frequency of at least one VCSO sound wave generator, the phase and / or the frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
[0011] The present invention thus makes it possible to generate spatialized sounds.
[0012] The present invention also relates to a method for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention, said method comprising at least the following steps: a. Input of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI keyboard (Musical Instrument Digital Interface); Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters comprising at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation of at least N audio instances of said set E; c.Generation of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of primary VCO sound wave generators; d. Filtering of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of primary VCF filters; e. Amplification of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of primary VCA amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i.a high-level parameter taken from at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being configured to control a set of low-level parameters, such as for example frequencies, phases or even the positions in space of the different audio instances; ii. A low-level parameter; iii. A spatial coordinate of said audio instance considered; g.Spatialization of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.
[0013] The present invention also relates to a computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to the present invention.
[0014] The present invention also relates to a non-transitory memory medium comprising a computer program product according to the present invention.
[0015] BRIEF DESCRIPTION OF THE FIGURES
[0016] The aims, objects, as well as the characteristics and advantages of the invention will emerge more clearly from the detailed description of an embodiment thereof which is illustrated by the following accompanying drawings in which:
[0017] [Fig.1] Figure 1 schematically represents a synthesizer according to an embodiment of the present invention.
[0018] [Fig.2] Figure 2 schematically represents the signal path of a conventional synthesizer.
[0019] [Fig.3] Figure 3 schematically represents the multiplication of the elements of a synthesizer into a number of instances according to an embodiment of the present invention.
[0020] [Fig.4] Figure 4 schematically represents the spatial positions of the 4 instances of 4 voices of polyphony according to an embodiment of the present invention.
[0021] [Fig.5] Figure 5 schematically represents the decorrelation of the instances of a VCSO according to an embodiment of the present invention.
[0022] [Fig.6] Figure 6 schematically represents the decorrelation of the instances of a VCSF according to an embodiment of the present invention.
[0023] [Fig.7] Figure 7 schematically represents the decorrelation of the instances of a SEG according to an embodiment of the present invention.
[0024] [Fig.8] Figure 8 schematically represents the decorrelation of instances of a VCSA according to an embodiment of the present invention.
[0025] [Fig.9] Figure 9 schematically represents the decorrelation of instances of a SEF according to an embodiment of the present invention.
[0026] [Fig.10] Figure 10 schematically represents the control parameters of the VCSS according to an embodiment of the present invention.
[0027] [Fig.11] Figure 11 schematically represents the signal path of a synthesizer according to an embodiment of the present invention.
[0028] [Fig.12] Figure 12 schematically represents examples of waveforms.
[0029] [Fig.13] Figure 13 schematically represents synthesis techniques using several VCSOs according to an embodiment of the present invention.
[0030] [Fig.14] Figure 14 schematically represents the signal path of an SFX within a spatial synthesis chain according to an embodiment of the present invention.
[0031] [Fig.15] Figure 15 schematically represents the signal path of a polyphonic voice according to an embodiment of the present invention.
[0032] [Fig.16] Figure 16 schematically represents the spatial distribution of 16 instances of 4 polyphonic voices according to an embodiment of the present invention.
[0033] [Fig.16a] Figure 16a schematically represents the case where the S. spdis equal to 0% and where the Dspd is equal to 0% according to an embodiment of the present invention.
[0034] [Fig.16b] Figure 16b schematically represents the case where the Sspd is equal to 30% and where the Dspd is equal to 0% according to an embodiment of the present invention.
[0035] [Fig.16c] Figure 16c schematically represents the case where the Sspd is equal to 30% and where the Dspd is equal to 30% according to an embodiment of the present invention.
[0036] [Fig.17] Figure 17 schematically represents the distribution of 16 instances during the execution of a trajectory of a polyphony voice according to an embodiment of the present invention.
[0037] [Fig.18] Figure 18 schematically represents an effect module according to an embodiment of the present invention.
[0038] [Fig.19] Figure 19 schematically represents a method according to an embodiment of the present invention.
[0039] The drawings are given as examples and are not limiting of the invention.They constitute schematic representations of principle intended to facilitate the understanding of the invention and are not necessarily on the scale of practical applications. In particular, the dimensions are not representative of reality.
[0040] DETAILED DESCRIPTION
[0041] Before beginning a detailed review of embodiments of the invention, optional features which may possibly be used in association or alternatively are set out below:
[0042] According to one example, the VCSS control module comprises at least one parameter taken from at least: a. A first parameter, preferably called Static Spread (Sspd), said first parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value; b.A second parameter, preferably called Dynamic Spread (Dspd), said second parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value modulated by at least one external source, preferably an envelope generator; c. A third parameter, preferably called Time Spread (T. spd), said third parameter being configured to apply at least one variation of at least one temporal parameter of the audio synthesizer, preferably of an envelope generator;
[0043] According to an example, the present invention comprises at least one of: a. M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; b. M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; c. M'' control instances, each control instance M'' comprising at least one primary envelope tracking and control module EF.
[0044] According to one example, the present invention comprises at least one of: a. An LFSO wave generator comprising at least two instances of said primary LFO wave generator; b. A SEG control module comprising at least two instances of said primary EG control module; c. A SEF control module comprising at least two instances of said primary envelope tracking and EF control module.
[0045] According to one example, each oscillator of the primary VCO sound wave generator comprises a frequency, this frequency being configured to be variable, preferably as a function of at least one spatial coordinate.
[0046] According to one example, each oscillator of the primary VCO sound wave generator comprises a phase, this phase being configured to be variable, preferably as a function of at least one spatial coordinate.
[0047] According to one example, the primary sound wave generator VCO is configured to generate sound waves whose shape may be one of: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wavetable.
[0048] According to one example, the primary filter VCF is configured to be a low-pass and / or high-pass and / or band-pass type filter.
[0049] According to one example, the amplifier VCA is configured to apply a predetermined amplitude to at least one sound wave, said amplitude being configured to vary around a predetermined amplitude, called nominal; Advantageously, said multiplier element of the primary amplifier VCA is configured to be a function of at least one spatial coordinate.
[0050] According to one example, the primary LFO wave generator comprises at least one oscillator whose frequency is configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each primary LFO wave generator.
[0051] According to one example, the primary LFO generator comprises at least one phase, said phase being configured to vary around a nominal phase.
[0052] According to one example, said specific nominal frequency is predetermined, advantageously determined by the user.
[0053] According to one example, said nominal frequency is predetermined, advantageously determined by the user.
[0054] According to one example, a sound wave generator may be called a VCSO, an acronym for Voltage Control Spatial Oscillator.
[0055] According to one example, several VCSO sound wave generators may be used simultaneously, allowing the creation of complex sound waveforms.
[0056] According to one example, the sound waves generated by each sound wave generator VCSO are configured to be modulated in frequency and / or amplitude.
[0057] According to one example, a VCSO comprises N VCOs such that VCOn with n=1, …, N.
[0058] According to one example, said control module EG may be an envelope generator preferably comprising at least 2, advantageously at least 3 adjustable parameters configured to vary around nominal values, preferably predetermined.
[0059] According to one example, the control module VCSS is configured to apply at least one offset, to at least one frequency in the case of controls of a filter, to at least one frequency in the case of controls of an oscillator, to at least one temporal parameter in the case of controls of an envelope generator.
[0060] According to one example, the present invention comprises at least one so-called sliding gain that can be used by at least one user to switch from one filter to another filter in the case where several VCSF filters are used.
[0061] According to one example, the SEG can control a so-called sliding gain that can be used to switch from one filter to another filter in the case where several VCSF filters are used.
[0062] According to one example, the present invention comprises at least one effect module configured to generate at least one effect, said effect module comprising at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input I1 configured to receive at least one monophonic audio signal, preferably said first audio input I1 being configured to receive at least said N audio instances of each voice of summed polyphony; ii.A second audio input I2 configured to receive at least one stereophonic audio signal, preferably said second audio input I2 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input I3 configured to receive at least one multichannel audio signal, preferably the number of channels being arbitrary, preferably said third audio input I3 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first mixing matrix module IM configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one processing module ME, said first mixing matrix module IM comprising at least: i.A predetermined number of input channels considered as entry points in said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal coming from at least one output channel of the first matrix mixing module IM; d. A second matrix mixing module OM configured to distribute the processed audio signals at the output of said processing module in at least said virtual space and to at least one binaural rendering module BR and / or to at least one output module SO, said second matrix mixing module OM comprising at least: i. A predetermined number of input channels considered as entry points in said virtual space; ii.A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates.
[0063] According to an example, the method according to the present invention comprises a step of controlling, by at least one envelope generator, the spatialization and / or a parameter of the synthesizer. Advantageously, when a note is entered by at least one user, all the envelope generators of the present invention are activated, preferably simultaneously (for example the SEG of the filter, the SEG of the VCSA, etc.).
[0064] According to one example, said N audio instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0065] According to one example, said M control instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variations determined by the manufacturer) and / or the spatial position of said N audio instances.
[0066] According to one example, said M' control instances are configured to undergo variations of at least one of their parameters (attack and / or decay and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (variation scales determined by the manufacturer) and / or the spatial position of said N audio instances.
[0067] According to one example, said M'' control instances are configured to undergo variations of at least one of their parameters (threshold and / or attack and / or sustain and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (variation scales determined by the manufacturer) and / or the spatial position of said N audio instances.
[0068] According to one example, the method according to the present invention comprises at least one step of creating at least one instance associated with said nominal frequency value, said instance comprising at least said set E.
[0069] According to one example, the decorrelation step comprises at least one step of driving at least said main sound wave generator VCSO by at least said control module VCSS.
[0070] According to one example, the decorrelation step comprises at least one step of driving at least said filter VCSF by at least said control module VCSS.
[0071] According to one example, the decorrelation step comprises at least one step of driving at least said amplifier VCSA by at least said control module VCSS.
[0072] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer by at least said SEG control module, preferably said SEG control module comprising at least M' control instances.
[0073] According to one example, the decorrelation step comprises at least one step of controlling at least said SEG control module by at least said VCSS control module.
[0074] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer from at least one other wave generated by the LFSO wave generator, said LFSO wave generator comprising at least M control instances.
[0075] According to one example, the decorrelation step comprises at least one step of controlling at least said LFSO wave generator by at least said VCSS control module.
[0076] According to one example, the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer by at least said envelope tracking and control module SEF, said envelope tracking and control module SEF comprising at least M'' control instances.
[0077] According to one example, the decorrelation step comprises at least one step of controlling at least said envelope tracking and control module SEF by at least said VCSS control module.
[0078] According to one example, the method according to the present invention comprises, before or after the spatialization step, a step of assembling said filtered sound wave with at least one delay line and / or said other wave with at least one other delay line, by the SFX assembly module comprising at least N' audio instances.
[0079] According to one example, the spatialization step comprises at least one step of generating at least one trajectory, by the trajectory generator, by modifying in time, preferably in real time, at least one spatial coordinate of said filtered sound wave.
[0080] According to one example, the method according to the present invention comprises, after the spatialization step, at least one step of audio rendering by at least one rendering engine.
[0081] According to one example, the variations which allow the decorrelation of the instances are variations applied via at least one of 3 high-level control parameters taken from: the Static Spread (Sspd), the Dynamic Spread (Dspd) and the Time Spread (Tspd).
[0082] According to one example, these high-level parameters control a set of low-level parameters (for example variation of the frequencies / phases / positions in the space of the different instances).
[0083] According to one example, the Sspd parameter operates static variations.
[0084] According to one example, the parameter Dspd operates variations dynamically via an external source, for example an envelope generator.
[0085] According to one example, the parameter T. spdoperates variations of the temporal parameters (for example the parameters of the instances of a SEG).
[0086] It is specified that in the context of the present invention, the following terms have the following definitions: a. VCO (Voltage Controlled Oscillator): sound wave generator, in the audible spectrum (20 Hz to 20,000 Hz). b. VCF (Voltage Controlled Filter): filter allowing only certain frequencies to pass, preferably said filter is configured to remove or accentuate or reduce certain parts of the sound spectrum represented in a signal. c. VCA (Voltage Controlled Amplifier): intensity control. Associated with an envelope generator, it allows these envelopes to be applied to a sound. d. EG (Envelope Generator): envelope generator, traditionally with 4 steps: Attack, Decay, Sustain, Release: i. Attack: attack time; ii. Decay: release time just after the attack; iii. Sustain: holding value to which the decay leads; iv.Release: release time. e. MIDI (Music Instrument Digital Interface): protocol for communicating a musical performance through computer data. f. Note ON / OFF: action of playing a note, then releasing it. In the case of a traditional envelope generator, Note On triggers the Attack and Decay stages, Note Off, and Release. Between the two, if the user holds down the note, the signal remains constant, at the Sustain value and / or depending on the velocity of the note played. g. LFO (Low Frequency Oscillator): generator of frequencies generally below the hearing threshold, allowing other parameters to be controlled. h. EF (Envelope Follower): analysis of the dynamics of a signal in order to control a parameter. i. Threshold: detection threshold during signal analysis; ii. Hold: duration of a signal's hold; iii.Envelope: A curve describing the evolution of a property of a sound (e.g., its intensity) as a function of time. i. Unison: A function allowing a polyphonic synthesizer to play a certain number of polyphonic voices at the same time from the same Note On / Off control. j. Audio engine: A computer program that allows audio signals and / or their spatial coordinates to be converted to loudspeakers, or to any other audio format.
[0087] The examples and conditional language used in this description are primarily intended to assist the reader in understanding the principles of the present invention and not to limit its scope to these specifically cited examples and conditions. It will be understood that a person skilled in the art can devise various arrangements which, although not explicitly described or shown herein, nevertheless embody the principles of the present invention and are included within its spirit and scope.
[0088] Further, as an aid to understanding, the following description may describe relatively simplified implementations of the present invention. As will be appreciated by those skilled in the art, various implementations of the present technology may be of greater complexity.
[0089] Furthermore, the following description listing the principles, aspects, and implementations of the present invention, as well as specific examples thereof, is intended to encompass both their structural and functional equivalents, whether presently known or developed in the future. Thus, for example, it will be appreciated by those skilled in the art that all block diagrams herein represent conceptual views of illustrative circuits incorporating the principles of the present invention.Similarly, it will be understood that all flowcharts, and the like, depict various processes that may be substantially represented on computer-readable media and thereby executed by a computer or processor, whether or not that computer or processor is explicitly depicted.
[0090] The functions of the various elements depicted in the figures, including any functional block referred to as a "processor" or "module," may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with an appropriate computer program or instructions. When provided by a processor, the instructions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.In some embodiments of the present invention, the processor may be a general-purpose processor, such as a central processing unit (CPU), for example. Furthermore, the explicit use of the term "processor" should not be interpreted as referring exclusively to hardware capable of executing software and may implicitly include, but is not limited to, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. Other hardware, conventional and / or custom, may also be included.
[0091] Software modules, or simply modules that are believed to be software, may be represented herein as any combination of flowchart elements or other elements indicating the execution of process steps and / or a textual description.Such modules may be executed by hardware that is expressly or implicitly represented. Furthermore, it should be understood that the module may include, for example, but not limited to, computer program logic, computer program instructions, software, firmware, hardware circuitry, or a combination thereof that provides the required capabilities.
[0092] The present invention relates to a 3D audio synthesizer. Its description will be made in two phases: the presentation of the concepts of spatial synthesis by decorrelation, and its application in a synthesizer according to the present invention.
[0093] Advantageously, the general principle of the invention is to synthesize sounds and associated spatial coordinates.
[0094] Then, and in order to be listened to, the rendering can be carried out by an audio engine.
[0095] Thus, as can be seen in Figure 1, the synthesis and coordinate blocks grouped in a gray frame 20 relate to spatial synthesis, while the blocks surrounded by the frame 30 are those implemented in a synthesizer, for example that of the present invention. The keyboard 10 represents an input interface for example.
[0096] According to one embodiment, the present invention is a method. This method can be implemented through a computer program product, preferably executable by a computer or at least by a processor. Thus, according to one embodiment, the present invention can be in the form of a computer program, that is to say a series of steps. Advantageously, this computer program can be configured to cooperate with at least one controller, such as an input interface, such as for example a piano keyboard.In addition, and in order to emit sounds, the present invention is preferably configured to cooperate with at least one speaker device and / or an audio headset.
[0097] In order to facilitate the understanding of the present invention, some reminders on the operation of a synthesizer in general follow.
[0098] Generally speaking, and in a manner well known to those skilled in the art (see for example Moog, RA (1977). Electronic music synthesizer. Patent 644,864 – US Patent.), a synthesizer comprises at least the following elements: a. Oscillator (VCO), also called primary sound wave generator; b. Filter (VCF), also called primary filter; c. Amplifier (VCA), also called primary amplifier.
[0099] So, VC is the acronym for Controlled Voltage and indicates that each element O (Oscillator), F (Frequency) or A (Amplifier) is controlled in intensity and time.
[0100] Usually, the nominal frequency generated by the VCO is controlled by the user using a piano-type keyboard, for example. The VCF and VCA are controlled by a four-step envelope generator (EG) (Attack, Decay, Sustain, Release), triggered by each action on the keyboard, allowing a spectral and temporal envelope to be created for the sound produced by the VCO.
[0101] Each of these elements is multiplied by the number of polyphonic voices, that is, the number of notes that can be played simultaneously.
[0102] Figure 2 represents the signal path of a classic synthesizer. We find the VCO, voltage-controlled by a piano keyboard in analog instruments, whose signal is filtered by a VCF, said VCF being able to be a high-pass filter, a low-pass filter or a band-pass filter. Then the signal passes through a VCA amplifier which modifies said signal according to an envelope generator.Thus, the VCA allows to create a temporal envelope to the sound, it is also common for the filter cutoff frequency to be modulated by another envelope generator, which allows to produce a spectral envelope to the sound.
[0103] Envelope generators are generally composed of 4 steps: Attack (a), Decay (d), Sustain (s) and Release (r). When the user plays a note, it triggers the Attack and Decay phases, the signal is then maintained at the Sustain value, which generally depends on the velocity, in other words the force with which the note is played, finally when the user releases the note, it triggers the Release phase.
[0104] These elements are multiplied by the number of polyphony voices, that is to say the number of notes that can be played at the same time. The polyphony voices are added together and often pass through an effect section, such as: reverb, chorus, flanger, etc.
[0105] In parallel, most synthesizers have one or more modulation modules, notably of the LFO type, an acronym for Low Frequency Oscillator. From a technical point of view, an LFO differs little from a VCO, except that the LFO works in low frequencies, with wavelengths that can last several minutes. It should be noted that VCOs and LFOs can be made up of any type of waveform (sinusoidal, triangular, square, etc.).
[0106] In the prior art, there are a number of spatialization tools, but very little work has attempted to associate these tools with sound generation. In particular, no element of the prior art has sought to associate signal decorrelations according to their spatial positions. Moreover, no prior art uses decorrelation.Finally, the prior art does not carry out any specific work on synthesizer parameters, such as the filter cutoff frequency or the frequency of an oscillator for example, and even less associated with spatial coordinates.
[0107] Advantageously, and as proposed by the present invention for the first time, spatial synthesis by decorrelation preferably consists of multiplying each element of a synthesizer, and this for each voice of polyphony.
[0108] Figure 3 schematically represents, and according to an embodiment of the present invention, the multiplication of the elements of a synthesizer into a certain number of instances making it possible to constitute new elements which bear the original names of the elements to which the letter S for Spatial is added to simplify understanding. It being understood that the VCSO is not in itself "spatial", but that it is part of a whole which is spatial.
[0109] Advantageously, and according to an embodiment of the present invention, each polyphonic voice, i.e. each note that can be played simultaneously, is made up of an equivalent of N audio instances of the VCO / VCF / VCA set of a monophonic synthesizer placed in a space. These N audio instances are controlled by one or more LFO, EG and / or EF of respectively M, M' and M'' instances.
[0110] Advantageously, each of the N audio instances of VCO, VCF, VCA and of the M, M' and M'' instances, respectively, of LFO, EG and EF are provided with slightly different settings with a view to creating variations in phase, spectrum, amplitude and / or time, depending on their positions in space.
[0111] As previously stated, and according to the present invention, each of the VCO, VCF, VCA, EG, EF and LFO elements which now has several instances acquires a new attribute S for “Spatial”: VCSO, VCSF, VCSA, SEG, SEF, LFSO.
[0112] According to one embodiment, these new elements are attached to an audio engine which is driven by an SCS module, an acronym for Spatial Coordinate Synthesis, in which each of the N audio instances of each polyphonic voice is associated with spatial coordinates. In order to better understand the present invention, Figure 4 represents, according to one embodiment, the spatial positions of the 4 instances of 4 polyphonic voices, here spaced around an original position for example.
[0113] Advantageously, the possible variations within each element are: a. VCSO: the frequency ƒ and / or the phase Ø, as represented in Figure 5. b. VCSF: the frequency F and / or the quality factor Q (resonance), as represented in Figure 6. c. SEG: the values ads and r as well as an offset on the triggering of phases a and d, then r, as shown in Figure 7 (as a reminder s being dependent on the velocity). d.VCSA: the values A and X as shown in Figure 8. According to one embodiment, the VCSA may comprise two amplifiers of N audio instances in series. The first amplifier is modulated by a SEG module, preferably reacting to musical interpretation, nuances, etc.; the second amplifier is preferably modulated directly by the SCS module in order to compensate the levels of each instance according to their spatial positions, for example to avoid too high a gain when the instances are grouped at a single point. e. SEF: the values a, t, h and r as well as an offset on the triggering of each of these values, which corresponds to a global offset, since the analyzed signal varies in time, as shown in Figure 9. f. LFSO: the frequency ƒ' and / or the phase Ø', preferably as for a VSO.
[0114] Advantageously, the variations of the parameters of each of the instances of the elements VCSO, VCSF, VCSA, SEG, SEF, LFSO, SCS, which make it possible to decorrelate the signals according to their spatial positions, are preferably controlled by three so-called high-level parameters: a. STATIC SPREAD (which can be called static decorrelation) (Sspd): variation of the parameters in a static manner; b. DYNAMIC SPREAD (which can be called dynamic decorrelation) (Dspd): variation of the parameters in a dynamic manner, for example via an envelope generator; c. TIME SPREAD (which can be called temporal decorrelation) (Tspd): variation of the temporal parameters, for example the instances of a SEG module.
[0115] According to the present invention, these three parameters are grouped under the name VCSS, acronym for Voltage Controlled Spatial Spread, and are represented in Figure 10.
[0116] For example, Figure 11 shows the signal path of a multidimensional audio synthesizer according to an embodiment of the present invention in which the VCSS operates the variations of each instance of each element of the synthesizer.
[0117] Advantageously, a VCSO module can have any waveform, recorded and / or generated in real time, as shown in a non-exhaustive manner in the Error! Source of the reference not found.. In addition, the instances of a VCSO can be modulated in frequency or amplitude, and several VCSOs can be summed (additive synthesis), or modulated between them, as shown in the Error! Source of the reference not found., for example.
[0118] According to one embodiment, each VCSO sound wave generator has N oscillators whose frequencies ƒ vary around the nominal frequency of the VCSO, i.e. the played note entered by the user, such as for example the note played on a keyboard by the user.
[0119] According to one embodiment, a VCSO can be expressed in the form: [Math 1] ^^. ^ ( ^^ ^ ^^ ^ ).
[0120] Preferably, for a VCSO: a. The variation of the frequency ƒ is determined by the values of the VCSS, preferably by the value of the Sspd of the VCSS. b. The variation of Ø is determined by the values of the VCSS, preferably by the value of the Dspd of the VCSS.
[0121] Advantageously, a VCSO can operate with any waveform: whether generic (sinusoidal, sawtooth, square, triangular, pulse width modulation, pink noise) or not (amplitude modulation, frequency modulation, wavetable, granular synthesis, synthesis by physical model, etc.).
[0122] According to one embodiment, several VCSOs can be used simultaneously to create new waveforms in particular via amplitude or frequency modulation methods, or additive synthesis.
[0123] According to one embodiment, the VCSO can be replaced by an external audio input; This external audio input can, for example, be taken from at least: a VCO from another synthesizer, a microphone, a pre-existing recording, or any other audio stream. Preferably, this audio input can be monophonic, and thus the signal is replicated to be able to be addressed to the N instances of the set E, or multichannel, in which case the user can advantageously choose how to matrix these channels to the N instances of the set E.
[0124] Preferably, each instance n of a VCSO is configured to cooperate with at least one instance n of a VCSF filter whose frequencies F vary around the nominal value of the VCSF filter.
[0125] Advantageously, for a VCSF: a. The variation of the frequencies F is determined by the value Sspd of the VCSS. b. The variation of the quality factor Q is determined by the value Dspd of the VCSS. c.The nominal value of the VCSF is determined by the user.
[0126] Preferably, each instance n of the VCSO / VCSF pair is configured to cooperate with at least one instance n of a VCSA amplifier whose amplitudes A vary around the nominal value of the VCSA.
[0127] Advantageously, for a VCSA: a. The variation of A is determined by the envelope generator SEG, itself undergoing variations via the values of the Tspd and / or the Sspd and / or the Dspd. b. The variation of X (X being linked to a position in space) is determined by the values of the T. spd and / or S spd and / or D spd.
[0128] Preferably, the nominal value of the VCSA is determined by an envelope generator. This envelope generator may have a number of instances M' different from the number of instances N of the VCSO / VCSF / VCSA set.
[0129] As a reminder, a VCSA is made up of 2 amplifiers with N audio instances in series. The first (A) is modulated in time by an envelope generator, thus creating a dynamic behavior to a sound. The second (X) makes it possible to control the volume of each instance according to their positions in space.
[0130] According to one embodiment, each LFSO has M oscillators whose frequencies ƒ' vary around the nominal value of the LFSO.
[0131] Advantageously, for a LFSO: a. The variation of ƒ' is determined by the value S spd and / or D spdof the VCSS. b. The variation of Ø' is determined by the Sspd and / or Dspd value of the VCSS.
[0132] Preferably, the LFSO can be addressed to any other value of the present invention, and take control of it in full or in part. The user preferably chooses how to matrix the m instances of the LFSO with the n and / or n' instances of the target elements.
[0133] Advantageously, just like the VCSO, the LFSO can operate with any waveform.
[0134] Advantageously, the VCSO can operate in the low frequencies and in turn be considered entirely as an LFSO.
[0135] Preferably, the nominal value of the LFSO is determined by the user.
[0136] According to one embodiment, each SEG control module comprises M' envelope generators so that each of the four variables a (attack), d (decay), s (sustain), and r (release) varies around the nominal values of the SEG.
[0137] Advantageously, for a SEG, the variations of a, d, s, and r are determined by the VCSS, preferably by the Tspd function of the VCSS.
[0138] Preferably, each SEG n also has a time offset Of for each of its variables a, d, s, and r such that Of(a) Of(d) Of(s) and Of(r) are advantageously controlled by the VCSS, preferably by the Tspd of the VCSS.
[0139] According to one embodiment, the SEG control module may be addressed to any other value of the present invention, and take control of it in full or in part. The user preferably chooses to matrix the instances m' of the SEG with the instances n or n' of the target elements.
[0140] Preferably, the nominal values and the triggering of the SEG are determined by the user.
[0141] According to one embodiment, each SEF has M'' followed by an envelope of which each of the four variables t (threshold), a (attack), h (hold), and r (release) varies around the nominal values of the SEF.
[0142] Preferably, the variations of t, a, h, and s are determined by the VCSS, preferably by the Tspd function of the VCSS.
[0143] Advantageously, each SEF n also has a time offset Of for each of its variables t, a, h, and s such that Of(t) Of(a) Of(h) and Of(s) controlled by the VCSS, preferably by the Tspd of the VCSS.
[0144] According to one embodiment, each SEF can follow two types of streams: a. Audio stream; b. Data stream.
[0145] Advantageously, the SEF can be addressed to any other value of the present invention, and take control of it in full or in part. The user preferably chooses how to matrix the instances M'' of the SEF with the instances M or M' of the target elements.
[0146] Preferably, the nominal values of the SEF are determined by the user.
[0147] According to one embodiment, each of the VCSO / VCSF / VCSA sets is attached to spatial coordinates AED whose azimuth Az, elevation El and distance Di variables vary around one or more origin positions O.
[0148] According to one embodiment, each of the VCSO / VCSF / VCSA sets is attached to spatial coordinates XYZ whose lateral position X, distance Y and elevation Z variables vary around one or more origin positions O.
[0149] Preferably, the variations of Az, El and Di are determined by: a. The value Sspd; b. The value Dspd, via an envelope generator; c. The value Tspd, via an envelope generator SEG.
[0150] Advantageously, the origin positions O are determined by the user.
[0151] Preferably, the original positions O can vary towards a position O' defined by a trajectory generator or any other element of the invention capable of modifying spatial coordinates.
[0152] Advantageously, all spatial coordinates are controlled by the SCS control module.
[0153] Advantageously, the SFX assembly module is configured to assemble different elements described upstream such as VCSF and VCSA to one or more delay lines. Preferably, the VCSD, acronym for Voltage Controlled Spatial Delay, comprises N' voices. The management of the value of these delays, associated with a VCSF filter, a VCSA amplifier and preferably a circuit for re-injecting the output signals inside the processing chain, preferably at the input, makes it possible to recreate many types of effects, such as for example: Delays, Chorus, Flanger, Freezer, etc.
[0154] Preferably, the VCSD is configured to apply a time delay to the input signal. The VCSD may comprise at least two delay lines, preferably at least N' delay lines.Advantageously, the VCSD is coupled to a filter, preferably a VCSF, to an LFO, preferably an LFSO, and to a circuit for re-injecting the output signal into the input of the chain, this makes it possible to create all kinds of effects.
[0155] Advantageously, the variations in delays ^^. ^ᇱ and ^^ ^ᇱ are a function of the Tspd.
[0156] According to one embodiment, the VCSD can be mathematically modeled by the following formula: [Math 2] ^^ ^ᇱ ( ^^) = ^^ ^ᇱ ( ^^) + ^^ ^ᇱ ∗ ^^ ^ᇱ ( ^^ − ^^ ^ᇱ) In which the factor d will control both the volume of the delay and the number of repetitions, and ^^ represents a time delay.
[0157] In a particularly clever manner, the decorrelation of the different control and / or processing elements leads to the production of 3D effects.
[0158] Advantageously, the present invention is clever in that it is configured so that the instances of each element present in said synthesizer are multiplied and that variations of at least part of the parameters of these instances are applied in order to create decorrelations of these instances. Preferably, these variations are in particular a function of the position in space of said instances. Hence the advantageous relationship of the variations of the parameters with the spatial coordinates.
[0159] The present invention thus relates to a multidimensional audio synthesizer.Advantageously, said audio synthesizer is configured to generate at least one sound wave distributed according to at least one spatial and / or temporal dimension, i.e. in space and in time.
[0160] According to one embodiment, said audio synthesizer comprises at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphony voice, preferably at least 2 polyphony voices, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i.A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a natural nominal frequency defined by the user; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c.Preferably, at least M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e. Preferably, at least M'' control instances, each control instance M'' comprising at least one primary envelope tracking and control module EF; f. At least one sound wave generator VCSO comprising at least two instances of said sound wave generator VCO; g. At least one filter VCSF comprising at least two instances of said primary filter VCF; h.At least one VCSA amplifier comprising at least two instances of said primary VCA amplifier, said VCSA amplifier comprising at least one multiplier element; i. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; j. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; k. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; l. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, ie with at least one of said polyphony voices, preferably with at least one of said sound waves; m.At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
[0161] According to another embodiment, said audio synthesizer may comprise at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value by at least one user; b.At least one polyphony voice, preferably at least 2 polyphony voices, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency entered by the user; each polyphony voice comprising at least 2 audio instances, preferably at least N audio instances, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a natural nominal frequency defined by the user; iii.A primary amplifier VCA configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary amplifier VCA; According to one embodiment, these N audio instances of said set E being controlled by at least one of: iv. An LFSO wave generator, preferably below the threshold of human hearing, comprising at least M instances of primary control LFO, preferably the LFSO wave generator comprises at least one voice, this voice comprising at least one waveform; v. A control module SEG comprising at least M' instances of primary control EG, said control module SEG being configured to drive at least a plurality of filters and / or amplifiers, advantageously simultaneously; vi. An envelope tracking and control module SEF comprising at least M'' instances of primary control EF; c.At least one sound wave generator VCSO comprising at least two instances of said primary sound wave generator VCO; d. At least one filter VCSF comprising at least two instances of said primary filter VCF; e. At least one amplifier VCSA comprising at least two instances of said primary amplifier VCA, preferably said amplifier VCSA comprising at least one multiplier element; f. Preferably, at least one wave generator LFSO comprising at least two instances of said primary wave generator LFO; g. Preferably, at least one control module SEG comprising at least two instances of said primary control module EG; h. Preferably, at least one control module SEF comprising at least two instances of said primary envelope tracking and control module EF; i. At least one spatial coordinate generation module SCS configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, ieto at least one of said polyphonic voices, preferably to at least one of said sound waves; j. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or the frequency of at least one VCSO sound wave generator, the phase and / or the frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance. Advantageously, the VCSS is configured to convert the high-level controls into low-level controls in order to operate said variations.
[0162] According to another embodiment, said audio synthesizer comprises at least: a.A digital input interface, such as a MIDI (Musical Instrument Digital Interface) keyboard. Said digital input interface is preferably configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least 2 polyphonic voices, and advantageously at least 4 polyphonic voices. Preferably, said polyphonic voice is configured to correspond to said at least one nominal frequency f entered by the user; c. At least one VCSO sound wave generator, preferably in the audible spectrum. Advantageously, said VCSO sound wave generator comprises at least two oscillators whose frequencies f. 1and f2 are configured to vary around a nominal frequency f; Advantageously, each oscillator comprises a phase, this phase is configured to be variable, for example this phase can be a function of at least one spatial coordinate; Preferably said nominal frequency f is predetermined, advantageously determined by the user; A sound wave generator can be called a VCSO from the English Voltage Control Spatial Oscillator; Advantageously, several main VCSO sound wave generators can be used simultaneously allowing the creation of complex sound waveforms; Each main VCSO sound wave generator can be configured to generate sound waves whose shape can be one of: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wavetable; according to one embodiment,each VCSO sound wave generator can be configured to be used as an LFSO by operating in the low frequency register; Preferably, the sound waves generated by each VCSO sound wave generator are configured to be modulated in frequency and / or amplitude; According to one embodiment, a VCSO sound wave generator comprises N VCOs such as VCOn with n=1, …, N; d. At least one VCSF filter, preferably at least two filters VCSF1 and VCSF2. Preferably, said VCSF filter is configured to be a low-pass and / or high-pass and / or band-pass type filter; According to one embodiment, the audio synthesizer comprises a plurality of VCSF filters. Advantageously, a so-called sliding gain can be used to switch from one filter to another filter in the case where several VCSF filters are used; e. Optionally, at least one SEG control module. Said SEG control module is advantageously configured to control at least one filter,preferably each of said filters, advantageously simultaneously; Said SEG control module may be an envelope generator preferably comprising at least 2, advantageously at least 4 adjustable parameters configured to vary around nominal values; said nominal values are preferably predetermined. f. At least one VCSA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave. Preferably each sound wave generator / VCSO / VCSF filter pair is configured to cooperate with at least one amplifier. According to one embodiment, said VCSA amplifier is configured to apply a predetermined amplitude to at least one sound wave, preferably via a SEG, said amplitude being configured to vary around a predetermined amplitude, called nominal. Advantageously, the amplifier comprises a multiplier element; preferably,said multiplier element is configured to be a function of at least one spatial coordinate; g. At least one LFSO wave generator, preferably below the hearing threshold. Preferably the LFSO wave generator comprises at least one voice, this voice comprising at least one waveform. Preferably, said waveform is fixed and advantageously taken from at least: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation. According to one embodiment, each LFSO wave generator comprises at least two oscillators whose frequencies are each configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each wave generator. According to one embodiment, LFSO comprises at least one phase,said phase is configured to vary around a nominal phase; h. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with at least one of said polyphonic voices, preferably with at least one of said sound waves. i. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or the frequency of at least one VCSO sound wave generator, the phase and / or the frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance. Advantageously,the VCSS is configured to convert the high-level controls into low-level controls in order to operate said variations.
[0163] According to one embodiment, the audio synthesizer comprises at least one SFX assembly module configured to assemble elements to at least one time delay line, said elements being taken from at least: i. The VCSO sound wave generator; ii. The VCSF filter; iii. The VCSA amplifier; iv. The LFSO wave generator.
[0164] According to one embodiment, the audio synthesizer comprises at least one trajectory generator configured to modify, preferably in real time, said at least one spatial coordinate and / or any other parameter that can influence said at least one spatial coordinate.
[0165] According to one embodiment, the audio synthesizer comprises at least one rendering engine configured to broadcast said sound wave in at least one acoustic environment, preferably via a listening device,such as for example an audio headset, one or more speakers.
[0166] The present invention can be understood according to a mathematical approach. Indeed, any value that can undergo variations, such as those previously described for example, can take the following expression according to the so-called high-level parameters of the VCSS module: [Math 3] ^^, ^ ( ^^ ) = ^^ ^ ^ ^^ ^,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ ∗ ^^ ௩ ൫ ^^, ^^ ^^ௗ ൯ ∗ ^^ ௩ ^ ^^, ^^ ^^ௗ , ^^ ଶ,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ ^^ Any F, or its angular for (Ø, ^, ^, etc.) ^^ varying from 1 to N ^^ ^^ௗ STATIC SPREAD Static distribution function DYNAMIC SPREAD Dynamic distribution function TIME SPREAD Time distribution function Delay functions induced by the ^^ ^^ௗ Time Function of variation due to position in space (is equal to 1 when ^^ ^( ^^) describes spatial coordinates) ൯ Spatial coordinates advantageous embodiment, certain elements of the present invention may have a different number of instances, such as for example: a. N for the VCSO, VCSF and VCSA b. M for the LFSO c. N' for the SFX d. M' and M'' for the SEG and SEF.
[0168] Furthermore, there may be different ways of applying variations depending on the nature of the parameters. These may be additive, subtractive or multiplicative. Thus the general expression presented previously can be broken down into a more general form. Here K replaces N for clarity: [Math 4] ^^ ∈ ℕ, ^^ ∈ ℕ 1 ^ ^^ ^ ^^ ^^ ^^ௗ ∈ 0 ^ ^^ ^^ௗ ^ 1 Static distribution Dynamic distribution due to an external signal Distribution due to time Distribution due to position in 3D space Delay of the reference signal ^^ ଶ,௩ ൫ ^^, ^^ ^^ௗ, ^^൯ External signal delay
[0169] Regarding the multiplicative form, the formula is thus the following: [Math 5] ^^ ^ ( ^^ ) = ^^ ^ ^ ^^ ^,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ ⋅ ^^ ௩ ൫ ^^, ^^ ^^ௗ ൯ ⋅ ^^ ௩ ^ ^^, ^^ ^^ௗ , ^^ ଶ,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ [Math 6] ^^ ^ ( ^^) = ^^ ^ ^ ^^ ^,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ + ^^ ௩ ൫ ^^, ^^ ^^ௗ ൯ + ^^ ௩ ^ ^^, ^^ ^^ௗ , ^^ ଶ,௩ ൫ ^^, ^^ ^^ௗ , ^^൯^ number of instances and spatial positions which may be different from the positions of the N audio instances. To create, for example, a chorus effect reproduced throughout the space while the source comes from a specific location, the present invention makes it possible to create N' channels specific to the SFX module.
[0172] Advantageously, the majority of the effects that the present invention can produce are produced from delays, filters, feedback (i.e. reinjection of the output signal at the input of the module chain) and sometimes modulations. The VCSD, from the English acronym Voltage Controlled Spatial Delay, has N' instances of delay line. Figure 14 represents the signal path of an SFX making it possible to recreate a majority of the effects that the present invention can produce.
[0173] According to one embodiment, the present invention may comprise an input matrix.Advantageously, said input matrix makes it possible to adapt the number of channels N, or even to relate them to the spatial positions of the instances N'. According to one embodiment, this input matrix can also be a full-fledged audio engine.
[0174] According to one embodiment, this input matrix can use a binaural engine.
[0175] According to one embodiment, the present invention is configured to cooperate with any type of rendering engine, also called an audio engine, applied at the end of the chain to listen to the rendering.
[0176] We will now describe in detail a preferred non-limiting embodiment of the present invention illustrated in Figure 15.
[0177] According to this embodiment, the audio synthesizer comprises the following characteristics: a. 4 voices of polyphony: i. Each VCSO, VCSF and VCSA is composed of 16 voices (N = 16) b. 5 VCSO: i.Each VCSO offers the following waveforms: Sine, Sawtooth, Triangle, Square, Pulse Width Modulation, Noise (Pink, White, Other), Wavetable; ii. Each VCSO can operate in LFSO mode (0.01Hz to 25Hz); iii. Each VCSO can be modulated in frequency or amplitude, via the LFSOs or the other VCSOs. c. 3 VCSFs i. A low-cut, a high-cut, and a band-pass; ii. A sliding gain allows switching between filters; iii. A SEG allows controlling these 3 VCSFs simultaneously. d. 1 VCSA e. A SEG is attached to the VCSA. f. 2 LFSOs i. Each LFSO has 4 instances (M = 4) for each of its 4 waveforms, for a total of 16 voices; ii. Waveforms are fixed: Sine, Sawtooth, Triangle, Square; iii. Synchronization with note On (phase reset). g. 2 SFX i. 1 reverb 12 instances in inputs and 12 voices in output (N' = 12); ii. 1 distortion 64 voices (N x 4 = 64). h. SCS i.76 voices: 16 (N = 16) x 4 (synthesizer polyphony) + 12 (N' = 12); i. 4 SEGs of 16 voices (M' = 16) allow to control each of the polyphony voices; j. 4 trajectory editors (1 per polyphony voice). k. Additional functions: i. Detune: allows to detune the 4 polyphony voices; ii. Glide: allows to perform glissandos from one note to another; iii. Unison: allows to assign the 4 polyphony voices simultaneously to each played note, thus accumulating a total of 320 voices of simultaneous oscillations: 4 (synthesizer polyphony) x 16 (N) x 5 (number of VCSOs).
[0178] Figure 15 represents, according to one embodiment, the signal path through an audio synthesizer according to the present invention. The solid line blocks are replicated for each polyphonic voice, while the dotted line blocks are common to the entire synthesizer according to the present invention.
[0179] As previously indicated, and according to an embodiment of the present invention, each VCSO can be modulated in frequency and / or in amplitude by an LFSO and / or by another VCSO. In addition, each VCSO can operate in the low frequency register through an LFSO mode, thus becoming an LFSO of 16 instances for example. Thus associated with spatial positions, these modulations add further decorrelations between the instances allowing completely new and previously unheard results.
[0180] According to an embodiment, the Sspd parameter of the VCSS makes it possible in particular to: a. Define the variation of the frequencies ƒ of the oscillators around the nominal frequency of the VCSO, by a multiplication; b. Define the variation of the frequencies F of the filters around the nominal frequency of the VCSF, by adding an exponential ratio; c. Define the variations of the frequencies ƒ' and the phases Ø' of the LFSOs. d.Define the spacing of the spatial positions of the N audio instances around the original position of a sound.
[0181] According to one embodiment, the Dspd parameter makes it possible in particular to: a. Define the phase variation Ø of the oscillators of the VCSO, by adding a fixed ratio; b. Define the variation of the Q factors of the filters around the nominal frequency of the VCSF; c. Define the variation X of the VCSA; d. Define the spacing of the spatial positions of the N audio instances around the original position of a sound.
[0182] According to one embodiment, the Tspd parameter makes it possible in particular to: a. Define the variation of a, d, s and r of the SEGs; b. Define the variation of the offsets of a, d, and r of the SEGs.
[0183] Advantageously, the spacings of the spatial positions of the N audio instances operated by the Sspd and the Dspd are cumulative. According to the present invention, Figure 16 illustrates how these spacings can act: a.First drawing on the left, Figure 16a: the polyphonic voices are placed at the 4 cardinal points. b. Middle drawing, Figure 16b: application of an Sspd of 30%, so the 16 instances are proportionally spaced up to + / - 30° around the barycenter of the polyphonic voice. c. Right drawing, Figure 16c: execution of an arpeggio (4 notes played successively) with a D. spdof 30%: i. Voice located to the north of the figure: initial position; ii. Voice located to the south of the figure: at the end of the attack phase; iii. Voice located to the east: during the sustain phase; iv. Voice located to the west: during the release phase.
[0184] According to one embodiment, the trajectory generator allows each polyphonic voice to be controlled independently.
[0185] The trajectories are preferably executed by an envelope generator whose values are equivalent to a % ratio of the SEG values of the VCSA. This makes it possible to easily match the duration of the trajectory with the duration of a sound.
[0186] According to one embodiment, the present invention may comprise at least one trajectory editing module. This module is preferably designed to edit the trajectories in two dimensions, but their path is projected onto a half-sphere.Figure 17 represents an example of trajectory execution, coupled with an Sspd value of 30% and a Dspd of 50%, we can see that: a. Drawing at the top left: initial position, the instances are spaced + / - 30° around an original position, barycenter of the polyphonic voice. b. Drawing at the bottom left: position of the instances at the end of the attack phase, split at almost 180° around the barycenter of the polyphonic voice. c. Drawing at the top right: position of the instances during the sustain phase, split at almost 180° around the barycenter of the polyphonic voice. Remember that sustain depends on velocity, so if the note had been played less loudly, the barycenter would have returned a little closer to the original position, and the instances less spaced apart since the Dspd is also driven by an envelope generator. d. Bottom right drawing: position of instances during the release phase, towards a return to the initial state.
[0187] According to a preferred embodiment of the present invention, the frequency variations ^^. ^ ( ^^) instances of a VCSO can be expressed using the multiplicative form presented above: [Math 7] ^^ ∈ ℕ, ^^ ∈ ℕ 1 ^ ^^ ^ ^^ ^^ ^ ൫ ^^, ^^ ^^ௗ ൯ = 1 + 0.01(−1) ^ ^^ ^^ ^^ ^^ௗ ^^ ^ ൫ ^^, ^^ ^^ௗ , ^^൯ = 1 ^^ ^ ൫ ^^, ^^ ^^ௗ , ^^൯ = 1 1 The azimuth ^^ ^ ( ^^) sets E by the SCS can be expressed using the additive form: [Math 8] ^^ ∈ ℕ, ^^ ∈ ℕ ^ 1 ି ^ ^^ ^ ^^ ^^ ^^ ^^ ^ ^ ^ by the action on the Tspd can be expressed using the following additive form: [Math 9] ^^′ ∈ ℕ, ^^′ ∈ ℕ 1 ^ ^^′ ^ ^^′ ^^ ை ൫ ^^′, ^^ ^^ௗ , ^^൯ = ^^ ^ ൫ ^^′, ^^ ^^ௗ , ^^൯ = ^^ ^ ൫ ^^′, ^^ ^^ௗ , ^^൯ = ^^ ோ ൫ ^^′, ^^ ^^ௗ , ^^൯ = ^^′ ^^ ^^ௗ ^^ை൫ ^^′, ^^ ^^ௗ൯ = ^^ ^൫ ^^′, ^^ ^^ௗ൯ = ^^ ^൫ ^^′, ^^ ^^ௗ൯ = ^^ ோ൫ ^^′, ^^ ^^ௗ൯ = 0 ൯ to cooperate with an effect module.
[0191] As a reminder, and as previously indicated, most of the effects are produced from the same processing chain consisting of delays, filters, amplifiers, a feedback chain, and modulation elements, generally an LFO.
[0192] According to one embodiment, the audio synthesizer comprises at least one effect module.
[0193] According to one embodiment, said effect module comprises at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input I1 configured to receive at least one monophonic audio signal, preferably said first audio input I1 being configured to receive at least said N audio instances of each voice of added polyphony; ii. A second audio input I2 configured to receive at least one stereophonic audio signal,preferably said second audio input l2 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input I3 configured to receive at least one multichannel audio signal, preferably the number of channels being arbitrary, preferably said third audio input l3 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first mixing matrix module IM, also called input matrix, configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one processing module ME,said first mixing matrix module IM comprising at least: i. A predetermined number of input channels considered as entry points in said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal coming from at least one output channel of the first mixing matrix module IM; d. A second mixing matrix module OM, also called output matrix, configured to distribute the processed audio signals at the output of said processing module in at least said virtual space and to at least one binaural rendering module BR and / or to at least one output module SO,said second OM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points in said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second OM mixing matrix module in at least one binaural space, preferably using their spatial coordinates.
[0194] Thus, Figure 18 illustrates an embodiment of said effect module. In this figure, and according to one embodiment,said effect module comprises at least: a. An audio input module; said audio input module being configured to accept at least three types of audio signals; said audio input module advantageously comprises at least: i. A first audio input I1 configured to receive at least one monophonic audio signal, preferably said first audio input l1 being configured to receive at least said N audio instances of each voice of added polyphony; ii. A second audio input I2 configured to receive at least one stereophonic audio signal, preferably said second audio input l2 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input I3 configured to receive at least one multichannel audio signal, preferably the number of channels can be any,preferably said third audio input l3 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first mixing matrix module IM, preferably with "intensity panning"; said mixing matrix module IM being configured to distribute the incoming audio signals into at least one virtual space, preferably to at least one processing module ME; According to one embodiment, the mixing matrix module IM comprises a number C of input channels, the number C being defined by a selection parameter of the input type: i. monophonic (1 channel), ii. stereophonic (2 channels), iii. multichannel - n channels defined by a parameter called "Input Channels". These input channels are considered as points - called "input" - in said virtual space; Preferably, the number C is equal to N'. Preferably,said IM mixing matrix module comprises a predetermined number of virtual output points corresponding to the number of effect channels of the ME processing module; Advantageously, the “Effect Channels” parameter defines said number of virtual output points; According to one embodiment, a first method for distributing the virtual points is described below. c. An ME processing module, also called a multi-voice and multi-channel effect module; Said ME processing module comprises at least one device for storing at least one series of instructions configured to be executed by at least one processor and to transform at least one sound signal into the output of said IM mixing matrix module. Preferably, the ME processing module is configured to apply at least one audio processing to at least one audio signal coming from at least one output channel of the IM mixing matrix module,preferably before exiting said processing module ME; Advantageously, the number of input channels of the processing module ME is equal to the number of output channels of the processing module ME, and preferably of the matrix mixing module IM; d. A second matrix mixing module OM, preferably with "intensity panning"; said second matrix mixing module OM being configured to distribute the processed audio signals entering at least one virtual space, preferably to at least one binaural rendering module BR on the one hand, and at least one output module SO on the other hand; According to one embodiment, the second matrix mixing module OM comprises a number D of input channels, the number D being defined by at least one parameter called "Effect Channels", which also defines the number of effect channels calculated in the processing module ME; Preferably the number D is equal to the number C; Advantageously,these input channels are configured to serve as entry points in said virtual space; Advantageously, a parameter called "Output Channels" is configured to define the number of virtual output points of said second mixing matrix module OP, preferably, said virtual output points correspond to the desired number of loudspeakers; According to one embodiment, a second method for distributing the virtual output points is described below. e. A binaural rendering module BR; Advantageously, the virtual output points of the second mixing matrix module OM are also defined in said binaural rendering module BR; said binaural rendering module BR comprises at least one device for storing at least one series of instructions configured to be executed by at least one processor and to synthesize at least one binaural audio signal; Preferably,said binaural rendering module BR is configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates; Advantageously, said binaural rendering module BR is configured to calculate the 3D stereo audio intended for at least one stereo output module HO and / or a digital-to-analog converter (DAC) intended for headphones.
[0195] According to one embodiment, the audio inputs I1, I2 and I3 can accommodate external audio sources.
[0196] According to one embodiment, and in order to illustrate an example of application of said effect module,This can generate a so-called "chorus" effect.
[0197] The chorus effect is a type of modulation effect used to thicken and color an audio signal enough to give the impression that several instruments are playing. The effect is achieved by taking an audio signal and mixing it with one or more modulated copies of itself. The modulations are produced by an LFO (Low Frequency Oscillator) which controls short delay variations of the original signal. A continuous variation in the pitch of the sound, following the modalities of the Doppler effect, occurs. When the modulated audio signal is then mixed with the input audio signal, a doubling effect of the sound occurs.
[0198] In the case of a multi-channel chorus made up as here of parallel channels, the principle consists of linearly shifting the phase of the LFO for each effect channel,in order to obtain a set of decorrelated output signals expressed spatially in a space. The decorrelation of the channels thus contributes to the spatiality of the output signal.
[0199] To determine the modulation phase value of each of the effect channels, we divide the maximum limit of a vector [0.1] by the number of effect channels defined by the "Effect Channels" parameter. For 8 effect channels, we will obtain a value of 0.125, for example.
[0200] This value is advantageously multiplied by the index value of each effect voice, from 0 to N-1 (N = number of channels). For example, we obtain, for 8 channels, a list of values to apply to each effect voice: 0., 0.125, 0.25, 0.375, 0.5, 0.625, 0.75 and 0.875.
[0201] The value obtained for each channel is then added to the dynamic value of the oscillation produced by the LFO, which oscillates linearly between 0 and 1, then from 1 to 0,before starting a new cycle (LFO called "triangle" type).
[0202] The LFO value added to the calculated offset is then amplified, i.e. multiplied, so that the variation occurs in a time domain, preferably defined in milliseconds. For a variable delay, we will want to vary the delay time between 0ms and 5ms, for example.
[0203] The modulation is then applied to a delay line, thus creating the pitch variations, following the modalities of the Doppler effect.
[0204] Each effect channel being decorrelated temporally and spatially, the sound result obtained is a multichannel "chorus" effect.
[0205] The Sspd parameter, expressed in percents, allows the phase shift of each effect voice to be linearly multiplied. With an Sspd value of 0, no shift is produced, each voice is in phase. As the value of Sspd increases, the phases are shifted,and the effects channels are increasingly decorrelated temporally and spatially. At an Sspd value of 100%, the phases are linearly decorrelated, and the chorus effect is at its most immersive.
[0206] According to one embodiment, the present invention makes it possible to apply the phase shift principle to different types of audio processing.
[0207] For example, the phase shift principle previously described can be applied to different types of sound transformations, preferably constituting a set of multichannel sound effects. Thus, and by way of non-limiting example, the present invention makes it possible to generate the following effects: a. "Tremolo" effect: the modulation (x) produced by the LFO, the phase of which is shifted,is applied to the reading of a sine wave table whose value (y) is applied to the modulation of the intensity of the signals of the output channels of the EM processing module; b. "Phaser" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading of a sine wave table whose value (y) is applied to the frequency sweeps of a cascade of all-pass filters; c. "Freezer" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading position of a wave table whose audio content is captured on the fly and played in a loop; d. "Flanger" effect: the principle is equivalent to the Chorus effect, by means of an adjustable reinjection (called feedback) of the modulated signal at the input of the EM processing module, for a timbral reinforcement. e. "Vibrato" effect: the principle is equivalent to the Chorus effect,with the only difference that the signal of an output channel of the EM processing module is not added to the modulated signal.
[0208] According to one embodiment, the present invention relates to a first method for distributing, preferably homogeneously, at least one incoming audio signal to a virtual space using a three-dimensional orthonormal reference frame whose different axes are defined by X, Y and Z, said method comprising at least the following steps: a. Defining at least one input point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi, and Zi; b. Defining at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculating at least one Euclidean distance between said input point PEi and at least said output point PSj; d. Applying at least one signal attenuation law to the value of said calculated Euclidean distance,preferably said attenuation law being defined as such: the intensity value of said audio signal is halved each time the Euclidean distance doubles; e. Deduction of a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;
[0209] This method thus makes it possible to obtain a homogeneous projection of the incoming signals towards a spherical space.
[0210] According to one embodiment, the present invention relates to a second method of distribution, preferably homogeneous, of at least one audio signal leaving said at least one virtual space using a three-dimensional orthonormal reference frame whose different axes are defined by X, Y and Z, said method comprising at least the following steps: a. Definition of at least one input point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi,and Zi; b. Defining at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculating at least one Euclidean distance between said input point PEi and at least said output point PSj: d. Applying at least one signal attenuation law to the value of said calculated Euclidean distance, preferably said attenuation law being defined as such: the intensity value of said audio signal is divided by two each time the Euclidean distance doubles; e. Deducing a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;
[0211] This method provides a homogeneous projection of the incoming signals to at least one output module SO and / or a digital-to-analog converter (DAC) intended for physical loudspeakers.
[0212] As illustrated in Figure 19,the present invention also relates to a method 100 for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention. Advantageously, said method 100 comprises at least the following steps: a. Input 110 of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI keyboard (Musical Instrument Digital Interface); Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters comprising at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation 120 of at least N audio instances of said set E; c. Generation 130 of at least said sound wave,by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of primary VCO sound wave generators; d. Filtering 140 of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of primary VCF filters; e. Amplification 150 of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of primary VCA amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation 160 by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from among at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd,and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being configured to control a set of low-level parameters, such as for example frequencies, phases or even the positions in space of the different audio instances; ii. a low-level parameter; iii. a spatial coordinate of said audio instance considered; g. Spatialization 170 of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave,by the SCS spatial coordinate generation module.
[0213] The present invention also relates to another method for generating at least one sound wave and its spatial coordinates. Advantageously, said method comprises at least the following steps: a. At least one decorrelation step taken from: i. A first step of varying at least one sound wave by modifying the first parameter S, spd, said first decorrelation step comprising at least: A) A step of shifting at least one frequency of at least one voice of at least one oscillator, said voice being associated with said sound wave; B) A step of shifting spatial coordinates of said at least one voice, preferably relative to at least one other voice; ii. A second step of varying said at least one sound wave by modifying the second parameter Tspd, said second decorrelation step comprising at least: A) A step of shifting at least one parameter of at least one envelope generator, preferably at least one parameter taken from: a, r, d, t, or h, so as to shift at least one temporal envelope of said at least one sound wave; Advantageously, the second parameter Tspd is positive or zero; According to one embodiment, this shifting step also allows a spatial shift of said at least one sound wave; iii.A third step of varying said at least one sound wave by modifying the third parameter Dspd, said third decorrelation step being performed by at least one envelope generator, preferably each time a note is played, said third step comprising at least: A) A step of shifting at least one phase of at least one voice of said at least one oscillator; B) A step of spatial shifting of at least one voice, preferably relative to at least one other voice; iv. A fourth step of varying said at least one sound wave comprising at least: A) A step of shifting at least one quality factor Q of at least one voice of at least one filter, preferably via the adjustment of the third parameter Dspd; B) A step of shifting at least one frequency of said at least one voice of said at least one filter, preferably via the adjustment of the first parameter Sspd. v.A fifth step of varying the amplitude of said sound wave as a function of at least one spatial coordinate of said sound wave.
[0214] The present invention also relates to a computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to the present invention.
[0215] The present invention also relates to a non-transitory memory medium comprising a computer program product according to the present invention.
[0216] All publications referred to in this description are incorporated by reference in their entirety for all purposes of assisting in the understanding of the present invention.
[0217] The invention is not limited to the embodiments previously described and extends to all embodiments covered by the claims.
Claims
Claims
1. Audio synthesizer configured to generate at least one sound wave distributed along at least one spatial dimension, said audio synthesizer comprising at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphony voice, preferably at least 2 polyphony voices, and advantageously at least 4 polyphony voices, each polyphony voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphony voice comprising at least N audio instances of a set E of elements comprising at least: i. A primary VCO sound wave generator, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f; ii.A primary filter VCF, said primary filter VCF comprising at least one filter whose frequency is configured to vary around a user-defined natural nominal frequency; iii. A primary amplifier VCA configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary amplifier VCA; c. At least one sound wave generator VCSO comprising at least two instances of said sound wave generator VCO; d. At least one VCSF filter comprising at least two instances of said primary filter VCF; e. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, said VCSA amplifier comprising at least one multiplier element; f. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of the at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; g.At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or the quality factor Q of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any one of the elements of the set E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.
2. Audio synthesizer according to the preceding claim wherein the VCSS control module comprises at least one parameter taken from at least: a.A first parameter, preferably called Static Spread, said first parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value; b. A second parameter, preferably called Dynamic Spread, said second parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer as a function of a predetermined value modulated by at least one external source, preferably an envelope generator; c. A third parameter, preferably called Time Spread, said third parameter being configured to apply at least one variation of at least one time parameter of the audio synthesizer, preferably of an envelope generator.
3. Audio synthesizer according to any one of the preceding claims comprising at least one of: a. M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprises at least one voice, this voice comprising at least one waveform; b.M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; c. M' control instances, each control instance M' comprising at least one primary envelope tracking and control module EF.
4. Audio synthesizer according to any one of the preceding claims comprising at least one of:. a. An LFSO wave generator comprising at least two instances of said primary LFO wave generator; b. An SEG control module comprising at least two instances of said primary EG control module; c. An SEF control module comprising at least two instances of said primary envelope tracking and EF control module.
5. An audio synthesizer according to any one of the preceding claims comprising at least one trajectory generator configured to modify, preferably in real time, said at least one spatial coordinate and / or any other parameter capable of influencing said at least one spatial coordinate.
6. An audio synthesizer according to any one of the preceding claims comprising at least one rendering engine configured to broadcast said sound wave in at least one acoustic environment, preferably via a listening device.
7. Audio synthesizer according to the preceding claim comprising at least one SFX assembly module configured to assemble elements to at least one time delay line, said elements being taken from at least: a. The VCSO sound wave generator; b. The VCSF filter; c. The VCSA amplifier; d. The LFSO wave generator.
8. Audio synthesizer according to any one of the preceding claims comprising at least one. effect module configured to generate at least one effect, said effect module comprising at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input I1 configured to receive at least one monophonic audio signal, preferably said first audio input I1 being configured to receive at least said N audio instances of each voice of summed polyphony; ii. A second audio input I2 configured to receive at least one stereophonic audio signal, preferably said second audio input I2 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii.A third audio input I3 configured to receive at least one multichannel audio signal, preferably the number of channels being arbitrary, preferably said third audio input I3 being configured to receive at least said N audio instances with their respective spatial coordinates. b. A first mixing matrix module IM configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one processing module ME, said first mixing matrix module IM comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. A processing module ME configured to apply at least one audio processing to at least one audio signal coming from at least one output channel of the first mixing matrix module IM; d. A second mixing matrix module OM configured to distribute the processed audio signals at the output of said processing module in at least said virtual space and to at least one binaural rendering module BR and / or to at least one output module SO, said second mixing matrix module OM comprising at least: i. A predetermined number of input channels considered as entry points in said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e.A binaural rendering module BR configured to arrange said output points of the second mixing matrix module OM in at least one binaural space, preferably using their spatial coordinates.
9. Method (100) for generating at least one spatialized sound wave by decorrelation preferably by at least one audio synthesizer according to any one of the preceding claims, said method (100) comprising at least the following steps: a. Input (110) of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface; Said nominal frequency value corresponding to a sound wave having predetermined parameters, said parameters comprising at least. one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, an offset parameter of the nominal frequency; b. Creation (120) of at least N audio instances of said set E; c. Generation (130) of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of VCO primary sound wave generators; d. Filtering (140) of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of VCF primary filters; e. Amplification (150) of said filtered sound wave by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of VCA primary amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f.Decorrelation (160) by at least one variation of at least one parameter of at least one audio instance considered taken from among said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from among at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as for example an envelope generator, said third parameter being configured to operate variations of the temporal parameters; said high-level parameter being. configured to control a set of low-level parameters; ii. a low-level parameter; iii. a spatial coordinate of said audio instance considered; g. Spatialization (170) of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.
10. Method (100) according to the preceding claim wherein the decorrelation step comprises at least one step of modulating at least one parameter of the audio synthesizer from at least one other wave generated by the LFSO wave generator, said LFSO wave generator comprising at least M control instances.
11. Method (100) according to any one of the two preceding claims wherein the decorrelation step comprises at least one step of driving at least said VCSF filter by at least said SEG control module, said SEG control module comprising at least M' control instances.
12. Method (100) according to any one of the three preceding claims comprising, before or after the spatialization step, a step of assembling said filtered sound wave with at least one delay line and / or said other wave with at least one other delay line, by the SFX assembly module comprising at least N' audio instances.
13. Method (100) according to any one of the four preceding claims wherein the spatialization step comprises at least one step of generating at least one trajectory, by the trajectory generator, by modifying in time, preferably in real time, at least one spatial coordinate of said filtered sound wave.
14. Method (100) according to any one of the five preceding claims comprising, after the spatialization step, at least one step of audio rendering by at least one rendering engine.
15. Computer program product comprising a plurality of instructions which when executed by at least one processor execute the method according to any one of the six preceding claims.
16. Non-transitory memory medium comprising a computer program product according to the preceding claim.