System and method configured to modify an audio effect based on spatial coordinates

Abstract

The present invention relates to a method for spatial sound effects, the parameters of which are modified by the position of the source to which it is applied. Unlike all prior art solutions where the spatial effect can only be applied after rendering, the present invention proposes applying the effect directly to the source, commonly called a sound object in the field of 3D audio, before rendering, according to its position in space, generally determined by panning. Fig. 8

Description

Title of the invention: System and method configured to modify an audio effect based on spatial coordinates. TECHNICAL FIELD OF THE INVENTION

[0001] The invention relates to the technical field of digital audiovisual systems, in particular, the invention relates to the technical field of spatial sound effects in audio processing systems. STATE OF THE ART

[0002] 3D audio is becoming the new standard for broadcasting sound content, in the music industry driven by technology giants, and more recently in television channels around the world that are adopting NGA (Next Generation Audio) encoding. For example, France Télévisions broadcast the Paris 2024 Olympic Games on France 2 in Dolby Atmos (AC-4 encoding). Companies offering software or hardware equipment must therefore adapt their offerings to these new standards. The majority of sound production software (editing, music production, mixing) is now compatible with at least one NGA format.

[0003] In the field of music, these software programs, commonly called "DAWs" (Digital Audio Workstations), are used with the addition of third-party software called "plug-ins" which are used to process sounds. Thus, the DAW allows, for example, placing sounds on a timeline, balancing them with each other via a mixer, and positioning them in space via panning.

[0004] As an example, [Fig. 1] represents the signal path found in DAWs: an audio source (an audio track or a virtual instrument, for example) passes through one or more effects, and then panning allows this source to be placed in a space. In so-called "channel-based" formats, the sound is distributed between the output tracks (which are then generally sent directly to the speakers, after being mixed with the other tracks), usually via an intensity pan.

[0005] Plug-ins are used to perform transformations on sounds: equalization, compression, effects such as reverb, chorus, delay, and many others. With the advent of 3D audio, these plug-ins have not undergone any major changes, except for an increase in the number of channels they can handle. That is to say, for a reverb plug-in, for example, it will produce a multichannel sound for a certain number of channels, which generally correspond to the number and position of the playback speakers (or to a "Bed" in the case of Dolby Atmos).

[0006] For a multichannel equalizer, we can decide to apply more or less effect to a particular channel, which generally corresponds to a loudspeaker.

[0007] Thus, current plug-ins do not allow for the specific management of each source individually for 3D audio. Consequently, it is difficult to create complex sound effects and to precisely control the position of said effect in the 3D audio space.

[0008] The present invention therefore aims to overcome, at least in part, the aforementioned disadvantages of the prior art.

[0009] The other objects, features and advantages of the present invention will become apparent from an examination of the following description and accompanying drawings. It is understood that other advantages may be incorporated.

[0010] SUMMARY

[0011] The present invention relates to a method for modifying at least one parameter of at least one effect as a function of at least one spatial coordinate of at least one virtual sound source, said effect being applied to said virtual sound source before playback by at least one listening device, said method being configured to be implemented by at least one audio processing system, the method comprising at least: a. Apply at least one effect to at least one virtual sound source before playback by at least one listening device, by at least one user via at least one input module comprising at least one first input interface, said effect comprising at least one parameter, said parameter being configured to be modified, preferably said parameter being modifiable; b. Define at least one spatial area of ​​application of said parameter of said effect, by said user via said input module comprising at least one second input interface, said spatial area of ​​application comprising a plurality of spatial coordinates; c. Assign at least one spatial coordinate to said source, by the user via at least one panning module, preferably said panning module including at least one third input interface; d. Compare, using at least one data processing unit, the said spatial coordinate of the said virtual sound source with the said spatial area of ​​application of the said effect: i. if the spatial coordinate of the virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said application area and thus the virtual sound source is present in said spatial application area, modify said parameter of said effect by the data processing unit.

[0012] The present invention also relates to an input module comprising at least: a. A first input interface configured to allow at least one user to apply at least one effect to at least one virtual sound source before playback by at least one listening device, said effect comprising at least one parameter, said parameter being configured to be modified; b. A second input interface configured to allow at least one user to define at least one spatial area of ​​application of at least one parameter of said effect.

[0013] The present invention also relates to an audio processing system configured to modify at least one parameter of at least one effect as a function of at least one spatial coordinate of at least one virtual sound source, said system comprising at least: a. An input module comprising at least: i. A first input interface configured to allow at least one user to apply at least one effect to at least one virtual sound source before playback by at least one listening device, said virtual sound source comprising at least one spatial coordinate, said effect comprising at least one parameter, said parameter being configured to be modified, preferably being modifiable; ii. A second input interface configured to allow at least one user to define at least one spatial area of ​​application of at least one parameter of said effect, said spatial area of ​​application comprising a plurality of spatial coordinates. b. A panning module configured to allow at least one user to assign at least one spatial coordinate to said virtual sound source, said panning module comprising at least one third input interface; c. A data processing unit configured to compare said spatial coordinate of said virtual sound source with said spatial area of ​​application of said effect, and if the spatial coordinate of the virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said area of ​​application and thus the virtual sound source is present in said spatial area of ​​application, the unit data processing is configured to modify said parameter of said effect; d. A listening device configured to reproduce at least one sound from said virtual sound source, preferably after application of said effect when said virtual sound source is in said spatial area of ​​application.

[0014] The present invention also relates to a computer program product comprising a plurality of instructions which, when executed by at least one processor, execute the process according to the present invention.

[0015] The present invention also relates to a non-transient memory support comprising a computer program product according to the present invention.

[0016] The present invention also relates to an audio synthesizer configured to modify at least one parameter of at least one effect as a function of at least one spatial coordinate of at least one virtual sound source, said audio synthesizer comprising at least the audio processing system according to the present invention, and the synthesizer further comprises: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least two polyphonic voices, and advantageously at least four polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphonic voice comprising at least N audio instances of a set E of elements comprising at least: i. A primary VCO sound wave generator, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a nominal natural frequency defined by the user; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. At least one VCSO sound wave generator comprising at least two instances of said VCO sound wave generator; d. At least one VCSF filter comprising at least two instances of said primary VCF filter; e. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, said VCSA amplifier comprising at least one multiplier element; f. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate to each of the N audio instances of at least one set E, i.e. to at least one of said polyphonic voices, preferably to at least one of said sound waves; g. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or Q quality factor of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the E assembly, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.

[0017] The present invention also relates to a synthesizer-type instrument, which can be virtual, which integrates spatialization in an intuitive and musical way, while being as close as possible to the classic operation of synthesizers.

[0018] The present invention relates to an audio synthesizer configured to generate at least one sound wave distributed along at least one spatial dimension, said audio synthesizer comprising at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least two polyphonic voices, and advantageously at least four polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphonic voice comprising at least two audio instances, preferably at least N audio instances, N being greater than 2, from a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f, preferably defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a nominal natural frequency defined by the user; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. Preferably, at least M control instances, each M control instance comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprising at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e. Preferably, at least M” control instances, each M” control instance comprising at least one primary envelope tracking and EF control module; f. At least one VCSO sound wave generator comprising at least two instances of said primary VCO sound wave generator; g. At least one VCSF filter comprising at least two instances of said primary VCF filter; h. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, said VCSA amplifier comprising at least one multiplier element; i. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; j. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; k. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; 1. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate to each of the N audio instances of at least one set E, i.e. to at least one of said polyphonic voices, preferably to at least one of said sound waves; m. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or Q quality factor of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the E assembly, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.

[0019] The present invention thus makes it possible to generate spatialized sounds.

[0020] The present invention also relates to a method for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention, said method comprising at least the following steps: a. Input of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI (Musical Instrument Digital Interface) keyboard; Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters including at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a parameter offsetting the nominal frequency; b. Creation of at least N audio instances of said set E; c. Generation of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of VCO primary sound wave generators; d. Filtering of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of VCF primary filters; e. Amplification of said sound wave filtered by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of VCA primary amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation by at least one variation of at least one parameter of at least one audio instance considered taken from said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from at least one first parameter, preferably called Sspd, a second parameter, of preference called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as an envelope generator, said third parameter being configured to operate variations of the time parameters; said high-level parameter being configured to control a set of low-level parameters, such as frequencies, phases, or even the positions in space of the different audio instances; ii. A low-level parameter; iii. A spatial coordinate of said audio instance in question; g. Spatialization of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.

[0021] The present invention also relates to a computer program product comprising a plurality of instructions which, when executed by at least one processor, execute the process according to the present invention.

[0022] The present invention also relates to a non-transient memory medium comprising a computer program product according to the present invention. BRIEF DESCRIPTION OF FIGURES

[0023] The aims, objects, features and advantages of the invention will become clearer from the detailed description of an embodiment thereof, which is illustrated by the following accompanying drawings in which:

[0024] [Fig.1] Fig.1 schematically represents the traditional signal path in DAWs (Digital Audio Workstations).

[0025] [Fig.2] Fig.2 schematically represents the signal path of an effect spatial whose parameters are affected by the spatial coordinates provided by the panoramic according to an embodiment of the present invention.

[0026] [Fig.3] The [Fig.3] represents the interface of the spatial equalizer implemented according to the present invention.

[0027] [Fig.4] Figure [Fig.4] represents a spatial equalizer according to one embodiment of the present invention, where we now have several sources.

[0028] [Fig.5] The [Fig.5] represents the interface of a spatial effect implemented according to an embodiment of the present invention.

[0029] [Fig.6] Fig.6 schematically represents the traditional path of a signal when a delay is applied to it according to the prior art.

[0030] [Fig.7] Fig.7 represents the signal path of the "SFX" implemented in a synthesizer according to an embodiment of the present invention.

[0031] [Fig.8] Fig.8 schematically represents a method according to an embodiment of the present invention.

[0032] [Fig.9] Fig.9 schematically represents an input module according to an embodiment of the present invention.

[0033] [Fig. 10] The [Fig. 10] schematically represents a system according to an embodiment of the present invention.

[0034] [Fig. 11] The [Fig. 11] schematically represents a synthesizer according to an embodiment of the present invention.

[0035] [Fig. 12] The [Fig. 12] schematically represents the signal path of a classic synthesizer.

[0036] [Fig. 13] The [Fig. 13] schematically represents the multiplication of the elements of a synthesizer into a certain number of instances according to an embodiment of the present invention.

[0037] [Fig. 14] The [Fig. 14] schematically represents the spatial positions of the 4 instances of 4 voices of polyphony according to an embodiment of the present invention.

[0038] [Fig. 15] Fig. 15 schematically represents the decorrelation of instances of a VCSO according to an embodiment of the present invention.

[0039] [Fig. 16] Fig. 16 schematically represents the decorrelation of instances of a VCSF according to an embodiment of the present invention.

[0040] [Fig. 17] Fig. 17 schematically represents the decorrelation of instances of a SEG according to an embodiment of the present invention.

[0041] [Fig. 18] Fig. 18 schematically represents the decorrelation of instances of a VCSA according to an embodiment of the present invention.

[0042] [Fig. 19] Fig. 19 schematically represents the decorrelation of instances of a SEF according to an embodiment of the present invention.

[0043] [Fig.20] Fig.20 schematically represents the VCSS control parameters according to an embodiment of the present invention.

[0044] [Fig.21] Fig.21 schematically represents the signal path of a synthesizer according to an embodiment of the present invention.

[0045] [Fig.22] Fig.22 schematically represents examples of waveforms.

[0046] [Fig. 23] Fig. 23 schematically represents synthesis techniques using several VCSOs according to an embodiment of the present invention.

[0047] [Fig.24] Fig.24 schematically represents the signal path of an SFX within a spatial synthesis chain according to an embodiment of the present invention.

[0048] [Fig.25] Fig.25 schematically represents the signal path of a polyphonic voice according to an embodiment of the present invention.

[0049] [Fig.26] Fig.26 schematically represents the spatial distribution of 16 instances of 4 voices of polyphony according to an embodiment of the present invention.

[0050] [Fig.26a] Fig.26a schematically represents the case where Sspd is equal to 0% and Dspd is equal to 0% according to an embodiment of the present invention.

[0051] [Fig.26b] Fig.26b schematically represents the case where Sspd is equal to 30% and Dspd is equal to 0% according to an embodiment of the present invention.

[0052] [Fig.26c] Fig.26c schematically represents the case where Sspd is equal to 30% and Dspd is equal to 30% according to an embodiment of the present invention.

[0053] [Fig.27] Fig.27 schematically represents the distribution of 16 instances during the execution of a trajectory of a polyphonic voice according to an embodiment of the present invention.

[0054] [Fig.28] Fig.28 schematically represents an effect module according to an embodiment of the present invention.

[0055] [Fig.29] Fig.29 schematically represents a method according to an embodiment of the present invention.

[0056] The drawings are given by way of example and are not limiting of the invention. They constitute schematic representations of principle intended to facilitate understanding of the invention and are not necessarily to scale with practical applications. In particular, the dimensions are not representative of reality. DETAILED DESCRIPTION

[0057] Before proceeding to a detailed review of embodiments of the invention, optional features that may be used in combination or alternatively are listed below:

[0058] According to one example, the spatial area of ​​application is spatially dynamic.

[0059] According to one example, the comparison step is applied to another virtual sound source, said other virtual sound source being pre-existing or newly created, and if the spatial coordinate of the other virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said application area and thus the other virtual sound source is present in said spatial application area, the present invention includes a step of modifying said parameter of said effect by the data processing unit applied to said other virtual sound source.

[0060] According to one example, the present invention includes at least one step of creating a new virtual sound source.

[0061] According to one example, the effect includes at least one of the following: filtering, delay, echo, compression, distortion, tremolo, delay combined with modulation.

[0062] According to one example, the virtual sound source is generated by at least one synthesizer and / or a digital audio workstation and / or a mixing console.

[0063] According to one example, the listening device is a pair of headphones and / or a spatialized sound system.

[0064] According to one example, spatial coordinates are defined using Cartesian or polar coordinates, two-dimensional and / or three-dimensional.

[0065] According to one example, the data processing unit is implemented on a general-purpose computer or a specialized digital signal processor.

[0066] According to one example, said effect is applied in real time or in post-processing.

[0067] According to one example, said spatial area of ​​application is defined using a graphical user interface and / or text input.

[0068] According to one example, the VCSS control module includes at least one parameter taken from at least: a. A first parameter, preferably called Static Spread (Sspd), said first parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer according to a predetermined value; b. A second parameter, preferably called Dynamic Spread (Dspd), said second parameter being configured to apply at least one variation of at least one parameter of the audio synthesizer as a function of a predetermined value modulated by at least one external source, preferably an envelope generator; c. A third parameter, preferably called Time Spread (Tspd), said third parameter being configured to apply at least one variation of at least one time parameter of the audio synthesizer, preferably of an envelope generator;

[0069] By way of example, the present invention comprises at least one of the following: a. M control instances, each control instance M comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprising at least one voice, this voice comprising at least one waveform; b. M' control instances, each control instance M' comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; c. M' ' control instances, each M' ' control instance comprising at least one primary envelope tracking and EF control module.

[0070] By way of example, the present invention comprises at least one of the following: a. An LFSO wave generator comprising at least two instances of said primary LFO wave generator; b. A SEG control module comprising at least two instances of said primary EG control module; c. An SEF control module comprising at least two instances of said primary envelope tracking and EF control module.

[0071] According to one example, each oscillator of the primary sound wave generator VCO includes a frequency, this frequency being configured to be variable, preferably as a function of at least one spatial coordinate.

[0072] According to one example, each oscillator of the primary sound wave generator VCO includes a phase, this phase being configured to be variable, preferably as a function of at least one spatial coordinate.

[0073] According to one example, the primary sound wave generator VCO is configured to generate sound waves whose shape can be one of: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wave table.

[0074] According to one example, the primary VCF filter is configured to be a low-pass and / or high-pass and / or band-pass type filter.

[0075] According to one example, the VCA amplifier is configured to apply a predetermined amplitude to at least one sound wave, said amplitude being configured to vary around a predetermined amplitude, said nominal; Advantageously said multiplier element of the primary VCA amplifier is configured to be a function of at least one spatial coordinate.

[0076] According to one example, the primary LFO wave generator includes at least one oscillator whose frequency is configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each primary LFO wave generator.

[0077] According to one example, the primary LFO generator comprises at least one phase, said phase being configured to vary around a nominal phase.

[0078] According to one example, said nominal natural frequency is predetermined, advantageously determined by the user.

[0079] According to one example, said nominal frequency is predetermined, advantageously determined by the user.

[0080] According to one example, a sound wave generator can be called a VCSO, an acronym for Voltage Control Spatial Oscillator.

[0081] According to one example, several VCSO sound wave generators can be used simultaneously allowing the creation of complex sound waveforms.

[0082] According to one example, the sound waves generated by each VCSO sound wave generator are configured to be modulated in frequency and / or amplitude.

[0083] According to an example, a VCSO comprises N VCOs such that VCOn with n=l, ..., N.

[0084] According to one example, said EG control module can be an envelope generator preferably including at least 2, advantageously at least 3 adjustable parameters configured to vary around nominal values, preferably predetermined.

[0085] According to one example, the VCSS control module is configured to apply at least one offset, at at least one frequency in the case of controls of a filter, at at least one frequency in the case of controls of an oscillator, at at least one time parameter in the case of controls of an envelope generator.

[0086] According to one example, the present invention includes at least one so-called sliding gain that can be used by at least one user to switch from one filter to another filter in the case where several VCSF filters are used.

[0087] According to one example, the SEG can control a so-called sliding gain that can be used to switch from one filter to another filter in the case where several VCSF filters are used.

[0088] By way of example, the present invention comprises at least one effects module configured to generate at least one effect, said effects module comprising at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each voice of added polyphony; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multichannel audio signal, preferably with any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM matrix mixing module configured to distribute said at least one incoming audio signal into at least one virtual space and to the destination of at least one ME processing module, said first IM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. An ME processing module configured to apply at least one audio processing to at least one audio signal from at least one output channel of the first IM matrix mixing module; d. A second OM matrix mixing module configured to distribute the processed audio signals output from said processing module into at least said virtual space and to at least one BR binaural rendering module and / or to at least one SO output module, said second OM matrix mixing module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second matrix mixing module OM in at least one binaural space, preferably using their spatial coordinates.

[0089] According to one example, the method according to the present invention includes a step of controlling, by at least one envelope generator, the spatialization and / or a parameter of the synthesizer. Advantageously, when a note is entered by at least one user, all the envelope generators of the present invention are activated, preferably simultaneously (for example, the filter's SEG, the VCSA's SEG, ...).

[0090] According to one example, said N audio instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variation determined by the manufacturer) and / or the spatial position of said N audio instances.

[0091] According to one example, said M control instances are configured to undergo variations of at least one of their parameters (frequency and / or phase) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variation determined by the manufacturer) and / or the spatial position of said N audio instances.

[0092] According to one example, said M' control instances are configured to undergo variations of at least one of their parameters (attack and / or decay and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (variation scales determined by the manufacturer) and / or the spatial position of said N audio instances.

[0093] According to one example, said M' ' control instances are configured to undergo variations of at least one of their parameters (threshold and / or attack and / or hold and / or release) as a function of control of high-level parameters (Sspd, Dspd, Tspd), low-level parameters (scales of variation determined by the manufacturer) and / or the spatial position of said N audio instances.

[0094] According to one example, the method according to the present invention includes at least one step of creating at least one instance associated with said nominal frequency value, said instance comprising at least said set E.

[0095] According to one example, the decorrelation step includes at least one step of driving at least said main sound wave generator VCSO by at least said control module VCSS.

[0096] According to one example, the decorrelation step includes at least one step of driving at least said VCSF filter by at least said VCSS control module.

[0097] According to one example, the decorrelation step includes at least one step of driving at least said VCSA amplifier by at least said VCSS control module.

[0098] According to one example, the decorrelation step includes at least one modulation step of at least one parameter of the audio synthesizer by at least said SEG control module, preferably said SEG control module comprising at least M' control instances.

[0099] According to one example, the decorrelation step includes at least one piloting step of at least said SEG control module by at least said VCSS control module.

[0100] According to one example, the decorrelation step includes at least one modulation step of at least one parameter of the audio synthesizer from at least one other wave generated by the LFSO wave generator, said LFSO wave generator comprising at least M control instances.

[0101] According to one example, the decorrelation step includes at least one step of driving at least said LFSO wave generator by at least said VCSS control module.

[0102] According to one example, the decorrelation step includes at least one modulation step of at least one parameter of the audio synthesizer by at least said SEF envelope tracking and control module, said SEF envelope tracking and control module comprising at least M'' control instances.

[0103] According to one example, the decorrelation step includes at least one step of driving at least said envelope tracking and SEF control module by at least said VCSS control module.

[0104] According to one example, the method according to the present invention comprises, before or after the spatialization step, an assembly step of said filtered sound wave with at least one delay line and / or said other wave with at least one other delay line, by the SFX assembly module comprising at least N' audio instances.

[0105] According to one example, the spatialization step includes at least one step of generating at least one trajectory, by the trajectory generator, by modifying in time, preferably in real time, at least one spatial coordinate of said filtered sound wave.

[0106] According to one example, the method according to the present invention comprises, after the spatialization step, at least one audio rendering step by at least one rendering engine.

[0107] According to one example, the variations that allow the decorrelation of instances are variations applied via at least one of 3 high-level control parameters taken from: the Static Spread (Sspd), the Dynamic Sread (Dspd) and the Time Spread (Tspd).

[0108] According to one example, these high-level parameters control a set of low-level parameters (e.g., variation of frequencies / phases / positions in space of the different instances).

[0109] According to an example, the Sspd parameter operates static variations.

[0110] According to one example, the Dspd parameter operates variations dynamically via a external source, for example an envelope generator.

[0111] According to an example, the Tspd parameter operates variations of the temporal parameters (for example the parameters of instances of a SEG).

[0112] It is specified that, within the framework of the present invention, the following terms have the following definitions: a. VCO (Voltage Controlled Oscillator): sound wave generator, in the audible spectrum (20 Hz to 20,000 Hz). b. VCF (Voltage Controlled Filter): a filter that allows only certain frequencies to pass through; preferably, the filter is configured to remove, accentuate, or reduce certain parts of the sound spectrum represented in a signal. c. VCA (Voltage Controlled Amplifier): intensity control. Combined with an envelope generator, it allows these envelopes to be applied to a sound. d. EG (Envelope Generator): envelope generator, traditionally with 4 steps: Attack, Decay, Sustain, Release: i. Attack: attack time; ii. Decay: the time of release immediately after the attack; iii. Sustain: maintenance value to which decay leads; iv. Release: release time. e. MIDI (Music Instrument Digital Interface): communication protocol for a musical performance through computer data. f. Note ON / OFF: the action of playing a note and then releasing it. In the case of a traditional envelope generator, Note On triggers the Attack and Decay stages, and Note Off triggers the Release. In between, if the user holds down the note, the signal remains constant, at the Sustain value and / or depending on the velocity of the note played. g. LFO (Low Frequency Oscillator): generator of frequencies generally below the hearing threshold, allowing control of other parameters. h. EF (Envelope Follower): analysis of the dynamics of a signal in order to control a parameter. i. Threshold: detection threshold during signal analysis; ii. Hold: duration of signal maintenance; iii. Envelope: curve describing the evolution of a property of a sound (for example its intensity) as a function of time. i. Unison: function allowing a polyphonic synthesizer to play a number of polyphonic voices at the same time from the same Note On / Off command.

[0113] The examples and conditional language used in this description are primarily intended to aid the reader in understanding the principles of the present invention and not to limit its scope to those specifically cited examples and conditions. It will be understood that a person skilled in the art can conceive of various arrangements which, although not explicitly described or illustrated herein, nevertheless embody the principles of the present invention and are included in its spirit and scope.

[0114] Furthermore, by way of aid to understanding, the following description may describe relatively simplified implementations of the present invention. As those skilled in the art will understand, various implementations of the present technology may be of greater complexity.

[0115] Furthermore, the following description, listing the principles, aspects, and implementations of the present invention, along with their specific examples, aims to encompass both their structural and functional equivalents, whether currently known or developed in the future. Thus, for example, it will be appreciated by those skilled in the art that all the functional diagrams herein represent conceptual views of illustrative circuits incorporating the principles of the present invention. Similarly, one will understand that all flowcharts, and the like, represent various processes that can be substantially represented on computer-readable media and thus executed by a computer or processor, whether that computer or processor is explicitly represented or not.

[0116] The functions of the various elements shown in the figures, including any functional block referred to as a "processor" or "module," can be performed using dedicated hardware as well as hardware capable of executing software in conjunction with a computer program or appropriate instructions. When provided by a processor, the instructions can be provided by a single dedicated processor, a single shared processor, or by a plurality of individual processors, some of which may be shared. In certain embodiments of the present invention, the processor may be a general-purpose processor, such as a central processing unit (CPU), for example.Furthermore, the explicit use of the term "processor" should not be interpreted as referring exclusively to hardware capable of executing software and may implicitly include, but not be limited to, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), read-only memory (ROM) for storing software, random-access memory (RAM), and non-volatile storage. Other hardware, both conventional and / or custom, may also be included.

[0117] Software modules, or simply modules that are assumed to be software, may be represented herein as any combination of flowchart elements or other elements indicating the execution of process steps and / or a textual description. Such modules may be executed by hardware that is expressly or implicitly represented. Furthermore, it should be understood that the module may include, for example, but not limited to, computer program logic, computer program instructions, software, firmware, hardware circuits, or a combination thereof that provides the required capabilities.

[0118] In the context of the present invention, a sound source may designate an object according to the nomenclature defined by NGA formats, such as ADM (Audio Definition Model - Recommendation ITU-R BS.2076-2). In particular, a sound source is preferably virtual, as long as it has not been rendered on a listening device. Advantageously, a virtual sound source may represent a real sound source, that is to say, a real musical instrument, for example.

[0119] In the context of the present invention, a "panoramic module" or "panoramic view," also called pano or pan for short, may refer to an adjustment of the mixing devices designed to place a sound in the sound space while maintaining its volume.

[0120] In the context of the present invention, a spatialized sound system may refer to a system for rendering spatialized sound on a listening device.

[0121] In the context of the present invention, an audio engine may refer to a computer program that converts audio signals and / or their spatial coordinates to loudspeakers, or to any other audio format.

[0122] The present invention relates in particular to the field of audio processing plug-ins which, in the prior art, allow processing to be applied to a sound, either directly to the sound itself (at its input, before panning) and thus replace the original sound with the processed sound, or to the rendered sound (at its output, after panning). Therefore, if the effect is to be applied only to a given area, it is necessary to place it after rendering and manually adjust the parameters of each channel. This type of effect is incompatible with NGA formats, which are rendered at the listener's end.

[0123] The present invention proposes to apply the control of the parameters of an effect (for example its level dosage), as a function of the spatial position of the sound to which it is applied, that is to say as a function of the position of the pan, before the rendering, that is to say the reproduction of the sound.

[0124] According to one embodiment, the invention relates to the generation of spatial effects in audio systems. It allows the parameters of the effects to be modified according to the spatial position of the sound to which they are applied, that is to say according to the panning and before rendering.

[0125] Audio formats are generally divided into three categories: channel-based, scene-based (such as the ambisonic format used in video games), and object-based (where each sound is associated with spatial coordinates). In a channel-based or scene-based system, panning distributes the signal between the output channels. In an object-based system, panning conveys spatial coordinates in parallel with the audio stream to which it is attached. Channel-based and scene-based effects are available today. In both cases, the processing is applied directly to the outputs, that is, after panning and rendering.

[0126] The present invention provides effects whose parameters vary according to the position of the sound to which they are applied, that is, according to the panning and before rendering. The sound thus produced can then be either mixed with its source or deployed on new sources.

[0127] The effect is thus applied directly to the objects, and it can be appreciated regardless of the rendering technique used (VBAP, DBAP, LBAP, etc.) or the encoding used if that is the case (ambisonic, wfs, binaural).

[0128] Figure 2 represents the signal path of a spatial effect whose parameters are affected by the spatial coordinates provided by the panner according to an embodiment of the present invention. Preferably, the panner continues to function normally: in a channel-based or scene-based system, it ensures the distribution of signals between the output channels; in an object-based system, it transmits its spatial coordinates.

[0129] Panning is generally defined by the user, or sometimes modulated by an external source such as a trajectory generator. Therefore, without the present invention, it is not possible to associate a real-time effect when the sound is located at a given point.

[0130] According to one embodiment, and as illustrated by figures 8, 9 and 10, the present invention thus relates to a method 200 of modifying at least one parameter of at least one effect as a function of at least one spatial coordinate of at least one virtual sound source, also called a sound object.

[0131] Preferably, the effect is applied to said source before playback by at least one listening device 500, such as a loudspeaker device for example.

[0132] Advantageously, said method 200 is configured to be implemented by at least one audio processing system 400 described later.

[0133] According to one embodiment, process 200 can be integrated and / or can integrate process 100 of [Fig.29] described later.

[0134] According to one embodiment, process 200 comprises at least the following steps: • Application 210 of at least one effect to at least one sound source before playback by at least one listening device 500, by at least one user via at least one input module 300. Preferably, the input module 300 includes at least one first input interface 310. Advantageously, said sound source is virtual. In one embodiment, the effect includes at least one parameter. Preferably, this parameter is configured to be modifiable, i.e., it is adjustable; • Definition 220 of at least one spatial area of ​​application of said effect parameter, by said user advantageously via said input module 300. Preferably, the input module includes at least a second input interface 320. Advantageously, said spatial area of ​​application comprising a plurality of spatial coordinates; • Assignment 230 of at least one spatial coordinate to said sound source, by the user, preferably via at least one panning module 410, advantageously the panning module includes at least one third input interface; • Comparison 240, by at least one data processing unit 420, of said spatial coordinate of the sound source with said spatial area of ​​application of said effect: if the spatial coordinate of the sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said area of ​​application and thus the sound source is present in said spatial area of ​​application, modification 250 of the parameter of the effect, preferably by the data processing unit 420.

[0135] According to one embodiment, the sound source is defined as a digital entity that can be created and manipulated in an audio processing system. The effect applied to this source can include any type of effect such as filtering, compression, distortion, tremolo, reverb, echo, or delay effects, as well as a delay associated with modulation allowing for a flanger, chorus, phaser, etc., for example, without limitation.

[0136] According to one embodiment, the spatial area can be represented graphically in the audio processing system 400. It can take different forms such as a plane, a sphere or a cube, for example, and can also be defined using raw spatial coordinates (AED, XYZ, etc.).

[0137] According to one embodiment, the spatial coordinate assigned to the sound source allows the position of the virtual sound source to be defined in space, and can be used to modify the parameters of an effect according to its position.

[0138] Thus, if the spatial coordinate of said sound source is present in said spatial area of ​​application, the parameter of said effect is modified by the data processing unit 420. This makes it possible to apply, for example, said effect or to modify one of its parameters only when the sound source is located in a predetermined space.

[0139] The present invention thus makes it possible to create specific sound effects depending on the position of the virtual sound source in space, which can be particularly useful for applications such as film, television, video games, or music. Using the present invention, it is possible to add dynamic sound effects to a virtual sound source, depending on its position in space, which can add an additional dimension to the audiovisual production.

[0140] According to one embodiment, the sound source can be mobile, that is to say, its spatial coordinate(s) can change over time.

[0141] According to one embodiment, the spatial application zone is characterized by its ability to change position or shape depending on the specific context. This spatial dynamic makes it possible to meet varied needs and maximize the efficiency of the process. Preferably, the spatial application zone can therefore be mobile, appearing and disappearing over time, for example.

[0142] Preferably, the spatial area of ​​application can be modified in real time to respond to rapid changes in environmental conditions or operational requirements. This ensures optimal performance throughout the process.

[0143] According to one embodiment, the comparison step 240 can be applied to another virtual sound source, such that if the spatial coordinate of the other virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said application area and thus the virtual sound source is present in said spatial application area, a modification step 250 of said parameter of said effect by the data processing unit 420 is applied to said other virtual sound source.

[0144] Furthermore, it is possible that method 200 be applied to another virtual sound source that is not present in the spatial area of ​​application. In this case, no modification of the effect parameter is made to this sound source.

[0145] According to one embodiment, the effect can be taken from at least one filtering, compression, distortion, tremolo, reverb, echo, or delay, as well as a delay associated with a modulation allowing a flanger, chorus, phaser, etc., for example non-limiting.

[0146] According to one embodiment, the sound source is advantageously produced by a synthesizer, for example as described below, which can be a specialized electronic device designed to create artificial sounds from electrical signals.

[0147] Preferably, a digital audio workstation can also be used to generate the sound source. This workstation is a computer platform that allows sounds to be manipulated and recorded digitally.

[0148] According to one embodiment, the sound source can be used in any process for which it is required, such as that described below. For example, but not limited to, it can be used in audio production or electronic music.

[0149] According to one embodiment, the sound source can be generated by any type of process enabling the generation of a sound source, which includes all existing or future techniques in the field of sound synthesis.

[0150] According to one embodiment, the present invention includes the use of a specific listening device 500, preferably configured to allow the reproduction of at least one sound, and which may take the form of a pair of headphones or a spatialized sound system, for example.

[0151] Preferably, the listening device 500 is a pair of earphones, which allow a user to receive sounds from different directions.

[0152] Advantageously, the spatialized sound system can be used to create the illusion of a sound coming from a specific source in space, by changing the position and direction of the sounds emitted by the headphones.

[0153] According to one embodiment, the listening device 500 can be used to improve the quality of a user's listening experience by providing a more realistic and immersive sound.

[0154] According to one embodiment, the spatial coordinates can be defined according to a Cartesian system, in which three orthogonal axes are used to describe the position of a point in space.

[0155] Preferably, the spatial coordinates can be defined according to a polar system, in which a central direction is chosen and the coordinates are defined as a function of this direction and angles from it.

[0156] Advantageously, spatial coordinates can be defined according to a spherical system, in which the coordinates are defined as a function of the distance to a central point (latitude) and the angles between the directions to this central point and two other directions (longitude).

[0157] According to one embodiment, the application of this effect can be carried out in real time, that is to say, immediately after the production or processing of the product concerned, and obviously before its release. This real-time application makes it possible to obtain faster results.

[0158] According to one embodiment, the application of this effect can also be carried out in post-processing, that is to say after the production or transformation of the sound signal concerned, but before its rendering and / or playback.

[0159] According to one embodiment, the present invention includes the use of a spatial application area defined using a graphical user interface and / or text input.

[0160] Preferably, this spatial area is defined by a graphical user interface, which allows users to view the area and manipulate it easily.

[0161] Advantageously, if the definition of the spatial area is impossible to achieve with a graphical interface or if it seems too complex, it can be defined using a text input.

[0162] We will now illustrate the present invention via one effect in particular, the delay.

[0163] Figure 6 represents the signal path of a delay, as found in the majority of prior art delay effects. Each parameter is then controlled manually. In the present invention, spatial coordinates are used to modulate these parameters. It should be noted that the vast majority of known effects (flanger, chorus, etc.) are based on this circuit, applying various modulations, most often via a low-frequency generator (commonly called an LFO, Low Frequency Oscillator).

[0164] Figure 7 represents the signal path according to an embodiment of the present invention, in particular a signal, preferably of the "SFX" as described below, implemented in a synthesizer according to the present invention. The elements found in a synthesizer (VCO, VCA, VCF) have the prefix "S" added for "Spatial," which primarily signifies that each element has n instances of said element. These elements are described below. For example, a VCSO has n instances of a VCO. The VCSD then has n instances of delay lines. The VCSS is used to convert high-level controls into low-level controls, and finally, the SCS is used to create and manipulate spatial coordinates. Thus, on this basis, it is possible to create numerous spatial effects. The output signal can either be mixed with the input signal or routed in parallel.

[0165] According to one embodiment, the present invention relates to an input module 300. Preferably, the input module comprises: a. A first input interface 310 configured to allow at least one user to apply at least one effect 210 to at least one sound source before playback by at least one listening device 500. The effect applied to the sound source includes at least one parameter that can be modified by the user. In one embodiment, this parameter is configured to allow modifications. b. A second input interface 320 configured to allow at least one user to define 220 at least one spatial area of ​​application of at least one parameter of said effect, said spatial area of ​​application comprising a plurality of spatial coordinates.

[0166] Figure 9 represents an input module 300 according to an embodiment of the present invention. It schematically shows the two input interfaces 312 and 320.

[0167] We will now illustrate some examples of user interfaces.

[0168] Figure 3 represents the interface of the spatial equalizer implemented in the prototype of a synthesizer according to an embodiment of the present invention. Note that, In this example, space is represented as a hemisphere viewed from above, and the letters correspond to the positions of speakers found in music mixing studios, particularly in Dolby Atmos. These can also be considered virtual speakers for binaural playback, for example. The dark gray dot represents the source's position in space (i.e., the position defined by the panning), and the gray circle represents the area where the effect will be effective. As can be seen at the bottom of the interface, this equalizer is in "high shelf" mode (boosting or attenuating high frequencies). Thus, the closer the source is to the center, represented by a white dot, of the gray area, the more pronounced the filter gain will be. This is an example of applying an effect based on the position of a virtual sound source.

[0169] Furthermore, the synthesizer is multidimensional, so that each note played generates a multitude of sounds positioned differently in space. Thus, [Fig. 4] represents the same equalizer as in [Fig. 3], where there are now several sources, the gray dots. Only a certain number of these sources are affected by the equalizer, those located within the spatial area of ​​application. This same principle can be applied in the case of a DAW as represented in [Fig. 2] to a multichannel source, or to several sources simultaneously. In the latter case, the visualization no longer represents a single multichannel source, but several different sources.

[0170] Figure 5 represents the spatial effect interface according to one embodiment. Here, a delay whose various parameters vary according to the position of the sources. In the previous example, proximity to the center of the zone allowed adjustment of the filter gain; here, we can control the amount of effect, that is, the ratio between the gain of the signal without the effect and the gain with the effect. We can also adjust other parameters, for example, the feedback rate (also called "feedback," which is the rate at which the output of the delayed signal is fed back to its input to delay it again).

[0171] In the equalizer example, the effect is applied directly to the source. However, in one embodiment, the signal produced by the effect may not be mixed with the original source. The signal obtained in the delay effect can, for example, feed a new source, here superimposed on the center of the spatial area of ​​application symbolized by the white dot. Thus, when a source moves, the sound produced by the effect remains where it was produced.

[0172] It should be noted that the area of ​​effect, also called the spatial area of ​​application, can be dynamic and can itself be moved in real time, for example. Thus, if, for example, the sources are fixed, the present invention makes it possible to move the effect.

[0173] According to one embodiment, the area is defined by a circle, but any other method is valid: a square, a three-dimensional area, an angle (representation in (camembert), etc. This area is preferably defined by polar or Catesian coordinates, or any other method that the panorama can use.

[0174] According to one embodiment, the present invention relates to an audio processing system 400 configured to allow the execution of the process 100 described above. Advantageously, this audio processing system 400 may be either stand-alone or included within a post-production system. This system 400 is advantageously designed to be used by at least one user.

[0175] According to one embodiment, this system 400 comprises at least: a. A 300 input module, preferably comprising two input interfaces: i. A first input interface 310 configured to allow the user to apply at least one effect 210 to at least one virtual sound source before playback by at least one listening device. Preferably, this sound source is virtual and includes at least one spatial coordinate. Advantageously, the applied effect includes at least one parameter, which can be configured to be modified. ii. A second input interface 320 configured to allow the user to define at least one spatial area for the application of said effect. This spatial area is preferably used to determine where the effect will be applied in the sound space. Advantageously, said spatial area of ​​application comprises a plurality of spatial coordinates. In one embodiment, the first input interface and the second input interface may be a single input interface. b. A 410 panning module configured to allow the user to assign at least one spatial coordinate to the virtual sound source. Panning is used to define the source's position in space. Preferably, the panning module includes at least one third interface. Advantageously, the panning module is implemented in a DAW, preferably in a plug-in host, for example. c. A data processing unit 420 configured to compare the spatial coordinate of the virtual sound source with the spatial area of ​​application of the effect. If the spatial coordinate of the sound source corresponds to at least one spatial coordinate of the plurality of spatial coordinates of the application area, and thus the sound source is present in the spatial area of ​​application, the data processing unit is configured to modify the parameter of the effect. d. A listening device 500 configured to reproduce at least one sound from said virtual sound source. The sound is produced according to the modifications made to the effect based on its spatial position in the sound space.

[0176] This system 400 thus makes it possible to apply sound effects to a virtual sound source based on its spatial position, thereby creating more realistic and convincing sound effects for users. For example, if a user wants to apply an echo effect to a virtual sound source, they can define the spatial area where the effect will be applied (for example, in a particular area of ​​a concert hall) and configure the effect parameter to be modified according to the source's position within that area. The system will then compare the source's position with the spatial area of ​​application of the effect and apply the effect only if the source is present in that area.

[0177] According to one embodiment, the present invention includes the use of a data processing unit 420 on a general purpose computer and / or a specialized digital signal processor (DSP).

[0178] Preferably, this data processing unit 420 is implemented on a general-purpose computer. This computer may be equipped with an operating system and a memory architecture that allow for efficient data management and the rapid execution of instructions necessary for data processing.

[0179] Advantageously, if the present invention is implemented on a specialized digital signal processor (DSP), it can be optimized for the numerical calculations specific to this type of processor. This allows for faster and more accurate results than if the processing were performed on a general-purpose computer.

[0180] However, it is useful to note that the flexibility of the present invention lies in its ability to be implemented on different types of electronic devices, whether a general-purpose computer or a specialized digital signal processor.

[0181] The present invention thus makes it possible to create more realistic and convincing sound effects for users, depending on the position of the virtual sound source in the sound space. It can be used in a variety of applications, particularly in the field of audio post-production for films, video games, or music.

[0182] According to one embodiment, the present invention relates to a computer program product comprising a plurality of instructions which, when executed by at least one processor, make it possible to generate spatial effects in an audio system.

[0183] The position of the sound source is determined by a panning, which ensures the distribution of signals between the output channels or conveys coordinates spatial effects are applied in parallel with the audio stream to which they are attached. The effects are applied to the signal before rendering, which allows an effect to be associated when the sound is located in a given place without having to do it manually at the same time as addressing the panning parameters.

[0184] The plurality of instructions of the invention makes it possible to modify one or more parameters of the effects according to the position of the sound source. The effects can be applied either to a single source or to several sound sources at the same time.

[0185] Effects can take various forms, such as equalizers, delays, or special effects. In the example of the equalizer, the controlled parameter can be the filter gain, which can be modified according to the position of the sound source. In the example of the delay, the various parameters can be modified according to the position of the sources, allowing the amount of effect to be adjusted and other parameters to be manipulated, for example, the feedback rate, the modulation speed of an LFO, or the depth of a modulation.

[0186] In summary, the present invention relates to a computer program product comprising a plurality of instructions which, when executed by at least one processor, make it possible to generate spatial effects in an audio system.

[0187] According to one embodiment, the computer program product is also designed to allow the creation of numerous spatial effects by adding additional instances of each element typically found in a synthesizer, such as the VCO (constant frequency oscillator), the VCA (amplitude control), and the VCF (frequency filter). For example, a VCSO has multiple instances of VCO, a VCSD has multiple instances of delay lines, and so on.

[0188] Finally, the computer program product can be designed to allow a graphical visualization of the area of ​​application of the spatial effect parameters, which can be represented as a plane, sphere, cube, or any other graphical representation. Furthermore, the spatial coordinates can also be defined using polar or Catesian coordinates, or any other method that the panning tool can use.

[0189] This invention makes it possible to add an additional dimension to music and sound effects, by making it possible to create spatial effects that can be applied to specific sources in space.

[0190] The present invention also relates to a 3D audio synthesizer. Its description will be made in two phases: the presentation of the concepts of spatial synthesis by decorrelation, and its application in a synthesizer according to the present invention.

[0191] According to one embodiment, the synthesizer comprises the system described above. Advantageously, the synthesizer is configured to allow the implementation of the method 200 described above.

[0192] Advantageously, the general principle of the invention is to synthesize sounds and associated spatial coordinates.

[0193] Next, and in order to be listened to, the rendering can be done by an audio engine.

[0194] Thus, as can be seen in [Fig. 1 1], the synthesis and coordinate blocks grouped in a gray frame 20 relate to spatial synthesis, while the blocks enclosed in the frame 30 are those implemented in a synthesizer, for example, that of the present invention. The keyboard 10 represents an input interface, for example.

[0195] In one embodiment, the present invention is a method. This method can be implemented through a computer program, preferably executable by a computer or at least by a processor. Thus, in one embodiment, the present invention can take the form of a computer program, that is, a series of steps. Advantageously, this computer program can be configured to cooperate with at least one controller, such as an input interface, for example, a piano keyboard. Furthermore, and in order to emit sounds, the present invention is preferably configured to cooperate with at least one speaker device and / or headphones.

[0196] To facilitate understanding of the present invention, a few reminders about the operation of a synthesizer in general follow.

[0197] Generally speaking, and as is well known to those skilled in the art (see, for example, Moog, RA (1977). Electronic music synthesizer. Patent 644,864 - US Patent.), a synthesizer comprises at least the following elements: a. Oscillator (VCO), also called primary sound wave generator; b. Filter (VCF), also called primary filter; c. Amplifier (VCA), also called primary amplifier.

[0198] Thus, VC is the acronym for Controlled Voltage and indicates that each O (Oscillator), F (Frequency) or A (Amplifier) ​​element is controlled in intensity and time.

[0199] Typically, the nominal frequency generated by the VCO is controlled by the user using a piano-type keyboard, for example. The VCF and VCA are controlled by a four-step envelope generator (Attack, Decay, Sustain, Release), triggered by each action on the keyboard, allowing the creation of a spectral and temporal envelope to the sound produced by the VCO.

[0200] Each of these elements is multiplied by the number of polyphonic voices, that is to say the number of notes that can be played simultaneously.

[0201] Figure 12 represents the signal path of a classic synthesizer. The VCO, voltage-controlled by a piano keyboard in analog instruments, has its signal filtered by a VCF, which can be a high-pass, low-pass, or band-pass filter. The signal then passes through a VCA amplifier, which modifies it using an envelope generator. Thus, the VCA creates a temporal envelope for the sound. It is also common for the filter's cutoff frequency to be modulated by another envelope generator, producing a spectral envelope for the sound.

[0202] Envelope generators are generally composed of 4 steps: Attack (a), Decay (d), Sustain (s) and Release (r). When the user plays a note, they trigger the Attack and Decay phases; the signal is then maintained at the Sustain value, which generally depends on the velocity, in other words, the force with which the note is played; finally, when the user releases the note, they trigger the Release phase.

[0203] These elements are multiplied by the number of polyphonic voices, that is, the number of notes that can be played simultaneously. The polyphonic voices are added together and often pass through an effects section, such as reverb, chorus, Ranger, etc.

[0204] In parallel, most synthesizers have one or more modulation modules, notably of the LFO type, an acronym for Low Frequency Oscillator. From a technical point of view, an LFO differs little from a VCO, except that the LFO operates in the low frequencies, with wavelengths that can last several minutes. It should be noted that VCOs and LFOs can consist of any type of waveform (sine, triangular, square, etc.).

[0205] In the prior art, a number of spatialization tools exist, but very few works have attempted to combine these tools with sound generation. In particular, no element of the prior art has sought to combine signal decorrelations based on their spatial positions. Moreover, no prior art uses decorrelation. Finally, the prior art does not perform any specific work on synthesizer parameters, such as the filter cutoff frequency or the frequency of an oscillator, for example, and even less so in relation to spatial coordinates.

[0206] Advantageously, and as proposed by the present invention for the first time, spatial synthesis by decorrelation preferably consists of multiplying each element of a synthesizer, and this for each voice of polyphony.

[0207] Figure 13 schematically represents, according to one embodiment of The present invention involves multiplying the elements of a synthesizer into a certain number of instances, allowing the creation of new elements that bear the original names of the elements, to which is added the letter S for Spatial. to simplify understanding. It being understood that the VCSO is not in itself "spatial", but that it is part of a whole which is spatial.

[0208] Advantageously, and according to one embodiment of the present invention, each polyphonic voice, that is, each note that can be played simultaneously, consists of an equivalent of N audio instances of the VCO / VCF / VCA set of a monophonic synthesizer placed in a space. These N audio instances are controlled by one or more LFOs, EG and / or EF of M, M' and M” instances respectively.

[0209] Advantageously, each of the N audio instances of VCO, VCF, VCA and of the M, M' and M” instances, respectively, of LFO, EG and EF are provided with slightly different settings in order to create variations in phase, spectrum, amplitude and / or time, depending on their positions in space.

[0210] As stated previously, and according to the present invention, each of the VCO, VCF, VCA, EG, EF and LFO elements which now has several instances acquires a new attribute S for "Spatial": VCSO, VCSF, VCSA, SEG, SEF, LFSO.

[0211] According to one embodiment, these new elements are attached to an audio engine which is driven by an SCS module, an acronym for Spatial Coordinate Synthesis, in which each of the N audio instances of each polyphonic voice is associated with spatial coordinates. To better understand the present invention, [Fig. 14] represents, according to one embodiment, the spatial positions of the 4 instances of 4 polyphonic voices, here spaced around an origin position, for example.

[0212] Advantageously, the possible variations within each element are: a. VCSO: the frequency / and / or phase 0, as represented in [Fig.15]. b. VCSF: the frequency F and / or the quality factor Q (resonance), such that represented in [Fig.16]. c. SEG: the values ​​ads and r as well as an offset on the triggering of phases a and d, then r, as represented on [Fig. 17] (as a reminder s being dependent on velocity). d. VCSA: the A and X values ​​as shown in [Fig. 18]. In one embodiment, the VCSA may comprise two amplifiers of N audio instances in series. The first amplifier is modulated by a SEG module, preferably responding to musical interpretation, nuances, etc.; the second amplifier is preferably modulated directly by the SCS module to compensate for the levels of each instance according to their spatial positions, for example, to avoid excessive gain when the instances are grouped at a single point. e. SEF: the values ​​a, t, h and r as well as an offset on the triggering of each of these values, which corresponds to a global offset, since the analyzed signal varies over time, as represented in [Fig. 19]. f. LFSO: the frequency / ' and / or the phase 0', preferably as for a vso.

[0213] Advantageously, the variations in the parameters of each of the instances of the elements VCSO, VCSF, VCSA, SEG, SEF, LFSO, SCS, which allow the signals to be uncorrelated according to their spatial positions, are preferably controlled by three so-called high-level parameters: a. STATIC SPREAD (which can be called static decorrelation) (Sspd): variation of parameters in a static way; b. DYNAMIC SPREAD (which can be called dynamic decorrelation) (Dspd): variation of parameters in a dynamic way, for example via an envelope generator; c. TIME SPREAD (which can be called temporal decorrelation) (Tspd): variation of temporal parameters, for example instances of a SEG module.

[0214] According to the present invention, these three parameters are grouped under the name VCSS, an acronym for Voltage Controlled Spatial Spread, and are represented in [Fig.20].

[0215] For example, [Fig.21] represents the signal path of a multidimensional audio synthesizer according to an embodiment of the present invention in which the VCSS operates the variations of each instance of each element of the synthesizer.

[0216] Advantageously, a VCSO module can have any waveform, recorded and / or generated in real time, as non-exhaustively represented in [Fig. 22]. In addition, instances of a VCSO can be frequency- or amplitude-modulated, and several VCSOs can be summed (additive synthesis), or modulated with each other, as shown in [Fig. 23], for example.

[0217] According to one embodiment, each VCSO sound wave generator has N oscillators whose frequencies / vary around the nominal frequency of the VCSO, i.e. the note played entered by the user, such as for example the note played on a keyboard by the user.

[0218] According to one embodiment, a VCSO can be expressed in the form:

[0219] [Math.l] xn(t) = sin(o„(7),

[0220] Preferably, for a VCSO: a. The frequency variation is determined by the VCSS values, preferably by the Sspd value of the VCSS. b. The variation of 0 is determined by the values ​​of the VCSS, preferably by the value of the Dspd of the VCSS.

[0221] Advantageously, a VCSO can work with any waveform: whether generic (sinusoidal, sawtooth, square, triangular, pulse width modulation, pink noise) or not (amplitude modulation, frequency modulation, wavetable, granular synthesis, physical model synthesis, etc.).

[0222] According to one embodiment, several VCSOs can be used simultaneously to create new waveforms, in particular via amplitude or frequency modulation processes, or additive synthesis.

[0223] According to one embodiment, the VCSO can be replaced by an external audio input; this external audio input can, for example, be taken from at least: a VCO from another synthesizer, a microphone, a pre-existing recording, or any other audio stream. Preferably, this audio input can be monophonic, and thus the signal is replicated so that it can be addressed to the N instances of set E, or multichannel, in which case the user can advantageously choose how to matrix these channels to the N instances of set E.

[0224] Preferably, each instance n of a VCSO is configured to cooperate with at least one instance n of a VCSF filter whose frequencies F vary around the nominal value of the VCSF filter.

[0225] Advantageously, for a VCSF: a. The variation of the frequencies F is determined by the Sspd value of the VCSS. b. The variation in the quality factor Q is determined by the value Dspd of the VCSS. c. The nominal value of the VCSF is determined by the user.

[0226] Preferably, each instance n of the VCSO / VCSF pair is configured to cooperate with at least one instance n of a VCSA amplifier whose amplitudes A vary around the nominal value of the VCSA.

[0227] Advantageously, for a VCSA: a. The variation of A is determined by the SEG envelope generator, itself undergoing variations via the values ​​of Tspd and / or Sspd and / or Dspd b. The variation of X (X being linked to a position in space) is determined by the values ​​of Tspd and / or Sspd and / or Dspd.

[0228] Preferably, the nominal value of the VCSA is determined by an envelope generator. This envelope generator may have a number of instances M' different from the number of instances N of the VCSO / VCSF / VCSA set.

[0229] As a reminder, a VCSA consists of two N-instance audio amplifiers in series. The first (A) is time-modulated by an envelope generator, thus creating dynamic behavior in a sound. The second (X) controls the volume of each instance according to their positions in space.

[0230] According to one embodiment, each LFSO has M oscillators whose frequencies / ' vary around the nominal value of the LFSO.

[0231] Advantageously, for an LFSO: a. The variation of / ' is determined by the Sspd and / or Dspd value of the VCSS. b. The variation of 0' is determined by the Sspd and / or Dspd value of the VCSS.

[0232] Preferably, the LFSO can be addressed to any other value of the present invention, and take total or partial control of it. The user preferably chooses how to matrix the m instances of the LFSO with the n and / or n' instances of the target elements.

[0233] Advantageously, just like the VCSO, the LFSO can operate with any waveform.

[0234] Advantageously, the VCSO can operate in the low frequencies and in turn be fully considered as an LFSO.

[0235] Preferably, the nominal value of the LFSO is determined by the user.

[0236] According to one embodiment, each SEG control module comprises M' envelope generators so each of the four variables a (attack), d (decay), s (sustain), and r (release) varies around the nominal values ​​of the SEG.

[0237] Advantageously, for a SEG, the variations of a, d, s, and r are determined by the VCSS, preferably by the Tspd function of the VCSS.

[0238] Preferably, each SEG n also has a time offset Of for each of its variables a, d, s, and r such that Of(a) Of(d) Of(s) and Of(r) are advantageously controlled by the VCSS, preferably by the Tspd of the VCSS.

[0239] According to one embodiment, the SEG control module can be addressed to any other value of the present invention, and take control of it in whole or in part. The user preferably chooses to matrix the instances m' of the SEG with the instances n or n' of the target elements.

[0240] Preferably, the nominal values ​​and the triggering of the SEG are determined by the user.

[0241] According to one embodiment, each SEF has M” followed by envelopes, each of the four variables t (threshold), a (attack), h (hold), and r (release) varying around the nominal values ​​of the SEF.

[0242] Preferably, the variations of t, a, h, and s are determined by the VCSS, preferably by the Tspd function of the VCSS.

[0243] Advantageously, each SEF n also has a time offset Of for each of its variables t, a, h, and s such that Of(t) Of(a) Of(h) and Of(s) controlled by the VCSS, preferably by the Tspd of the VCSS.

[0244] According to one embodiment, each SEF can follow two types of flows: a. Audio stream; b. Data flow.

[0245] Advantageously, the SEF can be addressed to any other value of the present invention, and take total or partial control of it. The user preferably chooses how to matrix the M' instances of the SEF with the M or M' instances of the target elements.

[0246] Preferably, the nominal values ​​of the SEF are determined by the user.

[0247] According to one embodiment, each of the VCSO / VCSF / VCSA assemblies is attached to spatial coordinates AED whose azimuth Az, elevation El and distance Di variables vary around one or more origin positions O.

[0248] According to one embodiment, each of the VCSO / VCSF / VCSA sets is attached to XYZ spatial coordinates whose lateral position variables X, distance Y and elevation Z vary around one or more origin positions O.

[0249] Preferably, the variations of Az, El and Di are determined by: a. The Sspd value; b. The Dspd value, via an envelope generator; c. The Tspd value, via a SEG envelope generator.

[0250] Advantageously, the origin positions O are determined by the user.

[0251] Preferably, the origin positions O can vary towards a defined position O' by a trajectory generator or any other element of the invention capable of modifying spatial coordinates.

[0252] Advantageously, all spatial coordinates are controlled by the SCS control module.

[0253] Advantageously, the SFX assembly module is configured to assemble various elements described upstream, such as VCSF and VCSA, to one or more delay lines. Preferably, the VCSD, an acronym for Voltage Controlled Spatial Delay, comprises N' voices. The management of the value of these delays, combined with a VCSF filter, a VCSA amplifier, and preferably a signal reinjection circuit, output within the processing chain, preferably at the input, allows for the recreation of many types of effects, such as: Delay, Chorus, Flanger, Freezer, etc.

[0254] Preferably, the VCSD is configured to apply a time delay to the input signal. The VCSD may include at least two delay lines, preferably at least N' delay lines. Advantageously, the VCSD is coupled to a filter, preferably a VCSF, an LFO, preferably an LFSO, and a circuit for feeding the output signal back into the input of the chain; this allows for the creation of all kinds of effects.

[0255] Advantageously, the variations of the delays dn, and are a function of the Tspd.

[0256] According to one embodiment, the VCSD can be mathematically modeled by the following formula:

[0257] [Math.2] y ,(t) = xn'(tï + cL'*y it-t„J

[0258] In which the factor d will control both the volume of the delay and the number of repetitions, and T represents a time delay.

[0259] In a particularly clever way, the decorrelation of the different control and / or processing elements leads to the production of 3D effects.

[0260] Advantageously, the present invention is ingenious in that it is configured so that the instances of each element present in said synthesizer are multiplied and that variations of at least some of the parameters of these instances are applied in order to create decorrelations of these instances. Preferably, these variations are, in particular, a function of the position in space of said instances. Hence the advantageous correlation of the parameter variations with the spatial coordinates.

[0261] The present invention thus relates to a multidimensional audio synthesizer. Advantageously, said audio synthesizer is configured to generate at least one sound wave distributed along at least one spatial and / or temporal dimension, i.e. in space and in time.

[0262] According to one embodiment, said audio synthesizer comprises at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least two polyphonic voices, and advantageously at least four polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphonic voice comprising at least two audio instances, preferably at least N instances audio, N being greater than 2, of a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a nominal natural frequency defined by the user; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. Preferably, at least M control instances, each M control instance comprising at least one primary LFO wave generator, preferably below the threshold of human hearing, preferably the primary LFO wave generator comprising at least one voice, this voice comprising at least one waveform; d. Preferably, at least M' control instances, each instance M' control comprising at least one primary control module EG, said primary control module EG being configured to drive at least a plurality of filters or amplifiers, advantageously simultaneously; e. Preferably, at least M” control instances, each M” control instance comprising at least one primary envelope tracking and EF control module; f. At least one VCSO sound wave generator comprising at least two instances of said VCO sound wave generator; g. At least one VCSF filter comprising at least two instances of said primary VCF filter; h. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, said VCSA amplifier comprising at least one multiplier element; i. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; j. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; k. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; 1. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate to each of the N audio instances of at least one set E, i.e. to at least one of said polyphonic voices, preferably to at least one of said sound waves; m. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or Q quality factor of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the E assembly, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.

[0263] According to another embodiment, said audio synthesizer may comprise at least: a. A digital input interface configured to accept at least one input of at least one nominal frequency value by at least one user; b. At least one polyphonic voice, preferably at least two polyphonic voices, and advantageously at least four polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency entered by the user; each polyphonic voice comprising at least two audio instances, preferably at least N audio instances, N being greater than 2, from a set E of elements comprising at least: i. A primary VCO sound wave generator, preferably in the audible spectrum, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f defined by the user; ii. A primary VCF filter, said primary VCF filter comprising at least one filter whose frequency is configured to vary around a nominal natural frequency defined by the user; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each The VCO / VCF pair is configured to cooperate with at least one VCA primary amplifier; According to one embodiment, these N audio instances of said set E are controlled by at least one of: i. An LFSO wave generator, preferably below the threshold of human hearing, comprising at least M primary control LFO instances, preferably the LFSO wave generator includes at least one voice, this voice comprising at least one waveform; ii. A SEG control module comprising at least M' primary control instances EG, said SEG control module being configured to drive at least a plurality of filters and / or amplifiers, advantageously simultaneously; iii. An envelope tracking and SEF control module comprising at least M'' primary control EF instances; iv. At least one VCSO sound wave generator comprising at least two instances of said primary VCO sound wave generator; v. At least one VCSF filter comprising at least two instances of said primary VCF filter; vi. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, preferably said VCSA amplifier comprising at least one multiplier element; vii. Preferably, at least one LFSO wave generator comprising at least two instances of said primary LFO wave generator; viii. Preferably, at least one SEG control module comprising at least two instances of said primary EG control module; ix. Preferably, at least one SEF control module comprising at least two instances of said primary envelope tracking and EF control module; x. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with each of the N audio instances of at least one set E, i.e. with at least one of said polyphonic voices, preferably with at least one of said sound waves; xi. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO sound wave generator, the frequency and / or Q factor of at least one VCSF filter, a parameter of said multiplier element of at least one amplifier VCSA, at least one parameter from any element of set E, at least one parameter from at least one other control module, and at least one spatial coordinate from at least one instance. Advantageously, the VCSS is configured to convert high-level controls into low-level controls to operate these variations.

[0264] According to another embodiment, said audio synthesizer comprises at least: a. A digital input interface, such as a MIDI (Musical Instrument Digital Interface) keyboard. Said digital input interface is preferably configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least two polyphonic voices, and advantageously at least four polyphonic voices. Preferably, said polyphonic voice is configured to correspond to said at least one nominal frequency f entered by the user; c. At least one VCSO sound wave generator, preferably in the audible spectrum. Advantageously, said VCSO sound wave generator comprising at least two oscillators whose frequencies f1 and f2 are configured to vary around a nominal frequency f; Advantageously, each oscillator comprises a phase, this phase being configured to be variable, for example, this phase being a function of at least one spatial coordinate; Preferably said nominal frequency f is predetermined, advantageously determined by the user; A sound wave generator may be called a VCSO, from the English Voltage Control Spatial Oscillator; Advantageously, several main VCSO sound wave generators may be used simultaneously, allowing the creation of complex sound waveforms;Each VCSO main sound wave generator can be configured to generate sound waves whose shape can be one of the following: sinusoidal, sawtooth, triangular, square, pulse-width modulation, noise (pink, white, other), wavetable; according to one embodiment, each VCSO sound wave generator can be configured to be used as an LFSO by operating in the low-frequency register; preferably, the sound waves generated by each VCSO sound wave generator are configured to be frequency-modulated and / or amplitude-modulated; according to one embodiment, a VCSO sound wave generator comprises N VCOs such that VCOs with n=1, ..., N; d. At least one VCSF filter, preferably at least two VCSF1 and VCSF2 filters. Preferably, said VCSF filter is configured to be a low-pass and / or high-pass and / or band-pass filter; according to a mode of In practice, the audio synthesizer includes a plurality of VCSF filters. Advantageously, a so-called sliding gain can be used to switch from one filter to another in the case where several VCSF filters are used; e. Optionally, at least one SEG control module. Said SEG control module is advantageously configured to drive at least one filter, preferably each of said filters, advantageously simultaneously; Said SEG control module may be an envelope generator comprising preferably at least 2, advantageously at least 4 adjustable parameters configured to vary around nominal values; said nominal values ​​are preferably predetermined. f. At least one VCSA amplifier configured to cooperate with at least one envelope generator to apply a predetermined envelope to a sound wave. Preferably, each sound wave generator / VCSO / VCSF filter pair is configured to cooperate with at least one amplifier. In one embodiment, said VCSA amplifier is configured to apply a predetermined amplitude to at least one sound wave, preferably via a SEG, said amplitude being configured to vary around a predetermined, or nominal, amplitude. Advantageously, the amplifier includes a multiplier element; preferably, said multiplier element is configured to be a function of at least one spatial coordinate; g. At least one LFSO wave generator, preferably below the threshold of hearing. Preferably, the LFSO wave generator comprises at least one voice, this voice comprising at least one waveform. Preferably, said waveform is fixed and advantageously selected from at least: sinusoidal, sawtooth, triangle, square, pulse-width modulation. In one embodiment, each LFSO wave generator comprises at least two oscillators whose frequencies are configured to vary around a nominal frequency, preferably predetermined, advantageously specific to each wave generator. In one embodiment, the LFSO comprises at least one phase, said phase being configured to vary around a nominal phase; h. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate with at least one of said polyphonic voices, preferably with at least one of said sound waves. i. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one generator of a VCSO sound wave, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or Q factor of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of assembly E, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance. Advantageously, the VCSS is configured to convert high-level controls into low-level controls in order to operate said variations.

[0265] According to one embodiment, the audio synthesizer includes at least one SFX assembly module configured to assemble elements at at least one time delay line, said elements being taken from at least: i. The VCSO sound wave generator; ii. The VCSF filter; iii. The VCSA amplifier; iv. The LFSO wave generator.

[0266] According to one embodiment, the audio synthesizer includes at least one trajectory generator configured to modify, preferably in real time, said at least one spatial coordinate and / or any other parameter that can affect said at least one spatial coordinate.

[0267] According to one embodiment, the audio synthesizer includes at least one rendering engine configured to broadcast said sound wave in at least one acoustic environment, preferably via a listening device, such as headphones, one or more speakers.

[0268] The present invention can be understood using a mathematical approach. Indeed, any value that can undergo variations, such as those described above, can take the following expression according to the so-called high-level parameters of the VCSS module:

[0269] [Math.3] vM =^0^1,¼ Trnkt) )Sv{n, S^D,^ O^, T^.f) <W), r„( O )

[0270] With:

[0271] v : Any value) f, F, A, etc.) or its exponential for angular values ​​(0, , , etc.)

[0272] n: variant of there N

[0273] Sspd: STATIC SPREAD

[0274] Sv: Static distribution function

[0275] Dspd: DYNAMIC SPREAD

[0276] Dv: Dynamic distribution function

[0277] Tspd: TIME SPREAD

[0278] Tv: Time distribution function

[0279] 7 j P and : Tspd-induced delay functions

[0280] t: Time

[0281] Cv: Function of variation due to position in space (is equal to 1 when vn(t) describes spatial coordinates)

[0282] [(pn(t), r^t)) : Spatial coordinates

[0283] According to an advantageous embodiment, certain elements of the present invention may have a different number of instances, such as for example: a. N for VCSO, VCSF and VCSA b. M for the LFSO c. N' for the SFX d. M' and M' ' for SEG and SEF.

[0284] Furthermore, there may be different ways to apply variations depending on the nature of the parameters. These variations can be additive, subtractive, or multiplicative. Thus, the general expression presented previously can be expressed in a more general form. Here, K replaces N for clarity:

[0285] [Math.4] ÆeN [Math.4] éeN [Math.4] L <k<K

[0286] S^eP.O^Vl

[0287] Dspd^P,0 <Dspd<l

[0288] Tspd^P,Q <Tspd<l

[0289] Syk,Sspdy. Static distribution

[0290] Dv(k, Dspd, t): Dynamic distribution due to an external signal

[0291] Tv^k,Tspd,y : Time distribution

[0292] Cv((p (t), 6k(t), rk(t) ) : Distribution due to position in 3D space

[0293] Tlv(k, Tspd, t): Delay of the reference signal

[0294] (k, Tspd, t): External signal delay

[0295] Regarding the multiplicative form, the formula is as follows:

[0296] [Math.5] MO = Tspil,t))Tv(k. > j

[0297] Regarding the additive form, the formula is as follows:

[0298] [Math.6] vkW = Tv**) ) +S>(k S*) + Dr(k. DspJ, r2r\k, T) +T^k, Ttpi, t) r^t) )

[0299] According to one embodiment, the SFX module, an acronym for Spatial FX, which can be inserted at the end of the audio chain, requires a number of instances and spatial positions that may differ from the positions of the N audio instances. For example, to create a chorus effect reproduced throughout space while the source originates from a specific location, the present invention allows the creation of N' channels specific to the SFX module.

[0300] Advantageously, most of the effects that the present invention can produce are achieved using delays, filters, feedback (i.e., re-injection of the output signal into the input of the module chain), and sometimes modulation. The VCSD, from the English acronym Voltage Controlled Spatial Delay, has N' instances of a delay line. Figure 24 shows the signal path of an SFX that allows for the recreation of most of the effects that the present invention can produce.

[0301] In one embodiment, the present invention may include an input matrix. Advantageously, said input matrix allows the number of channels N to be adjusted, or even related to the spatial positions of the instances N'. In one embodiment, this input matrix may also be a fully functional audio engine.

[0302] According to one embodiment, this input matrix can use a binaural engine.

[0303] According to one embodiment, the present invention is configured to cooperate with any type of rendering engine, also called an audio engine, applied at the end of the chain to listen to the rendering.

[0304] We will now describe in detail a preferred, non-limiting embodiment of the present invention illustrated in [Fig.25].

[0305] According to this embodiment, the audio synthesizer comprises the following features: a. 4 voices of polyphony: i. Each VCSO, VCSF, and VCSA is composed of 16 votes (N = 16) b. 5 VCSOs: i. Each VCSO offers the following waveforms: Sinusoidal, Sawtooth, Triangular, Square, Pulse Width Modulation, noise (pink, white, other), wavetable; ii. Each VCSO can operate in LFSO mode (0.01Hz to 25Hz); iii. Each VCSO can be modulated in frequency or amplitude, via the LFSO or other VCSOs. c. 3 VCSF i. A low-cut, a high-cut and a bandpass; ii. A sliding gain allows switching from one filter to another; iii. A SEG allows these 3 VCSFs to be controlled simultaneously. d. 1 VCSA e. A SEG is attached to the VCSA. f. 2 LFSO i. Each LFSO has 4 instances (M = 4) for each of its 4 waveforms, for a total of 16 voices; ii. The waveforms are fixed: Sinusoidal, Sawtooth, Triangular, Square; iii. Synchronization with note On (phase reset). g. 2 SFX i. 1 reverb 12 instances in inputs and 12 voices in output (N' = 12); ii. 1 distortion 64 voices (N x 4 = 64). h. SCS i. 76 voices: 16 (N = 16) x 4 (synthesizer polyphony) + 12 (N' = 12); i. 4 SEGs of 16 voices (M' = 16) allow control of each of the polyphonic voices; j. 4 trajectory editors (1 per voice of polyphony). k. Additional functions: i. Detune: allows you to detune the 4 voices of polyphony; ii. Glide: allows you to perform glissandos from one note to another; iii. Unison: allows you to assign all 4 polyphonic voices simultaneously with each note played, thus accumulating a total of 320 voices of simultaneous oscillations: 4 (synthesizer polyphony) x 16 (N) x 5 (number of VCSOs).

[0306] Figure 25 represents, according to one embodiment, the signal path through an audio synthesizer according to the present invention. The solid blocks are replicated for each polyphonic voice, while the dashed blocks are common to the entire synthesizer according to the present invention.

[0307] As previously stated, and according to one embodiment of the present invention, each VCSO can be frequency- and / or amplitude-modulated by an LFSO and / or another VCSO. Furthermore, each VCSO can operate in the low-frequency range through an LFSO mode, thus becoming, for example, a 16-instance LFSO. Combined with spatial positions, these modulations add further decorrelations between the instances, enabling entirely new and previously unheard-of results.

[0308] According to one embodiment, the Sspd parameter of the VCSS allows, in particular: a. Define the variation of the frequencies / of the oscillators around the nominal frequency of the VCSO, by a multiplication; b. Define the variation of the frequencies F of the filters around the nominal frequency of the VCSF, by adding an exponential ratio; c. Define the variations of the frequency ' and phase 0' of the LFSOs. d. Define the spacing of the spatial positions of the N audio instances around the origin position of a sound.

[0309] According to one embodiment, the Dspd parameter allows, in particular: a. Define the phase variation 0 of the VCSO oscillators, by adding a fixed ratio; b. Define the variation of the Q factors of the filters around the nominal frequency of the VCSF; c. Define the variation X of the VCSA; d. Define the spacing of the spatial positions of the N audio instances around the origin position of a sound.

[0310] According to one embodiment, the Tspd parameter allows, in particular: a. Define the variation of a, d, s and r of the SEGs; b. Define the variation of the offsets of a, d, and r of the SEGs.

[0311] Advantageously, the spatial positional shifts of the N audio instances operated by the Sspd and Dspd are cumulative. According to the present invention, [Fig. 26] illustrates how these shifts can act: a. First drawing on the left, [Fig.26a]: the polyphonic voices are placed at the 4 cardinal points. b. Middle drawing, [Fig. 26b]: application of a 30% Sspd, thus the 16 instances are proportionally spaced up to + / - 30° around the center of gravity of the polyphonic voice. c. Right-hand drawing, [Fig. 26c]: execution of an arpeggio (4 notes played successively) with a Dspd of 30%: i. Voice located to the north of the figure: initial position; ii. Voice located south of the figure: at the end of the attack phase; iii. Voice located to the east: during the sustain phase; iv. Voice located to the west: during the release phase.

[0312] According to one embodiment, the trajectory generator allows each voice of polyphony to be controlled independently.

[0313] The trajectories are preferably executed by an envelope generator whose values ​​are equivalent to a percentage ratio of the SEG values ​​of the VCSA. This makes it easy to match the duration of the trajectory with the duration of a sound.

[0314] According to one embodiment, the present invention may include at least one trajectory editing module. This module is preferably designed to edit trajectories in two dimensions, but their path is projected onto a hemisphere. Figure 27 shows an example of trajectory execution, coupled with an Sspd value of 30% and a Dspd value of 50%, thus showing that: a. Drawing at top left: initial position, the instances are spaced + / -30° around an original position, barycenter of the polyphonic voice. b. Drawing at bottom left: position of the instances at the end of the attack phase, spread out at almost 180° around the center of gravity of the polyphonic voice. c. Diagram at top right: position of the instances during the sustain phase, spread out almost 180° around the centroid of the polyphonic voice. Remember that sustain depends on velocity; thus, if the note had been played more softly, the centroid would have returned slightly closer to its original position, and the instances would have been less separated from each other since the Dspd is also driven by an envelope generator. d. Drawing at bottom right: position of instances during the release phase, towards a return to the initial state.

[0315] According to a preferred embodiment of the present invention, the frequency variations fn(t) of instances of a VCSO can be expressed using the multiplicative form presented above:

[0316] [Math.7] [Math.7] weN [Math.7] l<n<N

[0317] Sf(n, Sspa) = 1+0.01( -1)”. %Sspd

[0318] Df^Dsp(Pt) = \

[0319] Tf^Tspd,t^\

[0320] Cf((pn(t\ en(t\rn(t} ) = 1

[0321] T^n, Tspd,t)^\

[0322] TU(n,TspdJ)^\

[0323] Les variations de l’azimuth <pn{ t) des ensembles E par le SCS peuvent être exprimés en utilisant la forme additive :

[0324] [Math.8] / VeN [Math.8] neN [Math.8] l<n<N

[0325] p(n) = 2(^(^) + 1) (répartition des indices par paires) [03261 Sr(n, S^) = 90( -1 )". 103271 Dr(n,Ds^ t) = 8(1)(-)^.^0^ 103281

[0329] T,(». 7,^1)-°

[0330] C„( <!---->n(t).e„(t),r„(t))=O

[0331] r^n-T^t) =0

[0332] According to the present invention, the variations induced by the action on the Tspd can be expressed using the following additive form:

[0333] [Math.9] M'eN,

[0334] m EN,

[0335]

[0336] To(m\ Tspif t) = TA(m'. Tspd, t) = Tn(m\ = T^m'. t) = m'Tsptl

[0337] So(m',Sspd) = SA(m\Sspd) = SD(m',Sspd) =SR(m\Sspd) =0

[0338] Do(m', t) = DA(m', Dspd, t)=DD(m', 1)^, t)=DR(m', Dspd, t) = 0

[0339] = CA{v,„, <t)-6„,-(t).r„m                      )="cR(pm,(t),g^"

[0340] T\o(m',Tspd,t) = T^(m\Tspd,t) = Tu)(m\Tspdyt) = T^(m',Tspd,t) =0

[0341] Tspd,t) =r2A(m', Tspd, t) =T2p(m', T^t) = r2R(m', Tspd,t) =0

[0342] According to one embodiment, the present invention can be configured to cooperate with an effects module.

[0343] As a reminder, and as previously indicated, most of the effects are produced from the same processing chain consisting of delays, filter, amplifier, feedback chain, and modulation elements, usually an LFO.

[0344] According to one embodiment, the audio synthesizer includes at least one effects module.

[0345] According to one embodiment, said effect module comprises at least: a. An audio input module configured to receive at least one incoming audio signal and comprising at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each voice of added polyphony; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multichannel audio signal, preferably with any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM matrix mixing module, also called an input matrix, configured to distribute said at least one incoming audio signal into at least one virtual space and to at least one ME processing module, said first IM matrix mixing module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points; c. An ME processing module configured to apply at least one audio processing to at least one audio signal from at least one output channel of the first IM matrix mixing module; d. A second OM mixing matrix module, also called an output matrix, configured to distribute the processed audio signals output from said processing module into at least said virtual space and to at least one BR binaural rendering module and / or to at least one SO output module, said second OM mixing matrix module comprising at least: i. A predetermined number of input channels considered as entry points into said virtual space; ii. A predetermined number of output channels considered as virtual output points, preferably corresponding to loudspeakers; e. A binaural rendering module BR configured to arrange said output points of the second matrix mixing module OM in at least one binaural space, preferably using their spatial coordinates.

[0346] Thus, [Fig. 28] illustrates one embodiment of said effect module. In this figure, and according to one embodiment, said effect module comprises at least: a. An audio input module; said audio input module being configured to accept at least three types of audio signals; said audio input module advantageously comprises at least: i. A first audio input II configured to receive at least one monophonic audio signal, preferably said first audio input 11 being configured to receive at least said N audio instances of each voice of added polyphony; ii. A second audio input 12 configured to receive at least one stereophonic audio signal, preferably said second audio input 12 being configured to receive at least one stereophonic and / or binaural reduction of said N audio instances according to their respective spatial coordinates; iii. A third audio input 13 configured to receive at least one multichannel audio signal, preferably with any number of channels, preferably said third audio input 13 being configured to receive at least said N audio instances with their respective spatial coordinates; b. A first IM matrix mixing module, preferably with "intensity panning"; said IM matrix mixing module being configured to distribute incoming audio signals into at least one virtual space, preferably destined for at least one ME processing module; In one embodiment, the IM matrix mixing module comprises a number C of input channels, the number C being defined by an input type selection parameter: i. monophonic (1 channel), ii. stereophonic (2 channels), iii. multichannel - n channels defined by a parameter called "Input Channels". These input channels are considered as points - called "input" - in said virtual space; Preferably, the number C is equal to N'.

[0347] Preferably, said IM mixing matrix module includes a predetermined number of virtual output points corresponding to the number of effect channels of the ME processing module; Advantageously, the "Effect Channels" parameter defines said number of virtual output points; According to one embodiment, a first method for distributing the virtual points is described below. a. A multi-voice and multi-channel effects module (ME), also called a multi-voice and multi-channel effects module; said ME includes at least one instruction storage device configured to be executed by at least one processor and to transform at least one audio signal output from said IM mixing matrix module. Preferably, the ME is configured to apply at least one audio processing to at least one audio signal from at least one output channel of the IM mixing matrix module, preferably before exiting said ME; Advantageously, the number of input channels of the ME is equal to the number of output channels of the ME and, preferably, of the IM mixing matrix module; b. A second OM mixing matrix module, preferably with "intensity panning"; said second OM mixing matrix module being configured to distribute the processed audio signals entering at least one virtual space, preferably to at least one BR binaural rendering module on the one hand, and to at least one SO output module on the other; In one embodiment, the second OM mixing matrix module comprises a number D of input channels, the number D being defined by at least one parameter called "Effect Channels", which also defines the number of effect channels calculated in the ME processing module; Preferably the number D is equal to the number C; Advantageously, these input channels are configured to serve as entry points into said virtual space;Advantageously, a parameter called "Output Channels" is configured to define the number of virtual output points of said second OP mixing matrix module; preferably, said virtual output points correspond to the desired number of loudspeakers; According to one embodiment, a second method for distributing the virtual output points is described below. c. A binaural rendering module BR; Advantageously, the virtual output points of the second matrix mixing module OM are also defined in said binaural rendering module BR; said binaural rendering module BR includes at least one storage device for at least one set of instructions configured to be executed by at least one processor and to synthesize at least one binaural audio signal; Preferably, said binaural rendering module BR is configured to arrange said output points of the second matrix mixing module OM in at least one binaural space, preferably using their spatial coordinates; Advantageously, said binaural rendering module BR is configured to compute 3D stereo audio for at least one stereophonic output module HO and / or a digital-to-analog converter (DAC) for headphones.

[0348] According to one embodiment, audio inputs II, 12 and 13 can accommodate external audio sources.

[0349] According to one embodiment, and in order to illustrate an example of application of said effect module, it can generate a so-called "chorus" effect.

[0350] The chorus effect is a type of modulation effect used to thicken and color an audio signal sufficiently to give the impression that several instruments are playing. The effect is achieved by taking an audio signal and mixing it with one or more modulated copies of itself. The modulations are produced by a Low Frequency Oscillator (LFO) that controls short variations in the delay of the original signal. A continuous variation in pitch, following the modalities of the Doppler effect, occurs. When the modulated audio signal is then mixed with the input audio signal, a doubling effect of the sound occurs.

[0351] In the case of a multichannel chorus consisting, as here, of parallel channels, the principle consists of linearly shifting the phase of the LFO for each effect channel, in order to obtain a set of uncorrelated output signals that are spatially expressed. The decorrelation of the channels thus contributes to the spatiality of the output signal.

[0352] To determine the modulation phase value of each of the effect channels, the maximum bound of a vector [0.1] is divided by the number of effect channels defined by the parameter "Effect Channels". For 8 effect channels, a value of 0.125 will be obtained, for example.

[0353] This value is advantageously multiplied by the index value of each effect voice, from 0 to N-1 (N = number of channels). For example, for 8 channels, we obtain a list of values ​​to apply to each effect voice: 0., 0.125, 0.25, 0.375, 0.5, 0.625, 0.75 and 0.875.

[0354] The value obtained for each channel is then added to the dynamic value of the oscillation produced by the LFO, which oscillates linearly between 0 and 1, then from 1 to 0, before starting a new cycle (LFO of the "triangle" type).

[0355] The LFO value added to the calculated offset is then amplified, i.e., multiplied, so that the variation occurs within a time domain, preferably defined in milliseconds. For a variable delay, the delay time will be varied between 0ms and 5ms, for example.

[0356] The modulation is then applied to a delay line, thus creating the pitch variations, according to the modalities of the Doppler effect.

[0357] Since each effect channel is temporally and spatially uncorrelated, the resulting sound is a multichannel "chorus" effect.

[0358] The Sspd parameter, expressed as a percentage, linearly multiplies the phase shift of each effect channel. With an Sspd value of 0, no shift is produced; each channel is in phase. As the Sspd value increases, the phases are shifted, and the effect channels become increasingly temporally and spatially uncorrelated. At an Sspd value of 100%, the phases are linearly uncorrelated, and the chorus effect reaches its peak of immersion.

[0359] According to one embodiment, the present invention makes it possible to apply the phase shift principle to different types of audio processing.

[0360] For example, the phase-shifting principle described above can be applied to various types of sound transformations, preferably constituting a set of multichannel sound effects. Thus, and by way of non-limiting example, the present invention makes it possible to generate the following effects: a. "Tremolo" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading of a sinusoidal wave table whose value (y) is applied to the modulation of the intensity of the signals of the output channels of the EM processing module; b. "Phaser" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the reading of a sinusoidal wave table whose value (y) is applied to the frequency sweeps of a cascade of all-pass filters; c. "Freezer" effect: the modulation (x) produced by the LFO, whose phase is shifted, is applied to the playback position of a wavetable whose audio content is captured on the fly and played back in a loop; d. "Flanger" effect: the principle is equivalent to the Chorus effect, with an adjustable reinjection (called feedback) of the modulated signal into the input of the EM processing module, for a timbral reinforcement. e. "Vibrato" effect: the principle is equivalent to the Chorus effect, with the only difference being that the signal from an output channel of the EM processing module is not added to the modulated signal.

[0361] According to one embodiment, the present invention relates to a first method for distributing, preferably homogeneously, at least one incoming audio signal to a virtual space using a three-dimensional orthonormal coordinate system whose different axes are defined by X, Y and Z, said method comprising at least the following steps: a. Definition of at least one entry point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi, and Zi; b. Definition of at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculation of at least one Euclidean distance between said entry point PEi and at least said exit point PSj: d. Application of at least one signal attenuation law to the value of said calculated Euclidean distance, preferably said attenuation law being defined as follows: the intensity value of said audio signal is divided by two each time the Euclidean distance doubles; e. Deduction of a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;

[0362] This process thus allows obtaining a homogeneous projection of the incoming signals onto a spherical space.

[0363] According to one embodiment, the present invention relates to a second method for distributing, preferably homogeneously, at least one audio signal exiting said at least one virtual space using a three-dimensional orthonormal coordinate system whose different axes are defined by X, Y and Z, said method comprising at least the following steps: a. Definition of at least one entry point PEi of at least one audio signal in at least one spherical space by its position Xi, Yi, and Zi; b. Definition of at least one output point PSj of said audio signal in said at least one spherical space by its position Xj, Yj, and Zj; c. Calculation of at least one Euclidean distance between said entry point PEi and at least said exit point PSj: d. Application of at least one signal attenuation law to the value of said calculated Euclidean distance, preferably said attenuation law being defined as follows: the intensity value of said audio signal is divided by two each time the Euclidean distance doubles; e. Deduction of a weighted distribution of audio signals from the input point Pei to said at least one output point PSj;

[0364] This process provides a homogeneous projection of the incoming signals to at least one SO output module and / or a digital-to-analog converter (DAC) for physical loudspeakers.

[0365] As illustrated in [Fig. 29], the present invention also relates to a method 100 for generating at least one spatialized sound wave by decorrelation, preferably by at least one audio synthesizer according to the present invention. Advantageously, said method 100 comprises at least the following steps: a. Input 110 of at least one nominal frequency value, preferably by a user, advantageously using said digital input interface, such as for example a MIDI (Musical Instrument Digital Interface) keyboard; Said nominal frequency value advantageously corresponding to a musical note, preferably to a sound wave having predetermined parameters, said parameters including at least one of: said nominal frequency, a nominal amplitude and a nominal phase, a waveform, a nominal frequency offset parameter; b. Creation of at least N audio instances of said set E; c. Generation 130 of at least said sound wave, by at least said VCSO sound wave generator, said VCSO sound wave generator comprising at least N audio instances of VCO primary sound wave generators; d. Filtering 140 of said sound wave by at least said VCSF filter, said VCSF filter comprising at least N audio instances of VCF primary filters; e. Amplification 150 of said sound wave filtered by said VCSA amplifier, said VCSA amplifier comprising at least N audio instances of VCA primary amplifiers, modulated by at least one control module, preferably by at least one SEG control module; f. Decorrelation 160 by at least one variation of at least one parameter of at least one audio instance considered taken from said N audio instances, said at least one variation being a function of the control by the VCSS control module of at least: i. a high-level parameter taken from at least a first parameter, preferably called Sspd, a second parameter, preferably called Dspd, and a third parameter, preferably called Tspd, said first parameter being configured to operate static variations, said second parameter being configured to operate dynamic variations via at least one external source, such as an envelope generator, said third parameter being configured to operate variations of the time parameters; said high-level parameter being configured to control a set of low-level parameters, such as frequencies, phases, or the spatial positions of the different audio instances; ii. a low-level parameter; iii. a spatial coordinate of said audio instance in question; g. Spatialisation 170 of said amplified sound wave by modification of at least one spatial coordinate of said voice of the amplified sound wave, by the SCS spatial coordinate generation module.

[0366] The present invention also relates to another method for generating at least one sound wave and its spatial coordinates. Advantageously, said method comprises at least the following steps: a. At least one decorrelation step taken from: i. A first variation step where at least one sound wave is modified by changing the first parameter Sspd, said first decorrelation step comprising at least: A. A shift step of at least one frequency of at least one voice of at least one oscillator, said voice being associated with said sound wave; B. A spatial coordinate shifting step of said at least one voice, preferably relative to at least one other voice; ii. A second step of variation of said at least one sound wave by modification of the second parameter Tspd, said second decorrelation step comprising at least: A. A step of shifting at least one parameter of at least one envelope generator, preferably at least one parameter taken from: a, r, d, t, or h, so as to shift at least one temporal envelope of said at least one sound wave; Advantageously, the second parameter Tspd is positive or zero; According to one embodiment, this shifting step also allows a spatial shift of said at least one sound wave; iii. A third step of varying said at least one sound wave by modifying the third parameter Dspd, said third decorrelation step being carried out by at least one envelope generator, preferably each time a note is played, said third step comprising at least: A. A phase-shifting step of at least one phase of at least one voice of said at least one oscillator; B. A spatial shift step of at least one voice, preferably relative to at least one other voice; iv. A fourth variation step of said at least one sound wave comprising at least: A. A shift step of at least one quality factor Q of at least one voice of at least one filter, preferably via adjustment of the third parameter Dspd; B. A step of shifting at least one frequency of said at least one voice of said at least one filter, preferably via adjustment of the first parameter Sspd. v. A fifth step of variation of the amplitude of said sound wave as a function of at least one spatial coordinate of said sound wave.

[0367] According to one embodiment, this process also incorporates the steps of the process previously described.

[0368] The invention is not limited to the embodiments previously described and extends to all embodiments covered by the claims.

Claims

Demands

1. A method (200) for modifying at least one parameter of at least one effect as a function of at least one spatial coordinate of at least one virtual sound source, said effect being applied to said virtual sound source before playback by at least one listening device (500), said method (200) being configured to be implemented by at least one audio processing system (400), the method (200) comprising at least: a. Apply (210) at least one effect to at least one virtual sound source before playback by at least one listening device (500), by at least one user via at least one input module (300) comprising at least one first input interface (310), said effect comprising at least one parameter, said parameter being configured to be modified; b. Define (220) at least one spatial area of ​​application of said parameter of said effect, by said user via said input module (300) comprising at least one second input interface (320), said spatial area of ​​application comprising a plurality of spatial coordinates; c. Assign (230) at least one spatial coordinate to said virtual sound source, by the user via at least one panning module (410); d. Compare (240), by at least one data processing unit (420), said spatial coordinate of said virtual sound source with said spatial area of ​​application of said effect: i. If the spatial coordinate of the virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said application area and thus the virtual sound source is present in said spatial application area, modify (250) said parameter of said effect by the data processing unit (420).

2. Method (200) according to the preceding claim wherein the spatial area of ​​application is spatially dynamic.

3. A method (200) according to any one of the preceding claims, wherein the comparison step is applied to another virtual sound source, said other virtual sound source being pre-existing or newly created, and wherein if the spatial coordinate of the other virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said application area and thus the other virtual sound source is present in said spatial application area, the method (200) comprises a modification step (250) of said parameter of said effect by the data processing unit (420) applied to said other virtual sound source.

4. A method (200) according to any one of the preceding claims wherein the effect comprises at least one of: filtering, compression, distortion, tremolo, delay, echo, delay associated with modulation.

5. Method (200) according to any one of the preceding claims wherein the virtual sound source is generated by at least one synthesizer and / or a digital audio workstation and / or a mixing console.

6. Method (200) according to any one of the preceding claims wherein the listening device (500) is a pair of headphones and / or a spatialized sound system.

7. A method (200) according to any one of the preceding claims wherein the spatial coordinates are defined using Cartesian or polar coordinates.

8. A method (200) according to any one of the preceding claims wherein the data processing unit (420) is implemented on a general-purpose computer or a specialized digital signal processor.

9. Method (200) according to any one of the preceding claims wherein said effect is applied in real time or in post-processing.

10. Method (200) according to any one of the preceding claims wherein said spatial area of ​​application is defined using a graphical user interface and / or text input.

11. An audio processing system (400) configured to modify at least one parameter of at least one effect based on at least one

12. spatial coordinate of at least one virtual sound source, said system (400) comprising at least: a. An input module (300) comprising at least: i. A first input interface (310) configured to allow at least one user to apply (210) at least one effect to at least one virtual sound source before playback by at least one listening device (500), said sound source comprising at least one spatial coordinate, said effect comprising at least one parameter, said parameter being configured to be modified; ii. A second input interface (320) configured to allow at least one user to define (220) at least one spatial area of ​​application of at least one parameter of said effect, said spatial area of ​​application comprising a plurality of spatial coordinates. b. A panning module (410) configured to allow at least one user to assign (230) at least one spatial coordinate to said virtual sound source; c. A data processing unit (420) configured to compare (240) said spatial coordinate of said virtual sound source with said spatial area of ​​application of said effect, and if the spatial coordinate of the virtual sound source corresponds to at least one spatial coordinate of said plurality of spatial coordinates of said area of ​​application and thus the virtual sound source is present in said spatial area of ​​application, the data processing unit (420) is configured to modify (250) said parameter of said effect; d. A listening device (500) configured to reproduce at least one sound from said virtual sound source. An input module (300) according to the system of claim 11 comprising at least: a. A first input interface (310) configured to allow at least one user to apply (210) to

13.

14.

15. at least one effect to at least one virtual sound source before playback by at least one listening device, said effect comprising at least one parameter, said parameter being configured to be modified; b. A second input interface (320) configured to allow at least one user to define (220) at least one spatial area of ​​application of at least one parameter of said effect. Product computer program comprising a plurality of instructions which, when executed by at least one processor, carry out the process according to any one of claims 1 to 10. Non-transient memory carrier comprising a computer program product according to the preceding claim. Audio synthesizer configured to modify at least one parameter of at least one effect based on at least one spatial coordinate of at least one virtual sound source, said audio synthesizer comprising at least the audio processing system (400) according to claim 11, and the synthesizer further comprising: a. A digital input interface configured to accept at least one input of at least one nominal frequency value f by at least one user; b. At least one polyphonic voice, preferably at least 2 polyphonic voices, and advantageously at least 4 polyphonic voices, each polyphonic voice being configured to correspond to said at least one nominal frequency f entered by the user; each polyphonic voice comprising at least N audio instances of a set E of elements comprising at least: i. A primary VCO sound wave generator, said primary VCO sound wave generator comprising at least one oscillator whose frequency is configured to vary around a nominal frequency f; ii. A VCF primary filter, said VCF primary filter comprising at least one filter whose frequency is configured to vary around a user-defined nominal natural frequency; iii. A primary VCA amplifier configured to cooperate with at least one envelope generator so as to apply a predetermined envelope to a sound wave; preferably each VCO / VCF pair is configured to cooperate with at least one primary VCA amplifier; c. At least one VCSO sound wave generator comprising at least two instances of said VCO sound wave generator; d. At least one VCSF filter comprising at least two instances of said primary VCF filter; e. At least one VCSA amplifier comprising at least two instances of said primary amplifier VCA, said VCSA amplifier comprising at least one multiplier element; f. At least one SCS spatial coordinate generation module configured to associate at least one spatial coordinate to each of the N audio instances of at least one set E, i.e. to at least one of said polyphonic voices, preferably to at least one of said sound waves; g. At least one VCSS control module configured to apply a variation of at least one of the following parameters as a function of said spatial coordinate: The phase and / or frequency of at least one VCSO sound wave generator, the phase and / or frequency of at least one LFSO wave generator, the frequency and / or Q quality factor of at least one VCSF filter, a parameter of said multiplier element of at least one VCSA amplifier, at least one parameter of any of the elements of the E assembly, at least one parameter of at least one other control module, at least one spatial coordinate of at least one instance.

Images