Adaptive rendering of reverberation from loudspeakers

The method and apparatus for rendering reverberation in augmented and virtual reality environments address the challenge of changing listener positions by adapting loudspeaker gains and positions, ensuring consistent and accurate reverberation perception.

WO2025124945A1PCT designated stage expired Publication Date: 2025-06-19NOKIA TECHNOLOGIES OY
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/084215
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-14
Filing Date
2024-12-02
Publication Date
2025-06-19

AI Technical Summary

Technical Problem

Existing technologies struggle to accurately and adaptively render reverberation in augmented and virtual reality environments, particularly when the listener's position changes, leading to inconsistencies in the perceived spatial impression.

Method used

A method and apparatus for rendering reverberation that involves obtaining a reverberated signal based on the listener's position within an acoustic environment, adapting the listener position within a reproduction space, and determining gains and positions for loudspeakers to ensure consistent and accurate rendering of reverberation across changing listener positions.

Benefits of technology

The solution effectively maintains a consistent perception of reverberation regardless of the listener's position, preventing the sound from being localized to the closest loudspeaker and ensuring a more immersive and accurate spatial audio experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024084215_19062025_PF_FP_ABST
    Figure EP2024084215_19062025_PF_FP_ABST
Patent Text Reader

Abstract

A method for rendering reverberation, the method comprising: obtaining a reverberated signal based on a listener position within an acoustic environment; obtaining a listener position within a reproduction space; obtaining at least one reverberator output channel position; obtaining a position of at least one loudspeaker based on the at least one reverberator output channel position and the listener position within the reproduction space; determining a gain based on the position of the at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; applying the gain on the reverberated signal; and generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal.
Need to check novelty before this filing date? Find Prior Art

Description

[0001]ADAPTIVE RENDERING OF REVERBERATION FROM LOUDSPEAKERS Field The present application relates to apparatus and methods for spatialrendering of reverberation, and not exclusively generating listener position adaptiverendering of reverberation from loudspeakers in augmented reality and / or virtual reality apparatus. Background Reverberation refers to the persistence of sound in a space after the actual sound source has stopped. Different spaces are characterized by different reverberation characteristics. For conveying spatial impression of an environment, reproducing reverberation perceptually accurately is important. Room acoustics are often modelled with individually synthesized early reflection portion and a statistical model for the diffuse late reverberation. Figure 1 depicts an example of a synthesized room impulse response where the direct sound 101 is followed by discrete early reflections 103 (or reflection echoes) which have a direction of arrival (DOA) and diffuse late reverberation 105 which can be synthesized without anyspecific direction of arrival. The delay ^1(^) 102 in Figure 1 can be seen to denotethe direct sound arrival delay from the source to the listener and the delay ^2(^) 104 can denote the delay from the source to the listener for one of the early reflections (in this case the first arriving reflection). One method of reproducing reverberation is to utilize a set of ^ loudspeakers (or virtual loudspeakers reproduced binaurally using a set of head- related transfer functions (HRTF)). The loudspeakers are positioned around the listener somewhat evenly. Mutually incoherent reverberant signals are reproduced from these loudspeakers, producing a perception of surrounding diffuse reverberation. The positioning and the number of the loudspeakers suitable for producingthe diffuse perception has been studied, and found that somewhere around 6 – 12loudspeakers are required, depending on the positioning of the loudspeakers. The reverberation produced by the different loudspeakers has to be mutually incoherent. In a simple case the reverberations can be produced using the different channels of the same reverberator, where the output channels are uncorrelated butotherwise share the same acoustic characteristics such as reverberation time andlevel (specifically, the diffuse-to-direct ratio or reverberant-to-direct ratio or diffuse-to-total ratio or diffuse-to-source ratio or any other suitable parameter forrepresenting reverberation energy or level). Such uncorrelated outputs sharing the same acoustic characteristics can be obtained, for example, from the output tapsof a feedback delay network (FDN) reverberator with suitable tuning of the delayline lengths and mixing matrix, or from a reverberator based on using decayinguncorrelated noise sequences by using a different uncorrelated noise sequence in each channel. In this case, the different reverberant signals effectively have thesame features, and the reverberation is typically perceived to be similar in alldirections. There is provided according to a first aspect a method for renderingreverberation, the method comprising: obtaining a reverberated signal based on alistener position within an acoustic environment; obtaining a listener position withina reproduction space; obtaining at least one reverberator output channel position;obtaining a position of at least one loudspeaker based on the at least onereverberator output channel position and the listener position within thereproduction space; determining a gain based on the position of the at least oneloudspeaker, the listener position within the reproduction space, and thereverberator output channel position; applying the gain on the reverberated signal;and generating a loudspeaker signal to be reproduced from the at least oneloudspeaker based on the applied gain on the reverberated signal. Obtaining a reverberated signal based on a listener position within anacoustic environment may comprise: obtaining at least one reverberationparameter associated with the acoustic environment; configuring at least onereverberator based on the at least one reverberation parameter; and processing atleast one audio signal with the configured reverberator to produce the reverberated signal. Obtaining at least one reverberation parameter associated with the acoustic environment may comprise determining at least one delay line parameter. Obtaining the listener position within the reproduction environment may comprise adaptively obtaining the listener position, the listener position being time- varying. The method may comprise obtaining based on the adaptively obtainedlistener position, at least one of: at least one gain; and at least one delay.Configuring at least one reverberator based on the at least one reverberation parameter may comprise selectively or partially disabling the at least one reverberator based on determining the reproduction space within which the at least one loudspeaker is located is reverberant. Selectively or partially disabling the at least one reverberator may be basedon one of: a user input to selectively or partially disable the at least onereverberator; and a flag or indicator, the flag or indicator configured to indicate thatloudspeaker rendering of reverberation is to be skipped in order to reduce computational complexity, or if the reproduction environment is reverberant, or a combination of both. Applying the gain on the one reverberated signal comprises gain on thereverberated signal may produce a panned audio signal.Generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal may comprise summing the panned audio signal to generate a loudspeaker signal to be reproduced from the at least one loudspeaker. Summing the panned audio signal to generate a loudspeaker signal to bereproduced from the at least one loudspeaker may comprise summing the pannedaudio signal for a sub-set of panned audio signal to generate the loudspeaker signal to be reproduced from the at least one loudspeaker. The method may further comprise: determining at least one distancebetween the listener position and the position of the at least one loudspeaker withinthe reproduction space; determining a further gain based on the determined at leastone distance; and rendering the loudspeaker signal from the at least oneloudspeaker by applying the further gain to the loudspeaker signal. Obtaining at least one reverberator output channel position may comprise adaptively controlling the at least one reverberator output channel position. Adaptively controlling the at least one reverberator output channel position may comprise mapping the at least one reverberator output channel position to a nearest position of the at least one loudspeaker. The acoustic environment may be the same as the reproduction space in anaugmented reality application. The acoustic environment may be a virtual reality environment and thereproduction space may be a real space within which the at least one loudspeakeris located. According to a second aspect there is provided an apparatus, for renderingreverberation, the apparatus comprising at least one processor and at least one memory storing instructions that, when executed by the at least one processor,cause the system at least to perform: obtaining a reverberated signal based on alistener position within an acoustic environment; obtaining a listener position withina reproduction space; obtaining at least one reverberator output channel position;obtaining a position of at least one loudspeaker based on the at least onereverberator output channel position and the listener position within thereproduction space; determining a gain based on the position of the at least oneloudspeaker, the listener position within the reproduction space, and thereverberator output channel position; applying the gain on the reverberated signal;and generating a loudspeaker signal to be reproduced from the at least oneloudspeaker based on the applied gain on the reverberated signal. The apparatus caused to perform obtaining a reverberated signal based on a listener position within an acoustic environment may be caused to perform: obtaining at least one reverberation parameter associated with the acoustic environment; configuring at least one reverberator based on the at least one reverberation parameter; and processing at least one audio signal with the configured reverberator to produce the reverberated signal. The apparatus caused to perform obtaining at least one reverberationparameter associated with the acoustic environment may be caused to perform determining at least one delay line parameter. The apparatus caused to perform obtaining the listener position within thereproduction environment may be caused to perform adaptively obtaining thelistener position, the listener position being time-varying.The apparatus may be caused to perform obtaining based on the adaptivelyobtained listener position, at least one of: at least one gain; and at least one delay. The apparatus caused to perform configuring at least one reverberatorbased on the at least one reverberation parameter may be caused to perform selectively or partially disabling the at least one reverberator based on determining the reproduction space within which the at least one loudspeaker is located is reverberant. The apparatus caused to perform selectively or partially disabling the at leastone reverberator may be based on one of: a user input to selectively or partially disable the at least one reverberator; and a flag or indicator, the flag or indicator configured to indicate that loudspeaker rendering of reverberation is to be skipped in order to reduce computational complexity, or if the reproduction environment is reverberant, or a combination of both. The apparatus caused to perform applying the gain on the one reverberatedsignal comprises gain on the reverberated signal may be caused to produce a panned audio signal. The apparatus caused to perform generating a loudspeaker signal to bereproduced from the at least one loudspeaker based on the applied gain on the reverberated signal may be caused to perform summing the panned audio signal to generate a loudspeaker signal to be reproduced from the at least one loudspeaker. The apparatus caused to perform summing the panned audio signal togenerate a loudspeaker signal to be reproduced from the at least one loudspeaker may be caused to perform summing the panned audio signal for a sub-set of panned audio signal to generate the loudspeaker signal to be reproduced from the at least one loudspeaker. The apparatus may further be caused to perform: determining at least one distance between the listener position and the position of the at least one loudspeaker within the reproduction space; determining a further gain based on the determined at least one distance; and rendering the loudspeaker signal from the at least one loudspeaker by applying the further gain to the loudspeaker signal.The apparatus caused to perform obtaining at least one reverberator outputchannel position may be caused to perform adaptively controlling the at least onereverberator output channel position. The apparatus caused to perform adaptively controlling the at least onereverberator output channel position may be caused to perform mapping the atleast one reverberator output channel position to a nearest position of the at least one loudspeaker. The acoustic environment may be the same as the reproduction space in an augmented reality application. The acoustic environment may be a virtual reality environment and the reproduction space may be a real space within which the at least one loudspeaker is located. According to a third aspect there is provided an apparatus for renderingreverberation, the apparatus comprising means configured to: obtain a reverberated signal based on a listener position within an acoustic environment; obtain a listener position within a reproduction space; obtain at least onereverberator output channel position; obtain a position of at least one loudspeakerbased on the at least one reverberator output channel position and the listenerposition within the reproduction space; determine a gain based on the position ofthe at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; apply the gain on the reverberated signal; and generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal. The means configured to obtain a reverberated signal based on a listener position within an acoustic environment may be configured to: obtain at least onereverberation parameter associated with the acoustic environment; configure atleast one reverberator based on the at least one reverberation parameter; and process at least one audio signal with the configured reverberator to produce the reverberated signal. The means configured to obtain at least one reverberation parameterassociated with the acoustic environment may be configured to determine at leastone delay line parameter. The means configured to obtain the listener position within the reproduction environment may be configured to adaptively obtain the listener position, the listener position being time-varying. The means may be configured to obtain based on the adaptively obtained listener position, at least one of: at least one gain; and at least one delay. The means configured to configure at least one reverberator based on theat least one reverberation parameter may be configured to selectively or partiallydisable the at least one reverberator based on determining the reproduction spacewithin which the at least one loudspeaker is located is reverberant. The means configured to selectively or partially disable the at least onereverberator may be based on one of: a user input to selectively or partially disable the at least one reverberator; and a flag or indicator, the flag or indicator configuredto indicate that loudspeaker rendering of reverberation is to be skipped in order toreduce computational complexity, or if the reproduction environment is reverberant, or a combination of both. The means configured to apply the gain on the one reverberated signal comprises gain on the reverberated signal may be configured to produce a panned audio signal. The means configured to generate a loudspeaker signal to be reproducedfrom the at least one loudspeaker based on the applied gain on the reverberated signal may be configured to sum the panned audio signal to generate a loudspeaker signal to be reproduced from the at least one loudspeaker. The means configured to sum the panned audio signal to generate aloudspeaker signal to be reproduced from the at least one loudspeaker may beconfigured to sum the panned audio signal for a sub-set of panned audio signal to generate the loudspeaker signal to be reproduced from the at least one loudspeaker. The means may be further configured to: determine at least one distancebetween the listener position and the position of the at least one loudspeaker withinthe reproduction space; determine a further gain based on the determined at leastone distance; and render the loudspeaker signal from the at least one loudspeaker by applying the further gain to the loudspeaker signal. The means configured to obtain at least one reverberator output channelposition may be configured to adaptively control the at least one reverberator outputchannel position. The means configured to adaptively control the at least one reverberatoroutput channel position may be configured to map the at least one reverberator output channel position to a nearest position of the at least one loudspeaker. The acoustic environment may be the same as the reproduction space in an augmented reality application. The acoustic environment may be a virtual reality environment and the reproduction space may be a real space within which the at least one loudspeaker is located. According to a fourth aspect there is provided an apparatus for renderingreverberation, the apparatus comprising: obtaining circuitry configured to obtain a reverberated signal based on a listener position within an acoustic environment; obtaining circuitry configured to obtain a listener position within a reproduction space; obtaining at least one reverberator output channel position; obtainingcircuitry configured to obtain a position of at least one loudspeaker based on the atleast one reverberator output channel position and the listener position within the reproduction space; determining circuitry configured to determine a gain based on the position of the at least one loudspeaker, the listener position within thereproduction space, and the reverberator output channel position; applying circuitryconfigured to apply the gain on the reverberated signal; and generating circuitryconfigured to generate a loudspeaker signal to be reproduced from the at least oneloudspeaker based on the applied gain on the reverberated signal. According to a fifth aspect there is provided a computer program comprisinginstructions [or a computer readable medium comprising instructions] for causing an apparatus, for rendering reverberation, the apparatus caused to perform at leastthe following: obtaining a reverberated signal based on a listener position within anacoustic environment; obtaining a listener position within a reproduction space;obtaining at least one reverberator output channel position; obtaining a position ofat least one loudspeaker based on the at least one reverberator output channelposition and the listener position within the reproduction space; determining a gainbased on the position of the at least one loudspeaker, the listener position withinthe reproduction space, and the reverberator output channel position; applying thegain on the reverberated signal; and generating a loudspeaker signal to bereproduced from the at least one loudspeaker based on the applied gain on the reverberated signal. According to a sixth aspect there is provided a non-transitory computerreadable medium comprising program instructions for causing an apparatus, forrendering reverberation, to perform at least the following: obtaining a reverberatedsignal based on a listener position within an acoustic environment; obtaining alistener position within a reproduction space; obtaining at least one reverberatoroutput channel position; obtaining a position of at least one loudspeaker based onthe at least one reverberator output channel position and the listener position withinthe reproduction space; determining a gain based on the position of the at leastone loudspeaker, the listener position within the reproduction space, and thereverberator output channel position; applying the gain on the reverberated signal;and generating a loudspeaker signal to be reproduced from the at least oneloudspeaker based on the applied gain on the reverberated signal. According to a seventh aspect there is provided an apparatus, for renderingreverberation, comprising: means for obtaining a reverberated signal based on a listener position within an acoustic environment; means for obtaining a listener position within a reproduction space; means for obtaining at least one reverberatoroutput channel position; means for obtaining a position of at least one loudspeakerbased on the at least one reverberator output channel position and the listener position within the reproduction space; means for determining a gain based on the position of the at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; means for applying the gain on the reverberated signal; and means for generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal. According to an eighth aspect there is provided a computer readablemedium comprising instructions for causing an apparatus, for renderingreverberation, to perform at least the following: obtaining a reverberated signalbased on a listener position within an acoustic environment; obtaining a listener position within a reproduction space; obtaining at least one reverberator outputchannel position; obtaining a position of at least one loudspeaker based on the atleast one reverberator output channel position and the listener position within the reproduction space; determining a gain based on the position of the at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; applying the gain on the reverberated signal; and generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal. An apparatus comprising means for performing the actions of the method as described above. An apparatus configured to perform the actions of the method as described above. A computer program comprising program instructions for causing a computer to perform the method as described above. A computer program product stored on a medium may cause an apparatus to perform the method as described herein. An electronic device may comprise apparatus as described herein. A chipset may comprise apparatus as described herein. Embodiments of the present application aim to address problems associated with the state of the art. Summary of the Figures For a better understanding of the present application, reference will now be made by way of example to the accompanying drawings in which: Figure 1 shows a model of room acoustics with regard to the room impulseresponse; Figure 2 shows schematically an example apparatus within which someembodiments may be implemented;Figure 3 shows a flow diagram of the operation of the example apparatus asshown in Figure 2 with respect to reverberant audio signal rendering;Figure 4 shows schematically an example reverberator controller as shownin Figure 2 in further detail according to some embodiments; Figure 5 shows a flow diagram of the operation of the example reverberatorcontroller as shown in Figure 4;Figures 6a to 6d show example reverberation outputs rendered fromconstant user-relative positions using adaptive loudspeaker rendering; Figure 7 shows schematically an example adaptive loudspeaker renderer asshown in Figure 2 in further detail according to some embodiments; Figure 8 shows a flow diagram of the operation of the example adaptiveloudspeaker renderer as shown in Figure 7; Figures 9a to 9d show further example reverberation outputs rendered from constant user-relative positions using adaptive loudspeaker rendering; Figure 10 shows a flow diagram of a further operation of the exampleadaptive loudspeaker renderer as shown in Figure 7; Figures 11a and 11b show an example system within which someembodiments can be implemented; Figure 12 shows a reverberator which includes an example feedback delaynetwork (FDN) reverberator as shown in Figure 2 in further detail according to someembodiments; andFigure 13 shows an example device suitable for implementing the apparatusshown in previous figures. Embodiments of the Application The following describes in further detail suitable apparatus and possible mechanisms for controlling the rendering of audio scenes. As indicated above a method of reproducing reverberation is to utilize a setof ^ loudspeakers (or virtual loudspeakers reproduced binaurally using a set ofhead-related transfer functions (HRTF)). The loudspeakers are positioned around the listener somewhat evenly. Mutually incoherent reverberant signals are reproduced from these loudspeakers, producing a perception of surrounding diffuse reverberation. The positioning and the number of the loudspeakers suitable for producing the diffuse perception has been studied, e.g., in K. Hiyama, S. Komiyama, and K. Hamasaki, The Minimum Number of Loudspeakers and Its Arrangement for Reproducing the Spatial Impression of Diffuse Sound Field, AES 113thConvention,2002 and C. Kirch, J Poppitz, T. Wendt, S. van der Par, and S. Ewert, SpatialResolution of Late Reverberation in Virtual Acoustic Environments. Submitted to Trends in Hearing (currently available in the Carl von Ossietzky UniversitätOldenburg website), 2021. It has been found that somewhere around 6 – 12loudspeakers are required, depending on the positioning of the loudspeakers. The reverberation produced by the different loudspeakers is designed to be mutually incoherent, but, otherwise their content can be otherwise configured by the algorithm designer. In a simple case, for example, the reverberations can be produced using the different channels of the same reverberator, where the output channels are uncorrelated but otherwise share the same acoustic characteristics such as RT60 time and level (specifically, the diffuse-to-direct ratio or reverberant- to-direct ratio or source-energy-to-diffuse energy ratio). Such uncorrelated outputs sharing the same acoustic characteristics can be obtained, for example, from the output taps of a Feedback-Delay-Network (FDN) reverberator with suitable tuning of the delay line lengths, or from a reverberator based on using decaying uncorrelated noise sequences by using a different uncorrelated noise sequence in each channel. In this case, the different reverberant signals basically have the same features, and the reverberation is typically perceived to be similar to all directions. Traditional loudspeaker listening situations assume that the listener is static and remains in a so-called sweet spot. In a 6DoF listening situation, the listener is free to move in the space surrounded by loudspeakers and in some situations also outside the space surrounded by loudspeakers (the space within which the loudspeakers are arranged is also referred to as a loudspeaker circle for pure horizontal or 2D loudspeaker configurations). This potential movement of thelistener thus requires any audio rendering process to be continuously adapted tofollow any changed in the listener position. A reproduction space is usually the real space of the listener. That is, the room where the physical loudspeakers are located. Acoustic environment is either: a VR acoustic environment describing avirtual space having acoustic characteristics or dimensions; or it can be an AR environment describing the acoustic characteristics and dimensions of the reproduction space. In the case of the AR reproduction the acoustic environment and the reproduction space are the same. A currently discussed approach, such as found in the current working draft of ISO / IEC 23090-4, is one where the renderer can adapt to the changing listener position by applying gains and delays to loudspeaker signals such that theloudspeaker signals arrive at the listener position (off the sweet spot position) witha similar level and delay as they would arrive at the sweet spot position. As a partof the process the directions and distances of the sound sources and loudspeakers from the listener are updated based on the listener position. This approach is referred as Level 1 loudspeaker rendering. Another approach found in the currentworking draft of ISO / IEC 23090-4 is one where the listener perceives a 6DoF audioscene (e.g., with an audio object) while moving within the loudspeakerarrangement, referred as Level 2 loudspeaker rendering. The updated distances and directions of sound sources and loudspeakers are considered when performing 3D amplitude panning with the loudspeaker setup. The loudspeaker setup is provided as an input within the Listening Space Description Format (LSDF) file to the renderer. As a result, the renderer can reproduce 6DoF audio using physical loudspeakers while the listener moves within the loudspeaker area. The application of adaptive time varying rendering preventsthe perceived sound from being perceived to ‘collapse’ towards a nearestloudspeaker but is located at the sound source place in the virtual space (which corresponds to a place in the real listening space). In a virtual acoustics rendering system, the reverberation is typically rendered as a combination of a certain number of distinct early reflections and a stochastic model for the late reverberation. The early reflection synthesis is typicallytime varying whereas the late reverberation synthesis is not time varying. Togetherthese two early and late components create a plausible reverberation rendering for a physical or virtual space. When reproducing reverberation from physical loudspeakers, uncorrelated reverberation signals can each be reproduced from physical loudspeakers.However, as discussed above rendering in 6DoF scenes can adaptively render thescene based on listener position to prevent a nearest speaker sound sourcecollapse, meaning that the user will hear too much of the reverberation signal of the closest loudspeaker and too little of the reverberation from the farther away speakers. The concept as discussed herein in further detail in the following examples and embodiments is one of application of 6DoF adaptive rendering methods for rendering reverberation from physical loudspeakers. This can, for example, in some embodiments be implemented with respect to reproduction of (late) reverberation according to reverberation parameters of a(virtual or physical) acoustic space where apparatus and methods propose thatrendering of reverberation of an acoustic environment under time-varying listener- position to loudspeakers so that the position dependent changes in the reverberation perceived by the listener depend on the listener position within the acoustic space but not on the listener position with regard to the loudspeakers. In some embodiments a reverberation apparatus and methods of applying reverberation can be configured to obtain or receive, the reverberation parameters(RT60, direct-to-reverberant ratio. etc.) which control the desired characteristics ofreverberation. When reproducing the reverberated signals via loudspeakers, the rendering aims to adaptively control the gain, delay, and direction of reverberation signals such that the listener perceives reverberation according to the reverberation parameters and the reverberation is not affected by the changing listener positionwith respect to the loudspeakers.This can, in some embodiments, be achieved by: obtaining reverberation parameters containing at least a reverberation time; configuring a digital reverberator with reverberator parameters derived from the reverberation parameters, where at least one attenuation filter is configured based on the reverberation time; rendering a signal using the reverberator and at least one input signal to produce at least one reverberation signal; obtaining a user position; obtaining a loudspeaker position; calculating a distance between the user position and the loudspeaker position; based on the distance, calculating a gain; using the gain, rendering the reverberation signal from the loudspeaker; In some embodiments, the reverberator is configured to produce N nearly mutually decorrelated outputs. The reverberator outputs are given spatial positions surrounding the listener. Adaptive loudspeaker rendering is achieved by updating the spatial positions based on the current listener position in the real room and then applying adaptive 3D panning to the updated spatial positions and adjusting the gain and delay for the loudspeaker signals. The adaptive 3D panning to the updated spatial positions and the adjustment of the gain and delay for the loudspeaker signals can keep the rendered spatial positions of reverberation static with regards to the listener and the adaptive panning ensures that the levels and delays of the reverberation signals react to changing listener position, avoiding being localized to the closest loudspeaker. In some further embodiments, the spatial positions of the reverberation signals are updated based on the listener position such that each reverberation isreproduced from the physical loudspeaker the direction of which is closest to thedirection of the sound source. In such embodiments panning between loudspeakers is effectively not applied as the directions of reverberation sourcescoincide with loudspeaker directions (thus making the panning gain for eachreverberation source 1 for a single loudspeaker and zero for others). The distances to reverberation sources are kept constant and thus the 3D panning keeps the level of reverberation signals constant. In another set of embodiments, decorrelation is applied to the reverberation signals. With respect to some embodiments, the reverberation is reproduced from a subset of the loudspeakers. An example subset of the loudspeakers comprises front left and right speakers and back left and right speakers. In another set of embodiments a real room reverberation is taken intoaccount when adjusting the reverberator based on the reverberation time. In some embodiments bitstream signalling is employed to control howreverberation is rendered into loudspeakers. Example signalling can include:omitting reverberation rendering if physical room is reverberant; andcompensating for physical room reverberation; In some example embodiment, a Feedback-Delay-Network (FDN) reverberator is employed with a number of output channels equal to the number ofrecirculating delay lines. The reverberator can, for example, be configured with 3,7, 15, 31, or 63 delay lines. The FDN as described herein and summarized herein later can be onesimilar to the those described in WO2022167720.Figure 2 shows an example system or apparatus 299 suitable forimplementing embodiments within a late or later reverberation audio signalprocessing system. The system comprises inputs such as audio signal 200 andreverberation parameters 202. The system or apparatus 299 is configured to renderreverberant loudspeaker audio signals 212 as an output, containing latereverberation which are perceived according to the acoustic parameters carried inthe reverberation parameters 202. The acoustic parameters can describe theacoustics of an acoustic environment such as a virtual environment. The acoustic parameters can also describe the acoustics of a reproduction space, that is, a real listening environment or room. In some embodiments the reverberation parameters 202 comprises suitableparameters for configuring the reverberator 201. Suitable reverberation parameters202 can be: predelay ^^^^, RT60 or reverberation times ^^^(^) in frequency bands(where ^ is the frequency band index), reverberation ratio (such as reverberant-to-direct ratio ^^^(^)), room dimensions, and number of delay lines. Alternatively tothe RDR, the diffuse-to-source energy ratio (DSR) can be used. The reverberation parameters 202 can, for example, be obtained from abitstream (representing the reverberation parameters of a virtual scene) or from alistening space description format (LSDF) input to the renderer (representing theparameters of a physical scene). Additionally, the system or apparatus 299 can be configured to obtain orreceive a listener position and orientation 210 or listener pose from a head trackingapparatus. The system or apparatus 299 can furthermore be configured to obtain orreceive a loudspeaker setup 208 from the LSDF input.In some embodiments the system 299 comprises a Reverberator controller203 configured to obtain the reverberation parameters 202 and to convert thereverberation parameters 202 into suitable reverberator parameters 204 forcontrolling the reverberator 201.In some embodiments the system 299 comprises a reverberator 201configured to receive the audio signal 200 ^^^(^), where ^ is the sample (time) index.Furthermore, the reverberator 201 is configured to receive the reverberatorparameters 204.The reverberator 201 is shown herein using a feedback network (FN)implemented as a feedback delay network (FDN) but in other embodiments the FNcan be implemented using other suitable feedback architectures. In this example embodiment, the reverberator 201 has ^ output channelsindexed with ^ = 1, 2, … , The resulting reverberant audio signals 210 ^^^^(^, ^)are mutually incoherent, and they have acoustical characteristics according to thereverberator parameters 204 and their number D depends on the input diffuseness(number of delay loops). Here, t denotes the sample index (time).In some embodiments the system 299 comprises an adaptive loudspeakerrenderer 205. The reverberant audio signals 206 ^^^^(^, ^) are forwarded to theadaptive loudspeaker renderer 205. The adaptive loudspeaker renderer 205 insome embodiments is configured to further obtain the listener position and orientation 210 and the loudspeaker setup 208 and render the reverberated audiosignals to reverberant loudspeaker audio signals 212 ^^^,^^^^^^^^(^, i) (where ^ is theloudspeaker channel index), which can, for example, be reproduced using physicalloudspeakers. The adaptive loudspeaker renderer 205 thus takes the listener position andorientation 210 and loudspeaker setup 208 into account when panning thedirectional reverberant audio signals 206 into reverberant loudspeaker audiosignals 212 such that the listener position affects the listener position in the virtualaudio scene and is compensated for during panning. The reverberant loudspeakeraudio signals 212 can thus be perceived as surrounding and enveloping withacoustical characteristics according to reverberation parameters 202 and such thatacoustical characteristics change dependent on the listener position in the virtual audio scene, as intended.Figure 3 shows an example flow diagram of the operations of the systemshown in Figure 2 with respect to the reverberator and adaptive loudspeakerrenderer associated with the reverberator. First there is obtaining the audio signals, and reverberation parameters(predelay, RT60, reverberation ratio, room dimensions, number of delay lines D) as shown by 301. Then there is the operation of determining reverberator parameters (orotherwise reverberator configuration) from the reverberation parameters input asshown by 303. Then reverberated audio signals are generated based on the audio signaland the configured reverberator as shown by 305.Then reverberant adaptive loudspeaker audio signals are rendered usingthe listener position and orientation and loudspeaker setup parameters as shown by 307. Then reverberant loudspeaker signals are output as shown by 309.Figure 4 shows schematically an example reverberator controller 203 asshown in Figure 2 in further detail. The reverberator controller 203 in someembodiments is configured to obtain the reverberation parameters 202 (predelay,RT60, reverberation ratio, room dimensions, number of delay lines D) and generatesuitable reverberator parameters 204 (delay line length; delay line attenuation filter;reverberation ratio control filter; pre-delay line length; feedback matrix coefficients;and output channel position). For example, the reverberator parameter determiner 203 comprises a delayline length determiner 401. The delay line length determiner 401 in someembodiments is configured to receive the room dimensions and delay line numberD to determine the delay line lengths.The delay line length determiner 401 can, in some implementations, beconfigured to determine delay line lengths md for each of ^ delay lines based onvirtual room dimensions. Here, we use the dimensions of the enclosure, that is, a bounding box that encloses or is aligned with the walls of the physical or virtual room. For example, a shoebox shaped room can be defined with dimensions^^^^, ^^^^, ^^^^. If the room is not shaped as a shoebox (or cuboid) then ashoebox can be fit inside the room and the dimensions of the fitted shoebox can be utilized for the delay line lengths. Alternatively, the dimensions can be obtained as three longest orthogonal dimensions in the non-shoebox shaped room, or by another suitable method. The delays can in some embodiments be set proportionally to standing waveresonance frequencies in the virtual room or physical room. In some embodiments there can be a first set of roomModes as below (with the three values depicting the x, y, and z of the mode, respectively): roomModes{ { 1.0, 0.0, 0.0 }, { 2.0, 1.0, 1.0 }, { 0.0, 2.0, 1.0 }, { 1.0, 0.0, 1.0 }, { 2.0, 1.0, 0.0 }, { 0.0, 1.0, 1.0 }, { 1.0, 1.0, 1.0 }, { 1.0, 1.0, 0.0 }, { 0.0, 1.0, 2.0 }, { 1.0, 2.0, 1.0 }, { 1.0, 2.0, 0.0 }, { 0.0, 0.0, 1.0 }, { 0.0, 1.0, 0.0 }, { 1.0, 0.0, 2.0 }, { 2.0, 0.0, 1.0 }, }; With these roomModes the delay line lengths can be calculated for a maximum of D=15. In case there are more delay lines (D>15), additional room modes can be calculated by modifying these modes and collecting the modified modes which are between a certain minimum and maximum frequency. A frequency corresponding to a mode can be calculated as freq = sqrt(mode.x * mode.x + mode.y * mode.y + mode.z * mode.z); The above modes can be modified by incrementing the x, y, z values by fractional steps such as 0.0, 0.4, 0.8, 1.2, 1.6, 2.0 or other suitable amounts. A modified mode can be checked if its frequency is between the minimum and maximum frequency of the first set of roomModes, and selected to be used if it falls in between. In such a manner a necessary number of additional modes can be createdthis way until enough room modes are obtained (as many as there are delay lines). In some alternative embodiments other methods can be used for the delay line length determination. The delay line lengths ^^can further be made to be mutually prime integers. This choice can then minimize coherent repetition in the impulse response of the FN. The sieve of the Sundaram algorithm can be used to find the prime numbers up to the maximum delay line length. Each delay line length can then be mapped to the closest prime number in the obtained set of prime numbers. In some embodiments the reverberator controller 203 further comprises adelay line attenuation filter parameter determiner 403 which is configured todetermine attenuation filter coefficients. The attenuation filter coefficients in thedelay lines can be configured so that an amount of attenuation happens at eachsignal recirculation through the delay line so that the desired ^^60(^) time isachieved. This is done in a frequency dependent manner to ensure the appropriaterate of decay of signal energy at specified frequencies. For a frequency bin ^, the desired attenuation per signal sample iscalculated as ^^^^^^^^^^^^^^^^^^^^(^) = −60 / (^^ ∗ ^^60(^)), where ^^ is thesampling rate. The attenuation in decibels for a delay line of length ^^is then^^^^^^^^^^^^^(^) = ^^ ∗ ^^^^^^^^^^^^^^^^^^^^(^).Furthermore, the attenuation filters are designed as cascade graphicequalizer filters as described in V. Välimäki and J. Liski, “Accurate cascade graphicequalizer,” IEEE Signal Process. Lett., vol. 24, no. 2, pp. 176–180, Feb. 2017, foreach delay line. The design procedure outlined takes as input a set of command gains at octave bands. There are also methods for a similar graphic EQ structure which can support third octave bands, increasing the number of biquad filters to 31 and providing a better match for detailed target responses such as indicated in J. Rämö, J. Liski, and V. Välimäki, “Third-Octave and Bark Graphic-Equalizer Design with Symmetric Band Filters,” Applied Sciences, vol.10, no.4, p.1222, Feb.2020. In some embodiments the reverberator controller 203 comprises areverberation ratio control filter parameter determiner 405 which can be configuredto determine reverberation ratio control filter parameters. The control filter parameters can be designed such that, when the filter is applied to the input signal of the reverberator, the output reverberation will have the desired energy ratio defined by the ^^^(^). The input to the design procedure can in someembodiments be the vector of RDR values ^^^(^) obtained by the reverberatorparameter determiner 203.The GEQratio is configured to match the reverberator spectrum energy to thetarget spectrum energy. To do this, an estimate of the RDR of the reverberatoroutput and the target RDR is determined. The RDR of the reverberator output canbe obtained by rendering a unit impulse through the reverberator using the first reverberator parameters and measuring the energy of the reverberator output and energy of the unit impulse and calculating the ratio of these energies. In some embodiments the energy of the reverberator output can be measured from a certain time onwards, for example, from an input predelay time or other time indicating the beginning of where the RDR data has been given / provided / measured. In some embodiments the reverberation ratio control filter parameterdeterminer 405 is configured to create an input of a unit impulse followed by zeroesof a sufficient length to capture the reverberation tail. In practice, the length of thezero tail is adjusted to equal max(^^60(^)) plus the ^^^^ in samples. Themonophonic output signal ^^^^(^), which is a function of time ^, can be obtained bysummation of the outputs of the feedback network .A long FFT (of length ^^^^) is calculated over ^^^^(^) and its absolute valuecan be obtained as ^^^(^^) = abs(^^^(^^^^(^))Here, ^^ are the FFT bin indices. We furthermore obtain the positive halfspectral energy density as where we add the energy from the negative frequency indices ^^ into thecorresponding positive frequency indices ^^.The energy of a unit impulse can be calculated or obtained analytically. Denote it as ^^(^^). In some embodiments the band energies are calculated of both the positivehalf spectral energy density of the reverberator ^(^^) and the positive half spectralenergy density of the unit impulse ^^(^^). Band energies can be calculated as where ^^^^ and ^^^^^ are the lowest and highest bin indices belonging toband ^, respectively. The band bin indices can be obtained by comparing the frequencies of the bins to the lower and upper frequencies of each band. The reproduced ^^^^^^(^) of the reverberator output at the frequency bandk is obtained as^^^^^^(^) = ^(^) / ^^(^)The target linear magnitude response for GEQratio can be obtained as ^^^^^^^^^^^^^^^^^^^^^^^(^) = sqrt(^^^(^)) / sqrt(^^^^^^(^))where ^^^(^) is the linear target RDR value at band ^. The target response^^^^^^^^^^^(^) = 20 ∗ log^^(^^^^^^^^^^^^^^^^^^^^^^^(^))is input as for the graphic equalizer design routine as discussed in the previously cited documents of V. Välimäki and J. Liski, “Accurate cascade graphic equalizer,”IEEE Signal Process. Lett., vol. 24, no. 2, pp. 176–180, Feb. 2017 and J. Rämö, J.Liski, and V. Välimäki, “Third-Octave and Bark Graphic-Equalizer Design with Symmetric Band Filters,” Applied Sciences, vol.10, no.4, p.1222, Feb.2020. The RDR filter target response (control gains for the graphic EQ design routine) can also be obtained directly in the logarithmic domain as In some embodiments the reverberator controller 203 comprises a pre-delayline length determiner 407. The pre-delay line length determiner 407 is configuredto determine and adjust the length ^^^^ in samples of the pre-delay line based onthe input pre-delay time ^^^^. The input pre-delay can be converted to samples andthe length of the shortest FN delay line is subtracted from it. This can be set as thelength ^^^^. This will cause the first echoes from the FN to occur after time ^^^^. Insome other embodiments, the diffuse portion of the FN is set to start after time ^^^^.In this case ^^^^ can be lower and can be set based on an estimate of the time atwhich the FDN output becomes diffuse and by setting the pre-delay line such that the desired time can be obtained. The reverberator parameter determiner 203 further comprises a feedbackmatrix coefficient and output channel position determiner 409 configured togenerate feedback matrix coefficients. The core processing of the FDN calculationcan in some embodiments be realized by the below method process:process(sampleCount) { m_oneOverM = 1.0f / sqrt(m_outputCount + 1); / / m_outputCount is equal to the number of delay line loops D m_outputBuffer->fill(0.F); outputScaler{ 1.0f / m_outputCount }; vector updated_v(m_outputCount); for (sampleIndex = 0; sampleIndex < sampleCount; sampleIndex++) {d = accumulate(m_v[0], m_v[m_outputCount], 0); alphaTimesD = m_alpha * d; fill(updated_v, 0.0f); for (delayLineIndex = 0; delayLineIndex < m_outputCount;delayLineIndex++) { / / Read position starts from the beginning of the ring buffer and moves backwards (from / / the beginning of the second half which repeats the first half). float* s = &m_v[m_outputCount - delayLineIndex];b = 0; c = 0; for (dlId2 = 0; dlId2 < m_outputCount; dlId2++) {if (m_hasPositiveFeedbackGain[dlId2]) { b += s[dlId2]; } else { c += s[dlId2]; } } a= m_oneOverM * (b - c) + alphaTimesD; delayedSample = m_delayLines[delayLineIndex].getDelayedSample(m_inputBuffer- >at(sampleIndex) + a); filteredSample = m_filters[delayLineIndex]- >filter(delayedSample); updated_v[delayLineIndex] = filteredSample; (*m_outputBuffer)[delayLineIndex][sampleIndex] += filteredSample; } copy(&updated_v[0], m_outputCount, &m_v[0]); copy(&updated_v[0], m_outputCount, &m_v[m_outputCount]); for (outputChannelIndex = 0; outputChannelIndex < m_outputCount; outputChannelIndex++) { (*m_outputBuffer)[outputChannelIndex][sampleIndex] *= outputScaler; } } } The following parameters are needed to implement the core feedback matrix calculations of the FDN reverberator. In the example FDN shown later, the feedback matrix is depicted with A. The parameters required for feedback matrixcalculation are listed for different numbers of reverb delay line loops D: / / D = 3 m_hasPositiveFeedbackGain = { 0, 1, 0, }; m_alpha = -0.1666666667f; / / D = 7 m_hasPositiveFeedbackGain = { 0, 1, 1, 0, 1, 0, 0, }; m_alpha = -0.0923495156f; / / D = 15 m_hasPositiveFeedbackGain = { 0, 1, 1, 1, 0, 1, 1, 0, 0, 1, 0, 1, 0, 0, 0, }; m_alpha = -0.0500000000f; / / D = 31 m_hasPositiveFeedbackGain = { 0, 1, 1, 1, 1, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 0, 1, 1, 1, 0, 0, 1, 0, 0, 0, 1, 0, 1, }; m_alpha = -0.0265555905f; / / D = 63 m_hasPositiveFeedbackGain = { 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 0, 1, 1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 1, 0, 1, 1, 1, 0, 0, 0, 1, 1, 0, 1, 1, 0, 1, 0, 0, 1, 0, 0, 0, 1, 0, 0, 1, 1, 0, 0, 1, 0, 1, 0, 1, 0, 0, 0, 0, 0, }; m_alpha = -0.0138888889f; / / D = 127 = 0, 0, 1, 1, 0, 1, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 0, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 1, 1, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 1, 1, 1, 0, 0, 1, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 0, 1, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, }; m_alpha = -0.0071780445f; In the above embodiment, m_hasPositiveFeedbackGain lists, for each delay line index d, whether the delay line value should be summed to the positive sumaccumulator b (value of 1) or the negative sum accumulator c (value of zero). Thebenefit of the above embodiment is that m_hasPositiveFeedbackGain consists of zeros and ones and can thus be compactly stored in computer memory. In some embodiments the feedback matrix coefficient and output channelposition determiner 409 is further configured to output channel positions based ona selection from a stored table. For example, the azimuth and elevation angles in degrees for output directions can be selected from the table below: Azimuth degrees (degrees) Elevation (degrees)90 0-90 0114 20-60 -685 -44-130 -2149 41-67 52154 -9-48 -5519 -31-162 21151 73-9 20180 -63The output of this step is the reverberator output directions setup, ^^^^(^), ^^^^(^). As another example, the loudspeaker output positions can be selected using a suitable algorithm or software routine which places the output channel positions substantially uniformly (equidistant on azimuth, elevation or both) on a sphere, or at horizontal circles. The delay lines can be assigned the Loudspeaker setup positions such that the delay lines are arranged into ascending order according to their lengths and the output positions are assigned starting from the top of the table above. Figure 5 shows example operations of the reverberator controller 203. The first operation is obtaining the reverberation parameters (predelay,RT60, reverberation ratio, room dimensions, number of delay lines D) as shown by 501. Then is shown determining delay line lengths based on the room dimensionsand D as shown by 503.Following this is determining delay line attenuation filter parameters basedon the delay line lengths, D and ^^60(^) as shown by 505.Then determining reverberation ratio control filter parameters based on thereverberation ratio as shown by 507.After this is determining length of a pre-delay line based on the pre-delayand the delay line lengths as shown by 509. Then is the determination of the feedback matrix calculation parameters and the output channel positions based on D as shown by 511. Figure 12 shows in further detail the reverberator 201 introduced in Figure2. As discussed above the reverberator 201 can be used to produce ^ uncorrelatedoutputs. In some embodiments the reverberator 201 is configured to produce D=15(or some other determined number for D) outputs which are subsequently encodedto be rendered from different spatial directions defined by the directionalconfiguration. In some embodiments the reverberator 201 comprises a pre-delay line^^^^^^ 1201, configured to receive and delay the input audio signal. Thereverberator 201 also comprises a reverberation ratio control filter GEQratio 1203 which is configured to receive the pre-delay line output. The reverberator 201further comprises a number ^ of feedback delay lines ^^^^ 1251 andcorresponding feedback delay line attenuation filters GEQd 1253. The signals whichare output from GEQd 1253 are sent to inputs of a feedback matrix ^ 1257. ^ signalcombiners 1254 (adders) sum the outputs of the feedback matrix ^ 1257 with theoutput of GEQratio 1203 to be used as inputs to each of the feedback delay lines^^^^ 1251. The output of the feedback delay line attenuation filters 1253 are routedto ^ signal multipliers 1261 which in turn output the reverberant audio signals 206.The output of the feedback delay line attenuation filters 1253 are also the outputs of the FDN and outputs of the feedback delay line loops. The D feedback delay lineloops of the FN thus comprise the adders 1254, feedback delay lines 1251, andfeedback delay line attenuation filters 1253. The number of these feedback delayline loops determines the complexity of the FN calculation as the calculations need to be done for each delay line loop in all these elements, and also in the feedbackmatrix A 1257, for each incoming audio sample of Audio signal 200.Thus, in some embodiments the reverberator 201 is configured to receive reverberator parameters which comprise a delay length ^^^^, in samples, for pre-delay line ^^^^^^ 1201, coefficients of a reverberation ratio control filter GEQratio1203, delay lengths ^^ for each of ^ feedback delay lines ^^^^1251, coefficientsfor each of ^ feedback delay line attenuation filters GEQd 1253, and coefficientsfor the feedback matrix ^ 1257. The reverberator parameters also in someembodiments comprise output channel gains ^^which are used to configure ^ signal multipliers 1261. In some embodiments the attenuation filter GEQd is a graphic equalizer (EQ)filter using ^ biquad IIR band filters. In the case of octave-band filtering, ^ = 10.Thus, the reverberator parameters corresponding to each graphic EQ filtercomprise the feedforward and feedback coefficients for 10 biquad IIR filters, thegains for biquad band filters, and the overall gain. The feedback delay lines ^^^^1251 can also be referred as loop delay lines or recirculating delay lines and thefeedback delay line attenuation filters GEQd 1253 can be referred to as loop filters or recirculating filters. In some embodiments the coefficients of feedback matrix ^ 1257 are hardcoded in software code rather than provided as parameters. The reverberator thus comprises multiple recirculating delay lines (alsoreferred as delay line loops) associated with the feedback network (FN) 1250. Thefeedback matrix ^ 1257 is used to control the recirculation gain and routing withinthe network. The feedback delay line attenuation filters GEQd 1253 can beimplemented in some embodiments as graphic EQ filters implemented as cascadesof second-order section IIR filters and can facilitate controlling the energy decayrate at different frequencies. The feedback delay line attenuation filters GEQd 1253furthermore are designed such that they attenuate the signal by the desired amountwith each pass through the FN such that the desired reverberation time (RT60) isachieved. With respect to Figure 7 is shown a schematic view of an example adaptive loudspeaker renderer 205. The adaptive loudspeaker renderer 205 in some embodiments is configured to receive or obtain the listener position and orientation210, Loudspeaker setup 208 ^^^(^), ^^^(^), ^ = 1, … , ^^^., and Reverberated audiosignal 206 ^^^^(^, ^) and generate the reverberant loudspeaker audio signals 212.In some embodiments the loudspeaker setup can be one of the CICP loudspeaker setups defined in ISO / IEC 230913:2017(E) Information technology —Coding independent code-points — Part 3: Audio. As an example, two setups are given below, 5 is the common 5.1 setup and 12 is a horizontal setup with more loudspeakers. "Front / Informative Ch. Surr. Loudspeaker names in Loudspeaker geometric position Value is LFE" loudspeaker layout abbrev. Azim., Elev. LFE notation5 3 / 2.0 centre front,C 0, 0 0 left front, L 30, 0 0 right front, R −30, 0 0 left surround, Ls 110, 0 0 right surround Rs −110, 0 012 3 / 4.1 centre front,C 0, 0 0 left front, L 30, 0 0 right front, R −30, 0 0 left surround, Ls 110, 0 0 right surround, Rs −110, 0 0 rear surround left, Lsr 135, 0 0 rear surround right, Rsr −135, 0 0 LFE LFE 0, −15 1 The LSDF file can in some embodiments contain the index of the CICP setup and the loudspeaker setup information such as loudspeaker setup origin or reference point and the loudspeaker positions with regard to the reference point. The loudspeaker setup origin can in some situations be also referred to as thesweet spot and denoted with label ^. The loudspeaker setup ^^^(^), ^^^(^) denotesloudspeaker directions relative to ^. The adaptive loudspeaker rendering of reverberated signals can involve thefollowing: updating the listener position in the real space; updating the reverberator output directions based on the updated listener position information; updating the loudspeaker directions based on the listener position; calculating panning gains for the reverberator outputs based on the updated reverberator output directions and the updated loudspeaker directions; rendering loudspeaker signals using the panning gains and the reverberator output signals; calculating additional gain and delay parameters for the loudspeaker signals to compensate for the difference of listener position from the sweet spot; and rendering reverberated output signals using the loudspeaker signals and the gain and delay parameters. Figures 6a to 6d show examples of rendering reverberator outputs fromconstant user relative positions in adaptive loudspeaker rendering. For example, in Figure 6a, a reverb output direction ^^^^, ^^^^, 601 isdepicted. In Figure 6b, the reverberation output direction 605 is shown to be relative to the real listener position 603 within the listening space with loudspeakers. In Figure 6c, the real listener position p 603, the reverb output direction ^^^^,^^^^ 605 relative to the real listener position 603, the sweet spot s 607 and theloudspeakers 609 having directions ^^^(^), ^^^(^) relative to the sweet spot 607 aredepicted. In Figure 6d, the loudspeaker directions ^^^,^^^^(^), ^^^,^^^^(^) 611 with respectto the listener position p are depicted 603, along with the reverberation outputposition 605 with respect to the listener position 603 is shown.Adaptive loudspeaker panning is then performed such that the loudspeakerdirections are updated to be the listener relative ones ^^^,^^^^(^), ^^^,^^^^(^) 611.With respect to Figure 7 is shown a schematic view of an example adaptive loudspeaker renderer 205. The adaptive loudspeaker renderer 205 in some embodiments comprises aloudspeaker position calculator 701. The loudspeaker position calculator 701 isconfigured to calculate the position of the loudspeakers with regard to user position in the real scene. Furthermore, in some embodiments the adaptive loudspeaker renderer 205comprises a relative reverberator output generator 703. The relative reverberator output generator 703 is configured to generate a reverberation output which is relative to the user position in the real scene. Additionally, in some embodiments the adaptive loudspeaker renderer 205comprises a reverberated audio signal renderer 705. The reverberated audio signal renderer 705 is configured to render a reverberated signal from the user relative position using adaptive loudspeaker rendering with loudspeaker positions relative to the user position. Figure 8 shows example operations of the adaptive loudspeaker renderer205. The first operation is obtaining a user position in the real scene,reverberation output position, loudspeaker positions, and reverberated audio signalas shown by 801. Then is shown determining or calculating a position of loudspeakers with regard to user position in the real scene as shown by 803. Following this is generating reverberation output relative to the user position in the real scene as shown by 805. Then is shown the rendering of the reverberated signal from the user relativeposition using adaptive loudspeaker rendering with loudspeaker positions relative to the user position as shown by 807. Figures 9a to 9d show examples of rendering reverberator outputs where the reverberation outputs are rendered as loudspeaker signals using adaptive loudspeaker rendering. For example in Figure 9a, a reverb output direction ^^^^, ^^^^, 901 is depicted. In Figure 9b, the reverberation output direction 905 is shown to be relative to the real listener position 903 within the listening space with loudspeakers. In Figure 9c, the real listener position p 903, the reverb output direction ^^^^, ^^^^905 relative to the real listener position 903, and the loudspeakers 909 havingdirections ^^^(^), ^^^(^) relative to the real listener position 903 are depicted.Figures 7 and 10 further show a further embodiment implementation of the adaptive loudspeaker renderer 205. In Figure 7 as shown by the dashed line is also a direction mapper configured to map the direction of the reverberation output tothe nearest loudspeaker direction.Figure 10 shows example operations of the adaptive loudspeaker renderer205 with the mapping operation.The first operation is obtaining a user position in the real scene, reverberation output position, loudspeaker positions, and reverberated audio signal as shown by 801. Then is shown determining or calculating a position of loudspeakers with regard to user position in the real scene as shown by 803. Following this is generating reverberation output relative to the user position in the real scene as shown by 805. Then is shown the mapping of the direction of the reverberation output tothe nearest loudspeaker as shown by 1006.Then is shown the rendering of the reverberated signal from the loudspeaker mapped reverberation output position using adaptive loudspeaker rendering with loudspeaker positions relative to the user position as shown by 1007. In Figure 9d, the loudspeaker directions ^^^,^^^^(^), ^^^,^^^^(^) 911 with respectto the listener position p are depicted 903, along with the reverberation outputposition 915 coinciding with direction of a physical loudspeaker and with respect tothe listener position 903 is shown. The benefit of the mapping the reverberation output direction ^^^^, ^^^^ suchthat it matches with the closest physical loudspeaker direction from the listenerposition is that no panning between loudspeakers is then required and has thebenefit that no extra coherence is created to the rendered reverberation signal. Based on the listener relative loudspeaker setup ^^^,^^^^(^), ^^^,^^^^(^) and theuser-relative reverb output directions setup ^^^^(^), ^^^^(^), amplitude panninggains g(i) for each of the directions in ^^^^(^), ^^^^(^) are obtained. The amplitudepanning gains giare obtained for three loudspeakers corresponding to unit vectorsl1,i, l2,i, l3,i (the vector base from real listener position) forming a loudspeakertriangle (triplet) enclosing each the direction ^^^^(^), ^^^^(^). A column unit vectorv is formulated pointing towards the desired amplitude panning direction, and avector g containing the amplitude panning gains can be solved by a matrixmultiplication where the reverberator output channel index i is omitted for clarity, andwhere T denotes transpose and -1 the matrix inverse. After formulating gains g,their overall level is normalized such that for the final gains the energy sum gTg =1. The above example uses Vector-Base Amplitude Panning. Alternatively, in some embodiments, other methods of panning can be used. It is noted that thereis difference in these embodiments compared to conventional VBAP in that theloudspeaker unit vectors are constantly, and repeatedly recalculated based on thelistener position. Since the listener-to-loudspeaker distance also changes, the loudspeaker vectors are made unit vectors by dividing by their length after each user position update. In some embodiments where reverberator output directions are mapped to the direction of the closest loudspeaker to obtain the gain ^^^,^=1 for the mapped loudspeaker ls and the gain for other speakers is 0. This mapsthe output of each reverberator channel to a single speaker only. When the number of reverberator channels is larger than the number of speakers then each speaker is mapped multiple reverberator channels. Since the loudspeaker to which a reverberation output is mapped canchange, smoothing of the gain values can be performed, in some embodiments, toprevent switching artefacts. The smoother can be an IIR filter or other suitable smoothing mechanism. In some embodiments, switching of several reverberation outputs at the same time (rendering frame) is not allowed, but only one (or predetermined number) of reverberation outputs can change the target loudspeaker at once, and others are queued for changing later. With the gains g, the output signal corresponding to the unit vector l1,iforthe reverberator output channel i can be obtained as Then, the loudspeaker signals for the different loudspeaker channels ^ aresummed byyielding the reverberant loudspeaker signals ^^^(^, ^).Adaptive loudspeaker rendering can also involve receiving the user positionp and calculating additional gain and delay parameters ^(^), ^(^) for eachloudspeaker j based on the difference of the listener position and sweet spot p-s.The goal of the gain parameter is to compensate for the difference in distance gain attenuation due to different listener-to-loudspeaker distance compared to the sweet spot, and the goal of the delay parameter is to compensate for the difference in sound propagation delay. The distance from the user position p to a loudspeaker lj is ‖^ + ^^ − ^‖^.The difference of the distance compared to the distance from the sweet spot^^ + = 1 indicates the necessary delay ^(^) to be applied: ^(^) = where c=343m / s and fs=48000Hz. For example, if the distance from the userposition to loudspeaker lj is ^^ + ^^ − ^^ = 1.1, then the additional delay needed is^(^) =^.^∗ 48000 ≈ 13.9942 samples. Such an additional delay can beimplemented with a variable delay line (VDL). In a free field, the sound level attenuates with 1 / r, where r is the distance traveled by the sound. The difference in distance gain for speaker lj at position pcan be compensated with ^(^) assuming free fieldconditions. Thus, if ^^ + ^^ − ^^ = 1.1 then the gain to be applied to lj signal is^(^) = 1.1. Since the method is commonly applied in rooms which containreflections and reverberation due to the real space acoustics, the sound level attenuates slower than 1 / r. Such a behaviour can be modelled by configuring the system to apply less level compensation depending on the room reverberation time, for example. A decay parameter can be provided as a input to the LSDF for the renderer to control this behaviour. The output of the adaptive loudspeaker rendering are the signals^^^,^^^^^^^^(^, ^) = ^(^)^^^(^ − which are the output of the system.Figures 11a and 11b show schematically an example system where theembodiments are implemented in an encoder device 1901 which performs part of the functionality; writes data into a bitstream 1921 and transmits that for a renderer device 1941, which decodes the bitstream, performs reverberator processing according to the embodiments and outputs audio for headphone listening. The encoder side 1901 of Figure 11 can be performed on content creatorcomputers and / or network server computers. The output of the encoder is the bitstream 1921 which is made available for downloading or streaming. The decoder / renderer 1941 functionality runs on an end-user-device, which can be a mobile device, personal computer, sound bar, tablet computer, car media system, home HiFi or theatre system, head mounted display for AR or VR, smart watch, or any suitable system for audio consumption. The encoder 1901 is configured to receive the virtual scene description 1900 and the audio signals 1904. The virtual scene description 1900 can be provided in the MPEG-I encoder input format (EIF) or in another suitable format. Generally, thevirtual scene description contains an acoustically relevant description of thecontents of the virtual scene, and contains, for example, the scene geometry as a mesh or as voxels, acoustic materials, acoustic environments with reverberation parameters, positions of sound sources, and other audio element related parameters such as whether reverberation is to be rendered for an audio elementor not. The encoder 1901 in some embodiments comprises a scene andreverberation payload encoder 1913 configured to generate reverberation parameters. The encoder 1901 further comprises a MPEG-H 3D audio encoder 1914 configured to obtain the audio signals 1904 and MPEG-H encode them and pass them to a bitstream encoder 1915. The encoder 1901 furthermore in some embodiments comprises a bitstream encoder 1915 which is configured to receive the output of the scene and reverberation payload encoder 1913 and the encoded audio signals from the MPEG-H encoder 1914 and generate the bitstream 1921 which can be passed to the bitstream decoder 1941. The bitstream 1921 in some embodiments can bestreamed to end-user devices or made available for download or stored. In otherimplementations, the audio signals 1904 may be encoded via any suitable codec such as EVS, IVAS, AAC, OPUS, etc. The decoder 1941 in some embodiments comprises a bitstream decoder 1951 configured to decode the bitstream. The decoder 1941 further can comprise a scene payload decoder 1953 configured to obtain the encoded reverberation parameters and decode these in an opposite or inverse operation to the reverberation payload encoder 1913. The reverberator controller 203 / 1952 is configured to receive the decodedreverberation parameters and room dimensions and loudspeaker configuration or setup 1950 information and generate the reverberator control parameters discussed herein. Furthermore, the head pose generator 1957 receives information from a head mounted device 1970 or similar and generates head pose information or parameters which can be passed to the adaptive loudspeaker renderer 205 / 1967. The decoder 1941 comprises MPEG-H 3D audio decoder 1954 which isconfigured to decode the audio signals and pass them to the reverberator201 / 1961, early reflection renderer 1999 and direct sound processing 1965. In otherimplementations, the MPEG-H 3D audio decoder 1954 may be replaced by any suitable audio decoder depending on the audio coding method utilized. The decoder 1941 furthermore comprises a reverberator 201 / 1961 configured to implement a suitable reverberation of the audio signals from the MPEG-H 3D audio decoder 1954. The output of the reverberator 201 / 1961 is configured to output reverberated audio based on the reverberator parameters to an adaptive loudspeaker renderer 205 / 1959. The decoder 1941 furthermore comprises an early reflection renderer 1999 configured to obtain the output of the MPEG-H 3D audio decoder 1954 and generate early reflections using, for example, geometric acoustic rendering with image sources based on the physical or virtual scene geometry and pass these to the adaptive loudspeaker renderer 205 / 1967. The decoder further comprises a direct sound processor 1965 configured toapply direct sound processing such as air absorption, distance-gain attenuation and pass the results to a direct sound renderer 1963.The decoder 1941 further comprises a direct sound renderer 1963configured to render direction sound values and pass these to the adaptive loudspeaker renderer 205 / 1967. The decoder 1941 furthermore comprises the adaptive loudspeaker renderer 205 / 1967 configured to generate loudspeaker audio signals. In some embodiments, the reverberation parameters of the real room are provided as ^^^,^^^^(^), ^^^^^^^(^), ^^^^,^^^^. In some embodiments, when rendering the reverberation for an AR scene, the rendering of reverberation can be omitted as the real room already contains reverberation of the space. This omitting can be controlled by bitstream signalling. In some embodiments, the real room reverberation can be compensated when rendering virtual reverberation with parameters ^^^(^), ^^^(^), ^^^^. Additionally in some embodiments, the compensation is implemented bymodifying the reverberation parameters to be ^^^,^^^^(^) = max (0, ^^^(^)-^^^,^^^^(^)), ^^^^^^^(^) = max (0, ^^^(^)- ^^^^^^^(^)) and ^^^^,^^^^=max(0,^^^^-^^^^,^^^^). The bitstream signaling for configuration of reverb rendering for loudspeakers: Semantics: payloadReverbForLSPresent Indicates presence of payload for controllingreverb rendering to physical loudspeakers. A value equal to 1 indicates presence and a value equal to 0 indicates absence of bitstream information for controlling reverb rendering to physical loudspeakers. reverbForLSParamsPresent Indicates the presence of control parametersfor reverb rendering to physical LS isARScene true if the scene is an AR scene, false for VR scenethresholdReverbPresent indicates the presence of reverberation thresholddata performDecorrelation toggle applying additional decorrelation toreverberation signals numReverbDelayLinesPresent indicates presence of reverb delay linesfor loudspeaker renderingreverbLSMethod indicates method for reverb rendering to LSreverberationThresholdStruct indicates the threshold RT60 and RDR datasuch that if the environment has reverberation time larger than threshold and RDR larger than threshold no reverb rendering from physical loudspeakers is performed. This can be applied to both AR and VR scenes. class aligned(8) payloadReverb(){ ..... unsigned int(1) payloadReverbForLSPresent; if(payloadReverbForLSPresent){ unsigned int(1) reverbForLSParamsPresent; unsigned int(1) isARScene; if(isARScene){ unsigned int(1) thresholdReverbPresent; unsigned int(1) compensateRoomReverb; if(thresholdReverbPresent) reverberationThresholdStruct(); } if(reverbForLSParamsPresent){ unsigned int(1) performDecorrelation; unsigned int(1) numReverbDelayLinesPresent; unsigned int(4) reverbLSMethod; if(numReverbDelayLinesPresent) unsigned int(8) numDelayLines; / / 3, 7, 15, 31, 63, 128 reverberationThresholdStruct(); } ..... } aligned(8) reverberationThresholdStruct(){ unsigned int(1) reverbThresholdPresent; <any other parameter for reverberation threshold> if(reverbParamsStruct){ EncodedRT60Struct(); EncodedRDRStruct(); } } aligned(8) EncodedRT60Struct(){ unsigned int(8) num_frequency_bands; for (i=0;i<num_frequency_bands;i++){ unsigned int(32) frequency_encoded_value; unsigned int(32) scene_rt60_encoded_value; } } aligned(8) EncodedRDRStruct(){ unsigned int(8) num_frequency_bands; for (i=0;i<num_frequency_bands;i++){ unsigned int(32) frequency_encoded_value; unsigned int(32) scene_rdr_encoded_value; / / represented as logRDR, Huffman coded } } reverbLSMethod ValueReserved 0This indicates that the reverb is rendered as listener 1 relative position compared to virtual loudspeakers and perform panning to nearest physical loudspeakers This indicates that the reverb is rendered as listener 2 relative position to the virtual loudspeakers that are aligned with the physical loudspeakers (directionmapped to the closest) Reserved 3-15In embodiments when additional decorrelation is to be performed on the reverberation signals, each of the reverberated signals will be run through a decorrelator. The decorrelator can be a known decorrelator used in MPEG audio codecs, or another type of decorrelator such as a velvet noise decorrelator or any suitable decorrelator producing sufficient amount of decorrelation while not introducing significant spectral coloration. In implementation embodiments related to AR scenes, loudspeaker rendering of reverberation is performed only when the loudspeaker rendering of the reverberation does not increase the reverberation level. In implementation embodiments related to VR scenes, the loudspeaker rendering of reverberation only if the room reverberation introduced by the loudspeaker output is not sufficient or aligned with the VR scene content creatorrequirements. Consequently, an additional data structure carrying the thresholdreverberation information is included in the bitstream. In an embodiment, thebitstream can also carry a flag to indicate that loudspeaker rendering of reverberation may be skipped in order to reduce computational complexity or if the reproduction environment is reverberant or a combination of both. With respect to Figure 13 an example electronic device which may be usedas any of the apparatus parts of the system as described above. The device maybe any suitable electronics device or apparatus. For example, in someembodiments the device 2000 is a mobile device, user equipment, tablet computer,computer, audio playback apparatus, etc. The device may for example beconfigured to implement the encoder or the renderer or any functional block asdescribed above. In some embodiments the device 2000 comprises at least one processor orcentral processing unit 2007. The processor 2007 can be configured to executevarious program codes such as the methods described herein.In some embodiments the device 2000 comprises a memory 2011. In someembodiments the at least one processor 2007 is coupled to the memory 2011. Thememory 2011 can be any suitable storage means. In some embodiments thememory 2011 comprises a program code section for storing program codesimplementable upon the processor 2007. Furthermore, in some embodiments thememory 2011 can further comprise a stored data section for storing data, for example data that has been processed or to be processed in accordance with the embodiments as described herein. The implemented program code stored within the program code section and the data stored within the stored data section can be retrieved by the processor 2007 whenever needed via the memory-processor coupling. In some embodiments the device 2000 comprises a user interface 2005. Theuser interface 2005 can be coupled in some embodiments to the processor 2007. In some embodiments the processor 2007 can control the operation of the user interface 2005 and receive inputs from the user interface 2005. In some embodiments the user interface 2005 can enable a user to input commands to the device 2000, for example via a keypad. In some embodiments the user interface2005 can enable the user to obtain information from the device 2000. For example,the user interface 2005 may comprise a display configured to display informationfrom the device 2000 to the user. The user interface 2005 can in someembodiments comprise a touch screen or touch interface capable of both enablinginformation to be entered to the device 2000 and further displaying information tothe user of the device 2000. In some embodiments the user interface 2005 may bethe user interface for communicating. In some embodiments the device 2000 comprises an input / output port 2009.The input / output port 2009 in some embodiments comprises a transceiver. Thetransceiver in such embodiments can be coupled to the processor 2007 and configured to enable a communication with other apparatus or electronic devices, for example via a wireless communications network. The transceiver or any suitable transceiver or transmitter and / or receiver means can in some embodiments be configured to communicate with other electronic devices or apparatus via a wire or wired coupling. The transceiver can communicate with further apparatus by any suitableknown communications protocol. For example, in some embodiments thetransceiver can use a suitable universal mobile telecommunications system (UMTS) protocol, a wireless local area network (WLAN) protocol such as for example IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, or infrared data communication pathway (IRDA). The input / output port 2009 may be configured to receive the signals. In some embodiments the device 2000 may be employed as at least part ofthe renderer. The input / output port 2009 may be coupled to headphones (whichmay be a headtracked or a non-tracked headphones) or similar. In general, the various embodiments of the invention may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof. The embodiments of this invention may be implemented by computer software executable by a data processor of the mobile device, such as in the processor entity, or by hardware, or by a combination of software and hardware. Further in this regard it should be noted that any blocks of the logic flow as in the Figures may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions. The software may be stored on such physical media as memory chips, or memory blocks implemented within the processor, magnetic media such as hard disk or floppy disks, and optical media such as for example DVD and the data variants thereof, CD. The memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The data processors may be of any type suitable to the local technical environment, and may include one or more of general-purpose computers, special purposecomputers, microprocessors, digital signal processors (DSPs), application specificintegrated circuits (ASIC), gate level circuits and processors based on multi-core processor architecture, as non-limiting examples. Embodiments of the inventions may be practiced in various components such as integrated circuit modules. The design of integrated circuits is by and large a highly automated process. Complex and powerful software tools are available for converting a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate. Programs, such as those provided by Synopsys, Inc. of Mountain View, California and Cadence Design, of San Jose, California automatically route conductors and locate components on a semiconductor chip using well established rules of design as well as libraries of pre-stored design modules. Once the design for a semiconductor circuit has been completed, the resultant design, in a standardized electronic format (e.g., Opus, GDSII, or the like) may be transmitted to a semiconductor fabrication facility or "fab" for fabrication. As used in this application, the term “circuitry” may refer to one or more or all of the following: (a) hardware-only circuit implementations (such as implementations in only analog and / or digital circuitry) and (b) combinations of hardware circuits and software, such as (as applicable): (i) a combination of analog and / or digital hardware circuit(s) with software / firmware and (ii) any portions of hardware processor(s) with software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions) and I hardware circuit(s) and or processor(s), such as a microprocessor(s) or a portion of a microprocessor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation. This definition of circuitry applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term circuitry also covers an implementation of merely a hardware circuit or processor (or multiple processors) or portion of a hardware circuit or processor and its (or their) accompanying software and / or firmware. The term circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit or processor integrated circuit for a mobile device or a similar integrated circuit in server, a cellular network device, or other computing or network device. The term “non-transitory,” as used herein, is a limitation of the medium itself (i.e., tangible, not a signal ) as opposed to a limitation on data storage persistency (e.g., RAM vs. ROM). As used herein, “at least one of the following: ” and “at least one of ” and similar wording, where the list of two or more elements are joined by “and” or “or”, mean at least any one of the elements, or at least any two or more of the elements, or at least all the elements The foregoing description has provided by way of exemplary and non-limiting examples a full and informative description of the exemplary embodiment of this invention. However, various modifications and adaptations may become apparent to those skilled in the relevant arts in view of the foregoing description, when read in conjunction with the accompanying drawings and the appended claims. However, all such and similar modifications of the teachings of this invention will still fall within the scope of this invention as defined in the appended claims.

Claims

CLAIMS:

1. A method for rendering reverberation, the method comprising:obtaining a reverberated signal based on a listener position within an acoustic environment; obtaining a listener position within a reproduction space; obtaining at least one reverberator output channel position;obtaining a position of at least one loudspeaker based on the at least onereverberator output channel position and the listener position within the reproduction space; determining a gain based on the position of the at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; applying the gain on the reverberated signal; and generating a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal.

2. The method as claimed in claim 1, wherein obtaining a reverberated signalbased on a listener position within an acoustic environment comprises: obtaining at least one reverberation parameter associated with the acoustic environment; configuring at least one reverberator based on the at least one reverberation parameter; and processing at least one audio signal with the configured reverberator to produce the reverberated signal.

3. The method as claimed in claim 2, wherein obtaining at least onereverberation parameter associated with the acoustic environment comprises determining at least one delay line parameter.

4. The method as claimed in any of claims 1 to 3, wherein obtaining the listenerposition within the reproduction environment comprises adaptively obtaining the listener position, the listener position being time-varying.

5. The method as claimed in claim 4, comprising obtaining based on theadaptively obtained listener position, at least one of: at least one gain; and at least one delay.

6. The method as claimed in any of claims 2, 4 or 5, or claim 4 when dependenton claim 2, wherein configuring at least one reverberator based on the at least one reverberation parameter comprises selectively or partially disabling the at least one reverberator based on determining the reproduction space within which the at least one loudspeaker is located is reverberant.

7. The method as claimed in claim 6, wherein selectively or partially disablingthe at least one reverberator based on one of: a user input to selectively or partially disable the at least one reverberator; and a flag or indicator, the flag or indicator configured to indicate that loudspeaker rendering of reverberation is to be skipped in order to reduce computational complexity, or if the reproduction environment is reverberant, or a combination of both.

8. The method as claimed in any of claims 1 to 7, wherein applying the gain onthe one reverberated signal comprises gain on the reverberated signal to produce a panned audio signal.

9. The method as claimed in claim 8, wherein generating a loudspeaker signalto be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal comprises summing the panned audio signal to generate a loudspeaker signal to be reproduced from the at least one loudspeaker.

10. The method as claimed in claim 9, wherein summing the panned audio signalto generate a loudspeaker signal to be reproduced from the at least oneloudspeaker comprises summing the panned audio signal for a sub-set of pannedaudio signal to generate the loudspeaker signal to be reproduced from the at least one loudspeaker.

11. The method as claimed in any of claims 1 to 10, further comprising:determining at least one distance between the listener position and the position of the at least one loudspeaker within the reproduction space; determining a further gain based on the determined at least one distance; and rendering the loudspeaker signal from the at least one loudspeaker by applying the further gain to the loudspeaker signal.

12. The method as claimed in any of claims 1 to 11, wherein obtaining at leastone reverberator output channel position comprises adaptively controlling the at least one reverberator output channel position.

13. The method as claimed in claim 12, wherein adaptively controlling the at leastone reverberator output channel position comprises mapping the at least one reverberator output channel position to a nearest position of the at least one loudspeaker.

14. The method as claimed in any of claims 1 to 13, wherein the acousticenvironment is one of: the same as the reproduction space in an augmented reality application; and a virtual reality environment and the reproduction space is a real space within which the at least one loudspeaker is located.

15. An apparatus comprising means for performing the method of any of claims 1to 14.

16. A computer program comprising instructions, which, when executed by an apparatus, cause the apparatus to perform the method of any of claims 1 to 14.

17. An apparatus for rendering reverberation comprising at least one processorand at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: obtain a reverberated signal based on a listener position within an acoustic environment; obtain a listener position within a reproduction space; obtain at least one reverberator output channel position;obtain a position of at least one loudspeaker based on the at least one reverberatoroutput channel position and the listener position within the reproduction space; determine a gain based on the position of the at least one loudspeaker, the listener position within the reproduction space, and the reverberator output channel position; apply the gain on the reverberated signal; and generate a loudspeaker signal to be reproduced from the at least one loudspeaker based on the applied gain on the reverberated signal.

18. An apparatus as claimed in claim 17, wherein the apparatus is caused toobtain the reverberated signal causes the apparatus to: obtain at least one reverberation parameter associated with the acoustic environment; configure at least one reverberator based on the at least one reverberation parameter; and process at least one audio signal with the configured reverberator to produce the reverberated signal.

19. An apparatus as claimed in claim 18, wherein the apparatus is caused toobtain the at least one reverberation parameter causes the apparatus to determine at least one delay line parameter.

20. An apparatus as claimed in any of claims 17 to 19, wherein the apparatus iscaused to obtain the listener position within the reproduction environment causes the apparatus to adaptively obtain the listener position, the listener position being time-varying.

21. An apparatus as claimed in claim 20, is caused to adaptively obtain thelistener position based on at least one of: at least one gain; and at least one delay.

22. An apparatus as claimed in any of claims 17 to 21, is further caused to:determine at least one distance between the listener position and the position of the at least one loudspeaker within the reproduction space; determine a further gain based on the determined at least one distance; and render the loudspeaker signal from the at least one loudspeaker by applying the further gain to the loudspeaker signal.

23. An apparatus as claimed in any of claims 17 to 22, wherein the apparatus iscaused to obtain the at least one reverberator output channel position causes the apparatus to adaptively control the at least one reverberator output channel position.

24. An apparatus as claimed in claim 23, wherein the adaptively controlled at leastone reverberator output channel position causes the apparatus to map the at least one reverberator output channel position to a nearest position of the at least one loudspeaker.

25. An apparatus as claimed in any of claims 17 to 24, wherein the acousticenvironment is one of: the same as the reproduction space in an augmented reality application; and a virtual reality environment and the reproduction space is a real space within which the at least one loudspeaker is located.

Citation Information

Patent Citations

  • Apparatus, methods and computer programs for enabling audio rendering

    WO2022167720A1

  • Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer

    EP3025327B1

  • Reverberation level compensation

    GB2618983A

  • Apparatus for immersive spatial audio modeling and rendering

    US20230224668A1