Seamless transition of echoes within virtual venue

By separating early reflection and echo tail signals and processing them independently, the method provides seamless transitions between reverberation settings, ensuring continuous and immersive audio playback.

JP2024167895APending Publication Date: 2024-12-04HARMAN BECKER AUTOMOTIVE SYST GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024080672
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-22
Filing Date
2024-05-17
Publication Date
2024-12-04

AI Technical Summary

Technical Problem

Conventional audio processing techniques result in undesirable breaks and disruptions during transitions between different reverberation settings, affecting the continuity of the listening experience.

Method used

A method that separates the reverberation process into early reflection signals and echo tail signals, processing them independently for different acoustic environments and combining them through a fading process to create a seamless transition.

Benefits of technology

Ensures uninterrupted and immersive audio playback by smoothly transitioning between different acoustic environments, maintaining continuous audio output and enhancing the overall listening experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024167895000001_ABST
    Figure 2024167895000001_ABST
Patent Text Reader

Abstract

To provide seamless transition of echoes within a virtual venue.SOLUTION: A method implemented by a computer for audio signal processing involves: receiving an input audio signal; acquiring echo parameters associated with two distinguishable acoustic environments; and simultaneously generating early reflection signals for each acoustic environment. Those early reflection signals are then combined through a fading process to create a continuous transient early reflection signal during the transition between the two environments according to the fading process. In addition, an echo tail is generated and combined with the transient early reflection signal. An output audio signal is provided as a combination of the directly input audio signal, transient early reflection signal, and echo tail, which are switched separately, resulting in a seamless and immersive listening experience for a user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] FIELD OF THE DISCLOSURE Various embodiments of the disclosure relate generally to the field of audio processing, in particular to virtual venue reverberation, and more particularly to a method for enabling continuous playback and seamless reverberation transitions between different reverberation settings. [Background technology]

[0002] Audio processing has become an essential aspect of various industries, including entertainment systems in vehicles, online meetings, gaming, and virtual reality. One of the key components of audio processing is the simulation of room acoustics, or in other words, reverberation. Reverberation is the persistence of sound in a particular space after the original sound is generated. To create an immersive and realistic listening experience, audio engineers often employ various reverberation techniques that simulate different acoustic environments.

[0003] However, conventional reverberation techniques have known limitations: When a user wants to transition between virtual venues or between different reverberation settings, or want to adjust the listening experience, the audio often goes into a short mute phase, or the experience often changes suddenly in reverberation characteristics, which can result in undesirable discontinuities in the audio reproduction, affecting the overall listening experience and interrupting the continuity of the sound. Summary of the Invention [Means for solving the problem]

[0004] Therefore, there is a need for advanced techniques for virtual venue reverberation that alleviate or mitigate at least some of the limitations and drawbacks discussed above.

[0005] This need is met by the features of the independent claims. The features of the dependent claims define further advantageous embodiments.

[0006] In the following, the solution according to the present disclosure is described in relation to the claimed audio system together with the claimed reverberation method, and the features, advantages or alternative embodiments can be assigned to other objects recited in the claims and vice versa. In other words, claims relating to the audio system can be improved by features described in the context of the method and the method can be improved by features described in the context of the audio system.

[0007] A computer-implemented method for processing an input audio signal is provided, the method being implemented, for example, by an audio system including a processing unit or by a computing device.

[0008] The method includes receiving an input audio signal to which reverberation can be applied and which is subsequently output with the reverberation to a user using a loudspeaker.

[0009] A first set of reverberation parameters associated with a first acoustic environment is obtained, and a second set of reverberation parameters associated with a second acoustic environment, different from the first set of reverberation parameters, is also obtained.

[0010] The input audio signal is processed based on a first set of reverberation parameters to generate a first early reflection signal and based on a second set of reverberation parameters to generate a second early reflection signal, in other words, the first and second sets of reverberation parameters are used in a computational or processing procedure or step to generate, in parallel, the first and second early reflection signals, respectively.

[0011] Each of the first and second early reflection signals includes a respective synthetic audio signal representing only an early sound reflection in the respective acoustic environment, which may be referred to as a direct signal in the acoustic environment and / or a sound reflection occurring before a predetermined time threshold after the first reflection. They may not include further signal components associated with reverberant tail signals or multiple / diffuse reflections in the acoustic environment. The first and second early reflection signals are combined with each other to generate a combined signal including the first and second early reflection signals, transitioning from the first early reflection signal to the second early reflection signal. A fading process is used for the combining to fade from the first early reflection signal to the second early reflection signal, in other words to generate a transient early reflection signal, which thus includes a transition from the first early reflection signal to the second early reflection signal according to the fading process. The transition may be pseudo-continuous or in small steps with a step size smaller than a listener can distinguish.

[0012] The output audio signal is provided based on or using the transient early reflection signal. The output audio signal may include, among other signal components, a combination of the direct input audio signal and the transient early reflection signal.

[0013] According to the overall idea, the disclosed method is based on splitting the reverberation process into at least two separate parts or signals, e.g. an early reflection signal and a reverberation tail signal. By processing these two parts independently, where a first signal is provided in parallel for different acoustic environments, the method can provide the user with an uninterrupted audio experience while changing the reverberation parameters.

[0014] The first early reflection signal and the second early reflection signal include respective synthetic audio signals representing only early sound reflections within the respective acoustic environments, the synthetic audio signals being reverberant characteristics or reflections of a sound event that occur up to a predetermined time interval or period after the sound event in the direct signal, and not reverberant characteristics or reflections that occur after multiple reflections.

[0015] The early reflection signal may refer to a first portion of the reverberation signal that is provided in parallel to two different acoustic environments. The reverberation tail signal may refer to a second reverberation signal that is complementary to the first reverberation signal and / or includes effects that are not included in the first reverberation signal, at least partially included in the first signal. Thus, the reverberation tail signal includes reverberation effects that are not provided in parallel but are switched between the two acoustic environments. In other words, the reverberation tail signal is not calculated or included when providing the early reflection signal.

[0016] The early reflection signals of the reverberation process represent the early sound reflections in a given acoustic environment. Early reflections, also known as early sound reflections, are the first series of echoes that reach the listener's ears immediately after the direct sound. These reflections occur as the sound waves bounce off various surfaces in the acoustic environment, such as walls, ceilings, and objects. Early reflection signals are characterized by their short delay time and relatively high amplitude compared to the reverberation tail signals. These early reflections contribute significantly to the listener's perception of the size, shape, and material properties of the environment.

[0017] In other words, early reflections may include only a first number of sound reflections or a first predefined number of sound reflections in each simulated acoustic environment that reach the listener's ears after the sound arrives directly from the sound source. These reflections occur as the sound waves bounce off various surfaces in the acoustic environment, such as walls, ceilings, and objects, where multiple reflections may not be included. In terms of the simulation, early reflections may represent a limited number of sound reflections before the sound arrives at the listener. To distinguish early reflections from the reverberation tail, a predefined threshold can be established, for example, representing a maximum number of reflections or time delay before the sound is considered to be part of the reverberation tail signal.

[0018] These early reflections occur before the sound decay is further extended, known as the reverberation tail. In contrast, the reverberation tail, also described as diffuse reflection or reverberation decay, represents the subsequent sound reflections and decay characteristics that occur within an acoustic environment following the early reflections. Reverberation tail signals are characterized by their longer delay time and gradually decreasing amplitude. As the sound waves continue to bounce around the environment, they lose energy, become more diffuse, and eventually fade out altogether. Reverberation tail signals contribute to the listener's perception of the spatial size of the environment and the overall surroundings.

[0019] In other words, the reverberation tail signal, which includes multiple reflections or diffuse reflections, refers to the subsequent sound reflections to the early reflections and the decay characteristics that occur in the acoustic environment following the early reflections. Those reflections may have, for example, amplitudes that decrease stepwise as the sound waves continue to bounce around the environment, compared to the early reflections. In a sound propagation simulation, the reverberation tail may include all effects and reflections after a predefined threshold that represents a time point or delay time, the number of subsequent reflections where the early reflections transition to later reflections that are more diffuse. The reverberation tail contributes to the listener's perception of the spatial size of the environment and the overall surrounding environment. Thus, in contrast, the reverberation tail represents the later sound reflections and decay characteristics that occur in the acoustic environment following the early reflections. The processing method does not calculate the reverberation tail for both environments simultaneously. Instead, it switches between the reverberation tail signals of the two environments, or any intermediate steps between consecutive playbacks.

[0020] Thus, a way to explain the separation of early reflections and the reverberant tail is to define them as two distinct parts of the overall reverberant process. Early reflections can be thought of as the first sound reflections to occur in the acoustic environment, with the reverberant tail including the subsequent later sound reflections and decay characteristics. A threshold or another characteristic boundary can be used to distinguish between the two components.

[0021] For example, the most prominent reflection peaks for an acoustic environment can be detected for a speech signal and remodeled by an early reflection network.

[0022] For example, for each of a number of sound events contained in the input audio, the early reflection signals can be described as composite audio signals representing early sound reflections occurring within the acoustic environment, characterized by their rapid arrival at the listener's part after the direct sound, typically within the first 50 milliseconds, while the reverberant tail signals represent later sound reflections and decay characteristics within the acoustic environment, characterized by their occurrence after the early reflections and extending over a more extended period of time, typically greater than 50 milliseconds from the direct sound.

[0023] The time interval or period between the direct sound, the early reflections and the reverberant tail, as defined by the threshold, can be measured based on the time difference between the direct sound and the reflections. The early reflections and the reverberant tail signals represent the same sound event following the direct sound in the reverberant space. The distinction between the early reflections and the reverberant tail is based on their arrival time and characteristics. The early reflections are the first set of sound reflections that typically arrive at the listener's location within the first 50 milliseconds after the direct sound. The reverberant tail is composed of the late sound reflections and decay characteristics that occur after the early reflections and extend over a more extended period, typically more than 50 milliseconds from the direct sound. Thus, the period represents and characterizes the transition from the early reflection phase to the reverberant tail phase within the same consecutive sound event in the reverberant space.

[0024] It establishes a clear distinction between early reflection signals and reverberant tail signals using a predefined threshold as a time duration value that separates the two signals based on the reverberant effect for a particular sound event in the direct sound signal. In this definition, the threshold is typically set at 50 milliseconds. This means that sound reflections occurring within the first 50 milliseconds after a direct sound are considered part of the early reflection signal, while sound reflections and decay characteristics extending beyond 50 milliseconds are classified as reverberant tail signals.

[0025] It will be appreciated that the predefined threshold can be adjusted according to specific requirements and to emphasize specific aspects of the acoustic environment. For example, 40 ms may be appropriate for smaller acoustic environments or applications where early reflections are particularly critical in shaping the sensed space. For example, 60 ms may be appropriate for larger acoustic environments where early reflections are more widespread and require a longer time window to capture their full effect. By extending the threshold to, for example, 75 ms, the early reflection signal may provide a more detailed representation of early sound reflections in environments with complex geometry or a higher degree of diffusion. For example, 30 ms may be used in applications that focus on capturing the most immediate and prominent early reflections and emphasize the spatial impression of the direct sound. For example, 100 ms may be useful in situations where the reverberant nature of the acoustic environment is less important and the early reflection signal plays a more significant role in shaping the overall sound.

[0026] By providing a predefined or predetermined threshold that separates the early reflection signals and the reverberant tail signals, the audio signal processing method can be adapted to accommodate different acoustic environments and applications, ensuring an optimal balance between spatial characteristics and reverberant quality.

[0027] In general, a disclosed method for processing an audio signal receives an input audio signal and obtains two sets of reverberation parameters, each associated with a unique acoustic environment. The method processes the input audio signal based on the parameters to simultaneously generate a first early reflection signal and a second early reflection signal, the composite audio signals representing early sound reflections in their respective environments.

[0028] The method then combines the first and second early reflection signals through a fading process to generate a transient early reflection signal, which transitions from the first early reflection signal to the second early reflection signal according to the fading process or according to any intermediate step defined in the reverberation tail LUT, i.e., fading from one intermediate blending step to any intermediate blending step between the two rooms, even from one intermediate blending step to another. The output audio signal is composed of a combination of the direct input audio signal and the transient early reflection signal, providing the user with continuous audio playback during the transition.

[0029] In this approach, the early reflections and the reverberant tail are not calculated in the same process. This distinction allows parallel processing of the early reflection signals for the two different acoustic environments. As a result, the sound experience can remain uninterrupted while the listener transitions between the two environments. On the other hand, the reverberant tail signals are not processed simultaneously, and they can be switched during successive playbacks and even fade between them.

[0030] By separating the reverberation process into early reflections and reverberation tails, the method provides a more seamless audio experience when changing acoustic environments. By simultaneously calculating early reflections for both environments and then fading between them, a transient early reflection signal is generated simultaneously. This approach ensures that the audio output remains uninterrupted during the transition. The inventive approach of the audio signal processing method for separating early reflections and reverberation tails provides an improved audio experience for the user while changing between different acoustic environments. By processing those two components independently, the method ensures a smooth transition while maintaining a continuous audio playback. This distinction allows to enjoy an uninterrupted audio experience when adjusting the reverberation parameters, enhancing the overall listening experience. Thus, an advantage of the disclosed method is that it allows a continuous and seamless transition between different acoustic environments while maintaining an uninterrupted audio playback. By processing the input audio signal based on two sets of reverberation parameters and generating two early reflection signals simultaneously, the method allows a smooth blending of the acoustic characteristics of the different environments, thereby providing an immersive audio experience without any disruption in the playback.

[0031] The reverberation parameters may refer to characteristics of a given acoustic environment that affect how sound reverberates in the given acoustic environment. The term early reflections refers to early sound reflections that occur immediately after sound is emitted in the acoustic environment. The transient early reflection signal is a continuous and seamless audio signal representing a blend of early sound reflections in a first acoustic environment and a second acoustic environment, which is generated by combining a first early reflection signal and a second early reflection signal through a fading process, which can also be referred to as a blended or mixed signal representing a transition between two acoustic environments.

[0032] The first and second early reflection signals can be generated by simulating the first occurring sound reflections of the input audio signal in the respective acoustic environment. Simulating the first occurring sound reflections means replicating the early reflections of the sound waves in a particular environment. This can be achieved using mechanical models and algorithms that take into account the geometry, surfaces and materials of the acoustic environment. By accurately simulating the first occurring sound reflections, the method provides a realistic representation of the acoustic properties of different environments and improves the quality of the audio experience for the user.

[0033] The output audio signal can be output continuously to the user during the transition from the first early reflection signal to the second early reflection signal. Continuous output refers to uninterrupted playback of the audio signal during the transition between the different acoustic environments. This ensures that the user does not experience any gaps or disruptions in the audio playback. The continuous output maintains the user's immersion in the audio experience and results in a seamless transition between the different environments without any interruptions.

[0034] The direct input audio signal can be further processed based on a first set of reverberation parameters to generate a first reverberation tail signal and based on a second set of reverberation parameters to generate a second reverberation tail signal. The first reverberation tail signal and the second reverberation tail signal can be subsequently or simultaneously provided to each other and / or to the first early reflection signal and the second early reflection signal. An output audio signal can be provided that includes a combination of the direct input audio signal, the transient early reflection signal, and the first reverberation tail signal. During the continuous playback of the output audio signal and / or during the gradual transition from the first early reflection signal to the second early reflection signal, the first reverberation tail signal can be switched to the second reverberation tail signal. The output audio signal then includes the direct input audio signal, the transient early reflection signal, and the second reverberation tail signal after the switching.

[0035] The reverberant tail signal represents the late sound reflections and decay characteristics occurring in a particular acoustic environment following the early reflections. Processing the direct input audio signal based on different sets of reverberation parameters generates distinct reverberant tail signals for each environment. Switching the reverberant tail signal during successive playbacks allows for a smooth and immersive transition between different acoustic environments, maintaining a consistent audio experience for the user while reducing processing and memory resources. In other words, the terms early reflections and reverberant tail are used in the fields of audio processing and acoustics to describe different components of the output audio signal that represent reverberations in a room or acoustic environment. It is also possible to transition between a first reverberant tail signal and a second reverberant tail signal in a similar manner as for the early reflection signal.

[0036] Examples of real acoustic environments include concert halls, churches, stadiums, or small rooms, each of which has distinct reverberant characteristics due to their different sizes, shapes, and materials. In a concert hall, for example, the early reflection signal captures the early reflections from the walls, floor, and ceiling, while the reverberant tail signal represents the sustained reverberations and decay that give the hall its characteristic sound.

[0037] Acoustic environments can be designed to simulate specific real-world spaces or entire, new, unique environments. Examples of virtual venues might include virtual representations of famous concert halls, fantastical caverns with otherworldly reverberant properties, or digital simulations of intimate jazz clubs. In those cases, early reflection signals and reverberant tail signals are generated based on reverberant parameters associated with the virtual environment, providing the listener with a realistic and immersive audio experience within the simulated space.

[0038] A microphone signal may further be received, which may include an audio signal from a user. The first reverberant tail signal and the second reverberant tail signal may also be generated based on the microphone signal. The microphone signal refers to audio input captured by the microphone from the user, which may include the user's voice or other sounds. By incorporating the microphone signal into the generation of the reverberant tail signal, the method ensures that the user's input is also processed according to the changing acoustic environment. This allows for a more realistic and immersive audio experience, as the user's input is dynamically processed with the remainder of the audio signal to adapt to the changing acoustic environment.

[0039] In some embodiments, the microphone signal can be applied only to the reverberation tail, which cuts off when the microphone signal fades, in other embodiments, the microphone signal can also be applied to an early reflection network, which requires a low latency system EQ to provide a small delay in real time.

[0040] Processing the microphone signals based on the first or second set of reverberation parameters can further take into account the position of the user in the respective acoustic environment. The position of the user refers to the location of the user in the virtual or real acoustic environment. By taking into account the position of the user when processing the microphone signals, the method can more accurately simulate the sound reflection and reverberation characteristics occurring in the respective environment. Taking into account the position of the user ensures a more accurate and immersive audio experience since it takes into account the unique viewpoint of the user in the acoustic environment.

[0041] The transient early reflection signal can be a continuous and seamless audio signal that represents a blend of early sound reflections in the first and second acoustic environments. A continuous and seamless audio signal refers to an audio output that transitions smoothly between the first and second acoustic environments without any interruptions or noticeable changes in audio quality. This results in a more immersive and realistic audio experience and maintains the overall consistency of the audio reproduction, as the user experiences a smooth and uninterrupted transition between the different acoustic environments.

[0042] The first acoustic environment can correspond to a first virtual or real venue or scene, and the second acoustic environment can correspond to a second virtual or real venue or scene. Alternatively, the second acoustic environment can correspond to a user-induced parameter change of at least one parameter of the first set of parameters. A virtual venue is a digitally created acoustic environment that can be simulated using reverberant parameters. A user-induced parameter change refers to an adjustment made by a user to one or more parameters of the reverberant parameters that may affect the characteristics of the acoustic environment. This provides greater flexibility and customization to users, as they can transition between predefined virtual venues and make adjustments to parameters of existing environments, allowing users to adapt the audio experience to their preferences.

[0043] The reverberant parameter changes can be introduced by a user through an interface or control system that allows the user to adjust various aspects of the reverberant parameters associated with the first acoustic environment. Such adjustments can include modifying the room size, shape, surface materials, and the position of the listener within the material environment. The user can make those adjustments using physical controls, such as knobs or sliders, or through a software interface that provides a visual representation of the acoustic environment and associated parameters.

[0044] In conventional audio processing systems, changing the reverberant parameters of an environment typically results in short interruptions in audio playback. These interruptions occur because the system needs to recalculate and reload the early reflections and reverberant tail signals based on the new parameters. During this process, the audio output may be muted and cut off, creating an undesirable break in the audio experience for the user.

[0045] The present invention improves upon this limitation by splitting the processing of the reverberant tail and early reflection signals. By simultaneously generating and providing the first and second early reflection signals, the method allows seamless and continuous audio playback while the user adjusts parameters of the acoustic environment. As the user dials in new parameters, a transient early reflection signal is generated through a fading process that smoothly blends the first and second early reflection signals. This ensures that the main audio and early reflections are not interrupted, resulting in a seamless audio experience. Because the early reflections and main audio signal remain uninterrupted, the overall effect of the reverberant tail interruption is minimized, resulting in a more immersive and smooth audio experience.

[0046] The first early reflection signal and the second early reflection signal can be generated and / or provided simultaneously. Providing the early reflection signals simultaneously means that both signals are generated at the same time and are available for processing at the same time. This allows for smooth and seamless blending of the early reflection signals during transitions between acoustic environments. The simultaneous provision of the early reflection signals ensures a more immersive and consistent audio experience, so that the user can smoothly transition between different acoustic environments without any interruption or noticeable change in audio quality.

[0047] The computer-implemented method can include compensating for latency in a transient early reflection signal. The direct audio signal, the early reflection signal, and the reverberant tail signal are synchronized based on a latency control signal. The latency compensation ensures that the different audio signals remain synchronized during transitions between environments. By analyzing processing delays in the audio processing chain, a latency control signal can be generated. This allows for a seamless audio experience as the audio signals remain synchronized, preventing any noticeable artifacts or interruptions in audio playback.

[0048] The generation of the first and second reverberant tail signals can be controlled using a reverberant tail control signal. The control signal is based on a look-up table that contains the reverberant tail parameters of the first and second acoustic environments. The reverberant tail control signal can be a data-driven approach to managing the tail parameters of the reverberant effect. The look-up table can store different sets of parameters for various environments, allowing smooth transitions between them. This approach allows for a more precise and customizable audio experience as it allows for precise control over the reverberant tail characteristics in different virtual venues.

[0049] An equalization filter can be applied to the first reverberant tail signal and the second reverberant tail signal. The equalization filter shapes the tonal characteristics of the reverberant tail. The equalization filter can adjust the frequency response of the reverberant tail signals, providing further control over their tonal characteristics. This helps to better match the desired sound of the virtual environment. Applying the equalization filter to the reverberant tail signals enhances the overall audio experience by enabling a more realistic and immersive sound when transitioning between virtual venues.

[0050] The input audio signal can be a multi-channel audio signal. Multi-channel audio signals provide a more immersive and spatially accurate sound experience. This can include formats such as stereo, surround sound, or even more advanced 3D audio formats. Processing the multi-channel audio signal enables a more engaging and realistic audio experience in different virtual venues, providing a richer and more immersive listening experience for the user.

[0051] The fading process can be adaptive based on user input controlling the blending of the first and second early reflection signals in the transient early reflection signal. Adaptive fading allows the user to control the blending of the early reflection signals, giving more control over transitions between virtual venues. This can be done using a variety of user interface elements or input devices. By providing adaptive fading, the user can achieve a more personalized audio experience, allowing for smoother transitions and more control over the characteristics of the audio playback.

[0052] The computer-implemented method can include routing a direct input audio signal and a transient early reflection signal to a multi-channel 3D surround system. This generates a 3D audio signal that is provided to a system equalization filter for recreating room compensation at the loudspeaker level. This generates an output audio signal. The 3D audio signal processing and room compensation techniques can increase the spatial accuracy of the audio reproduction, resulting in a more immersive and realistic audio experience. This can be achieved using a variety of equalization and spatial processing algorithms. The incorporation of 3D audio and room compensation techniques ensures a more accurate and immersive audio experience for users regardless of their particular listening environment.

[0053] The first and second sets of reverberation parameters can be derived from a database of real-world or virtual acoustic environments. The database can store reverberation parameters for a variety of environments, allowing accurate reproduction of their acoustic characteristics. This can include real-world venues or virtual environments designed for specific purposes. By utilizing the database of reverberation parameters, the system can provide a more accurate and realistic audio experience, allowing users to immerse themselves in a wide range of virtual venues.

[0054] The methods or any combination of the methods can be implemented, for example, by an audio signal processing system, a computing device, or an audio system, as described below. Such a system of devices can be adapted to perform any method or combination of methods as described in this disclosure.

[0055] A corresponding audio system is provided that is adapted to process audio signals by performing the following steps: The audio system includes at least one processor, a memory, and optionally at least one loudspeaker and at least one microphone, which may be arranged at predefined positions around a user that can hear the audio signals generated by the audio system, and through which an audio input may be generated.

[0056] In the step of receiving the input audio signal, the processing unit of the audio system obtains an audio signal to be output to the user together with reverberations. This signal and optionally the microphone signal can be used to generate an immersive audio experience in the virtual environment.

[0057] In obtaining a first set of reverberation parameters, the system retrieves parameters associated with a first acoustic environment, the parameters defining characteristics of the reverberation effect within the first acoustic environment.

[0058] In obtaining a second set of reverberation parameters, the system retrieves parameters associated with a second acoustic environment that is different from the first environment, the parameters defining characteristics of the reverberation effect in the second acoustic environment.

[0059] In the step of processing the input audio signal, the audio system processes the input audio signal based on a first set and a second set of reverberation parameters. This generates a first early reflection signal for a first acoustic environment and a second early reflection signal for a second acoustic environment. Each early reflection signal includes a composite audio signal representative of early sound reflections in their respective environments and does not include a reverberation tail signal, i.e., a later occurring reverberation high frequency. In other words, the reverberation signal processing is split and switched between early reverberation signals provided in parallel to the two acoustic environments and late reverberation signals provided to only one respective acoustic environment at a certain point in time.

[0060] In the step of combining the first early reflection signal and the second early reflection signal, the audio system uses a fading process to generate a transient early reflection signal that represents a transition from the first early reflection signal to the second early reflection signal to ensure a smooth and continuous audio playback experience as the user moves between environments.

[0061] In the step of providing an output audio signal, the audio system generates an output signal including a combination of the direct input audio signal and the transient early reflection signal, the combined output signal producing a realistic and immersive audio experience for a user and simulating the sounds of the virtual environment.

[0062] A computing device is configured for processing an audio signal according to a method of the present disclosure, the computing device including a memory, an interface, and at least one processing unit, the memory containing instructions executable by said at least one processing unit, execution of the instructions causing the computing device to perform any method or combination of methods of the present disclosure.

[0063] The computer program, or computer program product, comprises program code to be executed by at least one processor of a computing device, where execution of the program code causes the at least one processor to perform one of the methods for processing an audio signal according to the present disclosure.

[0064] The computer-readable storage medium, when executed by a processor, causes the processor to perform any method or combination of methods according to the present disclosure.

[0065] For such a computing device, audio system, computer program, and computer-readable storage medium for processing an audio signal, technical effects corresponding to those described for the method and audio system for processing an audio signal may be achieved.

[0066] It is understood that the features mentioned above or described below can be used not only in the respective combinations shown, but also in other combinations or in isolation without departing from the scope of the present disclosure. In particular, the features mentioned above and described below can be used not only in the respective combinations shown, but also in other combinations or in isolation without departing from the scope of the present disclosure.

[0067] As such, the above summary is intended to provide a brief overview of some embodiments and features of some implementations and is not to be construed as limiting, as other embodiments may include features in addition to those described above.

[0068] These and other objects of the present invention will be appreciated and understood by those skilled in the art from the detailed description of the preferred embodiment and the following drawings, in which like reference numerals refer to like elements and in which: The present invention provides, for example, the following: (Item 1) 1. A computer-implemented method for audio signal processing by an audio system including a processing unit, comprising: receiving an input audio signal to be output to a user together with reverberations; - obtaining a first set of reverberation parameters associated with a first acoustic environment; - obtaining a second set of reverberation parameters associated with a second acoustic environment, the second set of reverberation parameters being different from the first set of reverberation parameters; - processing the input audio signal based on the first set of reverberation parameters to generate a first early reflection signal and based on the second set of reverberation parameters to generate a second early reflection signal, each of the first early reflection signal and the second early reflection signal comprising a respective synthesized audio signal representative of early sound reflections in a respective acoustic environment; - combining the first early reflection signal and the second early reflection signal through a fading process to generate a transient early reflection signal including a transition from the first early reflection signal to the second early reflection signal according to a fading process; - providing an output audio signal comprising a combination of said direct input audio signal and said transient early reflection signal; The computer-implemented method comprising: (Item 2) The computer-implemented method of the preceding item, wherein the first early reflection signal and the second early reflection signal are generated by simulating only the first occurring sound reflections of the input audio signal in the respective acoustic environments. (Item 3) - continuously outputting the output audio signal to the user during a transition from the first early reflection signal to the second early reflection signal. (Item 4) - processing the direct input audio signal based on the first set of reverberation parameters to generate a first reverberation tail signal, and based on the second set of reverberation parameters to generate a second reverberation tail signal; - providing the output audio signal comprising a combination of the direct input audio signal, the transient early reflection signal, and the first reverberation tail signal; - switching from the first reverberation tail signal to the second reverberation tail signal during the continuous playback of the output audio signal to provide the output audio signal comprising the direct input audio signal, the transient early reflection signal, and the second reverberation tail signal; 20. The computer-implemented method of any one of the preceding claims, further comprising: (Item 5) The computer-implemented method of any one of the preceding claims, wherein the first reverberation tail signal and the second reverberation tail signal comprise synthetic speech signals representing opportunity sound reflections and attenuation characteristics occurring within the respective acoustic environments following the early reflections within the respective acoustic environments. (Item 6) - receiving a microphone signal comprising a voice signal from the user; generating the first reverberation tail signal and the second reverberation tail signal further based on the microphone signal; 20. The computer-implemented method of any one of the preceding claims, further comprising: (Item 7) 2. The computer-implemented method of claim 1, wherein processing the microphone signals based on the first or second set of reverberation parameters further takes into account the position of the user within the respective acoustic environment. (Item 8) 2. The computer-implemented method of claim 1, wherein the transient early reflection signal is a continuous and seamless audio signal representing a blend of early sound reflections in the first acoustic environment and the second acoustic environment. (Item 9) the first acoustic environment corresponds to a first virtual venue and the second acoustic environment corresponds to a second virtual venue; or the second acoustic environment responds to a user-induced parameter change of at least one parameter of the first set of parameters. 2. A computer-implemented method according to any one of the preceding items. (Item 10) 2. The computer-implemented method of claim 1, wherein the first early reflection signal and the second early reflection signal are provided simultaneously. (Item 11) - compensating for latency in the transient early reflection signal to synchronize the direct speech signal, early reflection signal, and / or reverberation tail signal based on a latency control signal. (Item 12) The computer-implemented method of any one of the preceding claims, wherein generating the first reverberation tail signal and the second reverberation tail signal is controlled using a reverberation tail control signal based on a look-up table containing the reverberation tail parameters of the first acoustic environment and the second acoustic environment. (Item 13) 5. The computer-implemented method of claim 1, further comprising applying an equalization filter to the first reverberation tail signal and the second reverberation tail signal to shape the tonal characteristics of the reverberation tail. (Item 14) 13. The computer-implemented method of any one of the preceding claims, wherein the input audio signal is a multi-channel audio signal. (Item 15) 2. The computer-implemented method of claim 1, wherein the fading step is adaptive based on a user input controlling the blending of the first early reflection signal and the second early reflection signal in the transient early reflection signal. (Item 16) - routing said direct input sound signal and said transient early reflection signal to a multi-channel 3D surround system to generate a 3D sound signal; - providing the 3D audio signal to a system equalization filter for reconstructed room compensation at loudspeaker level to generate the output audio signal; 20. The computer-implemented method of any one of the preceding claims, further comprising: (Item 17) 2. The computer-implemented method of claim 1, wherein the first and second sets of reverberation parameters are derived from a database of real-world or virtual acoustic environments. (Item 18) 1. An audio system including at least one processing unit, receiving an input audio signal to be output to a user together with reverberations; - obtaining a first set of reverberation parameters associated with a first acoustic environment; - obtaining a second set of reverberation parameters associated with a second acoustic environment, the second set of reverberation parameters being different from the first set of reverberation parameters; - processing the input audio signal based on the first set of reverberation parameters to generate a first early reflection signal and based on the second set of reverberation parameters to generate a second early reflection signal, each of the first early reflection signal and the second early reflection signal comprising a respective synthesized audio signal representative of early sound reflections within the respective acoustic environment; - combining the first early reflection signal and the second early reflection signal through a fading process to generate a transient early reflection signal including a transition from the first early reflection signal to the second early reflection signal according to a fading process; - providing an output audio signal based on said transient early reflection signal; The audio system is configured to perform the steps of: (Item 19) 2. An audio system according to any one of the preceding items, further configured to perform a method according to any one of the preceding items. (Summary) A computer-implemented method for audio signal processing involves receiving an input audio signal, obtaining reverberation parameters associated with two distinct acoustic environments, and simultaneously generating early reflection signals for each acoustic environment. The early reflection signals are then combined through a fading process to create a continuous transient early reflection signal during a transition between the two environments according to the fading process. In addition, a reverberation tail is generated and combined with the transient early reflection signal. An output audio signal is provided as a combination of the direct input audio signal, the transient early reflection signal, and the reverberation tail, which are differentially switched, resulting in a seamless and immersive listening experience for the user. [Brief description of the drawings]

[0069] [Figure 1] 1 illustrates generally a flow chart for audio and control signal flow in an audio system, according to various embodiments. [Diagram 2]2 illustrates generally the steps of a method for processing an audio signal, according to various embodiments; [Diagram 3] 1 illustrates a schematic diagram of an audio system according to various embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0070] In the following, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be understood that the following description of the embodiments should not be interpreted in a limiting sense. The scope of the present invention is not intended to be limited to the embodiments or drawings described below, but rather to be interpreted as illustrating examples of the overall inventive concept. Unless otherwise stated, the features of the various embodiments can be combined with each other.

[0071] Some embodiments of the present disclosure generally provide a number of circuits, data storage devices, connections, or electrical devices, such as, for example, processors. All references to those entities, other electrical devices, and the functionality provided by each are not intended to be limited to include only those illustrated and described herein. While specific labels may be assigned to the various circuits or other electrical devices disclosed, such labels are not intended to limit the scope of operations for the circuits and other electrical devices. Such circuits and other electrical devices may be combined with each other and / or separated in any manner based on the particular type of electrical implementation desired. Any circuit or other electrical device disclosed herein may include any number of microcontrollers, graphics processor units (GPUs), integrated circuits, memory devices (e.g., flash, random access memory (RAM), read-only memory (ROM), electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or other suitable variations thereof), and software that cooperate with each other to perform the operation(s) disclosed herein. In addition, any one or more of the electrical devices may be configured to execute program code embodied in a non-transitory computer-readable medium programmed to perform any number of functions as disclosed.

[0072] The drawings should be considered as schematic representations, and the illustrated elements in the drawings are not necessarily drawn to scale. Rather, the various elements are represented so that their function and general purpose are apparent to a person skilled in the art. Any connection or coupling between functional blocks, devices, components or physical or functional units shown in the drawings or described herein may be performed by indirect connections or couplings. Coupling between components may be established through wired or wireless connections. The functional blocks may be implemented in hardware, firmware, software or a combination thereof.

[0073] Below, techniques are described for transitioning between different reverberation settings, or adapting reverberation parameters while maintaining continuous audio playback, without degrading sound quality or introducing undesirable artifacts.

[0074] FIG. 1 illustrates generally a flow chart for audio and control signal flow in an audio system, according to various embodiments.

[0075] As described in conjunction with Figure 1, the audio signal processing method enhances the listener's experience by providing a seamless transition between two acoustic environments. The technique may be particularly relevant to live room reverberation techniques, where continuous audio reproduction is desired as room reverberation parameters change. The invention achieves this by splitting the reverberation tail processing and early reflection processing, thus maintaining continuous audio reproduction while the user changes to different venues or intermediate parameters set between two virtual venues.

[0076] The audio signal flow for this live room reverberation technique involves processing both an input audio signal, also referred to as an audio source signal, such as music, conference, or entertainment audio, and an audio input, such as a microphone signal that captures speech from a person within a listening environment, such as the interior of a car.

[0077] The flow chart of the signal processing method starts with an audio source providing an input audio signal, which can be in stereo or surround format. The input audio signal is sent to a processing unit via a mixer / router, where it can be mixed with additional microphone signals, which generates an early reflection signal based on the early reflection patterns of two different acoustic environments, e.g., Room A and Room B. The early reflection signal can be created in a 3D surround format to provide a realistic audio experience.

[0078] In the audio processing step of early reflection patterns A and B, which can be performed by corresponding processing units, specific early reflections for both Room A and Room B are generated. Both patterns are provided simultaneously as the output of the step. The two separate early reflection audio signals then enter a multi-channel fader, called early reflection fader A / B, which fades between the early reflection patterns of Room A and Room B according to a control signal. This fading process generates a transient early reflection signal, which represents a continuous and seamless blend of the first and second early reflection signals, including a mixture of early sound reflections in the first and second acoustic environments.

[0079] In other words, the audio source signals (stereo or surround) are first processed to generate characteristic early reflection signals for two different acoustic environments in parallel. Those patterns are then combined by a multi-channel fader into a transient early reflection signal that includes a gradual transition from the first early reflection signal to the second early reflection signal, i.e., blended using a . The transient early reflection signal and the direct signal are then distributed to the early reflection router.

[0080] From the early reflection router the direct input audio signal and the transient early reflection signal are routed to a multi-channel 3D surround system to generate a 3D audio signal, which is further provided to an FIR filter system EQ unit, which applies system equalization for the reproduced room at the loudspeaker level so that the audio signal is optimized for the specific listening environment and provides it to the summation step. The combined direct and early reflection signals are continuously provided to the listener, even when transitions between reverberation parameters are to be made.

[0081] From the early reflection router, the direct sound signal and the transient early reflection signal are further distributed to an early reflection downmixer, which generates a downmix of the direct sound signal and the early reflection signal (combined direct / early reflection signal) into a two-channel stereo format or any other format that can be processed by a reverberation engine or unit. This downmix allows compatibility with a variety of audio formats and systems.

[0082] Latency compensation based on the latency control signal is applied to the combined direct signal and the transient early reflection signal from the downmixer to synchronize the audio signal including the continuous direct signal and early reflection signals and the reverberant tail signal to be generated. This synchronization ensures that the output audio signal remains coherent and artifact-free during the transition between the two acoustic environments.

[0083] The latency compensation is performed by a latency compensation unit to synchronize the reverberation tail signal to be generated in the reverberation unit with the direct signal including early reflections. This synchronization is achieved by controlling the latency compensation unit with a control signal based on a latency calculation look-up table (LUT). The audio signal is then sent to the reverberation unit, which produces the reverberation tail.

[0084] In the reverberation unit, using the parameter set provided by the reverberation tail LUT, the reverberation tail is generated for the direct / early reflection signal. When the parameters change from the first set of reverberation parameters to the second set of reverberation parameters, the reverberation unit may undergo a short mute phase to reconstruct the reverberation network. However, the direct signal and early reflections are not affected by this mute phase and provide a continuous sound to the FIR filter system EQ and summation step.

[0085] The tonal characteristics of the reverberation tail are shaped by a reverberation tail EQ and level unit, which is controlled by the reverberation control signal, in particular the reverberation tail LUT. The filtered multi-channel audio is then sent to a low latency system EQ unit which also provides a system EQ for the reproduction room at the loudspeaker level, and is also controlled by the reverberation control signal based on the reverberation tail LUT.

[0086] At the same time, an additional microphone signal capturing speech inside the vehicle is received and linearized by the microphone EQ unit. The linearized microphone signal is then equalized by the microphone balancing unit before being sent to the reverberation unit via the mixer / router and an optional additional microphone balancing unit. The reverberation unit can include the microphone signal of the user in the respective acoustic environment when processing the microphone signal based on the first or second set of reverberation parameters. Thereby, the user voice can also be output through the audio system loudspeaker with the same reverberation effect, for example a corresponding reverberation tail signal, as the input audio signal. Thus, the microphone signal can be included in the output signal of the reverberation unit. It is also possible to provide the microphone signal with an early reflection and a reverberation tail reverberation process, or simply an early reflection reverberation process.

[0087] The outputs of the FIR filter system EQ and the low latency system EQ are summed in a summation step and the resulting audio signal is provided to a loudspeaker for playback.

[0088] The described method allows for continuous output of the audio signal during the transition from the first to the second early reflection signal, ensuring an uninterrupted listening experience. As a user dials in a new venue or changes parameters of a current venue, the transient early reflection signal represents a blend of early sound reflections in the first and second acoustic environments, resulting in a smooth and seamless transition.

[0089] The method particularly includes processing the direct input audio signal based on a first set of reverberation parameters to generate a first reverberant tail signal and based on a second set of reverberant parameters to generate a second reverberant tail signal. The output audio signal includes a combination of the direct input audio signal, the transient early reflection signal, and the first reverberant tail signal. During continuous playback of the output audio signal, the system switches from the first reverberant tail signal to the second reverberant tail signal to provide an output audio signal including the direct input audio signal, the transient early reflection signal, and the second reverberant tail signal.

[0090] Early reflections refer to early sound reflections that arrive at the listener immediately after the direct sound, usually within the first few milliseconds. These reflections provide important spatial cues and contribute to the perception of the size and shape of the room. In other words, early reflections refer to an audio signal that is generated by simulating early sound reflections in a room or acoustic environment. This early reflection signal can then be mixed with the direct sound signal to create the complete audio signal that is to be reproduced. By combining the direct sound and the early reflections, the resulting audio reproduction simulates a more realistic and spatially accurate listening experience as it mimics how sound behaves in a real-world environment.

[0091] On the other hand, the reverberation tail refers to the later part of the reverberation, which is composed of multiple complex reflections that gradually decay over time. The reverberation tail contributes to the overall ambience and character of the space. In other words, the reverberation tail is implemented by simulating the complex late reflections that occur in a room or acoustic environment after the early reflections have occurred. This process typically involves using digital signal processing techniques such as convolutional or algorithmic reverberation to produce a dense series of echoes that decay over time, creating a perception of natural sustained reverberation. The reverberation tail can be mixed with the sound signal, which includes both the direct sound and the early reflections. This combination results in a complete sound reproduction, which simulates the full range of reverberations present in a real-world acoustic environment, resulting in an immersive and natural sound listening experience.

[0092] The direct sound signal represents the unprocessed sound traveling from the sound source to the listener without any reflections or reverberations. This signal provides the primary sound information and is combined or aggregated with the early reflection signals and the reverberant tail signals to produce a complete and realistic representation of the acoustic environment.

[0093] Thus, the transient early reflection signal represents a continuous and seamless audio signal representing a blend of early sound reflections in a first acoustic environment and a second acoustic environment. The first acoustic environment may correspond to a first virtual venue and the second acoustic environment may correspond to a second virtual venue or a user-induced parameter change of at least one parameter of the first set of parameters. Both the first early reflection signal and the second early reflection signal are provided simultaneously, ensuring that the transient early reflection signal remains uninterrupted during the fading process.

[0094] The first and second reverberant tail signals include synthetic speech signals representative of late sound reflections and attenuation characteristics occurring within the respective acoustic environments following early reflections within the respective acoustic environments, and may further be generated using microphone signals received from the user, taking into account the position of the user within the respective acoustic environments.

[0095] The final output from the summation step to the loudspeaker is a continuous audio playback that allows seamless adjustment of reverberation parameters while preserving the direct signal and early reflections throughout the process. This results in a smooth transition between different virtual acoustic environments, and speech captured by the microphone is also played back with the desired reverberation effects.

[0096] The acoustic environments in this live room reverberation technology can be representations of virtual or real spaces different from the current listening room. These environments can include concert halls, theaters, churches, stadiums, or even outdoor settings such as forests, canyons, or city streets. By simulating the acoustic properties of these environments, the system provides listeners with an immersive experience, making them feel as if they are in a completely different space, such as the interior of a car, while remaining in their current listening room. This seamless adjustment of reverberation parameters enhances the listening experience by creating realistic representations of various acoustic environments for both the audio source signal and the captured speech from the microphone.

[0097] The generation of the first and second reverberant tail signals is controlled using a reverberant tail control signal based on a reverberant tail look-up table (LUT) containing reverberant tail parameters of the first and second acoustic environments, which enables the system to accurately reproduce the reverberant characteristics of the selected environment during the transition.

[0098] Also, based on the reverberation tail LUT, an equalization is applied to the first reverberation tail signal and the second reverberation tail signal to shape the tonal characteristics of the reverberation tail. This equalization ensures that the reverberation tail signal is smoothly blended with the direct input audio signal and the transient early reflection signal.

[0099] The reverberant tail audio signal can be discretely switched between a first parameter setting and a second parameter setting.

[0100] The input audio signal can be a multi-channel audio signal, allowing the system to adapt to a variety of audio formats and playback environments. The fading process is adaptive based on a user input that controls the blending of the first and second early reflection signals in the transient early reflection signal, allowing the user to fine-tune the transition between two acoustic environments.

[0101] The first and second sets of reverberation parameters are derived from a database of real-world or virtual acoustic environments to ensure that the generated early reflection and reverberation tail signals accurately represent the acoustic characteristics of the selected environment.

[0102] In conclusion, this computer-implemented method for audio signal processing allows seamless transition between different acoustic environments in live room reverberation technology. By splitting the reverberation tail processing and the early reflection processing, the present invention maintains continuous audio playback while allowing the user to dial in a new venue or an intermediate parameter set between two venues. The transient early reflection signal, which is a blend of the first early reflection signal and the second early reflection signal, ensures a smooth and uninterrupted listening experience.

[0103] The method offers significant advances for a variety of audio applications, such as live sound reinforcement, virtual reality audio, and immersive audio experiences in movies and video games. By providing realistic and seamless transitions between different acoustic environments, the method enhances listener immersion and engagement with the audio content.

[0104] The adaptive fading process allows the user to fine-tune the blending of the first and second early reflection signals in the transient early reflection signal, giving them greater control over their audio experience. In addition, multi-channel audio signal support ensures that the system can adapt to a wide range of audio formats and playback environments, making it suitable for a variety of audio applications.

[0105] The latency compensation feature synchronizes the direct speech signal, the early reflection signal, and the reverberant tail signal to ensure a coherent, artifact-free output speech signal during transitions between acoustic environments. The equalization filter applied to the first and second reverberant tail signals shapes the tonal characteristics of the reverberant tail and contributes to a smooth blending of the signals in the output speech.

[0106] The use of a real-world environment database or a virtual acoustic environment database to generate the first and second sets of reverberation parameters ensures that the early reflections and reverberant tail signals accurately represent the acoustic characteristics of the selected environment, a feature that contributes to the realism and immersion of the audio experience.

[0107] The inventive audio signal processing method further includes incorporating microphone signals into early reflection processing, potentially enabling a more realistic and immersive audio experience. In addition, the system can implement fading between different reverberant tail signals for smoother and seamless transitions between acoustic environments. Furthermore, the signal processing can be split into three or more signals, such as early reflections, mid-reflection, and late reflections, and a similar fading process can be performed on the three or more signals, giving the user gradual control over blending and transitioning between different acoustic environments. Alternative methods of controlling reverberant tail switching, such as machine learning algorithms or predictive models, can be explored to improve the efficiency and accuracy of transitions between tails, potentially leading to a more immersive and realistic audio experience.

[0108] Thereby, the inventive audio signal processing method provides an effective solution for seamless transitions between different acoustic environments in various audio applications. By maintaining continuous audio playback and providing a smooth and immersive listening experience, the method significantly enhances user engagement with audio content. Its adaptability and compatibility with a wide range of audio formats and playback environments makes it suitable for a wide spectrum of applications, from live sound reinforcement and virtual reality audio to immersive audio experiences in movies and video games.

[0109] FIG. 2 illustrates generally steps of a method for processing an audio signal according to various embodiments.

[0110] The method starts at step S10. At step S20, an input audio signal is received, which is to be output to a user with reverberation. At step S30, a first set of reverberation parameters associated with a first acoustic environment is obtained, and a second set of reverberation parameters associated with a second acoustic environment different from the first set of reverberation parameters is also obtained.

[0111] In step S40, the input audio signal is processed based on a first set of reverberation parameters to generate a first early reflection signal and based on a second set of reverberation parameters to generate a second early reflection signal, each of the first early reflection signal and the second early reflection signal comprising a respective synthetic audio signal representative of early sound reflections in the respective acoustic environment.

[0112] In step S50, the first early reflection signal and the second early reflection signal are combined through a fading process to generate a transient early reflection signal, where the transient early reflection signal includes a transition from the first early reflection signal to the second early reflection signal according to the fading process.

[0113] Finally, in step S60, an output audio signal is provided based on the transient early reflection signal.The method ends in step S60.

[0114] FIG. 3 illustrates a schematic of an audio system, according to various embodiments.

[0115] As seen in Fig. 3, the audio system is composed of a processing device, a loudspeaker, and one or more microphones. The processing device includes a processor and a memory that work together to handle audio processing tasks. The loudspeaker is in charge of playing the processed audio, while the microphone captures the sound input that will be processed by the system. This audio system works with the described invention to provide continuous audio playback by modifying room reverberation parameters.

[0116] From the above, the following general conclusions can be drawn:

[0117] The overall idea allows for continuous audio playback of audio signals in live room reverberation technology while room reverberation parameters are changed. This is achieved by splitting the reverberation tail processing and the early reflection processing. By simultaneously providing early reflection patterns (i.e. audio signals) for two different virtual venues (Rooms A and B) and using a multi-channel fader to fade between them, the present invention allows for smooth transitions without muting the audio when changing parameters or switching between venues. This enhances the user experience and allows more flexibility in adjusting reverberation settings during live performance or audio production.

[0118] The fading between two different early reflection signals may involve a gradual transition or blending process, in which the amplitude of one signal is gradually decreased while the amplitude of the other signal is simultaneously increased. In that way, the contributions of the first and second early reflection signals in the transient early reflection signal change in a gradual manner. This process allows for a smooth and continuous change between the two signals, allowing for any intermediate steps or combinations of signals. The fading between the audio signals creates a seamless transition, which minimizes abrupt changes, enhances the listening experience, and makes it ideal for applications such as cross-fading between tracks, transitions between different audio effects, or blending of audio sources in a virtual environment. Such a process may also be described as gradual combining of signals, or transition / blending between signals.

[0119] The fading process can be described in various ways, such as gradually changing, fading between, transitioning between, or combining the first and second early reflection signals, which allows for the creation of an intermediate parameter set that represents a smooth progression between the first and second early reflection signals.

[0120] During this process, a transient early reflection signal is generated by gradually adjusting the contribution of each early reflection signal, ensuring a seamless transition between the two acoustic environments. This approach allows for a continuous sound playback experience, so that the user can perceive changes in the reverberation parameters without experiencing any abrupt shifts or interruptions in the sound output.

[0121] In other words, transitioning between two audio signals involves a smooth, progressive adjustment, where the strength of one signal decreases as the strength of the other signal increases. This method facilitates a continuous shift between the signals, adapting to any intermediate blend or ratio. Such seamless transitions are essential to minimize abrupt changes, improving the listening experience and well suited for applications such as cross-fading between songs, moving between distinct audio effects, and combining audio sources within a simulated space. Transitioning between two audio signals, along with gradual combining, may consist of a gradual, continuous modification, where the volume of one signal decreases while the volume of the other signal increases simultaneously. This process allows for a seamless change between the two signals, allowing for any intermediate mix or balance. Seamless fading is essential to prevent abrupt shifts, enhancing the overall auditory experience, making it perfect for scenarios of blending and transitioning between different reverberation settings within a virtual environment.

[0122] In the audio signal processing method, a first early reflection signal and a second early reflection signal are calculated and provided simultaneously with the first tail signal. This simultaneous processing allows for a smooth and seamless transition between the two acoustic environments as the early reflection signals are faded from each other, creating a transient early reflection signal.

[0123] While the early reflection signals are faded and combined, the first tail signal is applied to the audio output. The tail signal is not provided simultaneously or faded as the early reflection signals. Instead, the first tail signal is processed and applied to the audio output during the early reflection fading process.

[0124] Once the early reflection fading process is complete, or during the fading process, the tail signal is then switched from the first tail signal to a second tail signal, which may be done without simultaneous processing or fading of the tail signal, where the resulting audio output includes the direct input audio signal, the transient early reflection signal, and the second tail signal that reflects changes in the acoustic environment.

[0125] This approach ensures that the audio experience remains uninterrupted while the listener transitions between the two environments. The simultaneous calculation and provision of the first and second early reflection signals in combination with the application of the first tail signal allows for a smooth fading process. On the other hand, the reverberant tail signals are not processed simultaneously, and they are switched between successive playbacks to complete the transition to the new acoustic environment.

[0126] The early reflection signal may be a synthetic audio signal that represents the initial series of sound reflections that occur in the acoustic environment shortly after a direct sound is produced. These reflections result from sound waves bouncing off surfaces such as walls, ceilings, and floors in the environment, and they typically reach the listener within the first few milliseconds after the direct sound.

[0127] The early reflection signal is generated through various audio processing techniques, such as convolution with digital signal processing algorithms or impulse responses, to simulate the spatial and temporal characteristics of the early reflections. This synthetic signal captures critical information about the size, shape, and acoustic properties of the virtual or physical space, providing important spatial cues and contributing to realism in depth perception and the listening experience.

[0128] When the early reflection signal is combined with the direct sound signal, it produces a more immersive and spatially accurate sound reproduction as it replicates the natural behavior of sound in real-world environments. Early reflection signals play an important role in sound processing applications such as room simulation, virtual reality, and 3D sound rendering, where recreating a realistic and convincing acoustic environment is essential.

[0129] Outputting an audio signal based on the transient early reflection signal may include providing as the output signal a combination of the direct (i.e., original) audio signal and the transient early reflection signal.

[0130] The fading between the two early reflection signals can be achieved in a variety of ways, including directly mixing the early reflection signals or first combining them with another signal, such as direct audio, before performing the fading. In either approach, the objective is to ensure that the effect of the first early reflection gradually fades in the output signal while the effect of the second early reflection increases. This process continues until one of the early reflection signals is the only contributor to the output, resulting in a smooth and seamless transition between the two early reflection signals and their respective acoustic characteristics. Thus, all fading combinations of signals should be included that have the effect of decreasing the effect of the first early reflection signal on the listening experience and increasing the effect of the second early reflection signal on the listening experience. In other words, the fading between the first and second reverberation signals to generate a transient early reflection signal, which is a combination of the first and second reverberation signals, is based on the fading characteristics.

[0131] The method may optionally include receiving or requesting a first set of reverberation parameters corresponding to a first (virtual) reverberation setting or scenario in which reverberation is to be applied to the input audio signal, and a second set of reverberation parameters corresponding to a second (virtual) reverberation setting or scenario in which reverberation is to be applied to the input audio signal.

[0132] Processing based on the first and second sets of reverberation parameters may be performed simultaneously or in parallel, and the first early reflection signal and the second early reflection signal may be provided, for example, in real time synchronous with the microphone signal, simultaneously with each other, i.e. substantially simultaneously, and / or in parallel.

[0133] The input audio signal is to be reverberated, in other words the input audio signal is intended for or undergoes reverberation processing, in other words the purpose of processing the input audio signal is to apply a reverberation effect to it. Thus, the input audio signal undergoes reverberation processing according to various reverberation settings, parameters, situations and virtual room or venue characteristics, and the reverberation applied to the input audio signal can be adjusted and customized based on different sets of reverberation parameters.

[0134] An audio signal that includes early reflections may be referred to as an early reverberation signal, which may be a combination of the original (direct) audio signal and early reflections, which form the early part of the reverberation process.

[0135] The first reverberant signal may represent a first reverberant parameter, i.e., an early reflection pattern of the audio signal based on a first reverberant setting or situation, and the second reverberant signal represents a second reverberant parameter, i.e., an early reflection pattern of the audio signal based on a second reverberant setting or situation, The first and second reverberant parameters, reverberant settings may be different from each other.

[0136] The first set of reverberation parameters may correspond to a first reverberation setting, in particular a first virtual room or venue, such that the first reverberation signal represents the first reverberation setting, and the second set of reverberation parameters may correspond to a second reverberation setting, in particular a second virtual room or venue, such that the second reverberation signal represents the second reverberation setting.

[0137] First, the direct sound signal is combined with a transient early reflection signal, which is created through a fading process of the first early reflection signal and the second early reflection signal. This combination of the direct sound signal and the transient early reflection signal represents the spatial characteristics of the acoustic environment and is output successively during the fading process.

[0138] While the early reflection fading process is taking place, the first reverberant tail signal is applied to the audio output. The reverberant tail signal is simultaneously combined with the direct audio signal and the early reflection signal. Alternatively, it is processed and applied separately during successive playback of the output audio signal.

[0139] Once the early reflection fading process is complete and the transient early reflection signal is established, the reverberant tail signal is then switched from the first tail signal to the second tail signal, ensuring that the reverberant quality of the new acoustic environment is accurately represented.

[0140] By serially processing and combining the direct sound signal, the early reflection signal, and the reverberant tail signal, the sound signal processing method maintains continuity and consistency of the sound output while transitioning between different acoustic environments.

[0141] In summary, a computer-implemented method for audio signal processing involves receiving an input audio signal, obtaining reverberation parameters associated with two distinct acoustic environments, and simultaneously generating early reflection signals for each acoustic environment. The early reflection signals are then combined through a fading process to create a continuous transient early reflection signal during the transition between the two environments according to the fading process. In addition, a reverberation tail is generated and combined with the transient early reflection signal. An output audio signal is provided as a combination of the direct input audio signal, the transient early reflection signal, and the reverberation tail, resulting in a seamless and immersive listening experience for the user.

[0142] The provided technology provides an improved method of reverberation transition that allows for continuous audio playback while room reverberation parameters are changed without introducing artifacts or adversely affecting sound quality. The provided technology enhances the user experience, allows seamless transitions between different virtual venues, and facilitates real-time adjustment of reverberation settings during live performances, recordings, and other multimedia applications. The seamless reverberation transition maintains continuous audio playback while room reverberation parameters are changed without degrading sound quality or introducing undesirable artifacts.

[0143] It will be appreciated that the techniques described have been described with respect to an audio system in a vehicle, however, they can obviously be used with any system that involves playing audio signals to a user, where the audio signals are made to reverberate according to altered reverberation settings, and similar techniques can be easily applied to other kinds and types of audio systems, such as, for example, in buildings, or in consumer electronic devices.

[0144] While the disclosed technology has been described in terms of certain preferred embodiments, equivalents and modifications will occur to those skilled in the art upon reading and understanding this specification, and the present disclosure includes all such equivalents and modifications, and is limited only by the scope of the appended claims.

Claims

1. 1. A computer-implemented method for audio signal processing by an audio system including a processing unit, comprising: - receiving an input audio signal to be output to a user together with reverberations; - obtaining a first set of reverberation parameters associated with a first acoustic environment; - obtaining a second set of reverberation parameters associated with a second acoustic environment, said second set of reverberation parameters being different from said first set of reverberation parameters; - processing the input audio signal based on the first set of reverberation parameters to generate a first early reflection signal and based on the second set of reverberation parameters to generate a second early reflection signal, each of the first early reflection signal and the second early reflection signal comprising a respective synthesized audio signal representative of early sound reflections in a respective acoustic environment; - combining the first and second early reflection signals through a fading process to generate a transient early reflection signal including a transition from the first early reflection signal to the second early reflection signal according to the fading process; - providing an output audio signal comprising a combination of said direct input audio signal and said transient early reflection signal; The computer-implemented method comprising:

2. 2. The computer-implemented method of claim 1, wherein the first early reflection signal and the second early reflection signal are generated by simulating only the earliest occurring sound reflections of the input sound signal in the respective acoustic environments.

3. 2. The computer-implemented method of claim 1, further comprising: continuously outputting the output audio signal to the user during a transition from the first early reflection signal to the second early reflection signal.

4. - processing the direct input audio signal based on the first set of reverberation parameters to generate a first reverberation tail signal and based on the second set of reverberation parameters to generate a second reverberation tail signal; - providing the output audio signal comprising a combination of the direct input audio signal, the transient early reflection signal, and the first reverberation tail signal; - switching from the first reverberant tail signal to the second reverberant tail signal during the continuous playback of the output audio signal to provide the output audio signal comprising the direct input audio signal, the transient early reflection signal, and the second reverberant tail signal; The computer-implemented method of claim 1 , further comprising:

5. 5. The computer-implemented method of claim 4, wherein the first reverberant tail signal and the second reverberant tail signal comprise synthetic audio signals representative of opportunity sound reflections and attenuation characteristics occurring within the respective acoustic environments following the early reflections within the respective acoustic environments.

6. - receiving a microphone signal comprising a voice signal from said user; generating the first reverberation tail signal and the second reverberation tail signal further based on the microphone signal; The computer-implemented method of claim 4 further comprising:

7. 7. The computer-implemented method of claim 6, wherein processing the microphone signals based on the first or second set of reverberation parameters further takes into account a position of the user within the respective acoustic environment.

8. 2. The computer-implemented method of claim 1, wherein the transient early reflection signal is a continuous and seamless sound signal representing a blend of early sound reflections in the first acoustic environment and the second acoustic environment.

9. the first acoustic environment corresponds to a first virtual venue and the second acoustic environment corresponds to a second virtual venue; or the second acoustic environment responds to a user-induced parameter change of at least one parameter of the first set of parameters.

2. The computer-implemented method of claim 1.

10. The computer-implemented method of claim 1 , wherein the first early reflection signal and the second early reflection signal are provided simultaneously.

11. The computer-implemented method of claim 1, further comprising: compensating for latency in the transient early reflection signal to synchronize the direct speech signal, the early reflection signal, and / or the reverberation tail signal based on a latency control signal.

12. 5. The computer-implemented method of claim 4, wherein generating the first reverberant tail signal and the second reverberant tail signal is controlled using a reverberant tail control signal based on a look-up table containing the reverberant tail parameters of the first acoustic environment and the second acoustic environment.

13. The computer-implemented method of claim 4, further comprising applying an equalization filter to the first reverberation tail signal and the second reverberation tail signal to shape a tonal characteristic of the reverberation tail.

14. The computer-implemented method of claim 1 , wherein the input audio signal is a multi-channel audio signal.

15. 2. The computer-implemented method of claim 1, wherein the fading step is adaptive based on a user input that controls the blending of the first early reflection signal and the second early reflection signal in the transient early reflection signal.

16. - routing said direct input sound signal and said transient early reflection signal to a multi-channel 3D surround system to generate a 3D sound signal; - providing said 3D audio signal to a system equalization filter for reconstructed room compensation at loudspeaker level to generate said output audio signal; The computer-implemented method of claim 2 , further comprising:

17. The computer-implemented method of claim 1 , wherein the first and second sets of reverberation parameters are derived from a database of real-world or virtual acoustic environments.

18. 1. An audio system including at least one processing unit, - receiving an input audio signal to be output to a user together with reverberations; - obtaining a first set of reverberation parameters associated with a first acoustic environment; - obtaining a second set of reverberation parameters associated with a second acoustic environment, said second set of reverberation parameters being different from said first set of reverberation parameters; - processing the input audio signal based on the first set of reverberation parameters to generate a first early reflection signal and based on the second set of reverberation parameters to generate a second early reflection signal, each of the first early reflection signal and the second early reflection signal comprising a respective synthesized audio signal representative of early sound reflections in the respective acoustic environment; - combining the first and second early reflection signals through a fading process to generate a transient early reflection signal, the transient early reflection signal including a transition from the first early reflection signal to the second early reflection signal according to a fading process; - providing an output audio signal based on said transient early reflection signal; The audio system is configured to perform the steps of:

19. An audio system according to claim 18, further configured to carry out a method according to any one of claims 1 to 17.