Apparatus and method for rendering a virtual audio scene using information about a default acoustic environment - Patents.com
The system addresses the issue of missing acoustic parameters in virtual audio rendering by employing a 'default acoustic environment' to generate realistic sound effects, enhancing the plausibility and naturalness of virtual audio scenes.
Patent Information
- Application Number
- JP2024527297
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-11-09
- Filing Date
- 2022-11-09
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing virtual audio rendering systems fail to adequately render acoustic environments when detailed acoustic characteristics are missing, leading to unnatural sound experiences, particularly in scenarios like outdoor scenes or open spaces where acoustic parameters are unspecified.
A system that utilizes a 'default acoustic environment' to generate audio output channels when current acoustic environment information is unavailable, incorporating parameters such as reverberation, early reflections, and background sounds to enhance the plausibility of virtual audio scenes.
This approach improves the subjective quality of virtual auditory environments by providing realistic acoustic interactions even in scenarios lacking specific acoustic data, ensuring a more natural sound experience.
Smart Images

Figure 2024544511000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to using a default acoustic environment for rendering a virtual audio scene. Further, the present invention relates to providing information to the default acoustic environment. [Background technology]
[0002] In particular, the invention aims to improve the perceived plausibility of simulated acoustic environments when they do not contain detailed descriptions of all acoustic features or when the rendering system lacks the necessary resources to render them satisfactorily. The concept is expressed in a binaural reproduction system but can be extended to other forms of audio reproduction.
[0003] A key aspect of simulated experiences, such as Virtual Reality (VR) or Augmented Reality (AR), is the ability to create physical spaces and environments in which subjects can perceive complex acoustic phenomena. This is especially true in the case of so-called "six degrees of freedom" (6DoF) simulations, where subjects can move freely in a room with certain physical properties and thus experience different acoustic interactions. These consist of an early reflection part (ER) and a late reverberation part (LR). In [1] a description of the LR part of the room acoustics in a VR / AR scene is published, which is called the Acoustic Environment (AE).
[0004] When rendering a virtual acoustic space, it is essential to render the late reverberation reasonably well. Therefore, the characteristics of the late reverberation can be described as a set of parameters that can control an artificial reverberation generator to produce late reverberation with the desired characteristics.
[0005] As an example, the MPEG Audio standardization body recently published a specification for describing virtual acoustic scenes in 6DoF (6 Degrees of Freedom), which can be expressed, for example, in XML format, called "Encoder Input Format" (EIF) in the MPEG-1 Audio 6DoF standardization [1]. Among many other relevant constructs (e.g. specification of various kinds of audio sources, such as object sources, channel sources, and higher-order Ambisonics sources), the EIF specification includes a so-called acoustic environment description, which characterizes the late reverberation properties of a particular acoustic space.
[0006] For this purpose, it may contain, for example, fields / parameters describing the geometrical domain (domain) to which such parameters apply or the domain in the EIF where a particular parameter is considered valid, the spatial point (location) at which the indicated parameter is measured, the initial time delay (pre-delay) after which the late reverberation starts, a set of frequencies (frequencies) with associated RT60 values (i.e. the time it takes for the late reverberation to decay by 60 dB) and the Diffuse-Direct Ratio (DDR), which represents the ratio between the diffuse late reverberation energy and the direct / emitted sound energy, i.e. the reverberation amplitude / reverberation level.
[0007] For example, this information can be used to render realistic late reverberation in a virtual auditory environment.
[0008] When rendering a VR / AR scene, acoustic parameters are usually provided to render the room acoustics. However, during the scene authoring process, acoustic parameters may not be specified, e.g. for outdoor scene parts or scene parts partially open to the outdoors. Therefore, signal components related to reflections, reverberation or background noise are missing, and without acoustic parameters, sound sources are rendered practically as in an anechoic chamber, resulting in a poor and unnatural rendering. Summary of the Invention
[0009] The object of the present invention is to provide an improved concept for avoiding undesirable rendering behavior. This object is solved by an apparatus according to claim 1, a bitstream according to claim 39, an encoder according to claim 56, a method according to claim 58, a method according to claim 59 and a computer program according to claim 60.
[0010] According to one embodiment, an apparatus is provided for rendering a virtual audio scene, in which sounds are emitted from one or more sound sources. The apparatus includes an input interface configured to receive audio information, where the audio information includes audio information for the virtual audio scene. The apparatus further includes a renderer configured to generate one or more audio output channels for playing the virtual audio scene in response to the audio information for the virtual audio scene. If information about a current acoustic environment of the virtual audio scene is not available to the renderer, the renderer is configured to generate one or more audio output channels for playing the virtual audio scene in response to information about a default acoustic environment.
[0011] Further, a bitstream according to an embodiment is provided, the bitstream including encoded information for one or more audio channels of one or more sound sources that emit sound into the virtual audio scene, the bitstream including a number of data fields that include information about a default acoustic environment.
[0012] Further, an encoder is provided that is configured to generate a bitstream according to an embodiment, the encoder being configured to generate a bitstream including encoded information for one or more audio channels of one or more sound sources that emit sound into the virtual audio scene, the bitstream including a number of data fields that are configured with information about a default acoustic environment.
[0013] Further, according to one embodiment, there is provided a method for rendering a virtual audio scene, in which sounds are emanating from one or more sound sources. The method includes:
[0014] Receiving audio information, including audio information for a virtual audio scene; and generating, in response to the audio information for the virtual audio scene, one or more audio output channels for playing the virtual audio scene.
[0015] If information about the current acoustic environment of the virtual audio scene is not available, the generation of one or more audio output channels for playing the virtual audio scene is performed according to information about a default acoustic environment.
[0016] Further, a method is provided for generating a bitstream according to an embodiment, where the bitstream is generated such that it contains encoded information of one or more audio channels of one or more sound sources emitting sound into the virtual audio scene, and where the bitstream is generated such that a number of data fields comprising information about a default acoustic environment are included in the bitstream.
[0017] Furthermore, a computer program is provided for carrying out one of the above mentioned methods when executed on a computer or signal processor.
[0018] Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings. [Brief description of the drawings]
[0019] [Figure 1] FIG. 1 illustrates an apparatus for rendering a virtual audio scene according to one embodiment. [Diagram 2] FIG. 2 illustrates a bitstream according to one embodiment. [Diagram 3] FIG. 2 illustrates an encoder configured to generate a bitstream according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0020] 1 shows an apparatus 100 for rendering a virtual audio scene according to one embodiment, in which sounds emanate from one or more sound sources.
[0021] The apparatus 100 includes an input interface 110 configured to receive audio information, including audio information for a virtual audio scene.
[0022] Additionally, the apparatus 100 includes a renderer 120 configured to generate, in response to the audio information for the virtual audio scene, one or more audio output channels for playing the virtual audio scene.
[0023] If information about the current acoustic environment of the virtual audio scene is not available to the renderer 120, the renderer 120 is configured to generate one or more audio output channels for playing the virtual audio scene according to information about a default acoustic environment.
[0024] According to one embodiment, if information about the current acoustic environment of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene, for example, depending on the information about the current acoustic environment of the virtual audio scene.
[0025] In one embodiment, for example, the input interface 110 may be configured to receive a bitstream including audio information. If the bitstream includes information about the current acoustic environment of the virtual audio scene, the current acoustic environment of the virtual audio scene may be made available to the renderer 120, e.g., the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene in response to the information about the current acoustic environment of the virtual audio scene included in the bitstream. If the bitstream does not include information about the current acoustic environment of the virtual audio scene, the current acoustic environment of the virtual audio scene may not be made available to the renderer 120, e.g., the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene in response to the information about a default acoustic environment.
[0026] According to one embodiment, this bitstream includes information about the default acoustic environment.
[0027] In one embodiment, the device 100 includes a memory that stores predetermined information, where the predetermined information includes information regarding a default acoustic environment.
[0028] According to one embodiment, the default acoustic environment represents an outdoor acoustic environment.
[0029] In one embodiment, for each of a plurality of regions of a virtual audio scene for which information about the current acoustic environment for that region is available to renderer 120, renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in that region, e.g., using information about the current acoustic environment for that region. For each of a plurality of regions of a virtual audio scene for which information about the current acoustic environment for that region is not available to renderer 120, renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in that region, e.g., using information about a default acoustic environment as information about the acoustic environment for that region.
[0030] According to one embodiment, for at least one of the regions of the virtual audio scene, information about a current acoustic environment for the at least one region is available to the renderer 120 and the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is located in one of the at least one regions, e.g., using information about the current acoustic environment for the region. For at least two of the regions of the virtual audio scene, information about a current acoustic environment for the at least two regions is not available to the renderer 120 and the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is located in one of the at least two regions, e.g., using information about a default acoustic environment as information about the acoustic environment for the region.
[0031] In one embodiment, the receiving interface may be configured to receive indication data indicating, for example, a plurality of regions of the virtual audio scene for which a current acoustic environment is valid and / or indicating a plurality of regions of the virtual audio scene for which a current acoustic environment is not valid. For each of the plurality of regions of the virtual audio scene for which a current acoustic environment is valid, the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in the region, e.g., using information about the current acoustic environment for the region. For each of the plurality of regions of the virtual audio scene for which a current acoustic environment is not valid, the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in the region, e.g., using information about a default acoustic environment as information about the acoustic environment for the region.
[0032] According to one embodiment, the information about the default acoustic environment includes one or more reverberation parameters, the one or more reverberation parameters being information about one or more characteristics of reverberation in the default acoustic environment. If information about the current acoustic environment of a region of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is present in the region, e.g., depending on the one or more reverberation parameters of the current acoustic environment for the region. If information about the current acoustic environment of the region is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is present in the region, e.g., depending on the one or more reverberation parameters of the information about the default acoustic environment.
[0033] In one embodiment, the information about the default acoustic environment, the one or more reverberation parameters, includes information about one or more of a pre-delay time, a reverberation time, and a reverberation amplitude.
[0034] According to one embodiment, the information about the default acoustic environment includes one or more early reflection parameters, which consist of information about one or more characteristics of early reflections in the default acoustic environment. If information about the current acoustic environment for a region of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in that region, e.g., depending on the one or more early reflection parameters of the current acoustic environment for that region. If information about the current acoustic environment for a region of the virtual audio scene is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in that region, e.g., depending on the one or more early reflection parameters of the current acoustic environment for that region.
[0035] In one embodiment, the information about the default acoustic environment includes one or more background parameters, the one or more background parameters being information about one or more characteristics of background sounds in the default acoustic environment. If information about the current acoustic environment for a region of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in the region, e.g., in response to the one or more background parameters of the information about the current acoustic environment for the region. If information about the current acoustic environment for the region is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in the region, e.g., in response to the one or more background parameters of the information about the default acoustic environment.
[0036] According to one embodiment, the one or more background parameters of the information regarding the default acoustic environment include one or more rendering parameters for the background sound, where the rendering parameters include information regarding one or more of a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform.
[0037] In one embodiment, the information about the default acoustic environment includes one or more default acoustic environment guidance parameters for guiding the use of the default acoustic environment by the renderer 120. If information about the current acoustic environment for a region of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene using information about the current acoustic environment for the region, e.g., in response to the default acoustic environment guidance parameters, when a listener is in the region. If information about the current acoustic environment for the region is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene using information about the default acoustic environment, e.g., in response to the default acoustic environment guidance parameters, when a listener is in the region.
[0038] According to one embodiment, the default acoustic environment includes one or more trigger conditions necessary to trigger one or more or all of the parameters or components of the default acoustic environment. If information about the current acoustic environment for a region of the virtual audio scene is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene in response to the information about the default acoustic environment, e.g., by triggering a parameter or component of the default acoustic environment that satisfies at least one of the one or more trigger conditions.
[0039] In one embodiment, the information about the default acoustic environment includes one or more modification parameters for modifying at least one of a gain, a distance weighting, a time delay, an occlusion weighting, a velocity weighting, and a spatial source saturation weighting. For example, the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene in response to the one or more modification parameters.
[0040] According to one embodiment, the virtual audio scene is determined by a recording of a real audio scene in a real acoustic environment.
[0041] In one embodiment, for each of the multiple regions of the virtual audio scene where information about the current acoustic environment for that region is available to renderer 120, the current acoustic environment for that region represents the actual acoustic environment of the actual region of the actual audio scene corresponding to that region of the virtual audio scene. For each of the multiple regions of the virtual audio scene where information about the current acoustic environment for that region is not available to renderer 120, the default acoustic environment does not represent the actual acoustic environment of the actual region of the actual audio scene corresponding to that region of the virtual audio scene.
[0042] According to one embodiment, a virtual audio scene is associated with a virtual visual scene, where the virtual visual scene portrays a virtual visual room to a listener of the virtual audio scene.
[0043] In one embodiment, for each of the multiple regions of the virtual audio scene for which information about the current acoustic environment for that region is available to renderer 120, the current acoustic environment for that region is determined by the virtual acoustic properties of the region of the virtual visual room that corresponds to that region of the virtual audio scene. For each of the multiple regions of the virtual audio scene for which information about the current acoustic environment for that region is not available to renderer 120, the default acoustic environment is not determined by the virtual acoustic properties of the region of the virtual visual room that corresponds to that region of the virtual audio scene.
[0044] According to one embodiment, the position of the listener in the virtual audio scene depends on the listener's physical location in the real world.
[0045] In one embodiment, the virtual audio scene is associated with a virtual visual presentation of an augmented reality application, where the virtual visual presentation of the augmented reality application is dependent on an actual area of a real-world physical environment in which a listener of the virtual audio scene is located.
[0046] According to one embodiment, for each of the multiple regions of the virtual audio scene for which information about the current acoustic environment for that region is available to the renderer 120, the current acoustic environment for that region is determined by the actual acoustic properties of the real-world physical environment that corresponds to that region of the virtual audio scene. For each of the multiple regions of the virtual audio scene for which information about the current acoustic environment for that region is not available to the renderer 120, the default acoustic environment is not determined by the acoustic properties of the region of the real-world physical environment that corresponds to that region of the virtual audio scene.
[0047] In one embodiment, if the actual area of the real world in which the listener is located corresponds to an area of the virtual audio scene for which information about the current acoustic environment is available, the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene, e.g., according to a current acoustic environment for that area. If the actual area of the real world in which the listener is located corresponds to an area of the virtual audio scene for which information about the current acoustic environment is not available, the renderer 120 may be configured to generate one or more audio output channels for playing the virtual audio scene, e.g., according to a default acoustic environment.
[0048] According to one embodiment, the default acoustic environment is a first default acoustic environment of two or more default acoustic environments. The input interface 110 can be configured to receive, for example, an indication for at least one of the regions of the virtual audio scene indicating one of the two or more default acoustic environments as the default acoustic environment for the at least one region. For the at least one region, if information about the current acoustic environment of the at least one region is not available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene when a listener is in the region, for example using information about the default acoustic environment for the region.
[0049] In one embodiment, the bitstream includes information about two or more default acoustic environments.
[0050] According to one embodiment, the predetermined information stored in the memory of the device 100 includes information regarding two or more default acoustic environments.
[0051] In one embodiment, for example, the receiving interface can be configured to receive selection information, e.g., to select one of the two or more default acoustic environments in response to the selection information, and the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene using information about the default acoustic environment for the at least one region, e.g., if a listener is in the at least one region.
[0052] According to one embodiment, the instruction to indicate one of the two or more default acoustic environments as the default acoustic environment for the at least one area includes an identifier for each of the at least one area and / or an identifier for one of the two or more default acoustic environments.
[0053] In one embodiment, the audio information of the virtual audio scene includes one or more audio channels for each of the one or more sound sources and a position of each of the one or more sound sources. For example, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene in response to the one or more audio channels for each of the one or more sound sources, in response to the position of each of the one or more sound sources, and in response to a position of a listener in the virtual audio scene.
[0054] According to one embodiment, the sound source positions and the listener positions are defined in three dimensions and / or the sound source positions and the listener positions are defined in two dimensions.
[0055] In one embodiment, the position of the sound source is defined in three dimensions. The position and orientation of the listener is defined in six degrees of freedom, such that the position of the listener is defined in three dimensions and the orientation of the listener's head is defined using three rotation angles. For example, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene, further depending on the orientation of the listener's head in the virtual audio scene.
[0056] According to one embodiment, the sound scene generator can be configured to play virtual audio scenes, for example, for a virtual reality application, or, for example, for an augmented reality application.
[0057] In one embodiment, one or more audio channels of at least one of the one or more sound sources are represented in the Ambisonics domain. For example, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene in response to one or more audio channels of the at least one of the one or more sound sources represented in the Ambisonics domain.
[0058] According to one embodiment, the renderer 120 includes a binauralizer configured to generate two audio output channels for playing the virtual audio scene.
[0059] In one embodiment, if one or more, but not all, of the parameters of the current acoustic environment are available to the renderer 120, the renderer 120 may be configured to generate one or more audio output channels for playing a virtual audio scene depending on, for example, parameters of information about a default acoustic environment that are not provided in the current acoustic environment in the bitstream.
[0060] According to one embodiment, if information about the current acoustic environment of the virtual audio scene is available to the renderer 120, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene using information about the current acoustic environment of the virtual audio scene or information about a default acoustic environment, depending on whether resources for rendering acoustic characteristics are available to the renderer 120.
[0061] FIG. 2 illustrates a bitstream 200 according to one embodiment. The bitstream 200 contains encoded information 210 for one or more audio sources that emit sound into a virtual audio scene, and for one or more audio channels for each source.
[0062] Additionally, the bitstream 200 includes a number of data fields 220 that comprise information regarding the default acoustic environment.
[0063] According to one embodiment, the information about the default acoustic environment in the bitstream 200 includes one or more reverberation parameters of the default acoustic environment, which comprise information about one or more reverberation characteristics of the default acoustic environment.
[0064] In one embodiment, the information about the default acoustic environment, the one or more reverberation parameters, includes information about one or more of a pre-delay time, a reverberation time, and a reverberation amplitude.
[0065] According to one embodiment, the information about the default acoustic environment in the bitstream 200 includes one or more early reflection parameters that include information about one or more early reflection characteristics of the default acoustic environment.
[0066] According to one embodiment, the information about the default acoustic environment in the bitstream 200 includes one or more background parameters that include information about one or more characteristics of the background sounds in the default acoustic environment.
[0067] According to one embodiment, the information about the default acoustic environment in the bitstream 200, the one or more background parameters, include one or more rendering parameters for the background sound, where the rendering parameters include information about one or more of the following: a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform.
[0068] In one embodiment, the bitstream 200 includes one or more default acoustic environment guidance parameters to guide the renderer 120 to use a default acoustic environment.
[0069] According to one embodiment, the default acoustic environment includes one or more trigger conditions necessary to trigger one or more, or all, of the parameters or components of the default acoustic environment.
[0070] In one embodiment, the bitstream 200 includes one or more modification parameters for modifying at least one of the following: gain, distance weighting, time delay, occlusion weighting, velocity weighting, and spatial source saturation weighting.
[0071] According to one embodiment, the information regarding the default acoustic environment is first information regarding a first default acoustic environment of two or more default acoustic environments. The bitstream 200 includes information regarding two or more default acoustic environments.
[0072] In one embodiment, the bitstream 200 includes selection information for selecting one of two or more default acoustic environments.
[0073] According to one embodiment, for at least one of the plurality of regions, bitstream 200 specifies one of two or more default acoustic environments as the default acoustic environment for the at least one region.
[0074] In one embodiment, bitstream 200 includes an identifier for each of the at least one region and / or includes an identifier for one of two or more default acoustic environments to indicate a default acoustic environment for the at least one region.
[0075] According to one embodiment, the bitstream 200 further includes information about the current acoustic environment of the virtual audio scene.
[0076] In one embodiment, bitstream 200 includes indication data indicating at least one of a plurality of areas in which the current acoustic environment is valid and / or indicating one or more of a plurality of areas in which the current acoustic environment is not valid.
[0077] According to one embodiment, the bitstream 200 further includes information about the current acoustic environment for at least one of the regions of the virtual audio scene.
[0078] A further embodiment relates to the device 100 of the embodiment of Fig. 1. The bitstream 200 received at the receiving interface of the device 100 is the bitstream 200 according to the embodiment of Fig. 2. If the bitstream 200 does not contain information about the current acoustic environment of the virtual audio scene, the renderer 120 can be configured to generate one or more audio output channels for playing the virtual audio scene, for example depending on information about a default acoustic environment contained in the bitstream 200. The generation of such one or more audio output channels depends on one or more of the following:
[0079] · one or more reverberation parameters of the default acoustic environment, including information regarding one or more characteristics of the reverberation in the default acoustic environment, and / or information regarding one or more of the following: pre-delay time, reverberation time, and reverberation amplitude.
[0080] One or more early reflection parameters that contain information about one or more characteristics of the early reflections in the default acoustic environment.
[0081] one or more background parameters comprising information about one or more characteristics of the background sound in the default acoustic environment and / or one or more rendering parameters of the background sound, the rendering parameters comprising information about one or more of the following: a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform.
[0082] One or more default acoustic environment guidance parameters for guiding the renderer 120 to use a default acoustic environment.
[0083] One or more trigger conditions required to trigger one or all of the parameters or components of the default acoustic environment.
[0084] FIG. 3 illustrates an encoder 300 configured to generate a bitstream according to one embodiment.
[0085] The encoder 300 is configured to generate a bitstream such that the bitstream includes encoded information of one or more audio channels of one or more sound sources emitting sound into a virtual audio scene.
[0086] Additionally, the encoder 300 is configured to generate the bitstream such that the bitstream includes a number of data fields that comprise information about the default acoustic environment.
[0087] According to one embodiment, the encoder 300 can be configured to generate a bitstream, for example such that the bitstream is the bitstream 200 according to the embodiment of FIG.
[0088] A description of specific embodiments is provided below. An important concept of the present invention is that if no acoustic parameters are specified in the scene description, a "default acoustic environment" is provided to the rendering system, which can be used by the renderer to add general acoustic characteristics to a particular scene environment. In another embodiment, if no acoustic parameters are specified in the scene description for the part of the audio scene that is within the listener's reach, a "default acoustic environment" is provided to the rendering system, which can be used by the renderer to add general acoustic characteristics to a particular scene environment.
[0089] In this way, unnatural rendering behavior can be avoided, which results in an improved subjective quality of the virtual auditory environment.
[0090] The parameters of the default acoustic environment can include a number of aspects that characterize the typical acoustic behavior of the acoustic space, including (but not limited to):
[0091] Parameters for characterizing the early reflections (e.g. delay and / or density of the "reverberations"). Late reverberation parameters such as pre-delay time, reverberation time RT60 and reverberation amplitude. Parameters to modify the timbre of the sound source (EQ, low-pass filter) to simulate the effects of air absorption and wind turbulence.
[0092] Parameters describing the spatial region (acoustic limits) in which sound sources must be placed in order to be processed using the default acoustic environment.
[0093] Further subtle sources, such as a ubiquitous outdoor background noise floor (similar to the comfort noise used in voice communications), that can be sent to the renderer in the bitstream or generated by the rendering device. The rendering device can also be pre-equipped with a waveform describing the background noise signal (and possibly default parameters such as the ID of the background noise waveform to be used, an indication of the background signal level, or filtering characteristics describing the frequency response to be applied to the background waveform).
[0094] In a preferred embodiment of the present invention, the default acoustic environment may, for example, describe outdoor acoustic behavior. There are various ways in which such a "default acoustic environment" can be utilized.
[0095] In basic renderer systems, the parameters of a default acoustic environment are built into the renderer and can be activated automatically if no other acoustic environment data is available.
[0096] In a more comprehensive scenario involving encoded information of the VR / AR audio scene and a bitstream that can be stored in the decoder / renderer and / or transmitted over a network, the encoder can inform the renderer via a metadata bitstream to use a default acoustic environment. There are several ways to do this.
[0097] The transmission of the default acoustic environment can be indicated in the bitstream by a separate code or in any other way that differs from the signaling of the normal scene-specific acoustic environment.
[0098] In a preferred embodiment of the present invention, the default acoustic environment data is signaled in much the same way as other acoustic environments (i.e. acoustic environments defined by a scene provider). In particular, a bitstream element for signaling an acoustic environment includes a description of the geometrical region in which the acoustic environment is valid / defined, in addition to fields for reverberation parameters (as described above) and other parameters (e.g. additional background sounds). Typically, this region can be defined as a geometric primitive shape (e.g. a sphere or a box shape) or a mesh of multiple faces. However, instead of including such fields to describe the geometry of the region of the acoustic environment in the signaling of a normal acoustic environment, the default acoustic environment is signaled by transmitting a dedicated designation code.
[0099] As an example, instead of specifying a geometric region of the normal acoustic environment, a "null" (null pointer) can be sent.
[0100] Additionally, the renderer may include built-in pre-installed data for one or more predefined default acoustic environments (available to the scene creator). The encoder may then signal which of these default acoustic environment settings should be used in a particular bitstream field. The selectability of these default settings may be made available and selected during scene authoring / encoding.
[0101] A description of certain aspects of some embodiments follows. First, a description is given of the renderer aspects of a particular embodiment, possibly controlled by bitstream elements.
[0102] For example, in a particular embodiment, an audio renderer provided for rendering the sound impression of a virtual acoustic environment includes the following aspects:
[0103] Possibly (late) reverberation, including parameters such as pre-delay time, reverberation time RT60 and reverberation amplitude. Possibly early reflections. Possibly more subtle sound sources (such as outdoor background noise floor).
[0104] The renderer features, for example, the ability to recognize and render a default acoustic environment setting that is applied to areas of the scene where no other acoustic environment is specified.
[0105] In a preferred embodiment, this default acoustic environment may characterize the acoustic properties of, for example, an outdoor situation.
[0106] In a further preferred embodiment, the signaling of the default acoustic environment can include a dedicated code that is sent instead of sending, for example, the geometric area where the acoustic environment is valid / defined. As an example, instead of specifying the geometric area of the normal acoustic environment, a "Null" (null pointer) can be sent to the renderer.
[0107] Additionally, in certain embodiments, for example, the renderer may be configured to include built-in pre-installed data for one or more predefined default acoustic environments, where the renderer accepts an input bitstream field of which of these default acoustic environment settings should be used.
[0108] Additionally, in certain embodiments, for example, a rendering device may be configured to include built-in pre-installed waveforms describing the background noise signal (and possibly default parameters, such as the ID of the background noise waveform to be used, an indication of the background signal level, or filtering characteristics describing the frequency response to be applied to the background waveform), which may be overridden by values transmitted in the bitstream.
[0109] A description will now be given of the bitstream aspects of certain embodiments. For example, in a particular embodiment, a bitstream is provided that may include, for example, the following information:
[0110] Information about the default acoustic environment, signaled in a dedicated code, sent instead of sending the geometric area where the acoustic environment is valid / defined. As an example, instead of specifying the geometric area of the normal acoustic environment, a "Null" (null pointer) can be sent to the renderer.
[0111] In particular, the acoustic environment may include data regarding, for example, reverberation, early reflections, and background sounds.
[0112] Background sound rendering parameters may include, for example, the ID of the background noise waveform to be used, an indication of the background signal level, or filtering characteristics describing the frequency response to be applied to the background waveform.
[0113] According to one embodiment, the set of additional parameters to be interpreted by the renderer may include, for example:
[0114] Parameters that define the conditions necessary to trigger all or some components of the default acoustic environment.
[0115] Dedicated modifiers for separate aspects, namely: gain, distance weighting, time delay, occlusion weighting, velocity weighting, spatial source saturation weighting.
[0116] According to certain embodiments, for example, a bitstream field may be included that indicates which of the many pre-installed renderer's default sound environment settings may be used.
[0117] Certain embodiments may be applied, for example, in the field of real-time auditory 6DoF virtual environments or, for example, in the field of real-time virtual reality and real-time augmented reality.
[0118] It should be noted that all alternatives or aspects described herein, and all aspects defined by the independent claims in the following claims, can be used individually, i.e., without alternatives or purposes other than those contemplated, or the independent claims. However, in other embodiments, two or more alternatives, aspects, or independent claims can be combined with each other, and in other embodiments, all aspects, or alternatives, and all independent claims can be combined with each other.
[0119] The encoded or processed signals of the present invention may be stored in a digital or non-transitory storage medium or may be transmitted over a transmission medium, such as a wireless or wired transmission medium, such as the Internet.
[0120] Although some aspects have been described in the context of an apparatus, it will be apparent that these aspects are also descriptions of a corresponding method, with a block or device corresponding to a method step or feature of a method step, and similarly, aspects described in the context of a method step are also descriptions of a corresponding block, or item, or feature of a corresponding apparatus.
[0121] Depending on the particular implementation requirements, embodiments of the present invention can be implemented in hardware or software using a digital storage medium, such as a floppy disk, DVD, CD, ROM, PROM, EPROM, EEPROM or flash memory, on which electronically readable control signals are stored that cooperate (or can cooperate) with a programmable computer system to carry out the respective method.
[0122] Some embodiments according to the invention include a data carrier having electronically readable control signals capable of cooperating with a programmable computer system to perform one of the methods described herein.
[0123] Generally, embodiments of the present invention can be implemented as a computer program product having program code which is operative to perform one of the methods when the computer program product is run on a computer, and which can for example be stored on a machine readable carrier.
[0124] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier or a non-transitory storage medium.
[0125] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.
[0126] A further embodiment of the inventive method is, therefore, a data carrier (or digital storage medium, or computer readable medium) having recorded thereon the computer program for performing one of the methods described herein.
[0127] A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein, which data stream or sequence of signals can be adapted to be transmitted via a data communication connection, for example the Internet.
[0128] A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.
[0129] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.
[0130] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by any hardware apparatus.
[0131] The above-described embodiments are merely illustrative of the principles of the present invention. It will be understood that modifications and variations of the arrangements and details described herein will be apparent to those skilled in the art. It is therefore intended that the present invention be limited only by the scope of the following claims and not by the specific details presented as descriptions and illustrations of the embodiments herein.
[0132] Literature: [1] ISO / IEC JTC1 / SC29 / WG6 (MPEG Audio):N0054 - MPEG-I Immersive Audio Encoder Input Format. 30 April 2021.
Claims
1. An apparatus (100) for rendering a virtual audio scene, in which sounds originate from one or more sound sources, an input interface (110) configured to receive audio information, including audio information about the virtual audio scene; a renderer (120) configured to generate, in response to the audio information for the virtual audio scene, one or more audio output channels for playing the virtual audio scene; The apparatus (100), wherein the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene according to information about a default acoustic environment if information about a current acoustic environment of the virtual audio scene is not available to the renderer (120).
2. if information about the current acoustic environment of the virtual audio scene is available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the information about the current acoustic environment of the virtual audio scene. The apparatus (100) of claim 1.
3. the input interface (110) is configured to receive a bitstream containing the audio information; if the bitstream contains information about the current acoustic environment of the virtual audio scene, the current acoustic environment of the virtual audio scene is available to the renderer (120), the renderer (120) being configured to generate the one or more audio output channels for playing the virtual audio scene in response to the information about the current acoustic environment of the virtual audio scene contained in the bitstream, if the bitstream does not include the information about the current acoustic environment of the virtual audio scene, the current acoustic environment of the virtual audio scene is not available to the renderer (120), and the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene according to the information about the default acoustic environment. The apparatus (100) of claim 2.
4. the bitstream includes information about the default acoustic environment; The apparatus (100) of claim 3.
5. the device (100) comprising a memory having predetermined information stored therein, the predetermined information including the default acoustic environment; The apparatus (100) of claim 3.
6. the default acoustic environment represents an outdoor acoustic environment; An apparatus (100) according to any one of claims 1 to 5.
7. the renderer is configured to, for each region of the virtual audio scene for which information about a current acoustic environment for the region is available to the renderer, generate the one or more audio output channels for playing the virtual audio scene when the listener is in the region using the information about the current acoustic environment for the region; and wherein for each of the plurality of regions of the virtual audio scene for which information about the current acoustic environment for the region is not available to the renderer, the renderer is configured to generate the one or more audio output channels for playing the virtual audio scene when the listener is in the region using the information about the default acoustic environment as information about the acoustic environment for the region. An apparatus (100) according to any one of claims 1 to 6.
8. for at least one of the plurality of regions of the virtual audio scene, information about the current acoustic environment for the at least one region is available to the renderer (120), and the renderer (120) is configured to, when the listener is located in one of the at least one regions, use the information about the current acoustic environment for the region to generate the one or more audio output channels for playing the virtual audio scene; and wherein, for at least two of the regions of the virtual audio scene, information about the current acoustic environment for the at least two regions is not available to the renderer (120) and the listener is located in one of the at least two regions, the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene using the information about the default acoustic environment as the information about the acoustic environment for the region.
8. The apparatus (100) of claim 7.
9. the receiving interface is configured to receive indication data indicating that the current acoustic environment is valid for the plurality of areas of the virtual audio scene and / or that the current acoustic environment is not valid for the plurality of areas of the virtual audio scene; the renderer (120) is configured to, for each region of the plurality of regions of the virtual audio scene for which the current acoustic environment is valid, generate the one or more audio output channels for playing the virtual audio scene when the listener is in the region using the information about the current acoustic environment of the region; and and wherein the renderer is configured to: for each region of the plurality of regions of the virtual audio scene for which the current acoustic environment is not valid, when the listener is in the region, generate the one or more audio output channels for playing the virtual audio scene using the information about the default acoustic environment as the information about the acoustic environment for the region.
9. Apparatus (100) according to claim 7 or 8.
10. the information about the default acoustic environment includes one or more reverberation parameters comprising information about one or more characteristics of reverberation in the default acoustic environment; if information about the current acoustic environment for a region of the plurality of regions of the virtual audio scene is available to the renderer (120), the renderer (120) is configured to generate, when the listener is in the region, the one or more audio output channels for playing the virtual audio scene in response to the one or more reverberation parameters of the current acoustic environment for the region, if information about the current acoustic environment of the area is not available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the one or more reverberation parameters of the information about the default acoustic environment when the listener is in the area. An apparatus (100) according to any one of claims 7 to 9.
11. the one or more reverberation parameters of the information about the default acoustic environment include information about one or more of a pre-delay time, a reverberation time, and a reverberation amplitude; 11. The apparatus (100) of claim 10.
12. the information about the default acoustic environment includes one or more early reflection parameters, the early reflection parameters comprising information about one or more characteristics of early reflections in the default acoustic environment; if information about the current acoustic environment for a region of the plurality of regions of the virtual audio scene is available to the renderer (120), the renderer (120) is configured to generate, when the listener is present in the region, the one or more audio output channels for playing the virtual audio scene in response to the one or more early reflection parameters of the current acoustic environment for the region, if information about the current acoustic environment for the region is not available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene when the listener is in the region in response to the one or more early reflection parameters of the information about the default acoustic environment. An apparatus (100) according to any one of claims 7 to 11.
13. the information about the default acoustic environment includes one or more background parameters, the background parameters comprising information about one or more characteristics of background sounds in the default acoustic environment; if information about the current acoustic environment for a region of the plurality of regions of the virtual audio scene is available to the renderer (120), the renderer (120) is configured to generate, when the listener is present in the region, the one or more audio output channels for playing the virtual audio scene in response to the one or more background parameters of the information about the current acoustic environment for the region, if information about the current acoustic environment for the region is not available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the one or more background parameters of the information about the default acoustic environment when the listener is in the region. An apparatus (100) according to any one of claims 7 to 12.
14. the one or more background parameters of the information about the default acoustic environment include one or more rendering parameters of the background sound, the rendering parameters including information about one or more of a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform; 14. The apparatus (100) of claim 13.
15. the information about the default acoustic environment includes one or more default acoustic environment guidance parameters for guiding the use of the default acoustic environment by the renderer (120); if information about the current acoustic environment for a region of the plurality of regions of the virtual audio scene is available to the renderer, the renderer is configured to generate the one or more audio output channels for playing the virtual audio scene using the information about the current acoustic environment for the region when the listener is in the region in response to the default acoustic environment guidance parameters, if information about the current acoustic environment of the area is not available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene using the information about the default acoustic environment when the listener is in the area, in response to the default acoustic environment guidance parameters. An apparatus (100) according to any one of claims 7 to 14.
16. the default acoustic environment includes one or more trigger conditions necessary to trigger one or more, or all, of the parameters or components of the default acoustic environment; wherein, if information about the current acoustic environment for a region of the plurality of regions of the virtual audio scene is not available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene by triggering the parameters or components of the default acoustic environment that satisfy at least one of the one or more trigger conditions in response to the information about the default acoustic environment. An apparatus (100) according to any one of claims 7 to 15.
17. the information about the default acoustic environment includes one or more modification parameters for modifying at least one of a gain, a distance weighting, a time delay, an occlusion weighting, a velocity weighting, and a spatial source saturation weighting; and the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the one or more modification parameters. An apparatus (100) according to any one of claims 7 to 16.
18. the virtual audio scene is determined by a recording of a real audio scene in a real acoustic environment; An apparatus (100) according to any one of claims 7 to 17.
19. information about a current acoustic environment for said region is available to the renderer (120), for each region of the plurality of regions of the virtual audio scene, the current acoustic environment for said region representing the real acoustic environment of a real region of the real audio scene corresponding to said region of the virtual audio scene; for each of the plurality of regions of the virtual audio scene, where information about the current acoustic environment for the region is not available to the renderer (120), the default acoustic environment does not represent the actual acoustic environment of the actual region of the actual audio scene corresponding to the region of the virtual audio scene.
20. The apparatus (100) of claim 18.
20. the virtual audio scene is associated with a virtual visual scene, the virtual visual scene depicting a virtual visual room to the listener of the virtual audio scene; An apparatus (100) according to any one of claims 7 to 18.
21. information about a current acoustic environment for said region is available to the renderer (120), for each region of the plurality of regions of the virtual audio scene, the current acoustic environment for said region being determined by the virtual acoustic properties of a region of the virtual visual room corresponding to said region of the virtual audio scene; for each of the plurality of regions of the virtual audio scene for which information regarding the current acoustic environment for the region is not available to the renderer (120), the default acoustic environment is not determined by the virtual acoustic properties of a region of the virtual visual room corresponding to the region of the virtual audio scene; 21. The apparatus (100) of claim 20.
22. the position of the listener in the virtual audio scene is determined by the listener's physical position in the real world; 22. Apparatus (100) according to any one of claims 7 to 21.
23. the virtual audio scene is associated with a virtual visual presentation of an augmented reality application, the virtual visual presentation of the augmented reality application being dependent on an actual area of the real-world physical environment in which the listener of the virtual audio scene is located; 23. The apparatus (100) of claim 22.
24. information about a current acoustic environment is available to the renderer (120), for each region of the plurality of regions of the virtual audio scene, the current acoustic environment for said region being determined by actual acoustic properties of a region of the real-world physical environment that corresponds to said region of the virtual audio scene; and for each of the plurality of regions of the virtual audio scene where information about the current acoustic environment is not available to the renderer (120), the default acoustic environment is not determined by the acoustic properties of a region of the real-world physical environment that corresponds to the region of the virtual audio scene.
24. The apparatus (100) of claim 23.
25. the renderer (120) is configured to, if the actual area of the real world in which the listener is located corresponds to an area of the virtual audio scene for which information about the current acoustic environment is available, generate the one or more audio output channels for playing the virtual audio scene according to the current acoustic environment for the area; the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene according to the default acoustic environment if the actual area of the real world in which the listener is located corresponds to an area of the virtual audio scene for which information about the current acoustic environment is not available.
25. The apparatus (100) of claim 24.
26. the default acoustic environment is a first default acoustic environment of two or more default acoustic environments; the input interface (110) is configured to receive, for at least one region of the plurality of regions of the virtual audio scene, an indication indicating one of the two or more default acoustic environments as a default acoustic environment for the at least one region; wherein, for the at least one region, if information about a current acoustic environment for the at least one region is not available to the renderer, the renderer is configured to generate the one or more audio output channels for playing the virtual audio scene using information about the default acoustic environment for the region when the listener is present in the region.
26. Apparatus (100) according to any one of claims 7 to 25.
27. the bitstream includes information regarding the two or more default acoustic environments; The apparatus (100) according to claim 26, further dependent on claim 3.
28. the predetermined information stored in the memory of the device (100) includes information regarding the two or more default acoustic environments; The apparatus (100) according to claim 26, further dependent on claim 5.
29. the receiving interface is configured to receive selection information; and the renderer (120) is configured to select the one of the two or more default acoustic environments in response to the selection information, and is configured to generate the one or more audio output channels for playing the virtual audio scene using the information regarding the default acoustic environment for the at least one area when the listener is in the at least one area.
29. Apparatus (100) according to any one of claims 26 to 28.
30. the indication of the one of the two or more default acoustic environments as the default acoustic environment for the at least one area includes an identifier for each of the at least one area and / or includes an identifier for the one of the two or more default acoustic environments.
30. Apparatus (100) according to any one of claims 26 to 29.
31. the audio information for the virtual audio scene includes one or more audio channels for each source of the one or more sound sources and a position of each source of the one or more sound sources; the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the one or more audio channels of each of the one or more sound sources, in response to the position of each of the one or more sound sources, and in response to a position of a listener within the virtual audio scene.
31. Apparatus (100) according to any one of claims 1 to 30.
32. the positions of the sound sources and the positions of the listeners are defined in three dimensions; and / or the position of the sound source and the position of the listener are defined in two dimensions; 32. The apparatus (100) of claim 31.
33. the location of the sound source is defined in three dimensions; the position and orientation of the listener is defined in six degrees of freedom, such that the position of the listener is defined in three dimensions and the orientation of the listener's head is defined using three rotation angles; the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene further depending on the orientation of the head of the listener in the virtual audio scene.
32. The apparatus (100) of claim 31.
34. the audio scene generator is configured to play the virtual audio scene of a virtual reality application, or the audio scene generator is configured to play the virtual audio scene of an augmented reality application; 34. Apparatus (100) according to any one of claims 1 to 33.
35. the one or more audio channels of at least one of the one or more sound sources are represented in the Ambisonics domain; the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to the one or more audio channels of the at least one sound source of the one or more sound sources represented in the Ambisonics domain.
35. Apparatus (100) according to any one of claims 1 to 34.
36. the renderer (120) comprises a binauralizer configured to generate two audio output channels for playing the virtual audio scene; 36. Apparatus (100) according to any one of claims 1 to 35.
37. if one or more, but not all, of a plurality of parameters of the current acoustic environment are available to the renderer (120), the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene in response to parameters of a plurality of parameters of the information regarding the default acoustic environment that are not provided for the current acoustic environment in the bitstream.
37. Apparatus (100) according to any one of claims 1 to 36.
38. if information about the current acoustic environment of the virtual audio scene is available to the renderer, the renderer is configured to generate the one or more audio output channels for playing the virtual audio scene using the information about the current acoustic environment of the virtual audio scene or the information about the default acoustic environment depending on availability of resources of the renderer for rendering acoustic characteristics.
38. Apparatus (100) according to any one of claims 1 to 37.
39. - encoding information (210) of one or more audio channels of one or more sound sources emitting sound into the virtual audio scene; A plurality of data fields (220) configured with information regarding a default acoustic environment; Bitstream (200).
40. the information in the bitstream (200) about the default acoustic environment includes one or more reverberation parameters of the default acoustic environment, the one or more parameters consisting of information about one or more characteristics of reverberation in the default acoustic environment; 40. A bitstream (200) according to claim 39.
41. the one or more reverberation parameters of the information about the default acoustic environment include information about one or more of a pre-delay time, a reverberation time, and a reverberation amplitude; A bitstream (200) according to claim 40.
42. the information about the default acoustic environment in the bitstream (200) includes one or more early reflection parameters, the early reflection parameters comprising information about one or more characteristics of early reflections in the default acoustic environment; A bitstream (200) according to any one of claims 39 to 41.
43. the information about the default acoustic environment in the bitstream (200) includes one or more background parameters, the background parameters comprising information about one or more characteristics of background sounds in the default acoustic environment; A bitstream (200) according to any one of claims 39 to 42.
44. the one or more background parameters of the information on the default acoustic environment in the bitstream (200) include one or more rendering parameters for the background sound, the rendering parameters including information on one or more of a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform; A bitstream (200) according to claim 43.
45. the bitstream (200) includes one or more default acoustic environment guidance parameters for guiding the renderer (120) to use the default acoustic environment; A bitstream (200) according to any one of claims 39 to 44.
46. the default acoustic environment includes one or more trigger conditions necessary to trigger one or more, or all, of the parameters or components of the default acoustic environment; A bitstream (200) according to any one of claims 39 to 45.
47. the bitstream (200) includes one or more modification parameters for modifying at least one of the following: gain, distance weighting, time delay, occlusion weighting, velocity weighting, spatial source saturation weighting; A bitstream (200) according to any one of claims 39 to 46.
48. the information regarding the default acoustic environment is first information regarding a first default acoustic environment of two or more default acoustic environments; the bitstream (200) includes information about the two or more default acoustic environments; A bitstream (200) according to any one of claims 39 to 47.
49. the bitstream (200) includes selection information for selecting one of the two or more default acoustic environments; 49. A bitstream (200) according to claim 48.
50. the bitstream (200) designates, for at least one region of a plurality of regions, one of the two or more default acoustic environments as a default acoustic environment for the at least one region; A bitstream (200) according to claim 48 or 49.
51. the bitstream (200) includes an identifier for each of the at least one area and / or an identifier for the one of the two or more default acoustic environments to indicate the default acoustic environment for the at least one area. A bitstream (200) according to claim 50.
52. the bitstream (200) further comprises information about a current acoustic environment of the virtual audio scene. A bitstream (200) according to any one of claims 39 to 51.
53. the bitstream (200) includes indication data indicating at least one of a plurality of regions in which the current acoustic environment is valid, and / or indication data indicating one or more of the plurality of regions in which the current acoustic environment is not valid, 53. A bitstream (200) according to claim 52.
54. the bitstream (200) further comprises information about a current acoustic environment for at least one of the regions of the virtual audio scene; A bitstream (200) according to any one of claims 39 to 53.
55. The bitstream received by the receiving interface is a bitstream (200) according to any one of claims 39 to 54, If the bitstream (200) does not contain information about the current acoustic environment of the virtual audio scene, the renderer (120) is configured to generate the one or more audio output channels for playing the virtual audio scene according to the information about the default acoustic environment contained in the bitstream (200), and generating the one or more audio output channels comprises: - one or more reverberation parameters of the default acoustic environment, the reverberation parameters including information about one or more characteristics of the reverberation in the default acoustic environment and / or information about one or more of a pre-delay time, a reverberation time, and a reverberation amplitude; one or more early reflection parameters, the early reflection parameters including information regarding one or more characteristics of early reflections in the default acoustic environment; one or more background parameters comprising information of one or more characteristics of a background sound in the default acoustic environment and / or one or more rendering parameters of the background sound, the rendering parameters comprising information on one or more of a background sound waveform, an identifier of the background sound waveform, a background signal level, and filtering characteristics indicative of a frequency response to be applied to the background sound waveform; one or more default acoustic environment guidance parameters for guiding the use of the default acoustic environment by the renderer (120); and one or more trigger conditions necessary to trigger one or more, or all, of said parameters or components of said default acoustic environment; Apparatus (100) according to any one of claims 1 to 38, further dependent on claim 4.
56. An encoder (300) configured to generate a bitstream, comprising: the encoder (300) is configured to generate the bitstream such that the bitstream includes encoded information of one or more audio channels of each of one or more sound sources that emit sound into a virtual audio scene; and the encoder (300) is configured to generate the bitstream to include in the bitstream a number of data fields, the data fields being configured with information about a default acoustic environment; Encoder (300).
57. The encoder (300) is configured to generate the bitstream so as to make the bitstream into a bitstream (200) according to any one of claims 39 to 54.
57. The encoder (300) of claim 56.
58. 1. A method for rendering a virtual audio scene, in which sounds emanate from one or more sound sources, comprising: receiving audio information, the audio information including audio information about the virtual audio scene; generating, in response to the audio information of the virtual audio scene, one or more audio output channels for playing the virtual audio scene; 22. The method of claim 21, further comprising: generating the one or more audio output channels for playing the virtual audio scene in response to information about a default acoustic environment if information about a current acoustic environment of the virtual audio scene is unavailable.
59. 1. A method for generating a bitstream, comprising the steps of: generating said bitstream such that said bitstream comprises coding information for one or more audio channels for each of one or more sound sources emitting sound into the virtual audio scene; A method for effecting generation of the bitstream such that the bitstream includes a plurality of data fields that are comprised of information relating to a default acoustic environment.
60. 60. A computer program for performing the method of claim 58 or 59 when executed on a computer or signal processor.
