Method, Apparatus and System for Modeling Extensive Audio Objects

Abstract

A method of modeling an expansive audio object for audio rendering in a virtual or augmented reality environment is described. The method includes obtaining an expansiveness representation indicative of a geometry of an expansive audio object and information regarding one or more first audio sources associated with the expansive audio object. Further, the method includes obtaining a relative point on the geometry of the expansive audio object based on a user position in the virtual or augmented reality environment. The method also includes determining an expansiveness parameter of the expansiveness representation based on the user position and the relative point, and determining a position of one or more second audio sources relative to the user position for modeling the expansive audio object. Further, the method includes outputting a modified representation of the expansive audio object for modeling the expansive audio object.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to the following priority applications: U.S. Provisional Application No. 63 / 181,865, filed April 29, 2021 (Docket No. D21045USP1), U.S. Provisional Application No. 63 / 247,156, filed September 22, 2021 (Docket No. D21045USP2), and European Patent Application No. 21200055.8, filed September 30, 2021 (Docket No. D21045EP).

[0002] Technical Field This paper relates to object-based audio rendering, and more specifically to rendering pervasive audio objects in virtual reality (VR) environments. [Background technology]

[0003] The new MPEG-I standard enables audio experiences from different viewpoints and / or vantage points or listening positions by supporting full six degrees of freedom (6DoF) in virtual reality (VR), augmented reality (AR), mixed reality (MR), and / or extended reality (XR) applications. 6DoF interaction extends the 3DoF spherical video / audio experience, which is limited to head rotation (pitch, yaw, and roll), to include translational movements (front / back, up / down, and left / right), in addition to head rotation, allowing navigation within the virtual environment (e.g., physically walking around a room).

[0004] For audio rendering in VR applications, an object-based approach is widely adopted, by representing a complex auditory scene as multiple distinct audio objects, each of which is associated with parameters or metadata that define the location / position and trajectory of that object in the scene. Instead of being a point source, an audio object may be given a spatial extent that reflects the auditory perception resulting from that audio object. Such an audio object may emanate one or more sound sources to be rendered in a VR implementation.

[0005] To create a natural and realistic 6DoF experience for the listener, the listener's experience of the directionality and spatial extent of the sound or audio source (object) is important for 6DoF rendering, especially for realizing the experience of navigation through a scene and around a virtual audio source. Since 6DoF rendering further involves larger translational changes of the listener's listening position, the complex interaction between the constantly changing listening position and the audio object extent with sophisticated structure may pose challenges in 6DoF rendering implementation. In particular, more parameters are needed to model such position-object interactions, which causes very high computational complexity in the corresponding audio processing.

[0006] Please note that available audio rendering systems (such as MPEG-H 3D audio renderers) are typically limited to rendering 3DoF (i.e., rotational motion of the audio scene caused by the listener's head movement) which does not take into account translational changes of the listener's listening position. Even 3DoF+ only adds small translational changes of the listener's listening position and does not take into account larger translational movements of the listener. Thus, existing techniques that do not take into account the listener's larger translational movements may encounter difficulties in truly immersive rendering of 6DoF sound. Summary of the Invention [Problem to be solved by the invention]

[0007] Therefore, there is a need to provide a simple way to implement 6DoF rendering of audio objects. In particular, it may be desirable to simplify the modeling of the (spatial) extent of audio objects while taking into account significant user movements for 6DoF rendering. [Means for solving the problem]

[0008] According to one aspect, a (e.g., computer-implemented) method of modeling an extended audio object for audio rendering in a virtual or augmented reality environment (or generally, a computer-mediated reality environment) is described. The method may include obtaining an extent representation indicative of a geometric form of the extended audio object and information regarding one or more first audio sources associated with the extended audio object. The one or more first audio sources may be captured as recorded audio sources associated with the extended audio object using an audio sensor. In particular, the method may include obtaining a relative point using the geometric form of the extended audio object (e.g., the extent representation indicative of the geometric form) based on a user position (i.e., a listening position of a listener) in the virtual or augmented reality environment. Furthermore, the method may include determining an extent parameter of the extent representation based on the user position and the relative point.

[0009] In particular, the spaciousness parameters may describe a spatial extent of the spacious audio object perceived at a user position. Thus, it may be appreciated that such spatial extent of the spacious audio object may vary according to the user position, and the spacious audio object may be adaptively modeled for various user positions. To effectively model the spacious audio object, the method may also include determining positions of one or more secondary audio sources relative to the user position. Such one or more secondary audio sources may be considered as virtual reproduced audio sources for modeling the spacious audio object at the corresponding user position. Furthermore, the method may include outputting a modified representation of the spacious audio object to model the spacious audio object. It is noted that the modified representation includes the determined spaciousness parameters and the positions of the one or more secondary audio sources.

[0010] Organized as above, the proposed method allows modeling the sprawling audio object with simple parameters. In particular, with knowledge of the spatial extent of the sprawling audio object and the corresponding position of the second (virtual) audio source(s) calculated for a given user position, the sprawling audio object can be effectively modeled to have an appropriate (perceived) size corresponding to a given user position, which may be applicable for subsequent rendering (e.g., 6DoF) of the sprawling audio object. Thereby, the computational complexity of the audio rendering can be reduced, since detailed information about the audio object's shape / position / orientation and the user position movement may not be required.

[0011] In other words, the proposed method effectively converts 6DoF data (e.g., input audio object source, user position, object extent geometry, object extent position / orientation, etc.) into simple information as input for extent modeling interfaces / tools. This allows efficient 6DoF rendering of audio objects without the need to process huge amounts of data. In an embodiment, the extent representation indicative of the geometry of the extent audio object corresponds to (matches) the geometry of the extent audio object. For example, for relatively simple geometry, the geometry of the extent audio object may be used as the extent representation.

[0012] In an embodiment, the extent parameter may be determined further based on a position and / or an orientation of the expansive audio object. The method may further include determining one or more second audio sources for modeling the expansive audio object based on the one or more first audio sources. According to this embodiment, the method may further include determining an extent angle based on the user position, the relative point, and the position and / or orientation of the expansive audio object. For example, the extent angle may be an arc measure indicating the spatial extent of the expansive audio object perceived at the user position. Thus, the extent angle may refer to a relative arc measure (i.e., a relative extent angle) that depends on the relative point, and the position and / or orientation of the expansive audio object. In this case, the extent parameter may be determined based on the (relative) extent angle.

[0013] Organized as described above, the proposed method provides a simplified way to obtain accurate estimations of the spatial extent / perceived size of audio objects at different user positions, thereby improving the performance in modeling audio objects using simple parameters.

[0014] In an embodiment, determining the position of the one or more second audio sources may include determining an arc based on the user position, the relative point, and the geometry of the expansive audio object. In addition, determining the position of the one or more second audio sources may further include positioning the determined one or more second audio sources on the arc. Furthermore, the arc may include an arc related to a (relative) spread angle as a corresponding arc measure at the user position, and may be determined based on the spread angle and the user position. In an embodiment, the positioning may include distributing all the second audio sources equally spaced on the arc. Also, the positioning may depend on the correlation level between the second audio sources and / or the intention of the content creator. In other words, the second audio sources may be placed on the arc at an appropriate distance interval determined based on the correlation level between the second audio sources and / or the intention of the content creator.

[0015] In an embodiment, the spaciousness parameter may be determined further based on the number (i.e., count) of the determined one or more secondary audio sources. In particular, the determined number of the one or more secondary audio sources may be a predefined constant independent of the user position and / or relative point. Alternatively, determining the one or more secondary audio sources for modeling the spacious audio object may include determining the number of the one or more secondary audio sources based on a (relative) spaciousness angle. In this case, the number of the one or more secondary audio sources may increase as the spaciousness angle increases (i.e., the number may be positively correlated with the spaciousness angle). More specifically, determining the one or more secondary audio sources for modeling the spacious audio object may further include duplicating the one or more first audio sources or adding a weighted mix of the one or more first audio sources, and applying a decorrelation process to the duplicated or added first audio sources. That is, the first audio source(s) may be duplicated or a weighted mix of them may be added to obtain the determined number of secondary audio sources.

[0016] Configured as above, by appropriately defining the second (virtual) audio source, the method allows to model audio objects in an accurate and adaptable manner: in particular, modeling can be effectively performed for various user positions, for audio objects with different input sources and forms / positions, as well as for the content creator's intent.

[0017] In some embodiments, the spaciousness representation may refer to a two-dimensional or three-dimensional geometric form for representing the spatial extent of the spacious audio object. Further, the spacious audio object may be oriented in two or three dimensions. Furthermore, the spatial extent of the spacious audio object as perceived at a user's position may be described as the perceived width, size, and / or massiveness of the spacious audio object.

[0018] The relative point may be obtained closest to the user's position in the virtual or augmented reality environment using the geometry of the expansive audio object (e.g., an expansive representation of it).

[0019] In particular, the relative point may be the point on the geometric form of the spatial audio object (eg, a spatial representation showing it) that is closest to the user position.

[0020] The inventors have surprisingly found that using the closest relative point to the user position to model the spacious audio object leads to better control of the audio level attenuation for different user positions relative to the spacious audio object and therefore leads to better modelling of the spacious audio object.

[0021] In an embodiment, obtaining a relative point using a spatial representation indicative of a geometric form of a spatial audio object comprises obtaining a relative point on said geometric form or at a distance from said geometric form or spatial representation. For example, the relative point may be located on the geometric form. Alternatively, the relative point may be located at a distance from the spatial representation or geometric form. For example, the relative point may be located at a distance from a boundary or an origin of the spatial representation or geometric form.

[0022] In an embodiment, the method may further include obtaining a vertical projection of the sprawling audio object on a projection plane perpendicular to a first line connecting the user position and the relative point. The method may also include determining a number of boundary points that identify a projected size of the sprawling audio object on the vertical projection. In this case, a (relative) spread angle may be determined using the user position and the number of boundary points. For example, the spread angle may be determined by connecting two boundary points with the user position and determining the spread angle as an angle between two straight lines connecting each of the boundary points with the user position.

[0023] Specifically, determining the plurality of boundary points may include obtaining a second line relative to a horizontal projection size of the sprawling audio object. Thus, the plurality of boundary points may include a leftmost boundary point and a rightmost boundary point of a vertical projection on the second line. Depending on the orientation of the sprawling audio object, the horizontal projection size may be a maximum size of the sprawling audio object. In some embodiments, the sprawling audio object may have a complex geometry and the vertical projection may include a simplified projection of the sprawling audio object having the complex geometry. In this case, the method may further include obtaining a simplified geometry of the sprawling audio object for use in determining the relative point prior to obtaining the relative point on the geometry of the sprawling audio object.

[0024] When configured as described above, the method allows for simplifying the estimation of the spatial extent / perceived size of audio objects with various geometric forms, while providing sufficient accuracy in modeling audio objects using simple parameters.

[0025] In an embodiment, the method may further include rendering the expansive audio object based on the modified representation of the expansive audio object. The expansive audio object may be rendered using the determined positions of the one or more second audio sources and the expansive parameters. In particular, the rendering may include 6DoF audio rendering. The method may further include obtaining a user position, a position and / or an orientation and a geometry of the expansive audio object for rendering.

[0026] In an embodiment, the method may further include controlling a perceived size of the spacious audio object using the spaciousness parameter. Thus, the spacious audio object may be modeled as a point source or a wide source by controlling the perceived size of the spacious audio object. It should be noted that the positions of the one or more secondary audio sources may be determined such that all secondary audio sources have the same reference distance from the user position.

[0027] The above arrangement allows for an effective modelling of an expansive audio object with simple parameters. In particular, the spatial extent of the expansive audio object and the corresponding position of the second (virtual) audio source are calculated for a given user position to allow an accurate estimation of the appropriate (perceived) size of the audio object corresponding to the given user position (i.e. the spatial extent size that can be perceived at that user position). Since detailed information about the shape / position / orientation of the audio object and the movement of the user position may not be required for modelling, the processing for subsequent rendering of the audio object (e.g. 6DoF rendering) may be simplified accordingly.

[0028] In other words, the proposed method provides an automatic transformation of 6DoF data (e.g., input audio object source, user position, object extent geometry, object extent position / orientation, etc.) for audio extent modeling which may require simple parameters as input interface data, further allowing efficient 6DoF rendering of audio objects without complex data processing.

[0029] According to another aspect, an apparatus for modeling a spacious audio object for audio rendering in a virtual or augmented reality environment (or generally, a computer-mediated reality environment) is described. The apparatus may include a processor and a memory coupled to the processor that stores instructions for the processor. The processor may be configured to obtain a spaciousness representation indicative of a geometry of the spacious audio object and information regarding one or more first audio sources associated with the spacious audio object. The one or more first audio sources may be captured using an audio sensor as recorded audio sources associated with the spacious audio object. In particular, the processor may be configured to obtain a relative point on the geometry of the spacious audio object based on a user position in the virtual or augmented reality environment. Additionally, the processor may be configured to determine a spaciousness parameter for the spaciousness representation based on the user position and the relative point.

[0030] In particular, the spaciousness parameters may describe a spatial spaciousness of the spacious audio object perceived at a user position. It may thus be understood that such spatial spaciousness of the spacious audio object may vary according to the user position and the spacious audio object may be adaptively modeled for different user positions. Furthermore, the processor may be configured to determine positions of one or more secondary audio sources relative to the user position to model the spacious audio object. Such one or more secondary audio sources may be considered as virtual reproduced audio sources to model the spacious audio object at the corresponding user position. Also, the processor may be configured to output a modified representation of the spacious audio object to model the spacious audio object. In particular, the modified representation may include the spaciousness parameters and positions of the one or more secondary audio sources.

[0031] Configured as above, the proposed device effectively converts 6DoF data (e.g., input audio object source, user position, object spread geometry, object spread position / orientation, etc.) into simple information / parameters as input for spread modeling interfaces / tools. This allows efficient 6DoF rendering of audio objects without the need to process huge amounts of data.

[0032] In particular, with knowledge of the spatial extent of the expansive audio object and the corresponding position of the second (virtual) audio source calculated for a given user position, the expansive audio object can be effectively modeled to have an appropriate (perceived) size corresponding to a given user position, which may be applicable for subsequent rendering (e.g. 6DoF) of the expansive audio object, thereby reducing the computational complexity of the audio rendering, since detailed information about the audio object's shape / position / orientation and the user position movement may not be required.

[0033] According to another aspect, a system for implementing audio rendering in a virtual or augmented reality environment (or in general, a computer-mediated reality environment) is described. The system may include the proposed device (e.g. as described above) and a spaciousness modeling unit. The spaciousness modeling unit may be configured to receive information about a modified representation of a spacious audio object from the device as described above. Furthermore, the spaciousness modeling unit may be configured to further control a spaciousness size of the spacious audio object based on the information about the modified representation (e.g. a spaciousness parameter included in the modified representation). In some embodiments, the system may be or be part of a user virtual reality console (e.g. a headset, a computer, a mobile phone, or any other audio rendering device for rendering audio in a virtual and / or augmented reality environment). In some embodiments, the system may be configured to transmit the information about the modified representation of the spacious audio object and / or the controlled spaciousness size to an audio output.

[0034] According to a further aspect, a computer program is described that may include executable instructions for performing the method steps outlined throughout this disclosure when executed by a computing device.

[0035] According to another aspect, a computer readable storage medium is described, which can store a computer program adapted for execution on a processor and, when executed on the processor, to perform the method steps outlined throughout this disclosure.

[0036] It should be noted that the method and system, including its preferred embodiments as outlined in this patent application, may be used alone or in combination with other methods and systems disclosed herein. Furthermore, all aspects of the method and system outlined in this patent application may be combined in any manner. In particular, the features of the claims may be combined with each other in any manner.

[0037] It will be understood that apparatus features and method steps can be interchanged in many ways. In particular, details of the disclosed methods can be implemented by a corresponding apparatus, and vice versa, as will be understood by those skilled in the art. Furthermore, any statements made above with respect to methods (and, e.g., steps thereof) will be understood to apply equally to corresponding apparatus (and, e.g., blocks, stages, units thereof), and vice versa. [Brief description of the drawings]

[0038] The invention will now be described, by way of example only, with reference to the accompanying drawings, in which: [Figure 1] FIG. 1 is a conceptual diagram of an exemplary spread modeling tool in accordance with an embodiment of the present disclosure. [Figure 2a]1 illustrates an exemplary audio scene including different user positions for implementing audio rendering of a spacious audio object, according to an embodiment of the present disclosure. [Figure 2b] FIG. 2(b) illustrates a diagram showing the broadening level for a corresponding user position in the exemplary audio scene shown in FIG. 2(a) in accordance with an embodiment of the present disclosure. [Diagram 3] 1 illustrates an exemplary flowchart for implementing audio rendering of spacious audio objects in accordance with an embodiment of the present disclosure. [Figure 4] 1 illustrates an exemplary block diagram for implementing audio rendering of spacious audio objects, according to an embodiment of the present disclosure. [Figure 5a] 3 shows one schematic diagram for determining a modified representation of an expansive audio object, as implemented in a method 300 according to an embodiment of the present disclosure. [Figure 5b] 3 shows one schematic diagram for determining a modified representation of an expansive audio object, as implemented in a method 300 according to an embodiment of the present disclosure. [Figure 5c] 3 shows one schematic diagram for determining a modified representation of an expansive audio object, as implemented in a method 300 according to an embodiment of the present disclosure. [Figure 6] FIG. 3 is another schematic diagram for determining a modified representation of an expansive audio object, as implemented in the method 300 according to an embodiment of the present disclosure. [Figure 7] (a)-(b) show the definition of the reference distance for an extended object source. [Figure 8a] 3 illustrates respective resulting modified representations of the pervasive audio object for different user positions as shown in FIG. 2 according to an embodiment of the present disclosure. [Figure 8b] 3 illustrates respective resulting modified representations of the pervasive audio object for different user positions as shown in FIG. 2 according to an embodiment of the present disclosure. [Figure 8c] 3 illustrates respective resulting modified representations of the pervasive audio object for different user positions as shown in FIG. 2 according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] As outlined above, the present disclosure relates to effective modeling of sprawling audio objects for audio rendering in virtual and / or augmented reality environments (or computer-mediated reality environments in general). FIG. 1 shows a conceptual diagram of an exemplary sprawling modeling tool according to an embodiment of the present disclosure. Here, a sprawling audio object 101 to be modeled is associated with one or more audio sources 102. The audio sources 102 may be captured as recorded audio sources using an audio sensor (e.g., microphone, etc.). In general, the sprawling audio object 101 may be considered as a sprawling audio object having a geometric form. It may be provided with a sprawling representation indicating the geometric form and information about the one or more audio sources 102. In addition, the one or more audio sources 102 may include, for example, one or more point source signals associated with the sprawling audio object 101. A sprawling modeling tool 103 may model the sprawling audio object 101 based on the form of the sprawling audio object 101 and the information about the one or more audio sources 102. For example, the location of one or more audio sources 102 may be included in the spatial representation. The one or more audio sources 102 themselves may or may not be included in the spatial representation.

[0040] The spaciousness modeling tool 103 may also model the spacious audio object 101 based on a user position (e.g., a listener's listening position) in the virtual and / or augmented reality environment. That is, depending on the user position, the spacious audio object 101 may be modeled as an audio source (e.g., a wide source or a point source) having different spaciousness sizes. This may be achieved by providing a modified representation of the spacious audio object 101 for a particular user position based on the (original) spaciousness representation. Thus, the spacious audio object 101 may be effectively modeled as having different spaciousness sizes experienced / perceived at different user positions via the respective modified representations.

[0041] FIG. 2(a) illustrates an exemplary audio scene including different user positions for implementing audio rendering of a pervasive audio object according to an embodiment of the present disclosure. As an example, the pervasive audio object may include a "beachfront" with large waves. Other examples may be known to one of ordinary skill in the art. The exemplary audio scene may be applied to implement 6DoF audio rendering in a virtual or augmented reality environment. In this embodiment, an object pervasiveness 201 is illustrated as a pervasive audio object having a two-dimensional or three-dimensional geometric form that may be oriented in two or three dimensions. An (original) pervasiveness representation is obtained that illustrates the geometric form of the object pervasiveness 201 and includes information regarding the pervasiveness geometry, position, and orientation, as well as information regarding audio sources 202 associated with the object pervasiveness. Although the audio sources 202 are illustrated here as two point sources, any number and other types of audio sources may be feasible in the context of the present disclosure. As mentioned above, the audio sources 202 may be recorded audio sources captured using an audio sensor (e.g., a microphone, etc.). Additionally, user positions 203a, 203b, 203c (which may be, for example, relative positions with respect to the object expanse 201) are also obtained. In the illustrated exemplary scene, user 203a and user 203b are located in front of the object expanse 201 but at different distances from it, and user 203c is located to one side of the object expanse 201. However, any other positions may also be included in the scene as user positions.

[0042] FIG. 2(b) illustrates the broadness levels for corresponding user positions in the example audio scene shown in FIG. 2(a), according to an embodiment of the present disclosure, where broadness levels 204a, 204b, 204c represent the respective perceptions of object broadness 201 at user positions 203a, 203b, 203c. In this embodiment, the broadness levels may be defined using broadness parameters that describe the spatial broadness of the object broadness (broad audio object) perceived at a particular user position. In particular, the perception of the object broadness 201 (and thus the broadness parameters) may depend on the relative user-to-broadness geometric position and orientation (e.g., the orientation of the user position and / or the broad object relative to the object broadness). For example, as shown in FIG. 2(b), a user may experience a greater broadness level 204a at user position 203a than at user positions 203b and 203c, which have corresponding broadness levels 204b and 204c, respectively. It may therefore be beneficial to relate such a broadness level to the user position and simply use the broadness parameters to model broad audio objects in order to render audio scenes where significant changes in user position (i.e. large translational movements) may occur.

[0043] FIG. 3 illustrates an exemplary flowchart for implementing audio rendering of a spacious audio object, according to an embodiment of the present disclosure. As illustrated, a method 300 may be performed to model a spacious audio object, such as the spacious audio object 101 or the object spaciousness 201, for audio rendering in a virtual and / or augmented reality environment. In step 301, a spaciousness representation indicative of the geometry of the spacious audio object and information regarding one or more first audio sources associated with the spacious audio object are obtained. In step 302, a relative point on the geometry of the spacious audio object (e.g., the spaciousness representation indicative of the geometry) is obtained (e.g., determined) based on a user position in the virtual reality or augmented reality environment. In step 303, a spaciousness parameter (e.g., indicative of a spaciousness level indicative of a perceived / spatial spaciousness of the spacious audio object) is determined for the spaciousness representation based on the user position and the relative point. As described above, the spaciousness parameter may describe the spatial spaciousness of the spacious audio object perceived at the user position.

[0044] In step 304, the positions of one or more second audio sources are determined relative to the user position to model the spacious audio object. Unlike the first audio source, which may have been captured through direct recording, the one or more second audio sources may be virtual, reproduced audio sources determined based on the first audio source(s), for example through duplication and / or audio processing (including, for example, filtering), as described in detail below. Then, in step 305, a modified representation of the spacious audio object is output to model the spacious audio object. It should be noted that the modified representation may include the spaciousness parameters and the determined positions of one or more second audio sources for the given user position. Thus, the spacious audio object can be effectively modeled for a particular user position with simple parameters that include knowledge of the spatial extent of the spacious audio object and / or the corresponding positions of the second audio sources calculated for this particular position.

[0045] In other words, the proposed method 300 effectively converts 6DoF data (e.g., input audio object source, user position, object spread geometry, object spread position / orientation, etc.) into simple information (e.g., spread parameters included in the modified representation and the position of the second audio source) as input for a spread modeling interface / tool ​​(e.g., spread modeling tool 103), which in some implementations may be a legacy interface / tool.

[0046] Further, a subsequent rendering of the expansive audio object may be performed based on the modified representation of the expansive audio object. In this case, the expansive audio object may be rendered using the determined positions of the one or more second audio sources and the expansiveness parameters. In some embodiments, the rendering may be a 6DoF audio rendering of the expansive audio object. In this case, in addition to the user position, a position and / or orientation and a geometry of the expansive audio object may be obtained for rendering. Thus, the expansiveness parameters may be determined further based on the position and / or orientation of the expansive audio object.

[0047] 4 illustrates an exemplary block diagram for implementing audio rendering of an expansive audio object according to an embodiment of the present disclosure. In particular, system 400 comprises an apparatus for modeling an expansive audio object for audio rendering in a virtual and / or augmented reality environment. In embodiments, system 400 may be or be part of a user virtual reality console, such as a headset, computer, mobile phone, or any other audio rendering device for rendering audio in a virtual and / or augmented reality environment.

[0048] In some embodiments, the apparatus may be in the form of a parameter conversion unit 401, comprising, for example, a processor configured to perform all steps of the method 300 and a memory coupled to the processor for storing instructions for the processor. In particular, the parameter conversion unit 401 may be configured to receive audio scene data, e.g. 6DoF data including information about an input audio object source, a user position 403, and a spatial geometry, position, and / or orientation of a spatial audio object 402 (e.g., a spatial audio object 101 or an object spatiality 201). The parameter conversion unit 401 may further be configured to perform steps 301-305 of the method 300 described above. Thus, the parameter conversion unit 401 converts the received audio scene data into simplified information (e.g., as a modified representation of the spatial audio object). The simplified information comprises information about a second (virtual) audio object 404 (e.g. object position and signal data of the second audio source(s)) and a spaciousness parameter 405 indicating a spaciousness level describing the perceived / spatial spaciousness of said spacious audio object experienced at a particular position. The parameter transformation unit 401 may transmit this (simplified) information directly or via other processing components to an audio rendering unit (e.g. internal or external to the system 400) for outputting audio to a user (or alternatively may be part of an audio rendering unit for outputting audio to a user, e.g. via a suitable device speaker). Thus, when the system 400 is part of an audio rendering device, it may transmit the transformed parameters (e.g. the above-mentioned simplified information relating to the modified representation) to the audio output of the audio rendering device.

[0049] In some embodiments, the simplified information output by the parameter conversion unit 401 may then be provided as input interface data to the spaciousness modeling unit 406. The spaciousness modeling unit 406 (also known as a spaciousness modeling tool, e.g., the spaciousness modeling tool 103) may control the spaciousness size of the (e.g., rendered) spacious audio object based on the spaciousness parameters included in the simplified information. For example, the perceived size of the spacious audio object may be controlled using the spaciousness parameters, which may model the spacious audio object as a point source or a wide source. Thus, an appropriate (perceived) size corresponding to a particular user position may be provided for a subsequent rendering (e.g., 6DoF rendering) of the spacious audio object by simply adjusting the spaciousness parameters (e.g., the spaciousness level). This provides a simplified system for implementing 6DoF rendering of the spacious audio object. As a result, detailed information about the shape / position / orientation of the audio objects and the (translational) movement of the user position may not be required for rendering / modelling, which further allows 6DoF rendering to be performed by existing audio rendering techniques (e.g. suitable for 3DoF rendering), thereby reducing the computational complexity of 6DoF audio rendering.

[0050] In other words, an automatic transformation of 6DoF scene data is provided by the proposed method 300 and / or system 400 for audio spaciousness modeling which may require simple parameters as input interface data, allowing efficient 6DoF rendering of audio objects using available existing systems without requiring complex data processing for rendering.

[0051] 5(a)-5(c) show schematic diagrams for determining a modified representation of a sprawling audio object as performed in the method 300 according to an embodiment of the present disclosure. The sprawling representation is assumed to represent a three-dimensional geometric form for representing the spatial extent of the sprawling audio object oriented in three dimensions. In the exemplary embodiment shown in FIG. 5, the sprawling representation represents a cuboid representing the spatial extent of the sprawling audio object perceived at a given user position, which may be described as the perceived width, size, and / or mass of the sprawling audio object. However, the sprawling representation may also represent other solid shapes or more complex geometries for representing the object extent. An example of a first stage of transforming a three-dimensional (3D) geometry into a two-dimensional (2D) user observation domain is shown in FIG. 5(a). Then, the second stage in the 2D user observation domain determines a spreading parameter (e.g., spreading level) for a given user position, as shown in FIG. 5(b), and the third stage determines the position of one or more second audio sources according to a one-dimensional (1D) view, as shown in the example of FIG. 5(c).

[0052] As can be seen in the example of FIG. 5(a), a user 501 is located in front of an expansive audio object 503 that is oriented in three dimensions. The expansive audio object 503 is represented by a 3D geometric form that indicates the spatial extent of the expansive audio object 503. According to an exemplary embodiment, a point 502 on the geometric form of the expansive audio object 503 that is closest to the user 501 (e.g., as a relative point) may be obtained (e.g., determined). Optionally, a projection plane 504 may be obtained (e.g., determined) that is orthogonal to a first line 505 connecting the user position 501 and the point 502. On the projection plane 504, a vertical projection 506 of the expansive audio object 503 may be obtained (e.g., determined). Thereafter, a second line 507 that characterizes the horizontal size (e.g., on the projection) of the expansive audio object 503 may be obtained (e.g., determined). The second line 507 may form a plane 508 (e.g., as a viewing surface) together with the first line 505. Thus, the first stage shown in Figure 5(a) transforms the 3D geometry of the expansive audio object 503 into a 2D viewing surface 508.

[0053] As can be seen in the example of Fig. 5(b), a number of boundary points 509, 510 can be determined on the vertical projection 506. In particular, the boundary points 509, 510 can include the leftmost and rightmost boundaries of the perspective projection 506 on the second line 507. Thus, the number of boundary points 509, 510 can identify the projected size of the spacious audio object 503. Using the determined boundary points 509, 510 and the user position 501, a spread angle x, which represents the spread level (e.g., as a spread parameter), can be calculated. 0 can be calculated accordingly, for example by trigonometric calculations. 0 can be determined as the angle between two lines connecting the user position 501 and the boundary points 509, 510, respectively. Thus, as described above, the spread angle x 0may refer to a relative arc measure (i.e., a relative spread angle) that depends on the relative point, as well as the position and / or orientation of the expansive audio object. Additionally, the arc 513 may be determined based on the geometry of the user position 501, the relative point 502, and the expansive audio object 503. In particular, the arc 513 may be determined based on the spread angle x 0 may be an arc related to the spread angle x 0 and may be determined based on user position 501.

[0054] As mentioned above, the position and / or orientation of the spacious audio object may be used to determine the spaciousness parameter. More specifically, the user position 501, the relative point 502, and the position and / or orientation of the spacious audio object 503 may determine a spaciousness angle x on which the spaciousness parameter may be based. 0 As mentioned above, the divergence angle x 0 may be determined (e.g., calculated) by use of trigonometric operations. It may be further appreciated that the determined spreading level (e.g., as a scalar quantity) and therefore the corresponding arc obtained at this stage may be used for audio source localization, which is performed in the third stage described below.

[0055] Spread angle x 0 After determining the number of audio sources 511 and the corresponding arc 513, one or more second audio sources 511 may be positioned on the arc 513, as shown in the example of FIG. 5(c). Note that the audio sources positioned on the arc 513 may be of equal volume (e.g., may be perceived as equal loudness) to the user 501 and may have the same reference distance. Optionally, the number (count) of second audio sources 511 may be determined by the spread angle x 0For example, for small angles, only one secondary audio source (N=1) may be applied, and for large angles, two or more secondary audio sources (N>1) may be applied. That is, the number of secondary audio sources 511 is determined based on the spread angle x 0 Alternatively, the number N of secondary audio sources 511 may be independent of the user position 501 and / or the relative point 502 (e.g., as the spread angle x 0 , the spread level 512, and the length of the arc 513) may be a predetermined constant.

[0056] Then, a spaciousness level 512 is calculated using the (relative) spaciousness angle x 0and may be set / determined depending on the number N of secondary audio sources 511. In particular, the secondary audio sources 511 may be arranged / positioned on the arc 513. In case of more than one secondary audio source (i.e., N>1), these available N audio sources 511 may be positioned on the arc 513 such that all secondary audio sources 511 are equally loud (i.e., perceived as equal loudness) to the user and / or have the same reference distance (e.g., distance from the user position to the relative point 502) calculated from a point on the arc 513 for appropriate distance attenuation. For example, the secondary audio sources 511 may be equally distributed on the arc 513, i.e., arranged / positioned on the arc 513 such that the same distance separates adjacent secondary audio sources 511 from each other. In some embodiments where more than one second audio source is considered, the positioning may depend on the correlation level between the second audio sources 511 and / or the intent of the content creator, as shown for N=2 in the example of Fig. 5(c). For example, each pair of adjacent second audio sources 511 may have different levels of decorrelation (e.g., according to their original recordings or (additional / artificial) processing such as duplication, decorrelation filtering, etc.). The distance D2 between a pair of second audio signals 511 having a high (or higher) level of decorrelation may be larger than the distance D1 between a pair of second audio signals 511 having a low (or lower) level of decorrelation.

[0057] It is further noted that one or more second audio sources 511 may be determined from the (original) first audio sources, for example by increasing the number of first audio sources. This may be achieved by duplicating one or more first audio sources and / or adding a weighted mix of one or more first audio sources and then applying a decorrelation process to the duplicated and / or added first audio sources. For example, when only one or a few first audio sources have been recorded / captured for a spacious audio object, in order to determine the second audio source, the number of audio sources may be increased by duplicating one or a few first audio sources. Alternatively, in case of multiple first audio sources, the second audio source may be determined by adding a weighted mix of them. A subsequent application of a signal decorrelation process may be performed to obtain the final second audio source.

[0058] FIG. 6 shows another schematic diagram of an example for determining a modified representation of a spacious audio object (e.g., performed in method 300) according to embodiments of the present disclosure. While FIG. 5 shows a cuboid for representing the spatial extent of the spacious audio object 503, the example of FIG. 6 shows the case where the spacious audio object 603 may have a complex geometric shape (e.g., a vehicle). Similar to the embodiment of FIG. 5, a user 601 is located in front of the spacious audio object 603 oriented in three dimensions. However, in this exemplary embodiment, a simplified spaciousness representation 605, e.g., an ellipsoid, may be obtained before applying step 301 of the proposed method 300 in order to simplify steps 301 and 303. In other words, for embodiments in which the spacious object has a complex geometric shape, the method 300 may further include obtaining a simplified geometric shape (simplified spaciousness geometry) 605 of the spacious audio object to be used in determining the relative point before or in order to obtain the relative point on the geometric shape of the spacious audio object. Thus, a simplified vertical projection 606 of the spacious audio object 603 may be obtained for the subsequent determination of the spaciousness angle / level 604 as explained above.

[0059] Returning to FIG. 5, a second audio source 511 may be positioned on the arc 513 to have the same reference distance relative to the user position 501. It will be appreciated that the reference distance specifies the distance (e.g., user-source distance) at which the calculated attenuation of the audio source element is minimal, e.g., 0 dB, regardless of the distance attenuation law used. For an object source with an extent, such a user-source distance may be measured relative to the origin of the extent (e.g., its "position" attribute) or relative to the extent itself, as shown in the examples of FIG. 7(a) and FIG. 7(b), respectively. In the example of FIG. 7(a), the reference distance D ref is defined relative to the origin 702a of the object extent 701a, while in the example of FIG. 7(b) the reference distance D refis defined relative to the closest point of the object extent 701b, as also shown by relative point 502 in the example of Figure 5. Thus, with reference to Figures 7(a) and 7(b), the closest relative point to the user position will be located on the dashed line. In the example of Figure 7(a), the relative point is a reference distance D from the origin 702a of the object extent 701a. ref In the example of FIG. 7(b), the relative point is located at a reference distance D ref 5(b), since relative point 502 (e.g., as the closest point to user 501) is also located on arc 513, a second audio source located on arc 513 has the same reference distance as relative point 502, where the attenuation may show a minimum.

[0060] 8(a)-(c) show examples of the resulting modified representation of each of the spacious audio objects for different user positions as shown in FIG. 2 according to the embodiments of the present disclosure. Similar to the audio scene shown in FIG. 2, user 803a and user 803b are located in front of the object spaciousness 801 but at different distances from the object spaciousness 801, and user 803c is located on one side of the object spaciousness 801. It can be understood that any other positions can also be included in the scene as user positions. Thus, the resulting spaciousness levels 804a, 804b, 804c represent the respective perceptions (e.g., spatial spaciousness) of the object spaciousness 801 at user positions 803a, 803b, 803c. As shown in the example of FIG. 8, the resulting spaciousness level 804a at user position 803a is larger than the resulting spaciousness level 804b at user position 803b. This may also allow a larger number of secondary audio sources 802a to be determined (and positioned) to model the object spread 801. Similarly, the resulting spread level 804b at user position 803b is greater than the resulting spread level 804c at user position 803c, which may also allow a larger number of secondary audio sources 802b to be determined (and positioned) to model the object spread 801. In this example, the modified representation for user position 803a includes five secondary audio sources 802a, the modified representation for user position 803b includes two secondary audio sources 802b, and the modified representation for user position 803c includes only one secondary audio source 802c.

[0061] interpretation Aspects of the system described herein may be implemented in a suitable computer-based sound processing network environment (e.g., a server or cloud environment) for processing digital or digitized audio files. Portions of the adaptive audio system may include one or more networks including any desired number of individual machines, including one or more routers (not shown) that serve to buffer and route data transmitted between computers. Such networks may be built on a variety of different network protocols and may be the Internet, a wide area network (WAN), a local area network (LAN), or any combination thereof.

[0062] One or more of the components, blocks, processes, or other functional components may be implemented through a computer program that controls the execution of a processor-based computing device of the system. It should also be noted that the various functions disclosed herein may be described in terms of their behavior, register transfers, logical components, and / or other characteristics as data and / or instructions embodied using any number of combinations of hardware, firmware, and / or in various machine-readable or computer-readable media. The computer-readable media on which such formatted data and / or instructions may be embodied include various forms of physical (non-transitory) non-volatile storage media, such as, but not limited to, optical storage media, magnetic storage media, or semiconductor storage media.

[0063] In particular, it should be understood that the embodiments may include hardware, software, and electronic components or modules, and for purposes of discussion may be illustrated and described as if the majority of the components were implemented solely in hardware. However, based on reading this detailed description, one skilled in the art will recognize that in at least one embodiment, the electronic-based aspects may be implemented in software (e.g., stored in a non-transitory computer-readable medium) executable by one or more electronic processors, such as a microprocessor and / or an application-specific integrated circuit ("ASIC"). Thus, it should be noted that a number of hardware and software-based devices, as well as a number of different structural components, may be utilized to implement the embodiments. For example, a "content activity detector" described herein may include one or more electronic processors, one or more computer-readable media modules, one or more input / output interfaces, and various connections (e.g., a system bus) connecting the various components.

[0064] Although one or more implementations have been described in terms of specific embodiments by way of example, it is to be understood that the one or more implementations are not limited to the disclosed embodiments. Rather, it is intended to cover various modifications and similar arrangements that would be apparent to those skilled in the art. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

[0065] It is also to be understood that the phraseology and terminology used herein is for purposes of description and should not be regarded as limiting. The use of "including," "comprising," or "having," and variations thereof, is intended to encompass the listed items and equivalents thereof as well as additional items. Unless otherwise specified or limited, the terms "mounted," "connected," "supported," and "coupled," and variations thereof, are used broadly to encompass both direct and indirect mounting, connecting, supporting, and coupling.

[0066] LISTED ILLUSTRATIVE EMBODIMENTS Various aspects and implementations of the present disclosure can be understood from the following enumerated example embodiments (EEE), which are not claims. [EEE1] 1. A method for modeling an expansive audio object for audio rendering in a virtual reality or augmented reality environment, comprising: obtaining a spaciousness representation indicating a geometry of an expansive audio object and information about one or more first audio sources associated with the expansive audio object; obtaining a relative point on the geometry of the expansive audio object based on a user position in the virtual or augmented reality environment; determining spaciousness parameters of the spaciousness representation based on the user position and the relative point, the spaciousness parameters describing a spatial spaciousness of the expansive audio object perceived at the user position; determining positions relative to the user position of one or more second audio sources for modeling the expansive audio object; and outputting a modified representation of the expansive audio object for modeling the expansive audio object, the modified representation including the spaciousness parameters and positions of the one or more second audio sources. [EEE2] The method of claim 1, further comprising determining, based on the one or more first audio sources, the one or more second audio sources for modeling the spacious audio object. [EEE3] The method of any one of claims 1 to 2, wherein the spaciousness parameters are determined further based on a position and / or an orientation of the spacious audio object. [EEE4] The method according to EEE3, further comprising determining a relative spread angle based on the user position, the relative point and the position and / or orientation of the spacious audio object, wherein the spread parameter is determined based on the relative spread angle. [EEE5] The method of any one of EEE1 to 4, wherein determining a position of the one or more secondary audio sources comprises: determining an arc based on the user position, the relative point, and the geometry of the expansive audio object; and positioning the determined one or more secondary audio sources on the arc. [EEE6] The method of EEE5, wherein said positioning includes distributing all said second audio sources equally spaced on said arc. [EEE7] The method of any one of claims 5 to 6, wherein said positioning depends on a correlation level between said second audio sources and / or the intent of a content creator. [EEE8] 8. The method of any one of claims 2 to 7, wherein the wideness parameter is determined further based on a determined number of one or more secondary audio sources. [EEE9] The method of claim 8, wherein the determined number of one or more secondary audio sources is a predetermined constant independent of the user position and / or the relative point. [EEE10] The method according to EEE8 when citing EEE4, wherein determining the one or more secondary audio sources for modeling the spacious audio object comprises determining a number of the one or more secondary audio sources based on the relative spaciousness angle. [EEE11] The method of claim 10, wherein the number of the one or more secondary audio sources increases as the relative spread angle increases. [EEE12] 12. The method of any one of claims 8 to 11, wherein determining the one or more second audio sources for modeling the spacious audio object further comprises: replicating the one or more first audio sources or adding a weighted mix of the one or more first audio sources; and applying a decorrelation process to the replicated or added first audio sources. [EEE13] The method according to any one of EEE1 to 12, wherein the spaciousness representation indicates a two-dimensional or three-dimensional geometric form for representing the spatial extent of the spacious audio object. [EEE14] The method of any one of EEE1 to 13, wherein the expansive audio object (3) is oriented in two or three dimensions. [EEE15] The method of any one of EEE1 to 14, wherein the spatial extent of the extensive audio object perceived at the user position is described as the perceived width, size and / or weight of the extensive audio object. [EEE16] The method of any one of EEE1 to 15, wherein the relative point is the point on the geometric form of the expansive audio object that is closest to the user position. [EEE17] A method according to any one of EEE4 to 16, further comprising the steps of: obtaining a vertical projection of the sprawling audio object on a projection plane perpendicular to a first line connecting the user position and the relative point; and determining a number of boundary points on the vertical projection that identify a projected size of the sprawling audio object, wherein the relative spread angle is determined using the user position and the number of boundary points. [EEE18] The method of claim 8, wherein determining the plurality of boundary points includes obtaining a second line related to a horizontal projection size of the expansive audio object, the plurality of boundary points including a leftmost boundary point and a rightmost boundary point of the vertical projection onto the second line. [EEE19] The method according to EEE18, wherein the horizontal projection size is a maximum size of the expansive audio object. [EEE20] 20. The method of any one of claims 17 to 19, wherein the vertical projection comprises a simplified projection of the expansive audio object having a complex geometric shape. [EEE21] The method of EEE20, further comprising, prior to obtaining the relative point on the geometric form of the spacious audio object, obtaining a simplified geometric form of the spacious audio object for use in determining the relative point. [EEE22] The method of any one of EEE1 to 21, further comprising a step of rendering the spacious audio object based on the modified representation of the spacious audio object, wherein the spacious audio object is rendered using the determined positions of the one or more secondary audio sources and the spaciousness parameters. [EEE23] The method of claim 22, wherein the rendering comprises 6DoF audio rendering, and further comprises obtaining the user position, a position and / or an orientation and a geometry of the expansive audio object for the rendering. [EEE24] 24. The method of any one of claims 8 to 23, further comprising using the spaciousness parameter to control the perceived size of the spacious audio object. [EEE25] The method according to claim 8, wherein the expansive audio object is modelled as a point source or a wide source by controlling the perceived size of the expansive audio object. [EEE26] The method of any one of EEE1 to 25, wherein the positions of the one or more secondary audio sources are determined such that all the secondary audio sources have the same reference distance from the user position. [EEE27] An apparatus for modeling pervasive audio objects for audio rendering in a virtual or augmented reality environment, the apparatus having a processor and a memory coupled to the processor storing instructions for the processor, the processor configured to perform all the steps of the methods described in any one of EEE1 to EEE26. [EEE28] A system for implementing audio rendering in a virtual or augmented reality environment, the system comprising: an apparatus as described in EEE27; and a spaciousness modeling unit configured to receive information about the modified representation of the spacious audio object from the apparatus, and to control a spaciousness size of the spacious audio object based on the information about the modified representation. [EEE29] The system of claim EEE28, wherein the system is, or is part of, a user virtual reality console. [EEE30] 30. The system of claim EEE28 or 29, wherein the system is configured to transmit the information about the modified representation of the spacious audio object and / or the controlled spaciousness size to an audio output. [EEE31] A computer program comprising instructions which, when executed by a computing device, cause the computing device to perform all the steps of the method according to any one of claims EEE1 to 26. [EEE32] A computer readable storage medium storing a computer program according to claim 31.

Claims

1. 1. A computer-implemented method for modeling pervasive audio objects for audio rendering in a virtual or augmented reality environment, the method comprising: obtaining an expansive representation indicating a geometry of an expansive audio object and information about one or more first audio sources associated with said expansive audio object; using the spatial representation of the geometric form of the spacious audio object to obtain a relative point that is closest to a user position in the virtual or augmented reality environment, wherein obtaining the relative point using the spatial representation of the geometric form of the spacious audio object comprises obtaining the relative point on the geometric form; determining spaciousness parameters of the spaciousness representation based on the user position and the relative point, the spaciousness parameters describing a spatial extent of the spacious audio object perceived at the user position; determining a position relative to the user position of one or more secondary audio sources for modeling the spacious audio object; and outputting a modified representation of the spacious audio object for modeling the spacious audio object, the modified representation including the spaciousness parameters and positions of the one or more secondary audio sources. A computer-implemented method.

2. 2. The computer-implemented method of claim 1, further comprising the step of rendering the spacious audio object based on the modified representation of the spacious audio object, wherein the spacious audio object is rendered using the determined positions of the one or more second audio sources and the spaciousness parameters.

3. 3. The computer-implemented method of claim 2, wherein the rendering comprises 6DoF audio rendering, and further comprising obtaining for the rendering a user position, a position and / or an orientation and geometry of the expansive audio object.

4. 2. The computer-implemented method of claim 1, further comprising determining the one or more second audio sources for modeling the spacious audio object based on the one or more first audio sources.

5. The computer-implemented method of claim 1 , wherein the spaciousness parameter is determined further based on a position and / or an orientation of the spacious audio object.

6. 6. The computer-implemented method of claim 5, further comprising determining a relative spreading angle based on the user position, the relative point and the position and / or orientation of the spacious audio object, wherein the spreading parameter is determined based on the relative spreading angle.

7. Determining a position of the one or more secondary audio sources includes: determining an arc based on the user position, the relative point, and the geometry of the expansive audio object; positioning the determined one or more second audio sources on the arc.

10. The computer-implemented method of claim 1.

8. The computer-implemented method of claim 7 , wherein the positioning comprises distributing all of the second audio sources evenly on the arc.

9. The computer-implemented method of claim 7 , wherein the positioning depends on a correlation level between the second audio sources and / or a content creator's intent.

10. The computer-implemented method of claim 4 , wherein the wideness parameter is determined further based on a determined number of one or more secondary audio sources.

11. The computer-implemented method of claim 10 , wherein the determined number of one or more secondary audio sources is a predetermined constant independent of the user position and / or the relative point.

12. 5. The computer-implemented method of claim 4, wherein determining the one or more secondary audio sources for modeling the spacious audio object comprises determining a number of the one or more secondary audio sources based on the relative spaciousness angle.

13. 13. The computer-implemented method of claim 12, wherein a number of the one or more secondary audio sources increases as the relative spread angle increases.

14. Determining the one or more secondary audio sources for modeling the spacious audio object includes: duplicating the one or more first audio sources or adding a weighted mix of the one or more first audio sources; The computer-implemented method of claim 4 , further comprising applying a decorrelation process to the duplicated or added first audio source.

15. The computer-implemented method of claim 1 , wherein the spaciousness representation indicates a two-dimensional or three-dimensional geometric form for representing the spatial extent of the spacious audio object.

16. The computer-implemented method of claim 1 , wherein the expansive audio object is oriented in two or three dimensions.

17. 2. The computer-implemented method of claim 1, wherein the spatial extent of the expansive audio object perceived at the user position is described as a perceived width, size, and / or weight of the expansive audio object.

18. obtaining a perpendicular projection of the expansive audio object onto a projection plane perpendicular to a first line connecting the user position and the relative point; determining, on the vertical projection, a number of boundary points that identify a projected size of the expansive audio object; the relative divergence angle is determined using the user position and the plurality of boundary points. A computer-implemented method according to any preceding claim when relying on claim 6.

19. 20. The computer-implemented method of claim 18, wherein determining the plurality of boundary points includes obtaining a second line related to a horizontal projection size of the expansive audio object, the plurality of boundary points including a leftmost boundary point and a rightmost boundary point of the vertical projection on the second line.

20. 20. The computer-implemented method of claim 19, wherein the horizontal projection size is a maximum size of the expansive audio object.

21. 20. The computer-implemented method of claim 18, wherein the vertical projection comprises a simplified projection of the expansive audio object having a complex geometric shape.

22. The computer-implemented method of claim 1 , further comprising using the spaciousness parameter to control the perceived size of the spacious audio object.

23. 23. The computer-implemented method of claim 22, wherein the extensive audio object is modeled as a point source or a wide source by controlling the perceived size of the extensive audio object.

24. The computer-implemented method of claim 1 , wherein the positions of the one or more secondary audio sources are determined such that all of the secondary audio sources have the same reference distance from the user position.

25. 11. An apparatus for modeling pervasive audio objects for audio rendering in a virtual or augmented reality environment, the apparatus having a processor and a memory coupled to the processor storing instructions for the processor, the processor configured to perform all steps of the computer-implemented method of claim 1.

26. 1. A system for implementing audio rendering in a virtual or augmented reality environment, the system comprising: An apparatus for modeling pervasive audio objects for audio rendering in a virtual or augmented reality environment, the apparatus having a processor and a memory coupled to the processor storing instructions for the processor, the processor configured to perform all steps of the computer-implemented method of claim 1; a spaciousness modeling unit configured to receive information about the modified representation of the spacious audio object from the device and to control a spaciousness size of the spacious audio object based on the information about the modified representation, the system being configured to transmit the information about the modified representation of the spacious audio object and / or the controlled spaciousness size to an audio output. system.

Images