Audio rendering method and apparatus and nonvolatile computer readable storage medium

By adding radius attributes to the sound source and calculating diffusion parameters in real time, the problem of the inability to accurately render the three-dimensional sound field in the prior art is solved, which improves the sound rendering effect and reduces the calculation load.

WO2024245400A1PCT designated stage expired Publication Date: 2024-12-05DOUYIN VISION CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/096681
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-05-31
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

The existing spatial audio rendering technology cannot accurately render the three-dimensional sound field, resulting in poor sound rendering effect. Especially when the sound source is no longer infinitely small and the length of the sound propagation path is not much larger than the sound source size, the point sound source model cannot Effectively express the sound field heard by the listener.

Method used

By adding radius attributes to the sound source, assume that the sound source is a spherical sound source, and diffusion parameters such as diffusion angle, width and height are calculated in real time based on the radius of the sound source and the distance from the sound source to the listener, so as to maintain the spherical shape at any time The sound source size remains unchanged, and the diffusion parameters are dynamically adjusted to achieve volumetric sound rendering.

Benefits of technology

It improves the sound rendering effect, achieves accurate rendering of the three-dimensional sound field, reduces the calculation load, and does not require manual update of diffusion parameters. It is suitable for determining the size of the object.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024096681_05122024_PF_FP_ABST
    Figure CN2024096681_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure relates to an audio rendering method and apparatus and a nonvolatile computer readable storage medium, relating to the field of audio processing. The audio rendering method comprises: analyzing metadata of an object audio; calling a parameter adjustment interface according to an analysis result of the metadata to adjust scenario information; and performing audio rendering on the object audio according to the adjusted scenario information.
Need to check novelty before this filing date? Find Prior Art

Description

Audio rendering method, device and non-volatile computer-readable storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on and claims priority to PCT application number PCT / CN2023 / 097542, filed on May 31, 2023. The disclosed content of the PCT application is hereby incorporated into this application as a whole. Technical Field

[0003] The present disclosure relates to the technical field of audio processing, and in particular to an audio rendering method, an audio rendering device, and a non-volatile computer-readable storage medium. Background Art

[0004] In related spatial audio rendering technologies, the direction and energy of the direct sound path at the listener are calculated based on the relative position of the sound source object and the listener, as well as the direction and energy of the direct sound path at the listener, as calculated by the scene information processor. These directional energies are then encoded into the spatial audio intermediate signal medium by the spatial encoding module.

[0005] In the above process, each directional energy is often regarded as propagating from an infinitely narrow angle range, that is, a point sound source model. This modeling can express an infinitely small sound source.

[0006] Summary of the Invention

[0007] According to some embodiments of the present disclosure, an audio rendering method is provided, comprising: parsing metadata of an object audio; calling a parameter adjustment interface to adjust scene information based on the parsed result of the metadata; and performing audio rendering on the object audio based on the adjusted scene information.

[0008] In some embodiments, the parsed result of the metadata includes sub-elements, and the sub-elements include the sound source width, sound source height, and sound source depth of the object audio.

[0009] In some embodiments, the sound source of the object audio includes a spherical sound source, and the sound source width, the sound source height, and the sound source depth are used to determine a radius of the spherical sound source.

[0010] In some embodiments, calling a parameter adjustment interface to adjust scene information according to the parsing result of the metadata includes: adjusting the scene information in a scene information processor or a spatial encoding module.

[0011] In some embodiments, the audio rendering of the object audio according to the adjusted scene information includes: rendering the playback device and environment according to the parsing results of the metadata parsed from the metadata system through a core rendering system.

[0012] In some embodiments, the scene information includes a diffusion coefficient of the object audio, and calling a parameter adjustment interface to adjust the scene information based on the analysis result of the metadata includes: calculating the diffusion coefficient based on the analysis result and the distance information between the sound source and the listener.

[0013] In some embodiments, the diffusion coefficient is monotonically non-decreasing with the volume of the sound source, and the volume of the sound source is determined according to the analytical result.

[0014] In some embodiments, the distance information includes the length of a propagation path from the sound source to the listener, and the diffusion coefficient monotonically non-increases with the length of the propagation path.

[0015] In some embodiments, the diffusion coefficient includes a diffusion angle of a propagation path from the sound source to the listener, the analysis result is used to determine the volume information of the sound source of the object audio, and the calculation of the diffusion coefficient includes: calculating the diffusion coefficient based on an inverse tangent value of a ratio of the distance information to the volume information.

[0016] In some embodiments, calculating the diffusion coefficient based on an inverse tangent value of a ratio of the distance information to the volume information includes calculating the diffusion coefficient based on a complementary angle of the inverse tangent value.

[0017] In some embodiments, the diffusion coefficient includes at least one of a diffusion angle, a width, or a height of a propagation path from the sound source to the listener.

[0018] According to other embodiments of the present disclosure, an audio rendering device is provided, including: a parsing unit for parsing metadata of an object audio; an adjustment unit for calling a parameter adjustment interface to adjust scene information based on the parsing results of the metadata; and a rendering unit for performing audio rendering on the object audio based on the adjusted scene information.

[0019] In some embodiments, the parsed result of the metadata includes sub-elements, and the sub-elements include the sound source width, sound source height, and sound source depth of the object audio.

[0020] In some embodiments, the sound source of the object audio includes a spherical sound source, and the sound source width, the sound source height, and the sound source depth are used to determine a radius of the spherical sound source.

[0021] In some embodiments, the adjustment unit adjusts the scene information in a scene information processor or a spatial encoding module.

[0022] In some embodiments, the rendering unit performs rendering of the playback device and environment according to the parsing result of the metadata parsed from the metadata system through the core rendering system.

[0023] In some embodiments, the scene information includes a diffusion coefficient of the object audio, and the adjustment unit calculates the diffusion coefficient according to the analysis result and distance information between the sound source and the listener.

[0024] In some embodiments, the diffusion coefficient is monotonically non-decreasing with the volume of the sound source, and the volume of the sound source is determined according to the analytical result.

[0025] In some embodiments, the distance information includes the length of a propagation path from the sound source to the listener, and the diffusion coefficient monotonically non-increases with the length of the propagation path.

[0026] In some embodiments, the diffusion coefficient includes a diffusion angle of a propagation path from the sound source to the listener, the analysis result is used to determine volume information of the sound source of the object audio, and the adjustment unit calculates the diffusion coefficient based on an inverse tangent value of a ratio of the distance information to the volume information.

[0027] In some embodiments, the adjustment unit calculates the diffusion coefficient according to a complementary angle of the arc tangent value.

[0028] In some embodiments, the diffusion coefficient includes at least one of a diffusion angle, a width, or a height of a propagation path from the sound source to the listener.

[0029] According to some embodiments of the present disclosure, an audio rendering method is provided, comprising: calculating diffusion parameters of sound emitted by the sound source to the listener based on volume information of the sound source and / or distance information between the sound source and the listener; and rendering the sound based on the diffusion parameters.

[0030] In some embodiments, the sound source comprises a spherical sound source, and the volume information comprises a radius of the spherical sound source.

[0031] In some embodiments, the diffusion parameter is monotonically non-decreasing with the radius of the spherical sound source.

[0032] In some embodiments, the distance information includes the length of a propagation path from the sound source to the listener.

[0033] In some embodiments, the sound source is a non-point sound source, and the diffusion parameter monotonically non-increases with the length of the propagation path.

[0034] In some embodiments, the sound source is a non-point sound source, the diffusion parameter includes a diffusion angle of a propagation path from the sound source to the listener, and calculating the diffusion parameter of the sound emitted by the sound source to the listener includes: determining the diffusion parameter based on an inverse tangent value of a ratio of the distance information to the volume information.

[0035] In some embodiments, determining the diffusion parameter according to the arctangent value of the ratio of the distance information to the volume information includes: determining the diffusion parameter according to the complementary angle of the arctangent value.

[0036] In some embodiments, rendering the sound according to the diffusion parameter includes: using the diffusion parameter to drive Ambisonic encoding or speaker encoding for rendering.

[0037] In some embodiments, calculating the diffusion parameter of the sound emitted by the sound source to the listener includes: calculating the diffusion parameter in a scene information processor or a spatial encoding module.

[0038] In some embodiments, the diffusion parameter includes at least one of a diffusion angle, a width, or a height of a propagation path from the sound source to the listener.

[0039] According to other embodiments of the present disclosure, an audio rendering device is provided, comprising: a calculation unit for calculating diffusion parameters of sound emitted by the sound source to the listener based on volume information of the sound source and / or distance information between the sound source and the listener; and a rendering unit for rendering the sound based on the diffusion parameters.

[0040] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the audio rendering method described in any of the above embodiments is implemented.

[0041] According to some embodiments of the present disclosure, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to perform the audio rendering method according to any one of the above embodiments.

[0042] According to some embodiments of the present disclosure, a computer program product is further provided, comprising instructions, which, when executed by a processor, enable the processor to perform the audio rendering method according to any one of the above embodiments.

[0043] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of this application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the drawings:

[0045] FIG1 shows a flowchart of an audio rendering method according to some embodiments of the present disclosure;

[0046] FIG2 shows a schematic diagram of a spatial audio rendering framework according to some embodiments of the present disclosure;

[0047] FIG3 shows a schematic diagram of an audio rendering method according to some embodiments of the present disclosure;

[0048] FIG4 shows a block diagram of an audio rendering apparatus according to some embodiments of the present disclosure;

[0049] FIG5 shows a flowchart of an audio rendering method according to some other embodiments of the present disclosure;

[0050] FIG6 shows a block diagram of an audio rendering apparatus according to some other embodiments of the present disclosure;

[0051] FIG7 shows a block diagram of an audio rendering apparatus according to yet other embodiments of the present disclosure;

[0052] FIG8 shows a block diagram of an audio rendering apparatus according to further embodiments of the present disclosure. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is in no way intended to limit the present disclosure and its application or use. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure.

[0054] Unless otherwise specifically stated, the relative arrangement of the parts and steps, the numerical expressions and the numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure. At the same time, it should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not drawn according to actual proportional relationships. The techniques, methods and equipment known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the techniques, methods and equipment should be considered as part of the authorization specification. In all examples shown and discussed herein, any specific values ​​should be interpreted as being merely exemplary and not as limitations. Therefore, other examples of the exemplary embodiments may have different values. It should be noted that similar numbers and letters represent similar items in the following figures, and therefore, once an item is defined in one figure, it does not need to be further discussed in subsequent figures.

[0055] As mentioned above, when the sound source is no longer infinitesimal and the length of the sound propagation path is not much larger than the size of the sound source, the point sound source model cannot accurately express the three-dimensional sound field heard by the listener.

[0056] For example, when standing under a waterfall, the sound of the water seems to envelop them, rather than having a clear direction. When approaching a piano, the sound doesn't come from an infinitely narrow direction, but rather has a certain width. This situation is called the volumetric sound rendering problem. The following methods can be used to address this problem.

[0057] One approach is to sample several points on the sound-emitting object and render them as point sound sources. However, this approach has the disadvantage of high computational overhead. Another approach is to set fixed diffusion parameters, such as diffusion angle, width, and height, to reduce the directionality of the sound source. However, this approach has the disadvantage that the parameters must be manually adjusted, and fixed diffusion parameters have no geometric meaning when the distance between the listener and the sound source changes.

[0058] To address the above technical issues, volumetric sound rendering needs to be achieved with limited computing power; when the object size is determined, there is no need to manually update the diffusion parameters during runtime.

[0059] In some embodiments, a "radius" attribute can be added to each sound source, meaning that the sound source need not be an infinitesimal point source, but rather a spherical source with a certain volume. At runtime, appropriate diffusion parameters, such as the diffusion angle, width, and height, are calculated in real time based on the radius of the sound source and the distance from the listener, ensuring that the spherical size remains constant at all times.

[0060] The inventors of the present disclosure have discovered that the above-mentioned related technologies have the following problems: they cannot accurately render the three-dimensional sound field, resulting in poor sound rendering effects. In view of this, the present disclosure proposes a sound rendering technology solution that can improve the sound rendering effects.

[0061] FIG1 shows a flowchart of an audio rendering method according to some embodiments of the present disclosure.

[0062] As shown in FIG1 , in step 110, a diffusion parameter of the sound emitted from the sound source to the listener is calculated based on the volume information of the sound source and / or the distance information between the sound source and the listener. For example, the diffusion parameter includes at least one of the diffusion angle, width, or height of the propagation path from the sound source to the listener.

[0063] In some embodiments, the sound source comprises a spherical sound source, the volume information comprises a radius of the spherical sound source, and the diffusion parameter is monotonically non-decreasing with the radius of the spherical sound source.

[0064] In some embodiments, the distance information includes the length of the propagation path from the sound source to the listener. The sound source is a non-point sound source, and the diffusion parameter monotonically increases with the propagation path length.

[0065] In some embodiments, the sound source is a non-point sound source, and the diffusion parameter includes a diffusion angle of a propagation path from the sound source to the listener. The diffusion parameter is determined based on an inverse tangent of a ratio of distance information to volume information. For example, the diffusion parameter is determined based on a complementary angle of the inverse tangent.

[0066] In some embodiments, the diffusion parameter is calculated in a scene information processor or in a spatial encoding module.

[0067] In step 120 , the sound is rendered according to the diffusion parameter.

[0068] In some embodiments, the diffuseness parameter is used to drive the ambisonic encoding or the speaker encoding for rendering.

[0069] FIG2 shows a schematic diagram of a spatial audio rendering framework according to some embodiments of the present disclosure.

[0070] As shown in FIG2 , in a spatial audio rendering system, the calculation of the diffusion angle may occur in a scene information processor or a spatial encoding module.

[0071] For example, the diffusion angle can be used to drive ambisonic encoding. That is, the diffusion angle θ is converted to a floating-point equivalent ambisonic order, so that the ambisonic coefficients of the sound propagation path at the listener have a width greater than the current ambisonic order.

[0072] For example, speaker encoding can be driven by diffusion angle. That is, based on the diffusion angle θ and the speaker arrangement, the energy of the sound propagation path is dispersed to more speakers than when rendering a point sound source, thereby giving the sound propagation path at the listener width.

[0073] The spatial audio rendering system includes an audio signal acquisition module for acquiring an audio signal in a specific format that can be used for playback in a user application scenario based on an input audio signal; an audio signal spatial decoder for spatially decoding the audio signal in the specific format based on the playback type of the user application scenario; and a signal post-processing module for post-processing the decoded audio signal for a specific playback device in the user application scenario.

[0074] In some embodiments, the audio signal in a specific format may be in any suitable format as long as it can be used for playback in a user playback environment.

[0075] In some embodiments, the audio signal of the specific format can be directly obtained from the input audio signal without the need for spatial audio processing. The audio signal of the specific format includes an audio signal that does not require spatial encoding in an audio signal having an audio content format compatible with the audio rendering system obtained from the input audio signal. In some embodiments, the audio signal that does not require spatial encoding includes at least one of a non-narrative channel track and a narrative channel track that does not require spatial audio processing in a channel-based audio signal. As an example, when the format of the input audio signal directly corresponds to the specific format, the input audio signal can be directly used as the audio signal of the specific format, that is, directly transmitted / transparently transmitted to the audio signal spatial decoder.

[0076] In some embodiments, the input audio can be appropriately processed, such as by encoding or format conversion, to obtain an audio signal in a specific format. In some embodiments, when the input audio signal can be used to generate audio signals in two or more audio content formats, the obtained audio signals in the specific format have a common format, i.e., audio signals in various audio content formats all obtain an audio signal in the same format for playback. As an example, the audio signal in the specific format is an Ambisonics audio signal, or the audio signal in the specific format is any one of FOA (First Order Ambisonics), HOA (Higher Order Ambisonics), and MOA (Mixed-order Ambisonics).

[0077] In some embodiments, an input audio signal is used to obtain an audio signal of a specific format. This depends on the format of the input signal, such as the encoding method. For certain signal formats (e.g., signal encoding methods), the input signal or some signals contained in the input signal can be directly transmitted / transparently transmitted to the decoding block for decoding without undergoing spatial audio processing. In this case, these signals can be directly used as audio signals of a specific format. Alternatively, for other signal formats (e.g., signal encoding methods), the input signal or some signals contained in the input signal can undergo spatial audio processing to obtain an audio signal of a specific format. As an example, spatial audio processing may include but is not limited to pre-processing, audio information processing, audio signal spatial encoding, etc. These processes may be implemented by appropriate devices, components, etc., which may be implemented in various appropriate ways, such as hardware, firmware, software, etc.

[0078] In some embodiments, the audio rendering system may include a pre-processing module. Taking into account different application scenarios and input formats, the pre-processing module can be used to be compatible with inputs of different formats. In some embodiments, the pre-processing module is used to obtain an audio signal having an audio content format compatible with the audio rendering system and metadata information associated with the audio signal from the input audio signal, so that the audio signal of the specific format can be obtained based on the audio signal having an audio content format compatible with the audio rendering system. The pre-processing module may be included in the audio signal acquisition module,

[0079] In some embodiments, the audio signal having the audio content format compatible with the audio rendering system may include at least one of an object-based audio representation signal, a scene-based audio representation signal, and a channel-based audio representation signal.

[0080] In some embodiments, the pre-processing module is configured to parse any input spatial audio exchange format signal and, based on the signal format type, convert the signal into a format agreed upon by the audio rendering system. In some embodiments, the audio exchange format signal is a scene-based audio representation signal, and the pre-processing module is configured to convert the scene-based audio signal having different channel ordering and normalization coefficients into the channel ordering and normalization coefficients agreed upon by the audio rendering system.

[0081] As an example, the pre-processing module can be used to pre-process any spatial audio exchange format signal being distributed. Specifically, the pre-processing module can include an input signal parser. Thus, any spatial audio exchange format signal being distributed, whether non-streaming or streaming, can be classified by the input signal parser into three signal categories based on spatial audio signal representation methods: scene-based audio representation signals, channel-based audio representation signals, and object-based audio representation signals, as well as metadata corresponding to these signals. Furthermore, the pre-processing can also parse exchange format signal packets and convert the signals into a system-constrained format based on the format type. For example, for scene-based spatial audio representation signals (HOA), different data exchange formats use different channel orderings (e.g., ACN, Ambisonic Channel Number, FuMa, Furse-Malham, and SID, Single Index Designation) and different normalization coefficients (N3D, SN3D, FuMa). In this step, these can be converted to a certain agreed channel ordering and normalization coefficient, such as (ACN+SN3D).

[0082] In some embodiments, the input audio signal is directly used as the audio signal in the specific format. That is, the input audio signal does not need to be pre-processed, but is directly passed / transparently transmitted to the audio signal decoder for processing. In some embodiments, the pre-processing module includes an application program interface that is used to directly receive the input audio signal and directly transmit it to the audio signal decoder.

[0083] [Corrected 05 / 07 / 2024 according to Rule 91] As an example, this pre-processing module can implement pre-processing of input signals from custom applications. In some custom applications, since this processing occurs directly on the consumer side, spatial audio exchange format conversion can be eliminated. By providing an API within the rendering system, the application can directly pass the corresponding audio data and metadata into the system. Figure 2 illustrates the pre-processing of input signals in any spatial audio exchange format.

[0084] According to an embodiment of the present disclosure, the audio signal in a specific format may be obtained by spatially encoding an input audio signal, and in particular, by spatially encoding an audio signal obtained through pre-processing and parsing.

[0085] In some embodiments, the audio rendering system may include an audio signal spatial encoder configured to spatially encode an audio signal of a specific audio content format obtained from an input audio signal based on metadata information associated with the audio signal to obtain an encoded audio signal of the specific format. The audio signal spatial encoder may be included in the audio signal acquisition module.

[0086] The audio signal encoder can be implemented in various appropriate ways. The audio signal spatial encoder may include an acquisition unit for acquiring an audio signal having an audio content format compatible with an audio rendering system and metadata information associated with the audio signal; and an encoding unit for spatially encoding the audio signal into an encoded audio signal in a specific format that can be used for playback in a user application scenario based on the metadata information associated with the acquired audio signal. The audio signal having an audio content format compatible with an audio rendering system may refer to at least one of the three types of audio signals described above, or other suitable audio signals.

[0087] In some embodiments, metadata information associated with the audio signal can be obtained by various appropriate means. In some embodiments, metadata information can be directly input when the audio signal is input, or obtained and provided by other devices in the system or third-party devices.

[0088] In other embodiments, an information processing module can be used to extract signals of different formats and calculate corresponding parameters. In particular, the information processing module can process metadata associated with the audio signal to obtain appropriate information for subsequent signal processing, including signal space encoding and decoding processing.

[0089] In some embodiments, the audio rendering system may include an audio information processing module configured to extract information from an input audio signal based on an audio content format of an audio signal having an audio content format compatible with the audio rendering system. The audio information processing module may be included in the audio signal acquisition module and may receive metadata output by the pre-processing module and perform processing based thereon.

[0090] In some embodiments, the audio signal is an object-based audio representation signal, and the audio information processing module is configured to obtain spatial attribute information of the audio signal from metadata information associated with the audio signal for spatial audio encoding processing. In some embodiments, the spatial attribute information of the audio signal includes the orientation information of each audio element in the coordinate system, or the relative orientation information of the sound source associated with the audio signal relative to the listener. In a vague embodiment, the spatial attribute information of the audio signal further includes the distance information of each sound element of the audio signal in the coordinate system. As an example, in the metadata processing based on object-based audio representation, the orientation information (such as azimuth and elevation) and distance information (optional) of each sound element in the coordinate system can be obtained. Or the relative orientation information of each sound source relative to the listener's head.

[0091] In some embodiments, the audio signal is a scene-based audio representation signal, and the audio information processing module is configured to obtain rotation information related to the audio signal from metadata information associated with the audio signal for use in spatial audio coding processing.

[0092] In some embodiments, the rotation information associated with the audio signal includes at least one of the rotation information of the audio signal and the rotation information of a listener of the audio signal. As an example, in metadata processing based on scene-based audio representation, the rotation information of the scene audio and the rotation information of the listener are read from the metadata.

[0093] In some embodiments, the audio signal is a channel-based audio signal, and the audio information processing module is configured to process the audio signal based on the channel track type of the audio signal. In some embodiments, for narrative channel tracks, the audio information processing module is configured to perform one of the following: splitting the audio representation of the channel into audio elements by channel and converting them into metadata for processing; or directly outputting the audio signal without performing spatial audio processing on the audio signal. In yet another embodiment, for non-narrative channel tracks, the audio information processing module is configured to directly output the audio signal without performing spatial audio processing on the audio signal. As an example, in metadata processing based on channel-based audio representation, for narrative channel tracks, the audio representation of the channel can be split into audio elements by channel according to the standard definition of channels and converted into metadata for processing. Depending on the application scenario, spatial audio processing can be omitted and mixing can be performed for different playback modes in a subsequent stage. For non-narrative channel tracks, since dynamic spatialization processing is not required, mixing can be performed for different playback modes in a subsequent stage.

[0094] In some embodiments, the audio signal spatial encoder may perform appropriate encoding processing on the non-direct / transparent audio signal to obtain an encoded audio signal in a specific format that can be used for playback in a user application scenario. The encoded audio signal in the specific format may be an audio signal in the specific format described above and will not be described in detail here. The encoded audio signal can be added to the intermediate signal or directly / transparently transmitted to the spatial decoder. As an example, in the spatial coding module, all audio signals except the non-narrative channels are converted into FOA, HOA or MOA signals through spatial coding as intermediate signals.

[0095] In some embodiments, the audio signal spatial encoder can appropriately encode audio signals in different audio content formats. The audio signals in different audio content formats can be directly input, or can be extracted / parsed from the input audio signal, such as obtained by the pre-processing module described above.

[0096] In some embodiments, the audio signal of the specific audio content format is an object-based audio representation signal, and the audio signal spatial encoder is configured to spatially encode the object-based audio signal based on information related to the spatial propagation path from the sound object to the listener of the audio signal. In some embodiments, the information related to the spatial propagation path from the sound object to the listener includes at least one of the propagation duration, propagation distance, azimuth information, path intensity energy, and nodes along the way of each spatial propagation path from the sound object to the listener. In some embodiments, the audio signal spatial encoder is configured to spatially encode the audio signal for each spatial propagation path of each sound object according to a filter function that filters the audio signal based on the path energy intensity of the spatial propagation path and a spherical harmonic function based on the azimuth angle of the spatial propagation path. In some embodiments, the audio signal spatial encoder is configured to spatially encode the audio signal for each spatial propagation path of each sound object by calculating the product of the filter function that filters the audio signal based on the path energy intensity of the spatial propagation path and the spherical harmonic function based on the azimuth angle of the spatial propagation path. In some embodiments, for each spatial propagation path of each sound object, the filter function for filtering the audio signal based on the path energy intensity is a filter function for filtering the audio signal of the sound object before it propagates along the spatial propagation path, based on the path intensity energy of the path. In some embodiments, the audio signal of the sound object before it propagates along the spatial propagation path refers to the audio signal at a moment before the time required for the sound object to reach the listener along the spatial propagation path. In some embodiments, the azimuth angle of the spatial propagation path includes the direction angle of the spatial propagation path reaching the listener or the direction angle of the spatial propagation path relative to the coordinate system. In some embodiments, the audio signal spatial encoder is configured to encode each spatial propagation path of each sound object using at least one of a near-field compensation function and a diffusion function, further depending on the length of the spatial propagation path. In some embodiments, the audio signal spatial encoder is further configured to perform weighted superposition on the encoded signals of each object-based audio representation signal based on the weight of the sound object defined in the metadata.

[0097] As an example, in the spatial encoding process of object-based audio representation, for each audio object, the audio signal will be written into a delay device taking into account the delay of sound propagation in space. According to the results obtained by the audio information processing module, each sound object will have one or more propagation paths to the listener, and the time t1 required for the sound object to reach the listener is calculated based on the length of each path. The spatial encoding starts by obtaining the audio signal s of the sound object before time t1 from the delay device of the audio object, and filtering it according to the path energy intensity E and the direction θ of the path to the listener (the direction of the path relative to the coordinate system can also be used instead of the direction to the listener, so that the target sound field signal can be obtained by multiplying with the rotation matrix in the subsequent steps), and the signal is spatially encoded and converted into the HOA signal s N , where N is the number of channels of the HOA signal. A typical encoding method is as follows, where Y_N is the spherical harmonics of the corresponding channel. N =E(s(t-t1))Y N (θ)

[0098] The encoding operation can be performed in the time domain or frequency domain, and near-field compensation and source spread functions can be added based on the path distance to enhance the effect. Finally, the HOA signals obtained after each signal conversion are weighted and superimposed according to the weights of the sound objects defined in the metadata. The weighted sum of all object-based audio signals is obtained as the encoded signal, which can be used as an intermediate signal.

[0099] In some embodiments, the spatial encoding of the audio signal may also generate a reverberation-related signal to be included in the output encoded signal. In particular, the reverberation-related signal may be directly passed to a spatial decoder for decoding, or may be added to an intermediate signal included in the encoder output.

[0100] In some embodiments, the audio signal in the specific audio content format is an object-based audio representation signal, and the audio signal spatial encoder is further configured to obtain a reverberation-related signal of the object-based audio signal. In some embodiments, the audio signal spatial encoder is further configured to obtain a spatial reverberation response of the scene and convolve the audio signal based on the spatial reverberation response to obtain a reverberation-related signal of the audio signal. In some audio signal spatial encoders, the encoder is further configured to obtain reverberation parameter information and perform reverberation processing on the audio signal to obtain a reverberation-related signal of the audio signal. As an example, for more advanced scene information processors, the spatial room reverberation response of the scene may be generated, including but not limited to RIR (Room Impulse Response), ARIR (Ambisonics Room Impulse Response), BRIR (Binaural Room Impulse Response), and MO-BRIR (Multi-Orientation Binaural Room Impulse Response). For this type of information, a convolver may be added to this module to obtain a processed signal. Depending on the reverberation type, the generated result may be an intermediate signal (ARIR), an omnidirectional signal (RIR), or a binaural signal (BRIR, MO-BRIR). The output is added to the intermediate signal or transparently transmitted to a subsequent step for corresponding playback decoding. Optionally, the scene information processor may also provide reverberation parameter information such as reverberation duration. An artificial reverberation generator (such as a feedback delay network) can be added to this module to perform artificial reverberation processing. The result is output to the intermediate signal or transparently transmitted to the decoder for processing.

[0101] In some embodiments, the audio signal of a specific audio content format is a scene-based audio representation signal, and the audio signal spatial encoder is further configured to weight the scene-based audio representation signal based on the weight information in the metadata. In this way, the weighted signal can be used as an encoded audio signal for spatial decoding. In some embodiments, the audio signal of a specific audio content format is a scene-based audio representation signal, and the audio signal spatial encoder is further configured to perform a sound field rotation operation on the scene-based audio representation signal based on the rotation information indicated in the metadata. In this way, the rotated audio signal can be used as an encoded audio signal for spatial decoding. As an example, for a scene audio signal, it is itself an FOA, HOA or mix order Ambisonics signal, which can be weighted according to the weight information in the metadata, that is, the intermediate signal that is desired to be obtained. In addition, if the metadata indicates that the sound field needs to be rotated, the sound field rotation operation can be performed at this step or at spatial decoding (next step) depending on different implementations.

[0102] In some embodiments, the audio signal of the specific audio content format is a channel-based audio representation signal, and the audio signal spatial encoder is further configured to convert the channel-based audio representation signal into an object-based audio representation signal and encode it when the channel-based audio representation signal needs to be converted. The encoding operation here can be performed in the same manner as described above for encoding the object-based audio representation signal. As an example, in the spatial encoding process of channel-based audio representation, channel-based audio processing is performed according to the agreement in the previous step of scene information processing. If conversion to object-based audio is required, it is performed in the object-based audio processing manner. If spatial audio processing is not required, the intermediate signal is not added and it is directly transmitted to the next module.

[0103] An audio signal having an audio content format compatible with an audio rendering system and metadata information associated with the audio signal are obtained; and based on the metadata information associated with the obtained audio signal, the audio signal is spatially encoded into an encoded audio signal in a specific format that can be used for playback in a user application scenario.

[0104] In some embodiments, the audio signal spatial decoder uses a decoding matrix corresponding to the playback device in the user application scenario to decode the audio signal of the specific format. In this way, the decoded audio signal can be suitable for a specific type of playback environment, especially for the playback device in the playback environment, so that compatibility with various types of playback environments can be achieved. Here, the audio signal of the specific format can be the aforementioned intermediate signal, or it can be an audio signal directly transmitted / transparently transmitted to the spatial decoder, including an unencoded audio signal, or an encoded audio signal that has been spatially encoded but not included in the intermediate signal. In particular, after the spatial audio signal is encoded, the system obtains an intermediate medium signal that has been spatially encoded, and transparently transmitted signals such as non-narrative channel signals and binaural signals after reverberation processing. The spatial audio decoding module decodes the intermediate signal and the transparent signal onto the playback device according to the playback type of the user application scenario.

[0105] In some embodiments, the audio signal spatial decoder is configured to perform a sound field rotation operation on the audio representation signal to be decoded based on rotation information indicated in the metadata. For example, the intermediate media signal is first multiplied by a rotation matrix or rotated as needed based on the processing method of the previous module and the rotation information in the metadata, thereby decoding the rotated intermediate media signal.

[0106] In some embodiments, the decoding matrix is ​​a built-in or externally provided decoding matrix corresponding to the speaker array in the user application scenario.

[0107] As an example, in the case of standard speaker array spatial decoding, for the standard speaker array defined in the standard, the decoder will have built-in decoding matrix coefficients, and the playback signal L can be obtained by multiplying the intermediate signal with the decoding matrix. L = DS N , where L is the speaker array signal, D is the decoding matrix, S N The intermediate signal is also converted to an intermediate signal based on the definition of standard speakers. Specific methods include VBAP. For spatial decoding of special speaker arrays, such as sound bars or other more specialized speaker arrays, the speaker manufacturer must provide a correspondingly designed decoding matrix. The system provides a decoding matrix setup interface, which allows decoding processing by specifying the decoding matrix.

[0108] In some embodiments, when the speaker array is a custom speaker array, the decoding matrix is ​​a decoding matrix calculated based on the arrangement of the custom speaker array. In some embodiments, the decoding matrix is ​​calculated based on the azimuth and pitch angles of each speaker in the speaker array or the three-dimensional coordinate values ​​of the speaker. As an example, in the custom speaker array spatial decoding, in the scenario of the custom speaker array, such speakers usually have a spherical, hemispherical design or a rectangle, which can surround or semi-surround the listener. The decoding module can calculate the decoding matrix based on the arrangement of the custom speakers, and the required input is the azimuth and pitch angle of each speaker, or the three-dimensional coordinate values ​​of the speaker. The calculation methods of the speaker decoding matrix can include SAD (Sampling Ambisonic Decoder), MMD (Mode Matching Decoder), EPAD (Energy Preserved Ambisonic Decoder), AllRAD (All Round Ambisonic Decoder), etc.

[0109] In some embodiments, when the user application environment is a headphone playback environment, the audio signal spatial decoder is configured to directly decode the signal into a binaural signal, or perform speaker virtualization to obtain a decoded signal. As an example, for the headphone playback environment, there are several optional decoding methods. The first is to directly decode the intermediate medium signal into a binaural signal. Typical methods include LS (least squares), Magnitude LS, SPR (Spatial resampling), etc. For the transparent signal, it is usually a binaural signal, which is played back directly. Indirect rendering can also be performed, that is, first using a speaker array, and then performing HRTF convolution according to the position of the speaker to virtualize the speaker.

[0110] In some embodiments, the signal post-processing module is configured to perform at least one of frequency response compensation and dynamic range control on the decoded audio signal for a specific playback device. For example, the post-processing module accounts for inconsistencies in playback modes, such as varying frequency response curves and gain across different playback devices, and performs post-processing adjustments on the output signal to provide a consistent acoustic experience. Post-processing operations include, but are not limited to, device-specific frequency response compensation (EQ) and dynamic range control (DRC).

[0111] In the audio rendering system disclosed herein, the aforementioned audio information processing module, signal space encoder, signal space decoder, and output signal post-processing constitute the system's core rendering module, responsible for processing the signals in the three audio representation formats and their metadata obtained after pre-processing and playing them back through the user's playback environment. The overall framework of the core rendering module is shown in Figure 2.

[0112] It should be noted that the various elements of the audio rendering system described above are merely logical modules divided according to the specific functions they implement, and are not intended to limit specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). For example, an encoder, a decoder, etc. can use a chip (such as an integrated circuit module including a single chip), a hardware component, or a complete product. In addition, the elements shown in dotted lines in the drawings indicate that these elements may exist, but do not need to actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.

[0113] In addition, the audio rendering system may also include other components not shown, such as an interface, a memory, a communication unit, etc. As an example, the interface and / or the communication unit can be used to receive an input audio signal to be rendered, and can also output the final audio signal to a playback device in a playback environment for playback. As an example, the memory can store various data, information, programs, etc. used in and / or generated during the audio rendering process. The memory can include, but is not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory.

[0114] Based on the input audio signal, an audio signal in a specific format that can be used for playback in the user application scenario is obtained; the audio signal in the specific format is spatially decoded based on the playback type of the user application scenario; and the decoded audio signal is post-processed for the specific playback device in the user application scenario.

[0115] Although not shown, the audio rendering method according to the present disclosure may also include other steps to implement the processing / operations in the pre-processing, audio information processing, audio signal spatial coding, etc. described above, which will not be described in detail here. It should be noted that the audio rendering method according to the present disclosure and the steps therein can be performed by any appropriate device, such as a processor, an integrated circuit, a chip, etc., for example, it can be performed by the aforementioned audio rendering system and its various modules. The method can also be embodied in a computer program, instructions, computer program medium, computer program product, etc.

[0116] In some embodiments, the radius of the sound source is r, the length of the propagation path from the sound source to the listener is d, and the diffusion angle θ of the path at the listener is:

[0117] In other words, as long as the above formula is satisfied, the diffusion angle θ will be monotonically non-increasing with d and monotonically non-decreasing with r. Therefore, the diffusion angle of the path is automatically and dynamically adjusted according to the length of the sound propagation path, achieving a stable sense of sound source volume.

[0118] In some embodiments, the diffusion angle θ of the propagation path from the sound source to the listener is:

[0119] FIG3 shows a schematic diagram of an audio rendering method according to some embodiments of the present disclosure.

[0120] The geometric significance of the above diffusion angle calculation process is shown in Figure 3. For each sound propagation path, the corresponding diffusion angle θ needs to be calculated for the spatial audio rendering of the path.

[0121] For example, the direct sound diffusion angle 1st order reflected sound diffusion angle The diffusion angle of the point sound source θ″=0.

[0122] FIG4 shows a block diagram of an audio rendering apparatus according to some embodiments of the present disclosure.

[0123] As shown in Figure 4, the audio rendering device 4 includes: a calculation unit 41, which is used to calculate the diffusion parameters of the sound emitted by the sound source to the listener based on the volume information of the sound source and / or the distance information between the sound source and the listener; and a rendering unit 42, which is used to render the sound according to the diffusion parameters.

[0124] In some embodiments, the sound source comprises a spherical sound source, and the volume information comprises a radius of the spherical sound source.

[0125] In some embodiments, the diffusion parameter is monotonically non-decreasing with the radius of the spherical sound source.

[0126] In some embodiments, the distance information includes the length of a propagation path from the sound source to the listener.

[0127] In some embodiments, the sound source is a non-point sound source, and the diffusion parameter monotonically non-increases with the length of the propagation path.

[0128] In some embodiments, the sound source is a non-point sound source, and the diffusion parameter includes a diffusion angle of a propagation path from the sound source to the listener. The calculation unit 41 determines the diffusion parameter according to an arctangent value of a ratio of distance information to volume information.

[0129] In some embodiments, the calculation unit 41 determines the diffusion parameter according to the complementary angle of the arctangent value.

[0130] In some embodiments, the rendering unit 42 utilizes the diffuseness parameter to drive the Ambisonic encoding or the speaker encoding for rendering.

[0131] In some embodiments, the calculation unit 41 calculates the diffusion parameter in a scene information processor or a spatial encoding module.

[0132] In some embodiments, the diffusion parameter includes at least one of a diffusion angle, a width, or a height of a propagation path from the sound source to the listener.

[0133] FIG5 shows a flowchart of an audio rendering method according to some other embodiments of the present disclosure.

[0134] As shown in FIG5 , in step 510 , metadata of the target audio is parsed.

[0135] In some embodiments, the parsed result of the metadata includes sub-elements, and the sub-elements include the sound source width (width), sound source height (height), and sound source depth (depth) of the object audio.

[0136] In this way, audio rendering can be performed based on a sound source with a certain volume, and the three-dimensional sound field can be accurately rendered, thereby improving the effect of audio rendering.

[0137] In some embodiments, the sound source of the object audio includes a spherical sound source, and the sound source width, sound source height, and sound source depth are used to determine the radius of the spherical sound source. For example, the radius of the spherical sound source can be calculated based on the sub-element sound source width, sound source height, and sound source depth.

[0138] In step 520, based on the metadata parsing result, a parameter adjustment interface is called to adjust the scene information, for example, in a scene information processor or a spatial encoding module.

[0139] In this way, the appropriate scene information can be adjusted according to the metadata analysis results of the object audio to complete the audio rendering. On the one hand, the amount of calculation is reduced, and on the other hand, there is no need for human participation in mediation, thereby improving the effect of audio rendering.

[0140] In some embodiments, the scene information includes a diffusion coefficient of the target audio, and the diffusion coefficient is calculated based on the analysis results and the distance information between the sound source and the listener. For example, the diffusion coefficient includes at least one of the diffusion angle, width, or height of the propagation path from the sound source to the listener.

[0141] For example, the diffusion coefficient is monotonically non-decreasing with the volume of the sound source, where the volume of the sound source is determined based on analytical results. For example, the radius of a spherical sound source is determined based on analytical results, and the diffusion coefficient is monotonically non-decreasing with the radius of the spherical sound source.

[0142] For example, distance information includes the length of the propagation path from the sound source to the listener, and the diffusion coefficient monotonically increases with the length of the propagation path.

[0143] In some embodiments, the diffusion coefficient includes the diffusion angle of the propagation path from the sound source to the listener. The analysis result is used to determine the volume information of the sound source of the target audio. The diffusion coefficient is calculated based on the inverse tangent of the ratio of the distance information to the volume information. For example, the volume information of the sound source includes the radius of a spherical sound source. For example, the diffusion coefficient is calculated based on the complementary angle of the inverse tangent.

[0144] In step 530, the object audio is rendered according to the adjusted scene information. For example, the core rendering system performs rendering of the playback device and environment according to the parsing results of the metadata parsed from the metadata system.

[0145] FIG6 shows a block diagram of an audio rendering apparatus according to some other embodiments of the present disclosure.

[0146] As shown in Figure 6, the audio rendering device 6 includes: a parsing unit 61, which is used to parse the metadata of the object audio; an adjustment unit 62, which is used to call the parameter adjustment interface to adjust the scene information according to the parsing results of the metadata; and a rendering unit 63, which is used to perform audio rendering on the object audio according to the adjusted scene information.

[0147] In some embodiments, the parsed result of the metadata includes sub-elements, and the sub-elements include the sound source width, sound source height, and sound source depth of the object audio.

[0148] In some embodiments, the sound source of the object audio includes a spherical sound source, and the sound source width, sound source height, and sound source depth are used to determine the radius of the spherical sound source.

[0149] In some embodiments, the adjustment unit 62 adjusts the scene information in a scene information processor or a spatial encoding module.

[0150] In some embodiments, the rendering unit 63 performs rendering of the playback device and environment according to the parsing results of the metadata parsed from the metadata system through the core rendering system.

[0151] In some embodiments, the scene information includes a diffusion coefficient of the object audio, and the adjustment unit 62 calculates the diffusion coefficient according to the analysis result and the distance information between the sound source and the listener.

[0152] In some embodiments, the diffusion coefficient is monotonically non-decreasing with the volume of the sound source, and the volume of the sound source is determined according to analytical results.

[0153] In some embodiments, the distance information includes the length of a propagation path from the sound source to the listener, and the diffusion coefficient increases monotonically with the length of the propagation path.

[0154] In some embodiments, the diffusion coefficient includes the diffusion angle of the propagation path from the sound source to the listener. The analysis result is used to determine the volume information of the sound source of the object audio. The adjustment unit 62 calculates the diffusion coefficient based on the arctangent value of the ratio of the distance information to the volume information.

[0155] In some embodiments, the adjustment unit 62 calculates the diffusion coefficient according to the complementary angle of the arc tangent value.

[0156] In some embodiments, the diffusion coefficient includes at least one of a diffusion angle, a width, or a height of a propagation path from a sound source to a listener.

[0157] FIG7 shows a block diagram of an audio rendering apparatus according to yet other embodiments of the present disclosure.

[0158] As shown in FIG7 , the audio rendering method device 7 of this embodiment includes: a memory 71 and a processor 72 coupled to the memory 71 , and the processor 72 is configured to execute the audio rendering method of any one embodiment of the present disclosure based on instructions stored in the memory 71 .

[0159] The memory 71 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, a database, and other programs.

[0160] FIG8 shows a block diagram of an audio rendering apparatus according to further embodiments of the present disclosure.

[0161] As shown in FIG8 , the audio rendering device 8 of this embodiment includes: a memory 810 and a processor 820 coupled to the memory 810 . The processor 820 is configured to execute the audio rendering method of any of the aforementioned embodiments based on instructions stored in the memory 810 .

[0162] The memory 810 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, application programs, a boot loader, and other programs.

[0163] The audio rendering device 8 may further include an input / output interface 830, a network interface 840, a storage interface 850, and the like. These interfaces 830, 840, 850, as well as the memory 810 and the processor 820, may be connected, for example, via a bus 860. The input / output interface 830 provides a connection interface for input / output devices such as a display, mouse, keyboard, touch screen, microphone, and speakers. The network interface 840 provides a connection interface for various networked devices. The storage interface 850 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0164] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0165] So far, the present invention has been described in detail. In order to avoid obscuring the concept of the present invention, some details well known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.

[0166] The audio rendering method, audio rendering device, and non-volatile computer-readable storage medium of the present disclosure may be implemented in many ways. For example, the method and system of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless otherwise specified. In addition, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, which include machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers recording media that store programs for executing the method according to the present disclosure.

[0167] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. An audio rendering method, comprising: Parse the metadata of the object audio; According to the analysis result of the metadata, calling a parameter adjustment interface to adjust the scene information; The object audio is rendered according to the adjusted scene information.

2. The audio rendering method according to claim 1, wherein: The parsed result of the metadata includes sub-elements, and the sub-elements include a sound source width, a sound source height, and a sound source depth of the object audio.

3. The audio rendering method according to claim 2, wherein: The sound source of the object audio includes a spherical sound source, and the sound source width, the sound source height, and the sound source depth are all used to determine the radius of the spherical sound source.

4. The audio rendering method according to any one of claims 1 to 3, wherein: The calling of the parameter adjustment interface to adjust the scene information according to the analysis result of the metadata includes: In a scene information processor or a spatial encoding module, the scene information is adjusted.

5. The audio rendering method according to any one of claims 1 to 4, wherein: The performing audio rendering on the object audio according to the adjusted scene information comprises: The core rendering system is used to render the playback device and environment according to the parsing result of the metadata parsed from the metadata system.

6. The audio rendering method according to any one of claims 1 to 5, wherein: The scene information includes a diffusion coefficient of the object audio, The calling of the parameter adjustment interface to adjust the scene information according to the analysis result of the metadata includes: The diffusion coefficient is calculated according to the analysis result and the distance information between the sound source and the listener.

7. The audio rendering method according to claim 6, wherein: The diffusion coefficient is monotonically non-decreasing with the volume of the sound source, and the volume of the sound source is determined according to the analytical result.

8. The audio rendering method according to claim 6 or 7, wherein: The distance information includes the length of a propagation path from the sound source to the listener, and the diffusion coefficient increases monotonically with the length of the propagation path.

9. The audio rendering method according to any one of claims 6 to 8, wherein: The diffusion coefficient includes the diffusion angle of the propagation path from the sound source to the listener, and the analysis result is used to determine the volume information of the sound source of the object audio. The calculation of the diffusion coefficient comprises: The diffusion coefficient is calculated according to an arc tangent value of a ratio of the distance information to the volume information.

10. The audio rendering method according to claim 9, wherein: Calculating the diffusion coefficient according to the inverse tangent value of the ratio of the distance information to the volume information comprises: The diffusion coefficient is calculated according to the complementary angle of the inverse tangent value.

11. The audio rendering method according to any one of claims 6 to 10, wherein: The diffusion coefficient includes at least one of a diffusion angle, a width or a height of a propagation path from the sound source to the listener.

12. An audio rendering device, comprising: A parsing unit, used for parsing metadata of the object audio; An adjustment unit, configured to call a parameter adjustment interface to adjust scene information according to the analysis result of the metadata; A rendering unit is used to perform audio rendering on the object audio according to the adjusted scene information.

13. An audio rendering device, comprising: Memory; and A processor coupled to the memory, wherein the processor is configured to execute the audio rendering method according to any one of claims 1 to 11 based on instructions stored in the memory device.

14. A non-volatile computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the audio rendering method according to any one of claims 1 to 11 is implemented.

15. A computer program comprising: Instructions, when executed by a processor, cause the processor to perform the audio rendering method according to any one of claims 1-11.

16. A computer program product comprising instructions, which, when executed by a processor, cause the processor to perform the audio rendering method according to any one of claims 1-11.

Citation Information

Patent Citations

  • Apparatus and method for audio coding

    CN114600188A

  • Audio rendering method, audio rendering device, and electronic device

    WO2023051627A1

  • System and method for spatial audio rendering, and electronic device

    WO2023051708A1

  • Apparatus, method or computer program for synthesizing a spatially extended sound source using modification data on a potentially modifying object

    WO2023083753A1