An audio data processing method, device, equipment and readable storage medium

Abstract

The application discloses an audio data processing method and device, equipment and a readable storage medium, and relates to the technical field of audio processing, so as to improve the rendering effect of audio data. The method comprises the following steps: acquiring audio input data and a reverberation model in an environment where a user is currently located, wherein the reverberation model is determined according to an impulse response of at least one reflection path, and the at least one reflection path comprises a sound reflection path between an audio playing device in the environment and the environment; and rendering the audio input data according to the reverberation model to obtain audio output data. The embodiment of the application can improve the rendering effect of audio data.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, and in particular to an audio data processing method and device, equipment and a readable storage medium. BACKGROUND

[0002] In a real environment, the judgment of the sound direction by human ears depends on three important factors: ITD (Interaural Time Difference), ILD (Interaural Level Difference) and reverberation. In a specific implementation, ITD and ILD can be obtained by convolving HRTF (Head Related Transfer Function) with an audio signal. The reverberation is obtained by convolving the sound signal with the binaural room impulse response, and the effect of the generated reverberation depends on whether the binaural room impulse response model is accurate or not.

[0003] In existing sound effect rendering, the reverberation model can be obtained in the following ways: first, a fixed reverberation model, that is, the reverberation model is determined in advance during content production and is fixed, and the reverberation model is not changed in subsequent sound effect rendering; second, several reverberation models are preset in advance, and the user selects a reverberation model and then performs sound effect rendering.

[0004] However, using the first method of using a fixed reverberation model, there may be a problem that the reverberation model parameters do not match the actual acoustic environment; using the second method of presetting a reverberation model, it depends on the user's selection; and the selection of the reverberation model often depends on the user's professional knowledge, so the reverberation model selected by the user may not be suitable.

[0005] Therefore, using the reverberation model in the prior art for sound effect rendering may result in poor rendering effect of audio data. SUMMARY

[0006] The embodiments of the present application provide an audio data processing method, device, equipment and readable storage medium to improve the rendering effect of audio data.

[0007] In a first aspect, the embodiments of the present application provide an audio data processing method, comprising:

[0008] obtaining audio input data and a reverberation model in an environment where a user is currently located, the reverberation model being determined according to an impulse response of at least one reflection path, the at least one reflection path including a sound reflection path between an audio playback device in the environment and the environment;

[0009] render the audio input data according to the reverberation model to obtain audio output data.

[0010] In a second aspect, the embodiments of the present application further provide an audio data processing apparatus, comprising:

[0011] The first obtaining module is configured to obtain audio input data and a reverberation model of an environment in which a user is currently located, wherein the reverberation model is determined according to an impulse response of at least one reflection path, and the at least one reflection path comprises a sound reflection path between an audio playing device in the environment and the environment;

[0012] The second obtaining module is configured to render the audio input data according to the reverberation model to obtain audio output data.

[0013] In a third aspect, the embodiments of the present application further provide an electronic device, comprising a memory, a processor, and a program stored in the memory and capable of running on the processor, wherein the processor implements the steps in the audio data processing method when executing the program.

[0014] In a fourth aspect, the embodiments of the present application further provide a readable storage medium, wherein the readable storage medium stores a program, and the program is executed by a processor to implement the steps in the audio data processing method.

[0015] In the embodiments of the present application, the audio input data is rendered according to the reverberation model of the environment in which the user is currently located to obtain audio output data. Since the reverberation model is determined according to the impulse response of at least one reflection path, and the at least one reflection path comprises the reflection path between the audio playing device in the environment and the environment, the obtained reverberation model can be matched with the parameters of the environment in which the user is currently located, thereby improving the rendering effect of the audio data. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 FIG. 1 is one of flowcharts of the audio data processing method provided by the embodiments of the present application;

[0017] Figure 2 FIG. 2 is a schematic diagram of a binaural headphone;

[0018] Figure 3 FIG. 3 is another of flowcharts of the audio data processing method provided by the embodiments of the present application;

[0019] Figure 4 FIG. 4 is a schematic diagram of a plurality of distances obtained;

[0020] Figure 5 FIG. 5 is a schematic diagram of an impulse response of a room;

[0021] Figure 6is a process schematic diagram of an audio data processing method provided by an embodiment of the present application.

[0022] Figure 7 is a structural diagram of an audio data processing apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0023] In the embodiments of the present application, the term "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0024] In the embodiments of the present application, the term "a plurality of" means two or more, and other quantifiers are similar.

[0025] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0026] Referring to Figure 1 , Figure 1 is a flowchart of an audio data processing method provided by an embodiment of the present application, as shown in Figure 1 , comprising the following steps:

[0027] Step 101, obtaining audio input data and a reverberation model in an environment currently where a user is located.

[0028] The environment may, for example, be a closed or open environment, such as a closed room, etc. When the user is in the environment, audio can be played through an audio playing device such as a headset, etc. In the embodiments of the present application, the reverberation model is determined according to an impulse response of at least one reflection path, and the at least one reflection path includes a reflection path between the audio playing device and the environment in the environment. Therefore, the reflection path can also refer to a sound reflection path between the audio playing device and the environment formed by the sound played by the audio playing device in the environment.

[0029] In the embodiments of the present application, distances between the audio playback device and at least one position in the environment are obtained, and a measurement path of the obtained distances is taken as the reflection path. Wherein, the number of obtained distances is set as n, n is an integer greater than or equal to 1, for example, can be 5, 8, etc. After the above distances are obtained, the obtained distances can be sorted in ascending order, the nearest distance is numbered as 1, and the farthest distance is numbered as n. In practice, the reflection path can also include not only the reflection path formed by the measurement path, but also other reflection paths whose distances are not measured.

[0030] Wherein, the reverberation model is represented as a sum of impulse responses on the at least one reflection path. Specifically, the reverberation model can be represented as an impulse response R in the environment, which can be represented as:

[0031]

[0032] Wherein, R represents the reverberation model, n represents the total number of reflection paths, h i represents the impulse response on the i-th reflection path (target reflection path).

[0033] Specifically, for any target reflection path in the at least one reflection path, a reflection path gain can be obtained, and the impulse response on the target reflection path can be obtained according to the reflection path gain, a target distance corresponding to the target reflection path, and a sound propagation speed in air.

[0034] For example, for the impulse response on the i-th reflection path, it can be determined in the following manner:

[0035] According to the reflection path gain, the distance corresponding to the i-th reflection path, and the sound propagation speed in air, the impulse response on the i-th reflection path is obtained; wherein, i is an integer, and 1≤i≤n, n represents the total number of reflection paths.

[0036] Specifically, the impulse response on the i-th reflection path h i can be determined according to the following formula:

[0037]

[0038] Wherein, h i represents the impulse response on the i-th reflection path (target reflection path), A represents the reflection path gain, di represents the distance corresponding to the i-th reflection path, and c represents the sound propagation speed in air, which is 314 m / s.

[0039] In the embodiments of the present application, in the process of obtaining the reflection path gain, the reflection path attenuation parameter can be acquired first, and the reflection path gain is obtained according to the reflection path attenuation parameter. The reflection path attenuation parameter includes the light intensity of the environment and / or the noise of the environment. When the reflection path gain is determined according to the light intensity of the environment and the noise of the environment at the same time, the obtained reverberation model can be more matched with the parameters of the current environment.

[0040] Based on the above description, the reflection path gain is determined according to any one of the following formulas:

[0041]

[0042]

[0043] A=e -(m+70)

[0044] Wherein, A represents the reflection path gain, lu represents the light intensity of the environment, and m represents the noise of the environment.

[0045] Therefore, according to the different ways of obtaining the reflection path gain, the reverberation model can be expressed in different forms: if then:

[0046]

[0047] if then:

[0048]

[0049] if A=e -(m+70) then

[0050]

[0051] In the embodiments of the present application, the reflection path attenuation parameter refers to the attenuation parameter corresponding to the reflection path, which is used to determine the reverberation model in the environment. As described above, in the embodiments of the present application, the reflection path attenuation parameter includes the light intensity of the environment and / or the noise of the environment. Optionally, the reflection path attenuation parameter includes the light intensity of the environment and the noise of the environment, so that the matching between the obtained reverberation model and the actual environment parameters can be improved.

[0052] Wherein, the light intensity of the environment is obtained in the following manner:

[0053] obtaining light intensity values of t light sampling points in the environment, and taking the average of the light intensity values as the light intensity of the environment. t is an integer greater than or equal to 1. For example, the light intensity values of the t light sampling points in the environment can be collected by a camera disposed on the audio playback device.

[0054] Specifically, the light intensity of the environment can be determined according to the following formula:

[0055]

[0056] wherein lu represents the light intensity of the environment, t represents the number of light sampling points, and lu(j) represents the light intensity of the jth(1≤j≤t) light sampling point.

[0057] wherein the noise of the environment is obtained in the following manner:

[0058] obtaining environment noise values of k PCM (Pulse Code Modulation) sampling points in the environment, and taking the average of the environment noise values as the noise of the environment. k is an integer greater than or equal to 1. For example, the environment noise values of the k PCM sampling points in the environment can be collected by a microphone disposed on the audio playback device, and the average noise level of the environment can be obtained according to the collected environment noise values of the k PCM sampling points.

[0059] Specifically, the noise of the environment can be determined according to the following formula:

[0060]

[0061] wherein m represents the noise of the environment, x i (1≤i≤k) represents the environment noise value of the ith PCM sampling point.

[0062] Step 102, rendering the audio input data according to the reverberation model to obtain audio output data.

[0063] Specifically, in this step, the following content can be included:

[0064] (1) generating a reverberation signal according to the reverberation model and the audio input data.

[0065] Specifically, the audio input data and the reverberation model can be convolved to obtain the reverberation signal, which can be represented as:

[0066]

[0067] wherein s revb represents the reverberation signal, and S origrepresents audio input data, and R represents a reverberation model.

[0068] (2) Generating a direct sound signal according to the audio input data.

[0069] Specifically, the audio input data and the HRTF parameter can be convolved to obtain the direct sound signal, which can be represented as:

[0070]

[0071] wherein s dir represents a direct sound signal, s orig represents audio input data, H rtf represents an HRTF parameter.

[0072] Since the audio input data is data with azimuth information, the direct sound signal generated here can also be referred to as an azimuth direct sound signal.

[0073] wherein the direct sound (Direct Sound) signal refers to the sound directly transmitted to the user in the form of a straight line without any reflection from the sound source.

[0074] (3) Obtaining audio output data according to the reverberation signal and the direct sound signal.

[0075] Specifically, the reverberation signal and the direct sound signal can be superimposed to obtain the audio output data, which can be represented as:

[0076] s spkr = s dir + s revb

[0077] wherein s spkr represents audio output data, s dir represents a direct sound signal, and s revb represents a reverberation signal.

[0078] In the embodiments of the present application, the audio input data is rendered according to the reverberation model of the environment in which the user is currently located to obtain audio output data. Since the reverberation model is determined according to the impulse response of at least one reflection path, the at least one reflection path includes a reflection path between the audio playback device and the environment, so that the obtained reverberation model can be more matched with the parameters of the environment in which the user is currently located, thereby improving the rendering effect of the audio data.

[0079] The method of the embodiments of the present application can be applied in various environments, such as a closed environment, such as a room, etc. In the embodiments of the present application, the audio data decoded from the audio is rendered and played in an audio playing device. The audio playing device can be a binaural earphone, such as Figure 2 As shown in the figure, the binaural earphone is provided with two cameras 21 and a microphone 22.

[0080] In the embodiments of the present application, a closed room is taken as an example for description. Referring to Figure 3 , Figure 3 The flowchart of the method for processing audio data provided by the embodiments of the present application is shown in Figure 3 , which includes the following steps:

[0081] Step 301: Determine the echo distance to obtain the reflection path.

[0082] Specifically, the distance from the binaural earphone to different positions in the room can be measured according to the binocular distance measurement principle by using the camera provided on the earphone, and n distances are obtained. Wherein, n is greater than or equal to 5, and is recommended to be 8. For example, the camera on the binaural earphone is rotated for one week to obtain n distances. The n distances obtained are the echo distances, and the measurement path for measuring the distances can be used as the reflection path subsequently. As shown in Figure 4 , it is a schematic diagram of the multiple distances obtained. The n distances are reordered according to the distance, assuming that the nearest distance (i.e. the direct distance) is i = 1, and then the distances are sequentially ordered, and the farthest distance is i = n. The reflection path corresponding to the nearest distance can be called the direct path, and the other reflection paths can be called other reflection paths.

[0083] Step 302: Determine the light intensity and noise of the room.

[0084] The light intensity of the room is collected by using the camera on the earphone, for example, the camera is rotated for one week to obtain t light intensity values, and the average light intensity of the current room is calculated in the following manner, with the unit being lumens:

[0085]

[0086] Wherein, lu represents the light intensity of the room, t represents the number of light sampling points, and lu(j) represents the light intensity of the jth (1≤j≤t) light sampling point.

[0087] The ambient noise of the room is collected by using the microphone on the earphone to obtain the ambient noise values of k PCM sampling points, and then the average noise level m of the room is obtained:

[0088]

[0089] Wherein, m represents the noise of the environment, xi (1≤i≤k) represents the ambient noise value of the i-th PCM sampling point.

[0090] Step 303, generating a reverberation model.

[0091] The reverberation model can be represented as an impulse response R in the environment.

[0092] The reverberation model can be represented as:

[0093]

[0094] wherein R represents the reverberation model, n represents the total number of reflection paths, h i represents the impulse response on the i-th reflection path.

[0095] wherein,

[0096] Therefore,

[0097] wherein A represents the reflection path gain, lu represents the light intensity of the environment, and m represents the noise of the environment.

[0098] As Figure 5 shown, the impulse response R of the room is formed by the unit impulse pulse (impulse response) on each reflection path.

[0099] Step 304, generating a reverberation signal.

[0100] The audio input data and the reverberation model are convolved to obtain the reverberation signal, which can be represented as:

[0101]

[0102] wherein s revb represents the reverberation signal, S orig represents the audio input data, and R represents the reverberation model.

[0103] Step 305, generating a direct sound with orientation.

[0104] The audio input data and the HRTF parameter are convolved to obtain the direct sound signal, which can be represented as:

[0105]

[0106] wherein s dir represents the direct sound signal, S orig represents the audio input data, and H rtf represents the HRTF parameter.

[0107] Step 306, obtaining output audio data according to the reverberation signal and the direct sound.

[0108] The reverberation signal and the direct sound signal are superimposed to obtain the audio output data, which can be represented as:

[0109] s spkr =s dir +S revb

[0110] Wherein, s spkr represents the audio output data, s dir represents the direct sound signal, and s revb represents the reverberation signal.

[0111] Figure 6 A schematic diagram of the above process is shown. First, the distances of different positions of the user and the room are obtained, and the environmental parameters of the room such as light intensity and noise level are obtained. Then, the impulse response of the room is generated according to the impulse response on each reflection path to obtain a reverberation model. The reverberation signal is obtained by using the reverberation model and the audio input data; the direct sound is obtained by using the audio input data and the HRTF parameter; and the final audio output data is obtained by superimposing the reverberation signal and the direct sound.

[0112] Since the light intensity and the noise of the room are used to determine the reverberation model in the above process, the processing method of the embodiments of the present application can also be called a multi-modal three-dimensional sound rendering method.

[0113] In the embodiments of the present application, the camera is used to scan the surrounding environment of the room to obtain the distance, and then the single-path reverberation reflection path is obtained. Then, the reflection path attenuation parameters of the reverberation are established according to the light level and the noise level of the room, so as to form a reverberation model according to the reflection path attenuation parameters, and process the audio input data by using the reverberation model to obtain the audio output data. Therefore, in the embodiments of the present application, the automatic generation of the reverberation model is realized, and the generated reverberation model is matched with the actual environmental parameters of the room, so as to improve the rendering effect of the audio data. At the same time, since the reverberation model is automatically generated, the user does not need to select the corresponding model, thereby avoiding the problem that the selected reverberation model is not matched with the actual environmental parameters of the room due to the unprofessional selection of the user, and further improving the rendering effect of the audio data.

[0114] The embodiments of the present application also provide an audio data processing device. As shown in Figure 7 the audio data processing device 700 includes:

[0115] The first acquisition module 701 is used to acquire audio input data and a reverberation model of the user's current environment. The reverberation model is determined based on the impulse response of at least one reflection path, and the at least one reflection path includes the reflection path between the audio playback device in the environment and the environment. The second acquisition module 702 is used to render the audio input data according to the reverberation model to obtain audio output data.

[0116] Optionally, the reverberation model is represented as the sum of the impulse responses on the at least one reflection path.

[0117] Optionally, the device may further include:

[0118] The third acquisition module is used to acquire the impulse response of any target reflection path among the at least one reflection path in the following manner, which may include:

[0119] The first acquisition submodule is used to acquire the reflection path gain;

[0120] The second acquisition submodule is used to obtain the impulse response on the target reflection path based on the reflection path gain, the target distance corresponding to the target reflection path, and the speed of sound propagation in the air.

[0121] Optionally, the first acquisition submodule includes:

[0122] The first acquisition unit is used to acquire reflection path attenuation parameters, wherein the reflection path attenuation parameters include the light intensity of the environment and / or the noise of the environment;

[0123] The second acquisition unit is used to obtain the reflection path gain based on the reflection path attenuation parameter.

[0124] Optionally, the impulse response h on the target reflection path is determined according to the following formula. i :

[0125]

[0126] Among them, h i Let A represent the impulse response on the target reflection path, let di represent the distance corresponding to the i-th reflection path, let c represent the speed of sound in the air, let i represent the number of the target reflection path, i is an integer, and 1≤i≤n, and n represents the total number of reflection paths.

[0127] Optionally, the ambient light intensity can be obtained as follows:

[0128] Obtain the light intensity values ​​of t light sampling points in the environment, where t is an integer greater than or equal to 1;

[0129] The average of the light intensity values is taken as the light intensity of the environment.

[0130] Optionally, the noise of the environment is obtained in the following manner:

[0131] Obtain an environmental noise value of k pulse code modulation (PCM) sampling points in the environment, k being an integer greater than or equal to 1.

[0132] The average of the environmental noise values is taken as the noise of the environment.

[0133] Optionally, the reflection path gain is determined according to any one of the following formulas:

[0134]

[0135]

[0136] A = e -(m+70)

[0137] wherein A represents the reflection path gain, lu represents the light intensity of the environment, and m represents the noise of the environment.

[0138] Optionally, the second obtaining module 703 can include:

[0139] A first generating sub-module configured to generate a reverberation signal according to the reverberation model and the audio input data; a second generating sub-module configured to generate a direct sound signal according to the audio input data; and a first obtaining sub-module configured to obtain audio output data according to the reverberation signal and the direct sound signal.

[0140] Optionally, the first generating sub-module is configured to convolve the audio input data and the reverberation model to obtain the reverberation signal. The second generating sub-module is configured to convolve the audio input data and the HRTF parameter to obtain the direct sound signal. The first obtaining sub-module is configured to superimpose the reverberation signal and the direct sound signal to obtain the audio output data.

[0141] The apparatus provided by the embodiments of the present application can execute the method embodiments described above, and has similar implementation principles and technical effects, which will not be described here again.

[0142] It should be noted that the division of the unit in the embodiments of the present application is illustrative, and is only a logical function division. In actual implementation, another division manner can be used. In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0143] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, the integrated unit can be stored in a processor-readable storage medium. Based on this understanding, the technical solutions of the present application, essentially or in part, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and various other media that can store program codes.

[0144] The embodiments of the present application provide an electronic device, including a memory, a processor, and a program stored in the memory and executable on the processor; the processor is used to read the program in the memory to implement the steps in the audio data processing method.

[0145] The embodiments of the present application also provide a readable storage medium, and the readable storage medium stores a program. The program is executed by a processor to implement each process of the above-mentioned audio data processing method embodiments, and can achieve the same technical effects. To avoid repetition, details are not described herein. The readable storage medium can be any available medium or data storage device that can be accessed by the processor, including but not limited to a magnetic memory (for example, a floppy disk, a hard disk, a magnetic tape, a magneto-optical disk (MO), etc.), an optical memory (for example, a CD, a DVD, a BD, a HVD, etc.), and a semiconductor memory (for example, a ROM, an EPROM, an EEPROM, a non-volatile memory (NAND FLASH), a solid state disk (SSD), etc.).

[0146] It should be noted that, in the present document, the terms "comprises / comprising" or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the recited element.

[0147] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and necessary general hardware platforms, of course, they can also be realized by hardware, but in many cases, the former is a better embodiment. According to such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a number of instructions for causing a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

[0148] The embodiments of the present application are described above in combination with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. An audio data processing method, characterized by, The method comprises: obtaining audio input data and a reverberation model in an environment in which a user is currently located, the reverberation model being determined according to an impulse response of at least one reflection path, the at least one reflection path comprising a sound reflection path between an audio playback device in the environment and the environment; rendering the audio input data according to the reverberation model to obtain audio output data; wherein, for any target reflection path in the at least one reflection path, the impulse response of the target reflection path is obtained in the following manner, comprising: obtaining a reflection path gain; obtaining an impulse response on the target reflection path according to the reflection path gain, a target distance corresponding to the target reflection path, and a sound propagation speed in air; wherein, the obtaining of the reflection path gain comprises: obtaining a reflection path attenuation parameter, wherein the reflection path attenuation parameter comprises a light intensity of the environment and / or a noise of the environment; obtaining the reflection path gain according to the reflection path attenuation parameter.

2. The method of claim 1, wherein, The reverberation model is represented as a sum of the impulse responses on the at least one reflection path.

3. The method of claim 1, wherein, The impulse response h on the target reflection path is determined according to the following equation i : wherein h i represents an impulse response on the target reflection path, A represents a reflection path gain, di represents a distance corresponding to the target reflection path, c represents a sound propagation speed in air, i represents a number of the target reflection path, i is an integer, 1≤i≤n, n represents a total number of reflection paths.

4. The method of claim 1, wherein, The reflection path gain is determined according to any one of the following formulas: A = e -(m+70) wherein, A represents the reflection path gain, lu represents the light intensity of the environment, and m represents the noise of the environment.

5. The method of claim 1, wherein, The light intensity of the environment is obtained in the following manner: obtaining light intensity values of t light sampling points in the environment, t being an integer greater than or equal to 1; taking a mean value of the light intensity values as the light intensity of the environment.

6. The method of claim 1, wherein, The noise of the environment is obtained in the following manner: obtaining environment noise values of k pulse code modulation (PCM) sampling points in the environment, k being an integer greater than or equal to 1; taking a mean value of the environment noise values as the noise of the environment.

7. The method of claim 1, wherein, The rendering of the audio input data according to the reverberation model to obtain audio output data comprises: generating a reverberation signal according to the reverberation model and the audio input data; generating a direct sound signal according to the audio input data; obtaining audio output data according to the reverberation signal and the direct sound signal.

8. The method of claim 7, wherein, The generation of the reverberation signal according to the reverberation model and the audio input data comprises: convolving the audio input data and the reverberation model to obtain the reverberation signal.

9. The method of claim 7, wherein, The generation of the direct sound signal according to the audio input data comprises: convolving the audio input data and a head-related transfer function (HRTF) parameter to obtain the direct sound signal.

10. The method of claim 7, wherein, The obtaining of audio output data according to the reverberation signal and the direct sound signal comprises: superimposing the reverberation signal and the direct sound signal to obtain the audio output data.

11. An audio data processing apparatus, characterized by comprising: The method comprises: a first obtaining module, configured to obtain audio input data and a reverberation model in an environment in which a user is currently located, the reverberation model being determined according to an impulse response of at least one reflection path, the at least one reflection path comprising a sound reflection path between an audio playback device in the environment and the environment; a second obtaining module, configured to render the audio input data according to the reverberation model to obtain audio output data; The device further comprises: The third obtaining module is configured to obtain an impulse response of any target reflection path in the at least one reflection path, comprising: The first obtaining submodule is configured to obtain a reflection path gain; The second obtaining submodule is configured to obtain an impulse response on the target reflection path according to the reflection path gain, a target distance corresponding to the target reflection path, and a sound propagation speed in air; The first obtaining submodule comprises: The first obtaining unit is configured to obtain a reflection path attenuation parameter, wherein the reflection path attenuation parameter comprises a light intensity of the environment and / or a noise of the environment; The second obtaining unit is configured to obtain the reflection path gain according to the reflection path attenuation parameter.

12. An electronic device comprising: The memory, the processor, and a program stored in the memory and capable of running on the processor; the processor is configured to read the program in the memory to implement the steps in the audio data processing method according to any one of claims 1 to 10.

13. A readable storage medium for storing a program, characterized in that, The program is executed by the processor to implement the steps in the audio data processing method according to any one of claims 1 to 10.

Images