Audio processing method and device, readable storage medium and computer program product

Abstract

The invention discloses an audio processing method and device, a readable storage medium and a computer program product, and relates to the technical field of spatial audio, and the method comprises the steps: obtaining a to-be-processed original audio, and determining all shielding objects between a sound pickup source and a sound source; acoustic parameters of the sound source are determined, and the acoustic parameters comprise the propagation distance of a signal emitted by the sound source in each shelter, and / or the sound path distance difference of the signal emitted by the sound source passing through all the shelters to be propagated; determining an attenuation parameter based on the acoustic parameter, the attenuation parameter including a transmission attenuation value and / or a diffraction coefficient; and performing attenuation processing on the original audio based on the attenuation parameter to obtain a target audio. According to the invention, the simulation time delay of simulating the sound shielding effect of the shielding object is reduced.

Description

Technical Field

[0001] This application relates to the field of spatial audio technology, and in particular to an audio processing method, device, readable storage medium, and computer program product. Background Technology

[0002] Spatial audio, also known as 3D audio, is an audio technology designed to simulate or reproduce how sound propagates in real three-dimensional space. By simulating the location, distance, motion, and spatial environmental characteristics of sound, it provides listeners with an immersive auditory experience, just as if sound were naturally propagating in physical space.

[0003] Spatial audio algorithms can be used to simulate the propagation of sound in the physical world, mimicking the occlusion effect of objects. These algorithms simulate sound propagation by tracing every sound path from the sound source to the listener using ray tracing. The audio ray collides with an obstacle, changes direction, and eventually reaches the listener. The energy of the received audio ray is accumulated to simulate the occlusion effect. However, spatial audio algorithms are computationally intensive and complex, resulting in a long simulation delay for the occlusion effect.

[0004] Therefore, how to reduce the simulation delay of the sound blocking effect of simulated obstructions is a technical problem that urgently needs to be solved in this field. Summary of the Invention

[0005] The main objective of this application is to provide an audio processing method, device, readable storage medium, and computer program product, which aims to solve the technical problem of how to reduce the simulation delay of the sound blocking effect of simulated obstructions.

[0006] To achieve the above objectives, this application provides an audio processing method, which includes the following steps:

[0007] Acquire the raw audio to be processed and identify all obstructions between the pickup source and the sound source;

[0008] Determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source inside each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions;

[0009] The attenuation parameters are determined based on the acoustic parameters, wherein the attenuation parameters include transmission attenuation value and / or diffraction coefficient;

[0010] The original audio is attenuated based on the attenuation parameters to obtain the target audio.

[0011] In one embodiment, the step of determining the attenuation parameter based on the acoustic parameters includes:

[0012] If the acoustic parameters include each of the propagation distances, then the transmission attenuation value is determined based on each of the propagation distances;

[0013] If the acoustic parameters include path difference, then the diffraction coefficient is determined based on the path difference.

[0014] In one embodiment, the step of determining the transmission attenuation value based on each of the propagation distances includes:

[0015] For each of the aforementioned obstructions, the transmittance per unit length of the obstruction is obtained, and the product between the transmittance per unit length and the propagation distance corresponding to the obstruction is calculated;

[0016] The sum of all the products is determined to be the transmission attenuation value.

[0017] In one embodiment, when the acoustic parameters include the path difference of the signal emitted by the sound source propagating around all the obstructions, the step of determining the acoustic parameters of the sound source includes:

[0018] The distance between the sound pickup source and the sound source is defined as the direct transmission distance;

[0019] Projecting all the obstructions onto a preset vertical plane yields a projection area, wherein the preset vertical plane is perpendicular to the line connecting the sound pickup source and the sound source;

[0020] For each preset diffraction point, the distance between the preset diffraction point and the sound source is determined as a first distance, the distance between the preset diffraction point and the sound source is determined as a second distance, the sum of the first distance and the second distance is determined as the transmission distance, and the distance difference between the transmission distance and the direct transmission distance is calculated. Wherein, the projection point of the preset diffraction point on the preset vertical plane is located on the outline of the projection area, and the preset diffraction point is a point on any of the obstructions.

[0021] The path difference by which the signal emitted by the sound source propagates around all the obstructions is determined based on the distance differences.

[0022] In one embodiment, the step of determining the sound path difference of the signal emitted by the sound source propagating around all the obstructions based on each of the distance differences includes:

[0023] The minimum of all said distance differences is selected as the sound path difference for the signal emitted by the sound source to propagate around all said obstructions; or...

[0024] The average of all the distance differences is selected as the sound path difference of the signal emitted by the sound source propagating around all the obstructions.

[0025] In one embodiment, the step of attenuating the original audio based on the attenuation parameter to obtain the target audio includes:

[0026] If the attenuation parameter includes a transmission attenuation value but does not include a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the first audio is determined to be the target audio.

[0027] If the attenuation parameter includes the diffraction coefficient but does not include the transmission attenuation value, then the original audio is attenuated based on the diffraction coefficient to obtain the second audio, and the second audio is determined to be the target audio; or...

[0028] If the attenuation parameters include a transmission attenuation value and a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the original audio is attenuated based on the diffraction coefficient to obtain a second audio. The first audio and the second audio are then synthesized to obtain the target audio.

[0029] In one embodiment, the step of synthesizing the first audio and the second audio to obtain the target audio includes:

[0030] The distance between the sound pickup source and the sound source is determined as the direct transmission distance, and the intersection of the line segment between the sound source and the sound pickup source and the preset vertical plane is determined as the reference point;

[0031] Determine the projection area formed by projecting all the obstructions onto the preset vertical plane, determine the minor axis length of the projection area, and determine the sum of the minor axis length and the direct transmission distance as the reference distance;

[0032] The ratio between the minor axis length and the reference distance is determined as the transmission weight, and the ratio between the direct transmission distance and the reference distance is determined as the diffraction weight;

[0033] The first audio and the second audio are synthesized based on the transmission weight and the diffraction weight to obtain the target audio, wherein the transmission weight is used to adjust the first audio and the diffraction weight is used to adjust the second audio.

[0034] In addition, to achieve the above objectives, this application also provides an audio processing device, the audio processing device comprising: a speaker and a processor, the speaker being connected to the processor, the processor being configured to implement the steps of the audio processing method as described above.

[0035] In addition, to achieve the above objectives, this application also provides a readable storage medium, which is a computer-readable storage medium, on which a program implementing an audio processing method is stored, and the program implementing the audio processing method is executed by a processor to implement the steps of the audio processing method as described above.

[0036] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the audio processing method described above.

[0037] One or more technical solutions proposed in this application have at least the following technical effects:

[0038] The process involves acquiring the original audio to be processed and identifying all obstructions between the sound source and the pickup source. The acoustic parameters of the sound source are then determined, including the propagation distance of the signal emitted by the sound source within each obstruction and / or the path difference of the signal emitted by the sound source around all obstructions. Based on these acoustic parameters, attenuation parameters are determined, including transmission attenuation and / or diffraction coefficients. The original audio is then attenuated based on these attenuation parameters to obtain the target audio. Considering that sound propagation in the physical world encounters obstructions between the sound source and the listener, the obstruction is mainly due to transmission and diffraction. Transmission refers to sound passing through an obstruction and being attenuated before reaching the listener, while diffraction refers to sound traveling around an obstruction to reach the listener. Thus, this embodiment determines the propagation distance of the signal emitted by the sound source within each obstruction, thereby determining the transmission attenuation value, i.e., the signal attenuation due to transmission through the obstructions, and / or the path difference of the sound source around all obstructions, thereby determining the diffraction coefficient, i.e., the diffraction capability of the obstruction to the signal. It eliminates the need to use ray tracing to track every sound propagation path from the sound source to the pickup source; it only requires calculating the propagation distance of the signal emitted by the sound source within the obstructions and / or the path difference of the sound source around all obstructions. This reduces the computational load and complexity, thereby lowering the simulation delay of the sound obstruction effect. Furthermore, since the sound obstruction by the obstruction is mainly due to transmission and diffraction, it ensures that the target audio obtained by attenuating the original audio based on attenuation parameters such as the transmission attenuation value and / or the diffraction coefficient can simulate the sound obstruction effect of the obstruction. Attached Figure Description

[0039] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0040] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] Figure 1 This is a schematic flowchart of the first embodiment of the audio processing method of this application;

[0042] Figure 2 A diagram illustrating the sound-blocking effect of an obstruction.

[0043] Figure 3 This is a schematic diagram showing the propagation distance inside an obstruction in an embodiment of the audio processing method of this application;

[0044] Figure 4 This is a schematic diagram of the projection of an obstruction involved in an embodiment of the audio processing method of this application;

[0045] Figure 5 This is a simplified flowchart of the audio processing method of this application;

[0046] Figure 6 This is a schematic diagram of the device structure of the audio processing apparatus of this application;

[0047] Figure 7 This is a schematic diagram of the hardware operating environment of the audio processing device in the embodiments of this application.

[0048] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0049] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0050] Sound propagation in the physical world encounters obstructions between the sound source and the listener. In such cases, the obstruction causes transmission attenuation and diffraction effects on the sound. (Refer to...) Figure 2 As shown, some sound will pass through the obstruction and reach the listener after being attenuated by the obstruction; other sound will bypass the obstruction and travel to the listener.

[0051] Spatial audio algorithms simulate the propagation of sound in the physical world, including simulating the occlusion effect of obstacles. Some algorithms determine if an obstacle exists between the sound source and the listener, and if so, apply a low-pass filter to simulate occlusion attenuation. This method is simple and computationally inexpensive, but it doesn't consider more characteristics of the obstacle, such as its number and thickness, resulting in a less realistic effect. Other spatial audio algorithms simulate sound propagation through ray tracing. The audio ray collides with an obstacle, changes direction, and eventually reaches the listener. The energy of the audio ray received by the listener is accumulated to simulate the occlusion effect. This method is more realistic, but its high computational complexity makes real-time computation difficult.

[0052] Based on this, the main solution of this application is: to acquire the original audio to be processed, and to identify all obstructions between the pickup source and the sound source; to determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source within each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions; to determine attenuation parameters based on the acoustic parameters, wherein the attenuation parameters include a transmission attenuation value and / or a diffraction coefficient; and to perform attenuation processing on the original audio based on the attenuation parameters to obtain the target audio.

[0053] This application determines the transmission attenuation value (i.e., the signal attenuation due to transmission through the obstructions) by determining the propagation distance of the signal emitted by the sound source within each obstruction, and / or the path difference of the sound source around all obstructions, thereby determining the diffraction coefficient (i.e., the diffraction capability of the obstructions). This eliminates the need for ray tracing of every sound propagation path from the sound source to the pickup source; it only requires calculating the propagation distance of the signal emitted by the sound source within the obstructions and / or the path difference of the sound source around all obstructions. This reduces the computational load and complexity, thus lowering the simulation delay for simulating the sound obstruction effect of obstructions. Furthermore, since the sound obstruction by obstructions is mainly due to transmission and diffraction, it ensures that the target audio obtained by attenuating the original audio based on the transmission attenuation value and / or diffraction coefficient can simulate the sound obstruction effect of obstructions.

[0054] It should be noted that the execution subject of the audio processing method embodiments of this application can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an audio processing device capable of performing the above functions, such as AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, AR headsets, or VR headsets. The embodiments of the audio processing method of this application do not impose specific limitations in this regard.

[0055] Based on this, this application proposes an audio processing method according to a first embodiment, please refer to... Figure 1 The audio processing method includes steps S10 to S40:

[0056] Step S10: Obtain the original audio to be processed and identify all obstructions between the sound pickup source and the sound source;

[0057] A sound source is an object that outputs sound, such as a loudspeaker.

[0058] It should be noted that the sound source can be either a real sound source or a virtual sound source. A real sound source refers to the sound source that actually outputs sound, while a virtual sound source refers to the sound source that outputs sound virtually (which may actually be the sound output from another device). For example, in an AR game scene, when a game character speaks, the game character can be considered a virtual sound source (the sound is actually output from the AR device's speaker, not from the game character). Similarly, in an AR game scene, when an object is struck, the object being struck can be considered a virtual sound source (the sound is actually output from the AR device's speaker, not from the object being struck). Likewise, in an AR game scene, when a musical instrument is played, the instrument can be considered a virtual sound source (the sound is actually output from the AR device's speaker, not from the instrument itself).

[0059] A sound pickup source refers to an object or user (referred to as a listener) that receives the sound output from a sound source. For example, in a signal recording scenario, if a microphone is used to record the signal output from a speaker, then the microphone is the sound pickup source. Similarly, if a listener receives the signal output from a speaker, then the listener is the sound pickup source. Exemplarily, the various embodiments of the audio processing method of this application are described and illustrated using the listener as the sound pickup source.

[0060] An obstruction between a sound source and a listener is an object that blocks the signal emitted by the sound source as it travels towards the listener. In other words, if the signal emitted by the sound source travels in a straight line and first intersects an object before intersecting the listener, then that object is an obstruction. For example, refer to... Figure 3 As shown, the signal emitted by the sound source intersects with object 1 and object 2 in sequence as it propagates to the listener. Therefore, both object 1 and object 2 are obstructions, that is... Figure 3 Obstruction 1 and obstruction 2 are shown in the image.

[0061] The signal emitted by the sound source can specifically be the sound signal emitted by the sound source.

[0062] It should be noted that the obstruction can be a physical object or a virtual object, and this embodiment does not impose any specific restrictions on it.

[0063] Step S20: Determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source inside each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions;

[0064] It should be noted that, preferably, the propagation distance of the signal emitted by the sound source inside each obstruction is determined, and the path difference of the signal emitted by the sound source propagating around all obstructions is determined. That is, the acoustic parameters include each propagation distance and the path difference.

[0065] The propagation distance of the signal emitted by the sound source within each obstruction is the length of the propagation path of the signal from its entry into the obstruction to its exit from the obstruction. Considering that sound usually travels in a straight line, to simplify the calculation, in a preferred embodiment, the point where the signal emitted by the sound source enters the obstruction and forms an intersection with the obstruction is recorded as the entry point, and the point where the signal emitted by the sound source exits the obstruction and forms an intersection with the obstruction is recorded as the exit point. The straight-line distance between the entry point and the exit point can be determined as the propagation distance of the signal emitted by the sound source within the obstruction.

[0066] For example, refer to Figure 3 As shown, the signal emitted by the sound source enters the obstruction 1 from intersection 1, exits the obstruction 1 from intersection 2, enters the obstruction 2 from intersection 3, exits the obstruction 2 from intersection 4, and finally reaches the listener. Therefore, the straight-line distance between intersection 1 and intersection 2 can be determined as the propagation distance of the signal emitted by the sound source inside the obstruction 1, and the straight-line distance between intersection 3 and intersection 4 can be determined as the propagation distance of the signal emitted by the sound source inside the obstruction 2.

[0067] The path difference of a sound wave propagating around all obstructions is the difference between the path the signal travels from the sound source to the listener in a straight line (denoted as the first path) and the path the signal travels around all obstructions to the listener (denoted as the second path). Specifically, it can be expressed as an absolute difference. Here, path refers to the length of the path a sound wave takes from the sound source to the receiver.

[0068] Step S30: Determine attenuation parameters based on the acoustic parameters, wherein the attenuation parameters include transmission attenuation value and / or diffraction coefficient;

[0069] Optionally, if the acoustic parameters include each of the propagation distances, then the transmission attenuation value is determined based on each of the propagation distances; if the acoustic parameters include the sound path difference, then the diffraction coefficient is determined based on the sound path difference.

[0070] It should be noted that the transmission attenuation value is positively correlated with each propagation distance, and the diffraction coefficient is positively correlated with the sound path difference. Preferably, the transmission attenuation value is determined based on each propagation distance, and the diffraction coefficient is determined based on the sound path difference.

[0071] In one possible implementation, the acoustic path difference is denoted as d, and the diffraction coefficient can be 10. -0.05ΔL Where ΔL is the acoustic insertion loss, specifically, f is the signal frequency of the signal emitted by the sound source.

[0072] Step S40: Perform attenuation processing on the original audio based on the attenuation parameters to obtain the target audio.

[0073] It should be noted that, preferably, the original audio is attenuated based on the transmission attenuation value and the diffraction coefficient to obtain the target audio, that is, the attenuation parameters include the transmission attenuation value and the diffraction coefficient.

[0074] Attenuation processing of the original audio is performed based on attenuation parameters, which can specifically attenuate one or more signal indicators of the original audio, such as signal value, volume, signal strength, etc.

[0075] Furthermore, the attenuation amount can be determined based on attenuation parameters. Specifically, this attenuation amount can be positively correlated with the transmission attenuation value and negatively correlated with the diffraction coefficient. Different signal indicators may have different attenuation amounts. Based on the attenuation amount corresponding to each signal indicator, the word signal indicators of the original audio are attenuated to obtain the target audio. For example, if the signal indicator is volume, and the initial volume of the original audio is 70 dB, and the volume attenuation amount determined based on the transmission attenuation value and / or diffraction coefficient is 10 dB, then the volume of the original audio is attenuated from 70 dB to 60 dB to obtain the target audio. As another example, if the signal indicators are volume and signal value, and the initial volume of the original audio is 70 dB, and the volume attenuation amount determined based on the transmission attenuation value and / or diffraction coefficient is 10 dB, and the signal value attenuation amount determined based on the transmission attenuation value and / or diffraction coefficient is 0.3, then the volume of the original audio is attenuated from 70 dB to 60 dB, and the signal value of the original signal is multiplied by 0.7 to obtain the target audio.

[0076] In this embodiment, the original audio to be processed is acquired, and all obstructions between the sound source and the pickup source are identified. The acoustic parameters of the sound source are determined, including the propagation distance of the signal emitted by the sound source within each obstruction, and / or the path difference of the signal emitted by the sound source around all obstructions. Based on the acoustic parameters, attenuation parameters are determined, including transmission attenuation and / or diffraction coefficients. The original audio is attenuated based on the attenuation parameters to obtain the target audio. Considering that sound propagation in the physical world encounters obstructions between the sound source and the listener, the obstruction is mainly due to transmission and diffraction. Transmission refers to sound passing through an obstruction and being attenuated before reaching the listener, while diffraction refers to sound traveling around an obstruction to reach the listener. Thus, this embodiment determines the propagation distance of the signal emitted by the sound source within each obstruction, thereby determining the transmission attenuation value, i.e., the signal attenuation due to transmission through the obstructions, and / or the path difference of the sound source around all obstructions, thereby determining the diffraction coefficient, i.e., the diffraction capability of the obstruction to the signal. It eliminates the need to use ray tracing to track every sound propagation path from the sound source to the pickup source; it only requires calculating the propagation distance of the signal emitted by the sound source within the obstructions and / or the path difference of the sound source around all obstructions. This reduces the computational load and complexity, thereby lowering the simulation delay of the sound obstruction effect. Furthermore, since the sound obstruction by the obstruction is mainly due to transmission and diffraction, it ensures that the target audio obtained by attenuating the original audio based on the transmission attenuation value and / or diffraction coefficient can simulate the sound obstruction effect of the obstruction.

[0077] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description and will not be repeated hereafter. Based on this, when the acoustic parameters include the path difference of the signal emitted by the sound source propagating around all the obstructions, the step of determining the acoustic parameters of the sound source includes:

[0078] Step A10: Determine the distance between the sound pickup source and the sound source as the direct transmission distance;

[0079] This direct transmission distance can specifically be the straight-line distance between the listener and the sound source. For ease of subsequent explanation and illustration, let's denote this direct transmission distance as d. SL .

[0080] Step A20: Project all the obstructions onto a preset vertical plane to obtain a projection area, wherein the preset vertical plane is perpendicular to the line connecting the sound pickup source and the sound source;

[0081] The projection area is obtained by projecting all occlusions onto a preset vertical plane. Specifically, a 3D model of the occlusions can be constructed, such as a triangular mesh model. The vertices of each triangle in the mesh model are then projected onto the preset vertical plane to obtain the projection area.

[0082] For example, refer to Figure 4 As shown, there are two obstructions, 1 and 2, between the sound source and the listener. Points A and B are two vertices in the mesh model of obstruction 1, and points C and D are two vertices in the mesh model of obstruction 2 (for simplicity, projections of more points are not shown). Points A and B are projected onto points A' and B' on a preset vertical plane, respectively, and points C and D are projected onto points C' and D' on the preset vertical plane, respectively. The projection area formed by projecting all the vertices of the mesh models of obstruction 1 and obstruction 2 onto the preset vertical plane is also known as the projection region.

[0083] Step A30: For each preset diffraction point, determine the distance between the preset diffraction point and the sound source as a first distance, determine the distance between the preset diffraction point and the sound source as a second distance, determine the sum of the first distance and the second distance as the transmission distance, and calculate the distance difference between the transmission distance and the direct transmission distance. Wherein, the projection point of the preset diffraction point on the preset vertical plane is located on the outline of the projection area, and the preset diffraction point is a point on any of the obstructions.

[0084] It should be noted that the preset diffraction point is a point on any of the occluding objects, specifically, the preset diffraction point can be any vertex on the mesh model of any occluding object. For example, as shown... Figure 4 As shown, assuming that points A' and C' are located on the edge line of the projection area, then points A and C corresponding to points A' and C' are respectively a preset diffraction point.

[0085] The first distance can be the straight-line distance between the preset diffraction point and the sound source, and the second distance can be the straight-line distance between the preset diffraction point and the sound source.

[0086] Step A40: Determine the sound path difference of the signal emitted by the sound source propagating around all the obstructions based on the distance differences.

[0087] The sound path difference is determined based on each distance difference. Specifically, the sound path difference can be determined by randomly selecting one distance difference from each distance difference, or it can be determined based on a preset rule.

[0088] In this embodiment, by projecting the obstruction onto a preset vertical plane, and selecting a preset diffraction point on the contour line of the preset vertical plane, the distance difference between the signal emitted by the sound source propagating to the listener along a straight line and the distance propagating to the listener through the preset diffraction point is determined. The sound path difference is then determined based on these distance differences. It can be understood that the point on the edge of the projection area is located outside the obstruction, and the signal is more likely to diffract at this point. Thus, a simple projection method can determine the point where sound is most likely to diffract, thereby determining the sound path difference, without the need for complex ray tracing methods to simulate complex sound propagation paths, further reducing the complexity and computational load of simulating audio obstruction effects.

[0089] In one possible implementation, the step of determining the sound path difference of the signal emitted by the sound source propagating around all the obstructions based on each of the distance differences includes:

[0090] Step B10: Select the minimum of all the distance differences as the sound path difference of the signal emitted by the sound source propagating around all the obstructions; or,

[0091] Choosing the minimum of all distance differences as the sound path difference, and denoting the sound path difference as d, the sound path difference can be expressed by the formula d = min(d A ,d C ,…), where d A d represents the distance difference corresponding to the preset diffraction point A. C This represents the distance difference corresponding to the preset diffraction point C.

[0092] Step B20: Select the average of all the distance differences as the sound path difference of the signal emitted by the sound source propagating around all the obstructions.

[0093] The average of all distance differences is determined as the sound path difference, which can be expressed by the formula d = (d A +d C +…) / N, where N represents the total number of preset diffraction points.

[0094] In one possible implementation, the step of determining the transmission attenuation value based on each of the propagation distances includes:

[0095] Step C10: For each of the obstructions, obtain the transmittance per unit length of the obstruction, and calculate the product between the transmittance per unit length and the propagation distance corresponding to the obstruction;

[0096] Personnel can pre-set the transmittance per unit length for different materials, such as 5% for concrete and 20% for wood, so as to obtain the transmittance per unit length of the obstruction by acquiring the material of the obstruction.

[0097] Step C20: Determine the sum of all the products as the transmission attenuation value.

[0098] For example, refer to Figure 3 As shown, there are two obstructions, 1 and 2, between the sound source and the listener. The propagation distance of the signal emitted by the sound source inside obstruction 1 is d1, and the propagation distance of the signal emitted by the sound source inside obstruction 2 is d2. Assuming that obstruction 1 is made of concrete and obstruction 2 is made of wood, the transmission attenuation value is d1*5%+d2*20%.

[0099] In this embodiment, the product of the transmittance per unit length of all obstructions and the propagation distance is accumulated, which is to say, the transmission attenuation of the signal by all obstructions is accumulated. It can be understood that the transmittance per unit length can characterize the material of the obstruction, and the propagation distance can characterize the thickness of the obstruction. That is, the transmission attenuation value is calculated based on the number, thickness, material, etc. of the obstructions between the sound source and the listener, so that the audio can be attenuated based on the transmission attenuation value to simulate transmission attenuation, thereby improving the simulation accuracy of transmission attenuation.

[0100] Based on the first and / or second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to the first and second embodiments described above can be referred to the above description and will not be repeated hereafter. Based on this, the step of attenuating the original audio based on the attenuation parameter to obtain the target audio includes:

[0101] Step D10: If the attenuation parameter includes a transmission attenuation value but does not include a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the first audio is determined to be the target audio.

[0102] Step D20: If the attenuation parameter includes the diffraction coefficient but does not include the transmission attenuation value, then the original audio is attenuated based on the diffraction coefficient to obtain the second audio, and the second audio is determined to be the target audio; or,

[0103] Step D30: If the attenuation parameters include transmission attenuation value and diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the original audio is attenuated based on the diffraction coefficient to obtain a second audio. The first audio and the second audio are then synthesized to obtain the target audio.

[0104] If the transmission attenuation value and diffraction coefficient are calculated, the original audio is attenuated sequentially based on these values, and then the first and second audio are synthesized to obtain the target audio. Specifically, the first and second audio can be mixed in a certain proportion to obtain the target audio. This proportion can be random or determined based on preset rules.

[0105] In one possible implementation, the step of synthesizing the first audio and the second audio to obtain the target audio includes:

[0106] Step E10: Determine the distance between the sound pickup source and the sound source as the direct transmission distance, and determine the intersection of the line segment between the sound source and the sound pickup source and the preset vertical plane as the reference point;

[0107] The direct transmission distance is the straight-line distance between the sound source and the listener. The preset vertical plane can be the same plane as the preset vertical plane described in the above embodiment, or it can be another plane perpendicular to the line connecting the listener and the sound source. This embodiment does not impose any specific restrictions on this. To reduce the number of planes that need to be fitted and thus reduce computational complexity, preferably, the preset vertical plane is the same plane as the preset vertical plane described in the above embodiment.

[0108] The reference point is the intersection of the line segment (i.e., the line connecting the sound source and the listener) and a preset vertical plane. For example, refer to... Figure 4 As shown, Figure 4 Point O shown is the intersection of the line connecting the sound source and the listener with the preset vertical plane, which is also the reference point.

[0109] Step E20: Determine the projection area formed by projecting all the obstructions onto the preset vertical plane, determine the minor axis length of the projection area, and determine the sum of the minor axis length and the direct transmission distance as the reference distance;

[0110] It should be noted that the minor axis length of the projection area can specifically be twice the shortest distance among all contour points on the projection area to the reference point. For example, referring to... Figure 4 As shown, Figure 4 The shortest distance from the contour point C' on the projected region to the reference point O is denoted as d. OC’ The minor axis length is 2d OC’ .

[0111] Step E30: Determine the ratio between the minor axis length and the reference distance as the transmission weight, and determine the ratio between the direct transmission distance and the reference distance as the diffraction weight;

[0112] Let the transmission weight be r t Then the transmission weight can be expressed by the formula r t =2dOC’ / (d SL +2d OC’ Let the diffraction weight be r. d The diffraction weight can then be expressed by the formula r. d =d SL / (d SL +2d OC’ ).

[0113] Step E40: Based on the transmission weight and the diffraction weight, the first audio and the second audio are synthesized to obtain the target audio, wherein the transmission weight is used to adjust the first audio and the diffraction weight is used to adjust the second audio.

[0114] The target audio is obtained by synthesizing the first audio and the second audio based on the transmission weight and the diffraction weight. Specifically, the first audio is denoted as Audio. t The second audio is Audio. d The target audio is Audio. o The target audio can then be expressed by the formula Audio o =r t *Audio t +r d *Audio d .

[0115] Furthermore, if the first and second audio signals are frequency domain signals (i.e., the original audio is a frequency domain signal), then the transmission weight can be multiplied by the signal amplitude of each signal frequency point in the first audio, and the diffraction weight can be multiplied by the signal amplitude of each signal frequency point in the second audio. If the first and second audio signals are time domain signals, then the transmission weight can be multiplied by the signal value of each sampling point in the first audio, and the diffraction weight can be multiplied by the signal value of each sampling point in the second audio.

[0116] Furthermore, considering that the audio ultimately needs to be converted to the time domain so that the sound source can effectively output the audio, preferably, if the original audio is a frequency domain signal, the original frequency domain signal is converted to the time domain so that subsequent audio processing is performed based on the time domain signal.

[0117] In one possible implementation, the step of attenuating the original audio based on the transmission attenuation value to obtain the first audio includes:

[0118] Step F10: Determine the first filter gain and the first volume attenuation value based on the transmission attenuation value, wherein the first filter gain is negatively correlated with the transmission attenuation value, and the first volume attenuation value is positively correlated with the transmission attenuation value;

[0119] Gain (usually represented by G) refers to the degree to which a filter amplifies or attenuates the input signal. In this embodiment, the gain of the first filter is less than one, which is used to simulate the audio attenuation effect caused by the obstruction of sound by an obstruction.

[0120] Step F20: Perform low-pass filtering on the original audio based on the first filter gain, and perform volume attenuation on the original audio based on the first volume attenuation value to obtain the first audio.

[0121] The original audio is low-pass filtered based on the gain of the first filter. Specifically, the gain of the low-pass filter can be set to the gain of the first filter so that the original audio is input to the low-pass filter to complete the low-pass filtering process of the original audio.

[0122] Furthermore, the filter cutoff frequency can also be positively correlated with the transmission attenuation value. By increasing the cutoff frequency of the low-pass filter, the reduction of high-frequency components can be simulated. This is because high-frequency sound waves attenuate faster during transmission, resulting in a reduction of high-frequency components in the transmitted sound.

[0123] In one possible implementation, the step of attenuating the original audio based on the diffraction coefficient to obtain the second audio includes:

[0124] Step G10: Determine the second filter gain and the second volume attenuation value based on the diffraction coefficient, wherein the second filter gain is positively correlated with the diffraction coefficient, and the second volume attenuation value is negatively correlated with the diffraction coefficient;

[0125] Step G20: Perform low-pass filtering on the original audio based on the second filter gain, and perform volume attenuation on the original audio based on the second volume attenuation value to obtain the second audio.

[0126] Similarly, the gain of this second filter is less than one.

[0127] Furthermore, a larger diffraction coefficient means less loss of high-frequency components. Therefore, the cutoff frequency of the low-pass filter should be increased accordingly to retain more high-frequency components. Based on this, the filter cutoff frequency can also be set to be positively correlated with the diffraction coefficient.

[0128] In this embodiment, the first filter gain and the first volume attenuation value are determined based on the transmission attenuation value, and the first filter gain is negatively correlated with the transmission attenuation value, while the first volume attenuation value is positively correlated with the transmission attenuation value. The second filter gain and the second volume attenuation value are determined based on the diffraction coefficient, and the second filter gain is positively correlated with the diffraction coefficient, while the second volume attenuation value is negatively correlated with the diffraction coefficient. This enables intelligent adjustment of gain and volume attenuation, thereby improving the simulation effect of audio occlusion.

[0129] For example, to aid in understanding the technical concept or principle of the audio processing method after combining this embodiment with the first and second embodiments, a specific embodiment is now provided. In this specific embodiment, refer to... Figure 5 As shown, the audio processing flow is as follows:

[0130] 1. Transmission attenuation simulation:

[0131] This function detects collisions between the sound propagation path between a sound source and a listener and obstructions. For example, an obstruction can be represented as a 3D model of a triangular mesh in geometric space, and the sound propagation path between the sound source and the listener can be represented as a line segment in geometric space. The function detects whether this line segment intersects with any of the triangular meshes of the obstruction. For example... Figure 3 In the diagram, the line segment between the sound source and the listener intersects the obstruction triangle mesh at points 1-4.

[0132] Determine the distance the sound travels through each obstruction. For example, based on the 3D position information of intersection 1 and intersection 2, determine the distance the sound travels through obstruction 2 as d1, and based on the 3D position information of intersection 3 and intersection 4, determine the distance the sound travels through obstruction 1 as d2.

[0133] The transmittance per unit length of the barrier is determined based on the material of the barrier. For example, barrier 1 is made of concrete and has a transmittance of 5% per unit length, while barrier 2 is made of wood and has a transmittance of 20% per unit length.

[0134] The transmission attenuation value is calculated based on the distance the sound travels through each obstruction and the transmittance per unit length of the obstruction. For example, based on the distance d2 the sound travels through obstruction 2 and the transmittance per unit length of obstruction 2 being 20%, and the distance d1 the sound travels through obstruction 1 and the transmittance per unit length of obstruction 1 being 5%, the current transmission attenuation value is calculated as d1*5% + d2*20%.

[0135] Based on the calculated transmission attenuation value, the sound emitted by the sound source is low-pass filtered and the volume is attenuated to obtain the sound after transmission attenuation (i.e., the first audio frequency).

[0136] 2. Diffraction effect simulation:

[0137] Detect the projection of each triangular mesh of the obstruction onto a plane perpendicular to the line connecting the sound source and the listener. For example, the projections of all vertices of the triangles onto this vertical plane can be calculated, as shown in the example in the figure, where the projections of points A, B, C, and D onto this plane are A', B', C', and D'. For simplicity, projections of more points are not shown.

[0138] Determine whether the projection points are outside the projection area. For example, A' and C' are outside the projection area, while B' and D' are inside the projection area.

[0139] Consider the influence of the triangle vertices corresponding to points outside the projection area, such as A and C, on sound diffraction. Calculate the diffraction coefficients based on the relative positions of the sound source, the listener, and these points. For example, the distance d between the sound source and point A... AS The distance d between the listener and point A AL The distance d between the listener and the sound source SL , path difference d A =d AS +d AL -d SL Choose the point with the smallest sound path difference, d = min(d A ,d C (,…), with a diffraction coefficient of 10. -0.05ΔL Where ΔL is the acoustic insertion loss, specifically, f is the signal frequency of the signal emitted by the sound source.

[0140] Based on the calculated diffraction coefficients, the sound emitted by the sound source is low-pass filtered and the volume is attenuated to obtain the diffracted sound (i.e., the second audio).

[0141] 3. Combining the transmitted attenuated audio and the diffracted audio, the overall audio occlusion simulation results are obtained:

[0142] The result of the original audio after transmission attenuation: Audio t The audio output after diffraction effect simulation d The two are combined to generate the final occlusion-simulated audio. They can be blended based on a certain ratio, for example, in... Figure 4 In the middle, select point C', which is closest to point O among the points outside the projection area, and the transmission result scale r t =2d OC’ / (d SL +2d OC’ ), the diffraction result ratio r d =d SL / (d SL +2d OC’ Therefore, Audio o =r t *Audio t +r d *Audio d .

[0143] It should be noted that the above examples are only for the purpose of assisting in understanding this application and do not constitute a limitation on the audio processing method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0144] Furthermore, embodiments of this application also propose an audio processing apparatus, referring to... Figure 6 As shown, the audio processing device includes:

[0145] The acquisition module 10 is used to acquire the raw audio to be processed and to identify all obstructions between the sound pickup source and the sound source.

[0146] The first determining module 20 is used to determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source inside each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions;

[0147] The second determining module 30 is used to determine the attenuation parameter based on the acoustic parameter, wherein the attenuation parameter includes the transmission attenuation value and / or the diffraction coefficient;

[0148] The attenuation module 40 is used to attenuate the original audio based on the attenuation parameters to obtain the target audio.

[0149] In one embodiment, the second determining module 30 is further configured to:

[0150] If the acoustic parameters include each of the propagation distances, then the transmission attenuation value is determined based on each of the propagation distances;

[0151] If the acoustic parameters include path difference, then the diffraction coefficient is determined based on the path difference.

[0152] In one embodiment, the second determining module 30 is further configured to:

[0153] For each of the aforementioned obstructions, the transmittance per unit length of the obstruction is obtained, and the product between the transmittance per unit length and the propagation distance corresponding to the obstruction is calculated;

[0154] The sum of all the products is determined to be the transmission attenuation value.

[0155] In one embodiment, the first determining module 20 is further configured to:

[0156] The distance between the sound pickup source and the sound source is defined as the direct transmission distance;

[0157] Projecting all the obstructions onto a preset vertical plane yields a projection area, wherein the preset vertical plane is perpendicular to the line connecting the sound pickup source and the sound source;

[0158] For each preset diffraction point, the distance between the preset diffraction point and the sound source is determined as a first distance, the distance between the preset diffraction point and the sound source is determined as a second distance, the sum of the first distance and the second distance is determined as the transmission distance, and the distance difference between the transmission distance and the direct transmission distance is calculated. Wherein, the projection point of the preset diffraction point on the preset vertical plane is located on the outline of the projection area, and the preset diffraction point is a point on any of the obstructions.

[0159] The path difference by which the signal emitted by the sound source propagates around all the obstructions is determined based on the distance differences.

[0160] In one embodiment, the first determining module 20 is further configured to:

[0161] The minimum of all said distance differences is selected as the sound path difference for the signal emitted by the sound source to propagate around all said obstructions; or...

[0162] The average of all the distance differences is selected as the sound path difference of the signal emitted by the sound source propagating around all the obstructions.

[0163] In one embodiment, the attenuation module 40 is further configured to:

[0164] If the attenuation parameter includes a transmission attenuation value but does not include a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the first audio is determined to be the target audio.

[0165] If the attenuation parameter includes the diffraction coefficient but does not include the transmission attenuation value, then the original audio is attenuated based on the diffraction coefficient to obtain the second audio, and the second audio is determined to be the target audio; or...

[0166] If the attenuation parameters include a transmission attenuation value and a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the original audio is attenuated based on the diffraction coefficient to obtain a second audio. The first audio and the second audio are then synthesized to obtain the target audio.

[0167] In one embodiment, the attenuation module 40 is further configured to:

[0168] The distance between the sound pickup source and the sound source is determined as the direct transmission distance, and the intersection of the line segment between the sound source and the sound pickup source and the preset vertical plane is determined as the reference point;

[0169] Determine the projection area formed by projecting all the obstructions onto the preset vertical plane, determine the minor axis length of the projection area, and determine the sum of the minor axis length and the direct transmission distance as the reference distance;

[0170] The ratio between the minor axis length and the reference distance is determined as the transmission weight, and the ratio between the direct transmission distance and the reference distance is determined as the diffraction weight;

[0171] The first audio and the second audio are synthesized based on the transmission weight and the diffraction weight to obtain the target audio, wherein the transmission weight is used to adjust the first audio and the diffraction weight is used to adjust the second audio.

[0172] Furthermore, this application also proposes an audio processing device, which includes a speaker and a processor, wherein the speaker is connected to the processor, and the processor is used to perform the steps of the audio processing method described above.

[0173] In addition, refer to Figure 7 The diagram illustrates a structural schematic of an audio processing device suitable for implementing embodiments of this application. The audio processing device in the embodiments of this application may also include, but is not limited to, mobile terminals such as AR glasses, VR glasses, AR headsets, VR headsets, mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), etc., as well as fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The audio processing device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0174] like Figure 7As shown, the audio processing device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the audio processing device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the audio processing device to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows audio processing devices with various systems, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively.

[0175] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0176] The audio processing device provided in this application, employing the audio processing method described in the above embodiments, can solve the technical problem of how to reduce the simulation delay of the sound blocking effect caused by simulated obstructions. Compared with the prior art, the beneficial effects of the audio processing device provided in this application are the same as those of the audio processing method provided in the above embodiments, and other technical features of the audio processing device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0177] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0178] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0179] In addition, to achieve the above objectives, this application also provides a readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the audio processing method in the above embodiments.

[0180] The computer-readable storage medium provided in this application embodiment may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0181] The aforementioned computer-readable storage medium may be included in an audio processing device or may exist independently without being assembled into an audio processing device.

[0182] The aforementioned computer-readable storage medium carries one or more programs that, when executed by an audio processing device, cause the audio processing device to: acquire the original audio to be processed; identify all obstructions existing between the pickup source and the sound source; determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source within each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions; determine attenuation parameters based on the acoustic parameters, wherein the attenuation parameters include a transmission attenuation value and / or a diffraction coefficient; and perform attenuation processing on the original audio based on the attenuation parameters to obtain the target audio.

[0183] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0184] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0185] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0186] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described audio processing method, which can solve the technical problem of how to reduce the simulation delay of the simulated obstruction effect on sound. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the audio processing method provided in the above embodiments, and will not be repeated here.

[0187] Furthermore, embodiments of this application also propose a computer program product, including an audio processing program, which, when executed by a processor, implements the steps of the audio processing method described above.

[0188] The specific implementation of the computer program product in this application is basically the same as the embodiments of the audio processing method described above, and will not be repeated here.

[0189] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0190] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0191] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software sensor. This computer software sensor is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0192] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. An audio processing method, characterized in that, The audio processing method includes the following steps: Acquire the raw audio to be processed and identify all obstructions between the pickup source and the sound source; Determine the acoustic parameters of the sound source, wherein the acoustic parameters include the propagation distance of the signal emitted by the sound source inside each of the obstructions, and / or the path difference of the signal emitted by the sound source propagating around all the obstructions; The attenuation parameters are determined based on the acoustic parameters, wherein the attenuation parameters include transmission attenuation value and / or diffraction coefficient; The original audio is attenuated based on the attenuation parameters to obtain the target audio.

2. The audio processing method as described in claim 1, characterized in that, The step of determining the attenuation parameter based on the acoustic parameters includes: If the acoustic parameters include each of the propagation distances, then the transmission attenuation value is determined based on each of the propagation distances; If the acoustic parameters include path difference, then the diffraction coefficient is determined based on the path difference.

3. The audio processing method as described in claim 2, characterized in that, The step of determining the transmission attenuation value based on each of the propagation distances includes: For each of the aforementioned obstructions, the transmittance per unit length of the obstruction is obtained, and the product between the transmittance per unit length and the propagation distance corresponding to the obstruction is calculated; The sum of all the products is determined to be the transmission attenuation value.

4. The audio processing method as described in claim 1, characterized in that, When the acoustic parameters include the path difference of the signal emitted by the sound source propagating around all the obstructions, the step of determining the acoustic parameters of the sound source includes: The distance between the sound pickup source and the sound source is defined as the direct transmission distance; Projecting all the obstructions onto a preset vertical plane yields a projection area, wherein the preset vertical plane is perpendicular to the line connecting the sound pickup source and the sound source; For each preset diffraction point, the distance between the preset diffraction point and the sound source is determined as a first distance, the distance between the preset diffraction point and the sound source is determined as a second distance, the sum of the first distance and the second distance is determined as the transmission distance, and the distance difference between the transmission distance and the direct transmission distance is calculated. Wherein, the projection point of the preset diffraction point on the preset vertical plane is located on the outline of the projection area, and the preset diffraction point is a point on any of the obstructions. The path difference by which the signal emitted by the sound source propagates around all the obstructions is determined based on the distance differences.

5. The audio processing method as described in claim 4, characterized in that, The step of determining the sound path difference of the signal emitted by the sound source propagating around all the obstructions based on the distance differences includes: The minimum of all said distance differences is selected as the sound path difference for the signal emitted by the sound source to propagate around all said obstructions; or... The average of all the distance differences is selected as the sound path difference of the signal emitted by the sound source propagating around all the obstructions.

6. The audio processing method as described in claim 1, characterized in that, The step of attenuating the original audio based on the attenuation parameter to obtain the target audio includes: If the attenuation parameter includes a transmission attenuation value but does not include a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the first audio is determined to be the target audio. If the attenuation parameter includes the diffraction coefficient but does not include the transmission attenuation value, then the original audio is attenuated based on the diffraction coefficient to obtain the second audio, and the second audio is determined to be the target audio; or... If the attenuation parameters include a transmission attenuation value and a diffraction coefficient, then the original audio is attenuated based on the transmission attenuation value to obtain a first audio, and the original audio is attenuated based on the diffraction coefficient to obtain a second audio. The first audio and the second audio are then synthesized to obtain the target audio.

7. The audio processing method as described in claim 6, characterized in that, The step of synthesizing the first audio and the second audio to obtain the target audio includes: The distance between the sound pickup source and the sound source is determined as the direct transmission distance, and the intersection of the line segment between the sound source and the sound pickup source and the preset vertical plane is determined as the reference point; Determine the projection area formed by projecting all the obstructions onto the preset vertical plane, determine the minor axis length of the projection area, and determine the sum of the minor axis length and the direct transmission distance as the reference distance; The ratio between the minor axis length and the reference distance is determined as the transmission weight, and the ratio between the direct transmission distance and the reference distance is determined as the diffraction weight; The first audio and the second audio are synthesized based on the transmission weight and the diffraction weight to obtain the target audio, wherein the transmission weight is used to adjust the first audio and the diffraction weight is used to adjust the second audio.

8. An audio processing device, characterized in that, The audio processing device includes: a speaker and a processor, the speaker being connected to the processor, and the processor being configured to perform the steps of the audio processing method as described in any one of claims 1 to 7.

9. A readable storage medium, characterized in that, The readable storage medium is a computer-readable storage medium, on which a computer program is stored, and when executed by a processor, the computer program implements the steps of the audio processing method as described in any one of claims 1 to 7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the audio processing method as described in any one of claims 1 to 7.

Images