Sound wave reverberation method and device, computer equipment and storage medium

Abstract

The embodiment of the invention discloses a sound wave reverberation method and device, computer equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: acquiring attenuation parameters and delay durations of a plurality of mirror image sound sources corresponding to a sound source; based on the pulse function and the delay duration of each mirror image sound source, determining the pulse response of each mirror image sound source; for each mirror image sound source, carrying out convolution on the first sound wave, the attenuation parameter of the mirror image sound source and the pulse response of the mirror image sound source to obtain a second sound wave; and superposing the plurality of obtained second sound waves to obtain a target sound wave. According to the embodiment of the invention, a new sound wave reverberation mode is realized, the sound wave reverberation mode can be suitable for the situation that the sound source and the receiver move relatively, the situation that sound waves after reverberation contain noise due to the fact that the sound source and the receiver move relatively is avoided, the quality of the obtained target sound waves is guaranteed, and the reverberation effect is guaranteed.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a sound reverberation method, apparatus, computer device, and storage medium. Background Technology

[0002] Sound reverberation refers to the phenomenon where sound waves, after being reflected and absorbed by obstacles during propagation, persist even after the sound source has ceased to emit sound. Currently, many fields use digital audio signal processing technology to create digital reverberation effects for sound waves, such as song production or film dubbing. However, current sound reverberation solutions produce poor reverberation effects, resulting in poor sound wave quality received by the receiver. Summary of the Invention

[0003] This application provides a sound wave reverberation method, apparatus, computer device, and storage medium, which can guarantee the quality of the obtained target sound wave and ensure the reverberation effect. The technical solution is as follows:

[0004] On the one hand, a sound reverberation method is provided, the method comprising:

[0005] The attenuation parameters and delay durations of multiple mirror sound sources corresponding to the sound source are obtained. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver.

[0006] The impulse response of each mirror sound source is determined based on the impulse function and the delay duration of each mirror sound source.

[0007] For each mirror sound source, a second sound wave is obtained by convolving the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0008] The multiple second sound waves obtained are superimposed to obtain the target sound wave.

[0009] On the other hand, a sound reverberation device is provided, the device comprising:

[0010] The acquisition module is used to acquire the attenuation parameters and delay duration of multiple mirror sound sources corresponding to the sound source. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver.

[0011] The determination module is used to determine the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source;

[0012] The convolution module is used to convolve the first sound wave, the attenuation parameter of the mirror sound source and the impulse response of the mirror sound source for each mirror sound source to obtain a second sound wave. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0013] The superposition module is used to superimpose multiple second sound waves to obtain the target sound wave.

[0014] In one possible implementation, the acquisition module is configured to acquire the absorption rate corresponding to the mirror sound source, the absorption rate indicating the intensity of the sound wave emitted by the mirror sound source; and determine the attenuation parameter of the mirror sound source based on the distance between the receiver and the mirror sound source and the absorption rate.

[0015] In another possible implementation, the acquisition module is used to determine the ratio of the absorption rate to the distance as the attenuation parameter of the mirror sound source; or, to determine the product of the distance and the target value, and to determine the ratio of the absorption rate to the product as the attenuation parameter of the mirror sound source.

[0016] In another possible implementation, the acquisition module is used to determine the delay duration of the mirror sound source as the ratio of the distance between the receiver and the mirror sound source to the speed of sound wave transmission.

[0017] In another possible implementation, the determining module is used to call the pulse function to calculate the delay duration and target duration of the mirror sound source to obtain the pulse response of the mirror sound source, wherein the target duration is the time it takes for the sound wave emitted by the sound source without reflection to reach the receiver.

[0018] In another possible implementation, the convolution module is used to determine the product of the first sound wave and the attenuation parameter of the mirror sound source; and to convolve the product and the impulse response to obtain the second sound wave.

[0019] In another possible implementation, the superposition module is used to superimpose the first sound wave and the plurality of second sound waves to obtain the target sound wave.

[0020] In another possible implementation, the acquisition module is used to acquire the attenuation parameters and delay duration of the plurality of mirror sound sources at a plurality of first sampling times;

[0021] The convolution module is used to convolve the first sound wave, the attenuation parameter of the mirror sound source at the first sampling time, and the impulse response of the mirror sound source at the first sampling time to obtain the second sound wave of the mirror sound source at the first sampling time. The impulse response of the mirror sound source at the first sampling time is determined based on the impulse function and the delay time of the mirror sound source at the first sampling time.

[0022] The superposition module is used to superimpose the second sound waves of the multiple mirror sound sources at the same first sampling time to obtain the target sound waves at the multiple first sampling times.

[0023] In another possible implementation, the plurality of mirror sound sources include a first mirror sound source and a second mirror sound source, wherein the distance between the first mirror sound source and the sound source is less than the distance between the second mirror sound source and the sound source; the acquisition module is configured to acquire, based on a first sampling rate, attenuation parameters of the first mirror sound source at a plurality of first sampling times, wherein the first sampling rate indicates the number of samples per unit time; acquire, based on a second sampling rate, attenuation parameters of the second mirror sound source at a plurality of second sampling times, wherein the second sampling rate indicates the number of samples per unit time, wherein the first sampling rate is higher than the second sampling rate; acquire, based on the second sampling rate, delay durations of the plurality of mirror sound sources at a plurality of second sampling times; upsample the attenuation parameters of the second mirror sound source at a plurality of second sampling times to obtain attenuation parameters of the second mirror sound source at a plurality of first sampling times; upsample the delay durations of the plurality of mirror sound sources at a plurality of second sampling times to obtain delay durations of the plurality of mirror sound sources at a plurality of first sampling times.

[0024] In another possible implementation, the acquisition module is configured to acquire the position of the sound source at a plurality of first sampling times from the motion trajectory of the sound source based on the first sampling rate; determine the position of the first mirror sound source at each of the first sampling times based on the position of the sound source at each of the first sampling times; and acquire the attenuation parameter of the first mirror sound source at each of the first sampling times based on the position of the first mirror sound source at each of the first sampling times and the position of the receiver.

[0025] In another possible implementation, the acquisition module is configured to acquire the position of the sound source at each of the plurality of second sampling times from the motion trajectory of the sound source based on the second sampling rate; determine the position of the plurality of mirror sound sources at each of the second sampling times based on the position of the sound source at each of the second sampling times; and acquire the delay duration of the plurality of mirror sound sources at each of the second sampling times based on the positions of the plurality of mirror sound sources at each of the second sampling times and the position of the receiver.

[0026] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to perform the operations performed by the acoustic reverberation method as described above.

[0027] On the other hand, a computer-readable storage medium is provided that stores at least one computer program, which is loaded and executed by a processor to perform the operations performed by the acoustic reverberation method as described above.

[0028] In another aspect, a computer program product is provided, comprising a computer program that, when executed by a processor, performs the operations performed by the acoustic reverberation method described above.

[0029] In the solution provided in this application embodiment, the mirror sound source of the sound source is an independently moving individual. The attenuation parameter of the mirror sound source can reflect the absorption of the sound wave emitted by the sound source during the reflection process, which is equivalent to the intensity of the sound wave emitted by the mirror sound source. The delay time of the mirror sound source can change with the movement of the mirror sound source. Therefore, the impulse response of the mirror sound source can not only reflect the propagation of the sound wave emitted by the mirror sound source to the receiver, but also change with the movement of the mirror sound source. By using the attenuation parameter and delay time of the mirror sound source, the sound wave sent to the receiver by each mirror sound source can be obtained. Then, the sound waves sent to the receiver by multiple mirror sound sources are superimposed to obtain the target sound wave. The target sound wave is equivalent to the reverberated sound wave received by the receiver, realizing a new sound wave reverberation method. This sound wave reverberation method can be applied to the case where the sound source and the receiver move relative to each other, avoiding the case where the reverberated sound wave contains noise due to the relative movement of the sound source and the receiver, ensuring the quality of the obtained target sound wave and ensuring the reverberation effect. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 This is a schematic diagram of the structure of an implementation environment provided in an embodiment of this application;

[0032] Figure 2 This is a flowchart of a sound reverberation method provided in an embodiment of this application;

[0033] Figure 3 This is a flowchart of a sound reverberation method provided in an embodiment of this application;

[0034] Figure 4 This is a schematic diagram illustrating the relationship between a sound source and a mirrored sound source, provided in an embodiment of this application.

[0035] Figure 5 This is a schematic diagram of multiple mirror sound sources corresponding to a sound source provided in an embodiment of this application;

[0036] Figure 6 This is a flowchart of a sound reverberation method provided in an embodiment of this application;

[0037] Figure 7 This is a schematic diagram of the motion trajectory of a sound source and multiple mirror sound sources provided in an embodiment of this application;

[0038] Figure 8 This is a schematic diagram of a filter architecture provided in an embodiment of this application;

[0039] Figure 9 This is a schematic diagram of motion displacement, delay duration, and attenuation parameters provided in an embodiment of this application;

[0040] Figure 10 This is a flowchart of a sound reverberation method provided in an embodiment of this application;

[0041] Figure 11 This is a schematic diagram of a sound wave provided in an embodiment of this application;

[0042] Figure 12 This is a schematic diagram of a virtual game interface provided in an embodiment of this application;

[0043] Figure 13 This is a schematic diagram of the structure of a sound reverberation device provided in an embodiment of this application;

[0044] Figure 14This is a schematic diagram of the structure of a terminal provided in an embodiment of this application;

[0045] Figure 15 This is a schematic diagram of the structure of a server provided in an embodiment of this application. Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0047] The terms “first,” “second,” etc., as used herein may be used to describe various concepts, but unless otherwise stated, these concepts are not limited by these terms. These terms are used only to distinguish one concept from another. For example, without departing from the scope of this application, a first sound wave may be referred to as a second sound wave, and similarly, a second sound wave may be referred to as a first sound wave.

[0048] As used in this application, the terms "at least one," "multiple," "each," and "any" have the following meanings: at least one includes one, two, or more; multiple includes two or more; each refers to each of the corresponding multiple; and any refers to any one of the multiple. For example, multiple mirror sound sources include three mirror sound sources, where each refers to each of the three mirror sound sources, and any refers to any one of the three mirror sound sources, which could be the first mirror sound source, the second mirror sound source, or the third mirror sound source.

[0049] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the sound waves involved in this application were all obtained under full authorization.

[0050] The acoustic reverberation method provided in this application is executed by a computer device. Optionally, the computer device is a terminal or a server. Optionally, the server is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Optionally, the terminal is a smartphone, tablet computer, laptop computer, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, and in-vehicle terminal, etc., but is not limited to these.

[0051] In some embodiments, the computer program involved in the present application embodiments may be deployed and executed on a computer device, or executed on multiple computer devices located in one location, or executed on multiple computer devices distributed in multiple locations and interconnected through a communication network. Multiple computer devices distributed in multiple locations and interconnected through a communication network can form a blockchain system.

[0052] In some embodiments, the computer device is provided as a server. Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application. See also... Figure 1 The implementation environment includes a terminal 101 and a server 102, which are connected via a wireless or wired network. The terminal 101 includes a receiver.

[0053] Terminal 101 is used to receive sound waves emitted by a sound source through a receiver. That is, the receiver receives the first sound wave and sends the first sound wave to server 102. Server 102 is used to receive the first sound wave and, based on the first sound wave, obtain multiple second sound waves emitted by mirror sound sources and received by the receiver, that is, obtain multiple second sound waves. Then, the multiple second sound waves are superimposed to obtain the target sound wave, which is equivalent to the reverberated sound wave.

[0054] In some embodiments, an application provided by server 102 is installed on terminal 101, and terminal 101 can collect sound waves through this application. Optionally, the application is an application in the operating system of terminal 101, or an application provided by a third party. For example, the application is a game application, which has game functions. Of course, the game application can also have other functions, such as review functions, shopping functions, navigation functions, etc. Terminal 101 is used to log in to the application based on an account, receive sound waves emitted by a sound source through a receiver, and send the sound waves received by the receiver to server 102 through the application.

[0055] Figure 2 This is a flowchart of a sound reverberation method provided in an embodiment of this application. The method is executed by a computer device, such as... Figure 2 As shown, the method includes:

[0056] 201. The computer device obtains the attenuation parameters and delay duration of multiple mirror sound sources corresponding to the sound source. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver.

[0057] In this embodiment, the sound source is located in space, and the sound waves emitted by the sound source will spread to the surroundings. The emitted sound waves will encounter obstacles in the space and be reflected by the obstacles. The reflected sound waves are equivalent to the sound waves emitted by the mirror sound source symmetrical about the obstacle. Based on the obstacles in the space, multiple mirror sound sources of the sound source can be determined, so that the reflection of the sound waves emitted by the sound source can be converted into the propagation of the sound waves emitted by multiple mirror sound sources. This allows the receiver to subsequently determine the sound waves emitted by the sound source that have not been reflected, or the sound waves emitted by the sound source that have been reflected.

[0058] The sound source is located in any space, for example, in a room or other space containing obstacles.

[0059] For example, if a sound source is located in a room, and the room includes multiple walls, ceilings, and floors, and the sound waves emitted by the sound source are reflected by the walls of the room, then it can be determined that there is a mirror sound source on the other side of that wall. This mirror sound source is a virtual sound source. The mirror sound source is symmetrical to the original sound source about the wall, and the reflected sound waves are equivalent to the sound waves directly emitted by the mirror sound source. In this way, based on the multiple walls, ceilings, and floors of the room, multiple mirror sound sources of the sound source can be obtained.

[0060] In this embodiment, a sound source emits sound waves to the surrounding area. A portion of these emitted sound waves propagates directly to the receiver; this portion is referred to as the direct sound wave. Another portion of the emitted sound waves is reflected by an obstacle before reaching the receiver. Therefore, the sound waves received by the receiver include both the direct sound wave and the sound waves reflected by the obstacle. The sound waves received by the receiver and reflected are equivalent to the sound waves emitted by any mirror sound source to the receiver; that is, the direct sound waves emitted by any mirror sound source to the receiver. Considering that the sound waves reflected by obstacles may arrive at the receiver later than the direct sound waves emitted by the sound source, and that obstacles absorb some of the sound wave's energy during reflection, reducing the intensity of the reflected sound waves, the attenuation parameters and delay times of multiple mirror sound sources are obtained. This allows for the subsequent determination of the direct sound waves emitted by each mirror sound source to the receiver, simulating the reflection of the sound waves emitted by the sound source, and ultimately determining the sound waves received by the receiver.

[0061] The attenuation parameter can be expressed in any form. For example, the attenuation parameter is equivalent to the amplitude of the sound wave, which reflects the intensity of the sound wave. The larger the amplitude, the stronger the sound wave; the smaller the amplitude, the weaker the sound wave. The delay time is equivalent to the time it takes for a sound wave to travel from the sound source, through reflection from an obstacle, to reach the receiver. The receiver can be any type of receiver, such as a microphone. The sound wave can be any type of sound wave, such as a speech signal.

[0062] 202. The computer device determines the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source.

[0063] In this embodiment, the delay time of the mirror sound source is the propagation time of the sound wave emitted by the mirror sound source to the receiver. The impulse function is used to describe the instantaneous delay time of the sound wave. Based on the impulse function and the delay time of the mirror sound source, the impulse response of the mirror sound source is determined to reflect the propagation of the sound wave emitted by the mirror sound source to the receiver.

[0064] The impulse function describes an instantaneous physical quantity; in this embodiment, it describes an instantaneous sound wave. The impulse function can be of any type, such as a delta function. For example, if the impulse function is a time-varying impulse function, the impulse response is a time-varying impulse response. The time-varying impulse response output by the time-varying impulse function changes with time. When the input of the time-varying impulse function is equal to 0, the time-varying impulse response is positive infinity; when the input of the time-varying impulse function is not equal to 0, the time-varying impulse response is also positive infinity. Furthermore, the value obtained by integrating the time-varying impulse function over time is 1. The impulse response of the mirror sound source represents the propagation of the sound wave emitted by the mirror sound source to the receiver, and is also equivalent to the reflection of the sound wave after it is emitted by the sound source and propagates to the receiver.

[0065] In this embodiment, the impulse response of the mirror sound source is related to the delay duration of the mirror sound source, and the delay duration of the mirror sound source is roughly equivalent to its position. The position of the mirror sound source changes as the position of the sound source changes. Therefore, when the position of the sound source changes over time, or when the position of the receiver changes over time (i.e., when the sound source is a moving sound source or the receiver is a moving receiver), the impulse response of the mirror sound source will change over time. In the case of a moving sound source, the corresponding mirror sound source is a moving mirror sound source.

[0066] 203. For each mirror sound source, the computer device convolves the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source to obtain the second sound wave. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0067] In this embodiment, the attenuation parameter of the mirror sound source reflects the intensity of the sound wave emitted by the mirror sound source and received by the receiver. The delay time is the time it takes for the sound wave emitted by the mirror sound source to reach the receiver. Convolving the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source yields a second sound wave, which is equivalent to the sound wave directly emitted by the mirror sound source and received by the receiver. This is equivalent to the direct sound wave emitted by the mirror sound source received by the receiver. Since a second sound wave can be obtained for each mirror sound source, the above steps can be followed to obtain the second sound wave corresponding to each mirror sound source, resulting in multiple second sound waves. The first sound wave is the sound wave emitted by the sound source, without reflection, and received by the receiver.

[0068] 204. The computer equipment superimposes the multiple second sound waves to obtain the target sound wave.

[0069] In this embodiment of the application, the receiver can receive the sound waves emitted by each mirror sound source, and then the multiple second sound waves are superimposed to obtain the reverberation effect of the sound waves emitted by the sound source. The resulting target sound wave is equivalent to the reverberated sound wave.

[0070] In the solution provided in this application embodiment, the mirror sound source of the sound source is an independently moving individual. The attenuation parameter of the mirror sound source can reflect the absorption of the sound wave emitted by the sound source during the reflection process, which is equivalent to the intensity of the sound wave emitted by the mirror sound source. The delay time of the mirror sound source can change with the movement of the mirror sound source. Therefore, the impulse response of the mirror sound source can not only reflect the propagation of the sound wave emitted by the mirror sound source to the receiver, but also change with the movement of the mirror sound source. By using the attenuation parameter and delay time of the mirror sound source, the sound wave sent to the receiver by each mirror sound source can be obtained. Then, the sound waves sent to the receiver by multiple mirror sound sources are superimposed to obtain the target sound wave. The target sound wave is equivalent to the reverberated sound wave received by the receiver, realizing a new sound wave reverberation method. This sound wave reverberation method can be applied to the case where the sound source and the receiver move relative to each other, avoiding the case where the reverberated sound wave contains noise due to the relative movement of the sound source and the receiver, ensuring the quality of the obtained target sound wave and ensuring the reverberation effect.

[0071] exist Figure 2 Based on the embodiments shown, the embodiments of this application can obtain the attenuation parameters or delay time of the mirror sound source by utilizing the absorption rate of the mirror sound source, the distance between the receiver and the mirror sound source, the sound wave transmission speed, etc., and can obtain the second sound wave by using convolution. For details of the process, please refer to the following embodiments.

[0072] Figure 3 This is a flowchart of a sound reverberation method provided in an embodiment of this application. The method is executed by a computer device, such as... Figure 3 As shown, the method includes:

[0073] 301. The computer device obtains the absorption rate of multiple mirror sound sources corresponding to the sound source. The absorption rate indicates the intensity of the sound wave emitted by the mirror sound source. The mirror sound source is used to simulate the sound wave emitted by the sound source and reaching the receiver after reflection.

[0074] In this embodiment of the application, the sound wave emitted by the mirror sound source and received by the receiver is a sound wave emitted by the sound source and reflected by an obstacle before being received by the receiver. When the sound wave is reflected by the obstacle, the obstacle absorbs the energy, resulting in a reduction in the energy of the reflected sound wave. The absorption rate can reflect the intensity of the sound wave after being reflected by the obstacle. By obtaining the absorption rate corresponding to each mirror sound source, the intensity of the sound wave emitted by each mirror sound source to the receiver can be determined subsequently.

[0075] The absorption rate can be expressed in any form; for example, the absorption rate can be expressed numerically.

[0076] In one possible implementation, the process of obtaining the absorption rate corresponding to the mirror sound source includes: determining the absorption rate corresponding to the mirror sound source based on the room parameters of the room where the sound source is located.

[0077] The room parameters indicate the absorptivity of each wall, ceiling, or floor in the room. The wall absorptivity indicates the intensity of the sound waves reflected by the wall. For example, when a sound wave encounters a wall, the wall not only reflects the sound wave but also absorbs its energy, resulting in a reduction in the intensity of the reflected sound wave. This reflectivity reflects the intensity of the sound waves reflected by the wall.

[0078] In the embodiments of this application, since any mirror sound source is obtained by sound source being symmetrical about any face of the room, or by other mirror sound sources being symmetrical about multiple faces of the room, the absorption rate corresponding to each mirror sound source can be determined based on the room parameters.

[0079] Optionally, the process of determining the absorption rate corresponding to the sound source based on room parameters includes: for any mirror sound source, determining at least one target wall, the mirror sound source being obtained by the sound source through one or more symmetrical processes based on at least one target wall; determining the absorption rate of at least one target wall based on the room parameters; and determining the absorption rate of at least one target wall as the absorption rate corresponding to the mirror sound source.

[0080] In the embodiments of this application, any mirrored sound source is obtained by being symmetrical about any face of the room, or by being symmetrical about multiple faces of the room by other mirrored sound sources. When the mirrored sound source is obtained by being symmetrical about one face of the room, the absorption rate of the mirrored sound source is the absorption rate of that face. When the mirrored sound source is obtained by being symmetrical about multiple faces of the room, it is equivalent to the mirrored sound source being mirrored by other mirrored sound sources about any face of the room. The sum of the absorption rates of these multiple faces is the absorption rate of the mirrored sound source.

[0081] For example, the sound source is located in any room, such as Figure 4 As shown, sound source 401 is symmetrically positioned about wall 402 to obtain mirror sound source 403. The sound waves emitted by sound source 401 change direction after reflection by the wall; therefore, the changed sound waves are equivalent to the sound waves directly emitted by mirror sound source 403. Thus, the sound waves emitted by the sound source and received by the receiver after reflection are equivalent to the sound waves emitted by the mirror sound source and received by the receiver. Multiple mirror sound sources corresponding to this sound source are shown below. Figure 5As shown, mirror sound source 501 is obtained by mirroring sound source 502 with respect to wall 503 of the room; mirror sound source 504 is obtained by mirroring sound source 502 with respect to wall 505 of the room; mirror sound source 506 is obtained by mirroring sound source 501 with respect to wall 505 of the room; mirror sound source 507 is obtained by mirroring sound source 504 with respect to wall 503 of the room, and so on, resulting in 12 mirror sound sources for sound source 502. The absorption rate corresponding to mirror sound source 501 is the same as the absorption rate of wall 503; the absorption rate corresponding to mirror sound source 504 is the same as the absorption rate of wall 505; the absorption rate corresponding to mirror sound source 506 is the sum of the absorption rates of walls 503 and 505; and the absorption rate corresponding to mirror sound source 507 is the sum of the absorption rates of walls 503 and 505. Furthermore, the dashed box containing mirror sound source 501 is equivalent to a mirror room of the room, and similarly... Figure 5 Each dashed box in the diagram represents a mirrored room of the room, i.e., a virtual room of the room.

[0082] In this embodiment, for a mirror sound source obtained by symmetry of a sound source about any surface, the sound wave emitted by the mirror sound source is equivalent to the sound wave emitted by the sound source and reflected by that surface; for a mirror sound source obtained by symmetry of a sound source about multiple surfaces, the sound wave emitted by the mirror sound source is equivalent to the sound wave emitted by the sound source and reflected by multiple surfaces; when the sound wave emitted by the sound source is reflected by any surface, some energy will be absorbed by that surface, resulting in a reduction in the energy of the reflected sound wave. The absorption rate of that surface can reflect the degree of energy absorption of the sound wave by that surface, and thus reflect the energy intensity of the reflected sound wave. Therefore, the absorption rate corresponding to the mirror sound source can be determined based on the absorption rate of the target wall corresponding to the mirror sound source, ensuring that the absorption rate is related to the wall of the room where the sound source is located, simulating the reflection of sound waves in the room in a real scene, and ensuring the accuracy of the absorption rate corresponding to the mirror sound source.

[0083] In one possible implementation, the process of determining multiple mirror sound sources of a sound source includes: based on the location of the sound source in the room, the location of the walls of the room, the location of the ceiling of the room, and the location of the floor of the room, determining mirror sound sources symmetrical about the walls, ceiling, and floor of the sound source; for any currently determined mirror sound source, based on the location of the mirror sound source, the location of the walls of the room, the location of the ceiling of the room, and the location of the floor of the room, determining mirror sound sources symmetrical about the walls, ceiling, and floor of the mirror sound source, and so on, to obtain multiple mirror sound sources of the sound source.

[0084] Optionally, the number of mirror sound sources is related to the reverberation time. In the process of determining the mirror sound sources in the manner described above, the product of the reverberation time and the sound wave transmission speed is determined, and the distance between the multiple mirror sound sources and the receiver is less than this product.

[0085] 302. For each mirror sound source, the computer device determines the attenuation parameter of the mirror sound source based on the distance between the receiver and the mirror sound source and the absorption rate of the mirror sound source. The attenuation parameter indicates the intensity of the sound wave emitted by the mirror sound source and received by the receiver.

[0086] In this embodiment, the sound wave emitted by the mirror sound source to the receiver is equivalent to the sound wave emitted by the sound source and reflected by an obstacle to reach the receiver. When the sound wave is reflected by the obstacle, the obstacle absorbs its energy, resulting in a decrease in the energy of the reflected sound wave. This absorption rate can reflect the intensity of the sound wave after being reflected by the obstacle. The absorption rate corresponding to the mirror sound source can indicate the intensity of the sound wave emitted by the mirror sound source and received by the receiver. Furthermore, considering that the intensity of the sound wave changes with the propagation distance during the propagation process, and the intensity of the sound wave decreases as the propagation distance increases, the sound wave emitted by the mirror sound source and received by the receiver is not only related to the absorption rate corresponding to the mirror sound source, but also to the distance between the receiver and the mirror sound source. Therefore, based on the distance between the receiver and the mirror sound source and the absorption rate corresponding to the mirror sound source, the attenuation parameter of the mirror sound source is determined, which fully considers the energy loss when the sound wave is reflected and the energy loss during the propagation process, so that the attenuation parameter can accurately reflect the intensity of the sound wave emitted by the mirror sound source and received by the receiver, thus ensuring the accuracy of the attenuation parameter of the mirror sound source.

[0087] In one possible implementation, step 302 includes: determining the attenuation parameters of the mirror sound source based on the distance between the receiver and the mirror sound source, the absorption rate of the mirror sound source, and the phase transition parameters of the mirror sound source.

[0088] The phase transition parameter indicates the phase transition of the sound wave simulated by the mirror source and received by the receiver, compared to the sound wave emitted by the sound source. This phase transition parameter is related to the number of reflections of the sound wave simulated by the mirror source and received by the receiver. Optionally, the phase transition parameter is a value with base -1 raised to the power of the number of reflections.

[0089] In this embodiment, the sound wave emitted by the mirror sound source and received by the receiver is equivalent to the sound wave emitted by the sound source reaching the receiver after being reflected a number of times by the mirror sound source. In this embodiment, during the propagation process, the sound wave undergoes a 180-degree phase change with each reflection. Therefore, based on the phase change parameter, the phase change of the sound wave emitted by the mirror sound source can be determined to ensure the accuracy of the attenuation parameter.

[0090] In one possible implementation, step 302 includes the following two methods.

[0091] The first method is to determine the ratio of absorption rate to distance as the attenuation parameter of the mirror sound source.

[0092] In this embodiment, the intensity of the sound wave emitted by the mirror sound source and received by the receiver is directly proportional to the absorption rate of the mirror sound source and inversely proportional to the transmission distance of the sound wave. That is, it is inversely proportional to the distance between the mirror sound source and the receiver. Therefore, the ratio of absorption rate to distance is determined as the attenuation parameter of the mirror sound source to ensure that the attenuation parameter can reflect the propagation of the sound wave emitted by the mirror sound source and to ensure the accuracy of the attenuation parameter.

[0093] The second method is to determine the product of the distance and the target value, and then use the ratio of the absorption rate to the product as the attenuation parameter of the mirror sound source.

[0094] The target value can be any value, for example, the target value is 4π.

[0095] In this embodiment, the target value is equivalent to a scaling factor of the distance between the mirror sound source and the receiver. Considering that the intensity of the sound wave emitted by the mirror sound source and received by the receiver is directly proportional to the absorption rate of the mirror sound source and inversely proportional to the distance between the mirror sound source and the receiver, the intensity of the sound wave emitted by the mirror sound source and received by the receiver will be scaled according to the target value based on the distance between the mirror sound source and the receiver. Therefore, the product of the distance and the target value is determined, and the ratio of the absorption rate to the product is determined as the attenuation parameter of the mirror sound source, so as to ensure that the attenuation parameter can reflect the propagation of the sound wave emitted by the mirror sound source and ensure the accuracy of the attenuation parameter.

[0096] Optionally, the second method includes: determining a first product and a second product, where the first product is the product of the absorptivity and the phase transition parameter, and the second product is the product of the distance and the target value; and determining the ratio of the first product to the second product as the attenuation parameter of the mirror sound source. For example, if the absorptivity is 0.1 and the sound wave has a 180° phase transition, i.e., the number of reflections is 1, then the first product is -0.1.

[0097] Optionally, the attenuation parameters of the mirror sound source satisfy the following relationship:

[0098]

[0099] d i (t)=||p r -p s ||

[0100] Among them, A i(t) represents the attenuation parameter of the i-th mirror sound source at time t, where i is a positive integer, β i This represents the product of the absorptivity and phase transition parameter corresponding to the i-th mirror sound source, i.e., the first product; 4π represents the target value; d i (t) represents the distance between the i-th mirror sound source and the receiver at time t, p r p is used to represent the position of the i-th mirror sound source at time t. s Used to indicate the location of the receiver.

[0101] 303. For each mirror sound source, the computer equipment determines the delay time of the mirror sound source as the ratio of the distance between the receiver and the mirror sound source to the speed of sound wave transmission. The delay time is the time it takes for the sound wave emitted by the mirror sound source to reach the receiver.

[0102] In this embodiment of the application, after the mirror sound source emits a sound wave to the receiver, the sound wave propagates to the receiver according to the sound wave transmission speed. The ratio of the distance between the receiver and the mirror sound source to the sound wave transmission speed is the time it takes for the sound wave emitted by the mirror sound source to reach the receiver.

[0103] In this embodiment, the sound wave emitted by the mirror sound source and received by the receiver is equivalent to the sound wave emitted by the sound source after one or more reflections through an obstacle and then received by the receiver. Therefore, the distance between the mirror sound source and the receiver is equal to the distance that the sound wave emitted by the sound source travels to the receiver after one or more reflections through an obstacle. Thus, the ratio of the distance between the receiver and the mirror sound source to the sound wave transmission speed is determined as the delay time of the mirror sound source to ensure that the delay time can reflect the time it takes for the sound wave emitted by the mirror sound source to reach the receiver, thus ensuring the accuracy of the delay time.

[0104] In one possible implementation, the delay duration of the mirrored sound source satisfies the following relationship:

[0105]

[0106] Where, τ i (t) represents the delay time of the i-th mirror sound source at time t, d i (t) represents the distance between the i-th mirror sound source and the receiver at time i, and c represents the sound wave transmission speed.

[0107] It should be noted that the embodiments of this application use the absorption rate corresponding to the mirror sound source to obtain the attenuation parameter of the mirror sound source and the sound wave transmission speed to obtain the delay time of the mirror sound source for explanation. However, in another embodiment, it is not necessary to perform the above steps 301-303. Instead, other methods are used to obtain the attenuation parameters and delay time of multiple mirror sound sources corresponding to the sound source.

[0108] 304. The computer device determines the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source.

[0109] In one possible implementation, step 304 includes: calling a pulse function to calculate the delay duration and target duration of the mirror sound source to obtain the pulse response of the mirror sound source, wherein the target duration is the time it takes for the sound wave emitted by the sound source without reflection to reach the receiver.

[0110] In this embodiment, the receiver can receive not only the sound wave emitted by the sound source without reflection, but also the sound wave emitted by the sound source after reflection. The sound wave emitted by the sound source after reflection is equivalent to the sound wave emitted by the mirror sound source. The sound waves received by the receiver are all emitted by the sound source at the same time. Among the sound waves received by the receiver, the sound wave emitted by the sound source without reflection arrives at the receiver first, while the sound wave emitted by the mirror sound source arrives at the receiver later. Therefore, the pulse function is called to calculate the delay time and target duration of the mirror sound source to obtain the pulse response of the mirror sound source. This reflects the delay time of the sound wave emitted by the mirror sound source and received by the receiver compared to the sound wave emitted by the sound source without reflection and received by the receiver. This determines the influence of the sound wave emitted by the mirror sound source on the receiver and ensures the subsequent reverberation effect.

[0111] In one possible implementation, the impulse response of the mirror sound source satisfies the following relationship:

[0112]

[0113] Among them, Λ i (t) represents the impulse response of the i-th mirror sound source at time t, where t is an arbitrary time, t′ represents the target duration, and d i (t) represents the distance between the i-th mirror sound source and the receiver at time t, c represents the sound wave propagation speed, and δ(·) represents the impulse function.

[0114] 305. For each mirror sound source, the computer device determines the product of the first sound wave and the attenuation parameter of the mirror sound source; convolves the product and the impulse response of the mirror sound source to obtain the second sound wave, wherein the first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0115] In this embodiment, the product of the first sound wave and the attenuation parameter of the mirror sound source is equivalent to the linear invariant part of the sound wave emitted by the mirror sound source and received by the receiver, which can reflect the intensity of the sound wave emitted by the mirror sound source and received by the receiver. The impulse response of the mirror sound source is equivalent to the time-varying part of the sound wave emitted by the mirror sound source and received by the receiver, which can reflect the phase of the sound wave emitted by the mirror sound source and received by the receiver. Convolving the product of the first sound wave and the attenuation parameter of the mirror sound source with the impulse response of the mirror sound source, the sound wave emitted by the mirror sound source and received by the receiver can be obtained to ensure the accuracy of the second sound wave.

[0116] In the embodiments of this application, the second sound wave corresponding to each mirror sound source can be obtained in the manner described above, that is, multiple second sound waves can be obtained.

[0117] In one possible implementation, the second sound wave satisfies the following relationship:

[0118]

[0119]

[0120]

[0121] Among them, u i s(t) represents the second sound wave of the i-th mirror sound source at time t, and s(t) represents the first sound wave of the sound source at time t. i (t) represents the attenuation parameter of the i-th mirror sound source at time t, δ(t-τ) i (t) represents the impulse response of the i-th mirror sound source at time t, where i is a positive integer, and τ i (t) represents the delay time of the i-th mirror sound source at time t, β i The product of the absorptivity and phase transition parameter corresponding to the i-th mirror sound source is used, 4π is used to represent the target value, and d i (t) represents the distance between the i-th mirror sound source and the receiver at time t; c represents the speed of sound wave transmission.

[0122] It should be noted that the embodiments of this application are illustrated by convolving the product of the attenuation parameter of the first sound wave and the mirror sound source with the impulse response of the mirror sound source. In another embodiment, it is not necessary to perform the above step 305. Instead, other methods are used to convolve the attenuation parameter of the first sound wave, the mirror sound source, and the impulse response of the mirror sound source to obtain the second sound wave.

[0123] 306. The computer equipment superimposes the first sound wave and multiple second sound waves to obtain the target sound wave.

[0124] In this embodiment, the receiver can receive not only the sound waves emitted by the sound source without reflection, but also the sound waves emitted by each mirror sound source to the receiver. The first sound wave and multiple second sound waves are superimposed to make the target sound wave have a reverberation effect, thereby achieving the reverberation effect of the sound waves emitted by the sound source and ensuring the accuracy of the target sound wave.

[0125] In one possible implementation, step 306 includes: superimposing the first sound wave and multiple second sound waves in chronological order to obtain the target sound wave.

[0126] In this embodiment of the application, considering that sound waves are continuous, the sound waves at the same moment are superimposed in chronological order during the superposition of the first sound wave and multiple second sound waves, so that the target sound wave can reflect the effect of sound wave reverberation in the real scene and ensure the accuracy of the target sound wave.

[0127] In one possible implementation, the target sound wave satisfies the following relationship:

[0128]

[0129] in, Used to represent the target sound wave, u i s(t) represents the second sound wave of the i-th mirror sound source at time t, where i is an integer greater than 0 and not greater than N, and N is the number of mirror sound sources. s(t) represents the first sound wave of the sound source at time t. i (t) represents the attenuation parameter of the i-th mirror sound source at time t, δ(t-τ) i (t) is used to represent the impulse response of the i-th mirror sound source at time t, τ i (t) is used to represent the delay time of the i-th mirror sound source at time t.

[0130] It should be noted that the embodiments of this application are illustrated by superimposing the first sound wave and multiple second sound waves. In another embodiment, it is not necessary to perform the above step 306. Instead, other methods are used to superimpose the obtained multiple second sound waves to obtain the target sound wave.

[0131] In the solution provided in this application embodiment, the mirror sound source of the sound source is an independently moving individual. The attenuation parameter of the mirror sound source can reflect the absorption of the sound wave emitted by the sound source during the reflection process, which is equivalent to the intensity of the sound wave emitted by the mirror sound source. The delay time of the mirror sound source can change with the movement of the mirror sound source. Therefore, the impulse response of the mirror sound source can not only reflect the propagation of the sound wave emitted by the mirror sound source to the receiver, but also change with the movement of the mirror sound source. By using the attenuation parameter and delay time of the mirror sound source, the sound wave sent to the receiver by each mirror sound source can be obtained. Then, the sound waves sent to the receiver by multiple mirror sound sources are superimposed to obtain the target sound wave. The target sound wave is equivalent to the reverberated sound wave received by the receiver, realizing a new sound wave reverberation method. This sound wave reverberation method can be applied in mobile scenarios where the sound source and receiver move relative to each other. It is suitable for situations where the sound source and receiver move relative to each other, avoiding the situation where the reverberated sound wave contains noise due to the relative movement of the sound source and receiver, ensuring the quality of the obtained target sound wave, and ensuring the reverberation effect.

[0132] In this embodiment, some of the sound waves emitted by the sound source are directly received by the receiver without reflection, and some of the sound waves emitted by the sound source are received by the receiver after one or more reflections. By determining multiple mirror sound sources of the sound source, each mirror sound source can simulate the sound waves emitted by the sound source after reflection and received by the receiver. In this way, the process of the sound waves emitted by the sound source being received by the receiver is equivalent to the process of the sound source and multiple mirror sound sources emitting sound waves to the receiver. Moreover, the multiple mirror sound sources are independent moving individuals. For the sound waves emitted by each mirror sound source to the receiver, they can be decomposed into two parts: a linear time-invariant part and a time-varying part. As the sound source moves, the position of the mirror sound source also changes, which in turn changes the distance between the mirror sound source and the receiver. This affects the delay time of the mirror sound source, and consequently its impulse response, thus affecting the time-varying part of the sound wave emitted by the mirror sound source to the receiver. This ensures that the sound wave emitted by each mirror sound source to the receiver is applicable to the case of sound source movement. Since multiple mirror sound sources are independent moving entities, the sound wave emitted by each mirror sound source to the receiver can be obtained according to the above-mentioned linear time-invariant and time-varying parts. Then, using the superposition principle, the sound waves emitted by multiple mirror sound sources and received by the receiver are superimposed to ensure that the obtained target sound wave can represent the sound wave received by the receiver, thereby simulating the sound wave reverberation effect in a real scene. The reverberation effect is equivalent to the superposition of sound waves with different delays, ensuring the accuracy of the target sound wave.

[0133] In the above Figure 2Based on the embodiments shown, this application embodiment takes into account the continuity of the sound waves emitted by the sound source and adopts a sound wave discrete method to sample the sound waves of multiple mirror sound sources at multiple sampling times, thereby obtaining the reverberant sound waves received by the receiver at multiple sampling times. For details of the process, please refer to the following embodiments.

[0134] Figure 6 This is a flowchart of a sound reverberation method provided in an embodiment of this application. The method is executed by a computer device, such as... Figure 6 As shown, the method includes:

[0135] 601. The computer device acquires the attenuation parameters and delay durations of multiple mirror sound sources corresponding to the sound source at multiple first sampling times. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver.

[0136] In this embodiment of the application, considering the continuity of the sound waves emitted by the sound source, the sound waves emitted by the mirror sound source to the receiver are equivalent to the sound waves that are received by the receiver after being reflected from the sound waves emitted by the sound source. Therefore, the sound waves emitted by the mirror sound source to the receiver are also continuous. Thus, a discrete approach is adopted to determine the attenuation parameters and delay durations of multiple mirror sound sources at multiple first sampling times, so as to determine the sound waves received by the receiver at multiple first sampling times.

[0137] In this embodiment, since the location of the sound source may change over time, the location of the mirror sound source may also change over time. Furthermore, the distance between the mirror sound source and the receiver is related to the attenuation parameter of the mirror sound source; therefore, a change in the location of the mirror sound source will cause a change in the distance between the mirror sound source and the receiver. Consequently, the attenuation parameter of the mirror sound source may change at different times. Similarly, the distance between the mirror sound source and the receiver is related to the delay duration of the mirror sound source; therefore, a change in the location of the mirror sound source will cause a change in the distance between the mirror sound source and the receiver. Consequently, the delay duration of the mirror sound source may change at different times. Figure 7 As shown, Figure 7 The system includes a sound source 701 and seven mirror sound sources 702. Arrows are used to indicate the motion trajectory. As the sound source moves along the motion trajectory, the position of the sound source 701 will change over time, and the positions of the seven mirror sound sources 702 will also change over time. Therefore, the delay duration of each mirror sound source 702 may change at different times.

[0138] Among the multiple first sampling times, the different first sampling times represent different times, and the interval between any two adjacent first sampling times may be the same or different.

[0139] In one possible implementation, multiple first sampling moments are obtained according to a first sampling rate, which indicates the number of samples per unit time.

[0140] The unit of time can be any time, such as 1 second or 1 minute.

[0141] In this embodiment of the application, the first sampling rate can reflect the number of samples per unit time. According to the first sampling rate, the first sampling time of the number of samples is obtained within the unit sampling time, thereby obtaining multiple first sampling times.

[0142] For example, if the first sampling rate is 16000Hz, which indicates that the number of samples per unit time is 16000, then 16000 first sampling moments can be obtained from the unit time. If the unit time is 1 second, the first first sampling moment is 1 / 16000 seconds, and the second first sampling moment is 2 / 16000 seconds.

[0143] Step 601 is the same as step 201 above, and will not be repeated here.

[0144] 602. The computer device determines the impulse response of each mirror sound source at the first sampling time based on the impulse function and the delay time of each mirror sound source at the first sampling time.

[0145] Step 602 is the same as step 202 or step 304 above, and will not be described again here.

[0146] 603. For each mirror sound source, the computer device convolves the first sound wave, the attenuation parameter of the mirror sound source at the first sampling time, and the impulse response of the mirror sound source at the first sampling time to obtain the second sound wave of the mirror sound source at the first sampling time. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0147] In this embodiment of the application, for any mirror sound source, the attenuation parameters and impulse responses of the mirror sound source at multiple first sampling times have been obtained. The number of attenuation parameters of the mirror sound source is the same as the number of impulse responses of the mirror sound source. For the attenuation parameters and impulse responses of the mirror sound source at any first sampling time, the first sound wave and the attenuation parameters and impulse responses of the mirror sound source at any first sampling time are convolved to obtain the second sound wave of the mirror sound source at that first sampling time. According to the above method, the second sound waves of the mirror sound source at multiple first sampling times can be obtained, that is, multiple second sound waves of the mirror sound source are obtained.

[0148] For example, for any mirror sound source, convolving the first sound wave, the attenuation parameter of the mirror sound source at the first sampling time, and the impulse response of the mirror sound source at the first sampling time yields the second sound wave of the mirror sound source at the first sampling time; convolving the first sound wave, the attenuation parameter of the mirror sound source at the second sampling time, and the impulse response of the mirror sound source at the second sampling time yields the second sound wave of the mirror sound source at the second sampling time, and so on. Based on the attenuation parameter and impulse response of the mirror sound source at each first sampling time, the second sound wave of the mirror sound source at each first sampling time can be obtained.

[0149] Step 602 is the same as step 203 or step 305 above, and will not be described again here.

[0150] 604. The computer equipment superimposes multiple second sound waves from multiple mirror sound sources at the same first sampling time to obtain multiple target sound waves at the first sampling time.

[0151] In this embodiment of the application, the second sound wave of multiple mirror sound sources at the same first sampling time is the sound wave emitted by multiple mirror sound sources and received by the receiver at the same time. The multiple second sound waves of multiple mirror sound sources at the same first sampling time are superimposed so that the obtained target sound wave is equivalent to the sound wave received by the receiver in the real scene, simulating the reverberant sound wave received by the receiver in the real scene, thus ensuring the accuracy of the obtained target sound waves at multiple first sampling times.

[0152] In one possible implementation, after acquiring the target sound waves at multiple first sampling times, the method further includes: generating a target sound file based on the target sound waves at multiple first sampling times, wherein the duration of the target sound file is the interval between the first sampling time and the last first sampling time, and playing the target sound file.

[0153] In this embodiment of the application, the target sound waves at multiple first sampling times are equivalent to the sound waves received by the receiver at multiple first sampling times, that is, the sound waves collected by the receiver at multiple first sampling times. After generating the target sound file based on the target sound waves at multiple first sampling times, the target sound file can be played to realize the process of sound acquisition and playback, thus ensuring the accuracy of sound playback.

[0154] In this embodiment, considering the continuity of the sound waves emitted by the sound source, the sound waves emitted by the mirror sound source to the receiver are equivalent to the sound waves received by the receiver after reflection of the emitted sound waves. Therefore, the sound waves emitted by the mirror sound source to the receiver are also continuous. Thus, a discrete approach is adopted to determine the attenuation parameters and delay times of multiple mirror sound sources at multiple first sampling times, so as to determine the sound waves received by the receiver at multiple first sampling times. This eliminates the need to process the continuous sound waves in real time, reduces the amount of computation, and ensures the accuracy of the target sound waves obtained based on the target sound waves at multiple first sampling times.

[0155] In the above Figure 6 Based on the embodiment shown, multiple mirror sound sources include a first mirror sound source and a second mirror sound source, and the distance between the first mirror sound source and the sound source is less than the distance between the second mirror sound source and the sound source; then the process of obtaining the attenuation parameters and delay duration of the multiple mirror sound sources at multiple first sampling times includes the following steps 1-5.

[0156] Step 1: The computer device acquires the attenuation parameters of the first image sound source at multiple first sampling times based on the first sampling rate. The first sampling rate indicates the number of samples per unit time.

[0157] In this embodiment of the application, considering that when the sound source changes over time, the attenuation parameter of the mirror sound source that is close to the sound source changes non-linearly over time, while the attenuation parameter of the mirror sound source that is far from the sound source changes linearly over time, the multiple mirror sound sources are divided into two types according to the distance between the mirror sound sources: a first mirror sound source and a second mirror sound source, so as to obtain the attenuation parameters of different mirror sound sources in different ways.

[0158] The first sampling rate can be any sampling rate, such as a preset sampling rate. For example, if the first sampling rate is 16kHz, then the first sampling rate indicates that the number of samples per unit time is 16000. These multiple first sampling moments can be sampling moments within a single unit time, or multiple sampling moments within multiple unit time periods. For example, if the first sampling rate is 16kHz, the unit time is 1 second, and the number of multiple first sampling moments is 32000, then the multiple sampling moments are obtained based on the first sampling rate from samples taken within 2 seconds.

[0159] In this embodiment, multiple first sampling times can be determined based on the first sampling rate, thereby obtaining the attenuation parameters of the first mirror sound source at each first sampling time.

[0160] In one possible implementation, step 1 includes: obtaining the position of the sound source at multiple first sampling times from the motion trajectory of the sound source based on a first sampling rate; determining the position of the first mirror sound source at each first sampling time based on the position of the sound source at each first sampling time; and obtaining the attenuation parameter of the first mirror sound source at each first sampling time based on the position of the first mirror sound source at each first sampling time and the position of the receiver.

[0161] In this embodiment of the application, considering that the attenuation parameter of the first mirror sound source changes non-linearly with time, the attenuation parameter of the first mirror sound source at each first sampling moment is determined according to the first sampling rate to ensure the accuracy of the obtained attenuation parameter.

[0162] In this embodiment, the sound source moves along the motion trajectory. The change in the position of the sound source will cause the change in the position of the mirror sound source. The distance between the mirror sound source and the receiver is related to the attenuation parameter of the mirror sound source. Therefore, based on the first sampling rate, the position of the sound source at multiple first sampling times is obtained, and then the position of the first mirror sound source at each first sampling time is obtained. Based on the position of the first mirror sound source at each first sampling time and the position of the receiver, the attenuation parameter of the first mirror sound source at each first sampling time is obtained. This is to ensure that the motion of the sound source can be taken into account in the process of determining the attenuation parameter of the first mirror sound source, and thus the influence of the sound source motion on the mirror sound source is considered, thereby ensuring the accuracy of the attenuation parameter of the first mirror sound source.

[0163] Optionally, the motion trajectory of the sound source can be any motion trajectory set for the sound source, or the motion trajectory of the sound source can be obtained by tracking the sound source.

[0164] Optionally, the process of determining the attenuation parameter of the first mirror sound source at each first sampling time includes: determining the distance between the first mirror sound source and the receiver at any first sampling time based on the position of the first mirror sound source at any first sampling time and the position of the receiver, obtaining the absorption rate corresponding to the first mirror sound source, and determining the attenuation parameter of the first mirror sound source at the first sampling time based on the distance between the receiver and the first mirror sound source at the first sampling time and the absorption rate corresponding to the mirror sound source.

[0165] It should be noted that the process of determining the attenuation parameter of the first mirror sound source at each first sampling moment is the same as steps 301-302 above, and will not be repeated here.

[0166] In one possible implementation, the process of determining the first and second mirror sound sources includes: determining the distance between each mirror sound source and the sound source among multiple mirror sound sources; identifying the mirror sound sources whose distance to the sound source is less than a threshold as the first mirror sound source; and identifying the mirror sound sources other than the first mirror sound source among the multiple mirror sound sources as the second mirror sound source. The threshold can be any value.

[0167] In another possible implementation, the process of determining the first and second mirror sound sources includes: based on the distance between each mirror sound source and the sound source, sorting the multiple mirror sound sources in ascending order of distance, determining the top 8 mirror sound sources as the first mirror sound source, and determining the mirror sound sources other than the first mirror sound source as the second mirror sound source.

[0168] Step 2: The computer device acquires the attenuation parameters of the second mirror sound source at multiple second sampling times based on the second sampling rate. The second sampling rate indicates the number of samples per unit time, and the first sampling rate is higher than the second sampling rate.

[0169] The second sampling rate is any sampling rate lower than the first sampling rate. For example, a second sampling rate of 5Hz means 5 samples are taken per unit time. These multiple first sampling moments can be sampling moments within a single unit time, or multiple sampling moments within multiple unit time periods. For example, if the first sampling rate is 5Hz, the unit time is 1 second, and the number of multiple first sampling moments is 10, then the multiple sampling moments are obtained from samples taken within 2 seconds based on the first sampling rate.

[0170] In this embodiment, multiple second sampling times can be determined based on the second sampling rate, thereby obtaining the attenuation parameters of the second mirror sound source at each second sampling time.

[0171] In one possible implementation, step 1 includes: obtaining the position of the sound source at multiple second sampling times from the motion trajectory of the sound source based on the second sampling rate; determining the position of the second mirror sound source at each second sampling time based on the position of the sound source at each second sampling time; and obtaining the attenuation parameter of the second mirror sound source at each second sampling time based on the position of the second mirror sound source at each second sampling time and the position of the receiver.

[0172] Optionally, the process of determining the attenuation parameter of the second mirror sound source at each second sampling time includes: determining the distance between the second mirror sound source and the receiver at any second sampling time based on the position of the second mirror sound source and the position of the receiver at any second sampling time, obtaining the absorption rate corresponding to the second mirror sound source, and determining the attenuation parameter of the second mirror sound source at the second sampling time based on the distance between the receiver and the second mirror sound source at the second sampling time and the absorption rate corresponding to the mirror sound source.

[0173] It should be noted that the process of determining the attenuation parameters of the second mirror sound source at each second sampling time is the same as steps 301-302 above, and will not be repeated here.

[0174] Optionally, the process of obtaining the second sampling rate includes: obtaining the motion frequency of the sound source based on the motion trajectory of the sound source, and determining the second sampling frequency based on the motion frequency of the sound source.

[0175] In this embodiment of the application, the second sampling rate is a low sampling rate compared to the first sampling rate. The motion frequency of the sound source is determined based on the motion trajectory, and then the second sampling frequency is determined to ensure that the second sampling frequency is as small as possible so that the attenuation parameter obtained based on the second sampling rate is as small as possible, thereby reducing the amount of calculation. At the same time, it can also ensure that the obtained attenuation parameter is accurate enough.

[0176] Step 3: The computer device obtains the delay duration of multiple mirror sound sources at multiple second sampling times based on the second sampling rate.

[0177] In this embodiment of the application, multiple second sampling times can be determined based on the second sampling rate, thereby obtaining the delay duration of each mirror sound source at each second sampling time.

[0178] In one possible implementation, step 3 includes: obtaining the position of the sound source at multiple second sampling times from the motion trajectory of the sound source based on the second sampling rate; determining the position of multiple mirror sound sources at each second sampling time based on the position of the sound source at each second sampling time; and obtaining the delay duration of the multiple mirror sound sources at each second sampling time based on the positions of the multiple mirror sound sources at each second sampling time and the position of the receiver.

[0179] In this embodiment of the application, considering that the delay duration of each mirror sound source changes linearly with time, the delay duration of each mirror sound source at each second sampling moment is determined according to the second sampling rate to ensure the accuracy of the obtained delay duration.

[0180] In this embodiment, the sound source moves along the motion trajectory. The change in the position of the sound source will cause the change in the position of the mirror sound source. The distance between the mirror sound source and the receiver is related to the delay time of the mirror sound source. Therefore, based on the second sampling rate, the position of the sound source at multiple second sampling times is obtained, and then the position of each mirror sound source at each second sampling time is obtained. Based on the position of each mirror sound source at each second sampling time and the position of the receiver, the delay time of each mirror sound source at each second sampling time is obtained. This allows the movement of the sound source to be taken into account in the process of determining the delay time of each mirror sound source, and thus the impact of the sound source movement on the mirror sound source is considered, ensuring the accuracy of the delay time of the mirror sound source.

[0181] Optionally, the process of obtaining the delay duration of multiple mirror sound sources at each second sampling time includes: for any mirror sound source and any second sampling time, based on the position of the mirror sound source at the second sampling time and the position of the receiver, determining the distance between the mirror sound source and the receiver at the second sampling time, and determining the ratio of the distance between the mirror sound source and the receiver at the second sampling time to the sound wave transmission speed as the delay duration of the mirror sound source at the sampling time.

[0182] It should be noted that the process of determining the delay duration of the mirror sound source at each second sampling moment is the same as step 303 above, and will not be repeated here.

[0183] In one possible implementation, the process of determining the delay duration of the mirror sound source at each second sampling time includes: for any mirror sound source, calling a pulse function to calculate the first sound wave at the second sampling time and the delay duration of the mirror sound source at the second sampling time, thereby obtaining the pulse response of the mirror sound source at the second sampling time, wherein the first sound wave at the second sampling time is the sound wave emitted by the sound source, which has not been reflected and is received by the receiver at the second sampling time.

[0184] In this embodiment, since some of the sound waves emitted by the sound source reach the receiver directly without reflection and are received by the receiver, i.e., the first sound wave, and the sound wave emitted by the mirror sound source and received by the receiver is equivalent to the sound wave emitted by the sound source reaching the receiver after reflection and being received by the receiver, the pulse response of the mirror sound source is obtained by combining the delay time of the first sound wave and the mirror sound source, so as to reflect the propagation of the sound wave emitted by the mirror sound source to the receiver and ensure the accuracy of the pulse response of the mirror sound source.

[0185] In one possible implementation, the impulse function includes multiple convolution functions. The process of determining the delay duration of the mirror sound source at each second sampling time includes: calling each convolution function in the impulse function to convolve the first sound wave at the second sampling time to obtain multiple convolutional sound waves at the second sampling time; calling the impulse function to fuse the multiple convolutional sound waves at the second sampling time and the delay duration of the mirror sound source at the second sampling time to obtain the impulse response of the mirror sound source at the second sampling time.

[0186] In this system, multiple convolution functions correspond one-to-one with multiple convolutional sound waves. Different convolution functions contain different parameters, and therefore, different convolution functions correspond to different convolutional sound waves.

[0187] In this embodiment, the first sound wave and the delay time are calculated by using a pulse function and a convolution and fusion method to ensure that the obtained pulse response can reflect the propagation of the sound wave emitted by the mirror sound source to the receiver, thus ensuring the accuracy of the pulse response.

[0188] Optionally, the impulse response of the mirror sound source satisfies the following relationship:

[0189] Λ i (n) = Υ(n) T △(n)

[0190] Υ(n)=[y0(n),y1(n),...,y N (n)] T

[0191]

[0192]

[0193] Where n represents any second sampling time, Λ i γ(n) represents the impulse response of the i-th mirror sound source at the second sampling time n, γ(n) represents the vector composed of multiple convolutional sound waves, Δ(n) represents the vector composed of the delay times of the mirror sound sources at the second sampling time n, T represents the transpose of the matrix, y0(n) represents the 0th convolutional sound wave, y1(n) represents the 1st convolutional sound wave, and y N (n) is used to represent the Nth convolutional sound wave, where N is an integer greater than 1, y k (n) represents the k-th convolutional acoustic wave, where k is an integer not less than 0 and not greater than N, s(n) represents the first acoustic wave at the second sampling time n, and c k (n) is used to represent the k-th convolution function in the impulse function, where k is an integer not greater than N. Used to represent convolution.

[0194] Optionally, the impulse function can be included within the Farrow (a type of filter) architecture. The delay times of the first sound wave and the mirror sound source are input into the Farrow architecture for calculation. The Farrow architecture can perform calculations according to the impulse function and output the impulse response of the mirror sound source. For example, the structure of the Farrow architecture is as follows: Figure 8 As shown.

[0195] In this embodiment, a discrete digital calculation method is used to determine the delay duration of the mirror sound source at each second sampling moment. For continuous time d i (t) at any second sampling time n, d i (n), d i (n) is not an integer, d i (n) includes different integer and fractional parts. During the acquisition of the impulse response of the mirror sound source at the second sampling time, for d... iThe integer part of (n) is achieved by translating the sound wave along the time axis, resulting in an integer delay; while for d i The fractional part of (n) is implemented using the Farrow architecture to obtain the fractional delay. The integer delay and fractional delay are then fused to obtain the impulse response of the mirror sound source at the second sampling time.

[0196] Step 4: The computer device upsamples the attenuation parameters of the second mirror sound source at multiple second sampling times to obtain the attenuation parameters of the second mirror sound source at multiple first sampling times.

[0197] In this embodiment of the application, considering that the attenuation parameter of the second mirror sound source changes linearly with time, the attenuation parameter of the second mirror sound source at multiple second sampling times is obtained at a second sampling rate lower than the first sampling rate, so that the attenuation parameter of the second mirror sound source at multiple first sampling times can be obtained by upsampling, so as to minimize the amount of calculation and ensure the efficiency of obtaining the attenuation parameter.

[0198] In one possible implementation, step 4 includes: for any first sampling time, determining two second sampling times adjacent to the first sampling time, and determining the attenuation parameter of the second mirror sound source at the first sampling time by interpolation based on the attenuation parameter of the second mirror sound source at the two second sampling times.

[0199] In this embodiment, since the attenuation parameter of the second mirror sound source changes linearly with time, an interpolation method is adopted to determine the attenuation parameter of the second mirror sound source at multiple first sampling times based on the attenuation parameter of the second mirror sound source at multiple second sampling times, so as to ensure that the attenuation parameter of the second mirror sound source at multiple first sampling times changes linearly with time and to ensure the accuracy of the determined attenuation parameter.

[0200] Step 5: Upsample the delay duration of multiple mirror sound sources at multiple second sampling times to obtain the delay duration of multiple mirror sound sources at multiple first sampling times.

[0201] In this embodiment of the application, considering that the delay duration of the mirror sound source changes linearly with time, the delay duration of the mirror sound source at multiple second sampling moments is obtained at a second sampling rate lower than the first sampling rate, so that the upsampling method can be adopted to obtain the delay duration of the mirror sound source at multiple first sampling moments, so as to minimize the amount of computation and ensure the efficiency of obtaining the delay duration.

[0202] It should be noted that step 5 is the same as step 4 above, and will not be repeated here.

[0203] In the solution provided in this application embodiment, considering that when the sound source changes over time, the attenuation parameter of the mirror sound source with a small distance from the sound source changes non-linearly over time, while the attenuation parameter of the mirror sound source with a large distance from the sound source changes linearly over time, the multiple mirror sound sources are divided into two types according to the distance between the mirror sound sources: a first mirror sound source and a second mirror sound source. The delay duration of each mirror sound source changes linearly over time. Therefore, the attenuation parameter of the first mirror sound source at multiple first sampling times is obtained according to a first sampling rate, and the attenuation parameter of the second mirror sound source at multiple second sampling times and the delay duration of each mirror sound source at multiple second sampling times are obtained according to a second sampling rate lower than the first sampling rate. In order to further adopt an upsampling method to obtain the attenuation parameter of the second mirror sound source at multiple first sampling times and the delay duration of the mirror sound source at multiple first sampling times, so as to minimize the amount of computation and ensure the efficiency of obtaining the attenuation parameter and delay duration.

[0204] It should be noted that the embodiments of this application take the movement of the sound source as an example, using the movement trajectory of the sound source to obtain the attenuation parameters and delay duration of each mirror sound source. In another embodiment, the sound source remains unchanged, but the receiver moves. Then, following the above method, based on the motion trajectory of the receiver and combined with the first sampling rate or the second sampling rate, the position of the receiver at multiple first sampling times, or the position of the receiver at multiple second sampling times, is determined. Then, combined with the positions of the mirror sound sources at multiple first sampling times, or the positions of the mirror sound sources at multiple second sampling times, the attenuation parameters and delay duration of each mirror sound source are obtained. In addition, the above two optional schemes can be combined, that is, both the sound source and the receiver move. In this case, obtaining the attenuation parameters and delay duration of each mirror sound source is the same as above, and will not be repeated here.

[0205] The above embodiments involve the attenuation parameter of the first mirror sound source changing non-linearly with time, the attenuation parameter of the second mirror sound source changing linearly with time, and the delay duration of each mirror sound source changing linearly with time. Based on the above embodiments, the following embodiments will provide a detailed explanation of the non-linear attenuation parameter of the first mirror sound source changing non-linearly with time, the attenuation parameter of the second mirror sound source changing linearly with time, and the delay duration of each mirror sound source changing linearly with time.

[0206] For any continuous motion, the displacement p(t), velocity v(t), and acceleration a(t) satisfy the following relationships:

[0207]

[0208]

[0209] Where τ represents the independent variable of time, and the range of τ is [0, t], a(τ) represents the acceleration with respect to the independent variable τ, v0 represents the initial velocity of the motion, dτ represents the derivative with respect to the independent variable τ, dt represents any moment in the motion, t′ represents another moment in the motion, and dt′ represents the derivative with respect to time t′.

[0210] The relationship satisfied by the displacement p(t), velocity v(t), and acceleration a(t) of the above motion can be transformed into an expression in terms of the motion frequency, yielding the following relationship:

[0211]

[0212]

[0213] Where a(t) represents the acceleration of the motion, and w represents the frequency of the motion. It uses the frequency of motion to represent the velocity of motion, and is also used to represent the Fourier transform of acceleration a(t). It is a function of the frequency of motion, where a(τ) represents the acceleration with respect to the independent variable τ, and dτ represents the derivative with respect to the independent variable τ. The displacement of motion is expressed using the frequency of motion.

[0214] Based on the relationship satisfied by the displacement p(t), velocity v(t), and acceleration a(t) mentioned above, which can be converted into an expression for the motion frequency, the following relationship can be obtained:

[0215]

[0216] Where p(w) represents the displacement of the motion in terms of the motion frequency, w represents the motion frequency, and v(t) represents the velocity of the motion. Used to represent displacement related to velocity v(t), The function is used to represent displacement related to acceleration, τ is used to represent the independent variable of time, and the range of τ is [0, t]. a(τ) is used to represent the acceleration with respect to the independent variable τ. dτ is used to represent the derivative with respect to the independent variable τ. t is used to represent any moment in the motion process. t′ is used to represent another moment in the motion process. dt′ is used to represent the derivative with respect to time t′. e is used to represent the natural constant. v0 is used to represent the initial velocity of the motion. j is used to represent the imaginary unit. δ(w) is used to represent a function with respect to the motion frequency w.

[0217] Based on the above relationship, it can be seen that the bandwidth of motion displacement depends on the bandwidth of motion acceleration, that is, on the rate of change of motion acceleration, i.e., the motion frequency, and it decays rapidly with the square of the motion frequency. The rate of change of acceleration of human limb movements is less than 5Hz, and the displacement bandwidth is less than 2Hz; even the shaking of special populations is only 4-6Hz. Therefore, it is unnecessary to use a high sampling rate to sample the position of the sound source from the motion trajectory of the sound source.

[0218] Furthermore, by performing a Taylor series expansion on the attenuation parameters of the mirror sound sources, taking the i-th mirror sound source as an example, the attenuation parameters of the i-th mirror sound source have the following relationship:

[0219]

[0220]

[0221] Among them, A i (t) represents the attenuation parameter of the i-th mirror sound source at time t, p i (t) represents the position of a mirror sound source at time t, p r The location of the receiver is used to represent the L2 norm, and x is used to represent the L2 norm. i Equivalent to ||p i (t)-p r || 2 x p The parameter A used to represent the location of the i-th mirror sound source in the mirror room is the attenuation parameter A of the i-th mirror sound source at time t. i (t) is obtained by performing a Taylor series expansion on the position of the i-th mirror sound source in the mirror room, and can also represent the distance between the i-th mirror sound source and the sound source.

[0222] Based on the relationship satisfied by the attenuation parameters of the i-th mirror sound source, it can be seen that at the mirror distance x p When the distance is greater than 1 meter, as the mirror distance x p Furthermore, since the higher-order terms in the Taylor series expansion decay rapidly, the attenuation parameter of the i-th mirror sound source is only related to the position of the i-th mirror sound source, and the bandwidth of the mirror sound source's trajectory can be ignored. At a mirror distance x... pWhen the distance is less than 1 meter, the higher-order terms in the above Taylor series expansion relationship exist, and the bandwidth of the motion trajectory of the mirror sound source is high. Therefore, for multiple mirror sound sources corresponding to the sound source, it can be determined that the attenuation parameter of the first mirror sound source changes non-linearly with time, and the attenuation parameter of the second mirror sound source changes linearly with time. That is, it can be determined that the attenuation parameter of the low-order mirror sound source changes non-linearly with time, and the attenuation parameter of the high-order mirror sound source changes linearly with time. Therefore, the direct sound wave of the first mirror sound source and the sound source are both obtained with a high sampling rate. The direct sound wave of the sound source refers to the sound wave emitted by the sound source and received by the receiver without being reflected.

[0223] Expanding the delay of the mirror sound source using a Taylor series, taking the i-th mirror sound source as an example, the delay of the i-th mirror sound source has the following relationship:

[0224] x i =|p i,x -p r,x |

[0225]

[0226]

[0227] Where, x i Used to represent the distance on the X-axis between the i-th mirror sound source and the receiver, y i，0 z is used to represent the distance on the Y-axis between the i-th mirror sound source and the receiver. i，0 f(x) represents the distance between the i-th mirror sound source and the receiver on the Z-axis. i x is used to represent the distance between the i-th mirror sound source and the receiver. p This indicates the location of the mirrored room.

[0228] Based on the Taylor series expansion of the delay time of the i-th mirror sound source at the location of the mirror room where the i-th mirror sound source is located, it can be seen that the motion range of the mirror sound source is affected by the display of the room where the sound source is located, that is, the motion range of the mirror sound source is a minimum value, f(x i With f(x) p It increases and then decays rapidly.

[0229] Based on the Taylor series expansion of the delay time of the i-th mirror sound source, the following relationship can be obtained:

[0230]

[0231] Where x(t) is used to represent any sound wave, The bandwidth used to represent the square of the sound wave x(t) This is used to represent the bandwidth of the sound wave x(t). Therefore, based on the above relationship, it can be seen that the square of the band-limited sound wave is twice the bandwidth of the sound wave itself, that is, the bandwidth of the quadratic term in the Taylor series is twice the bandwidth of the motion displacement.

[0232] Based on the above reasoning, we can derive the theory of motion-time sampling reconstruction. The upper limit of the bandwidth of displacement during motion determines the sampling rate of the reconstructed sound wave propagating through the air to the receiver in time. This is because, after Taylor series expansion, if f(x) p As the Taylor series increases, the higher-order terms decay rapidly. For a higher-order mirror source in the second mirror image, only the terms below the quadratic value in the first Taylor series can be retained. Therefore, the delay bandwidth of the higher-order mirror source is approximately twice the motion frequency of the source. Consequently, the delay duration of the higher-order mirror source can be obtained using a low sampling rate, i.e., twice the motion frequency. This allows for sampling the attenuation parameters and delay duration of the mirror source at different sampling rates, reducing computational complexity.

[0233] For example, regarding the sound source, the first mirror sound source, and the second mirror sound source, the motion displacement, delay time, and attenuation parameters of each sound source are as follows: Figure 9 As shown, through Figure 9 It can be seen that the motion displacements of the sound source, the first mirror sound source, and the second mirror sound source are synchronized, while the delay duration and attenuation parameters of the sound source are not synchronized with the motion displacement of the sound source, reflecting that the direct sound wave emitted by the sound source exhibits nonlinear changes; the delay duration and attenuation parameters of the first mirror sound source are not synchronized with the motion displacement of the first mirror sound source, while the delay duration and attenuation parameters of the second mirror sound source are synchronized with the motion displacement of the second mirror sound source.

[0234] In this embodiment, the complex sound field wave equation is transformed into the superposition of multiple mirror sound sources in a free field using Green's function. Furthermore, considering that the position of the sound source changes over time, the position of the mirror sound source also changes over time. Therefore, the sound wave emitted by the mirror sound source and received by the receiver is decomposed into a linear time-invariant part and a time-varying part. This allows the sound reverberation scheme provided in this embodiment to be applicable to scenarios where the position of the sound source changes, thus having a wide range of applications. For example, when a user speaks, their head moves back and forth, or when a user walks around a room while speaking; in these scenarios, the scheme provided in this embodiment can obtain an accurate reverberated sound wave.

[0235] The Green's function satisfies the following relationship:

[0236]

[0237] in, Used to indicate the location of the receiver. The function is used to represent the location of the sound source, t′ to represent the time when the sound source emits the sound wave, t to represent the time when the receiver receives the sound wave, c to represent the speed of sound wave transmission, and δ(·) to represent the impulse function.

[0238] Based on the embodiments shown above, this application also provides a flowchart of a sound reverberation method, such as... Figure 10 As shown, the first mirror sound source is referred to as the low-order mirror sound source, and the second mirror sound source is referred to as the high-order mirror sound source. The method includes:

[0239] 1001. Randomly generate the motion trajectory of the sound source.

[0240] 1002. For a low-order mirror sound source, based on the first sampling rate, obtain the position of the sound source at multiple first sampling times from the motion trajectory of the sound source; based on the position of the sound source at each first sampling time, determine the position of the low-order mirror sound source at each first sampling time; for each first sampling time, based on the position of the low-order mirror sound source at the first sampling time and the position of the receiver, determine the distance between the low-order mirror sound source and the receiver at that first sampling time, obtain the absorption rate corresponding to the low-order mirror sound source, and based on the distance between the receiver and the low-order mirror sound source at that first sampling time and the absorption rate corresponding to the mirror sound source, determine the attenuation parameter of the first mirror sound source at the first sampling time.

[0241] 1003. Obtain the position of the sound source at multiple second sampling times from the motion trajectory using the second sampling rate; for each second sampling time, determine the position of each mirror sound source at the second sampling time based on the position of the sound source at the second sampling time, that is, obtain the position of each mirror sound source at each second sampling time.

[0242] 1004. For each mirror sound source, based on the position of the mirror sound source at the second sampling time and the position of the receiver, determine the distance between the mirror sound source and the receiver at the second sampling time. The ratio of the distance between the mirror sound source and the receiver at the second sampling time to the sound wave transmission speed is determined as the delay time of the mirror sound source at the sampling time, and thus the delay time of each mirror sound source at each second sampling time is obtained.

[0243] 1005. For a high-order mirror sound source, based on the position of the high-order mirror sound source at the second sampling time and the position of the receiver, determine the distance between the high-order mirror sound source and the receiver at the second sampling time, obtain the absorption rate corresponding to the high-order mirror sound source, and based on the distance between the high-order mirror sound source and the receiver at the second sampling time and the absorption rate corresponding to the mirror sound source, determine the attenuation parameter of the high-order mirror sound source at the second sampling time.

[0244] 1006. Using a parallel processing approach, for each mirror sound source, the delay duration of the mirror sound source at multiple second sampling times is upsampled to obtain the delay duration of the mirror sound source at multiple first sampling times.

[0245] 1007. By adopting a parallel processing method, the attenuation parameters of the high-order mirror sound source at multiple second sampling times are upsampled to obtain the attenuation parameters of the high-order mirror sound source at multiple first sampling times.

[0246] 1008. Call the linear modulation system and adopt parallel processing. For each first sampling time and each mirror sound source, process the attenuation parameters of the first sound wave and the mirror sound source at the first sampling time, and input the processing results into the time-varying fractional delay system.

[0247] 1009. Call the time-varying fractional delay system and adopt a parallel processing method. For each first sampling time and each mirror sound source, process the delay time of the mirror sound source at the first sampling time based on the impulse function to obtain the impulse response of the mirror sound source. Convolve the impulse response of the mirror sound source and the corresponding processing result of the mirror sound source to obtain the second sound wave of the mirror sound source at the first sampling time.

[0248] 1010. Given the second sound wave of each mirror sound source at each first sampling time, for each first sampling time, the second sound wave of the first sampling time is superimposed with the first sound wave to obtain the target sound wave of the first sampling time, and thus multiple target sound waves at the first sampling time are obtained. The target sound wave is the reverberated sound wave.

[0249] In this embodiment, the first sampling rate is 16kHz and the second sampling rate is 5Hz. During the acquisition of the target sound wave, the computational complexity is reduced from 1.44G to 705K, a decrease of 2092 times. Furthermore, compared with related technologies, such as... Figure 11 As shown, in related technologies, the reverberated sound waves suffer from phase discontinuities and sawtooth gain, resulting in a picket fence effect. In contrast, the reverberated sound waves in this application have continuous phases and do not exhibit sawtooth gain issues. Therefore, the reverberated sound waves obtained using the solution provided in this application have high quality. Furthermore, the solution provided in this application can solve the problem of poor robustness in multi-channel end-to-end voice tracking algorithms, achieving reverberation rendering in low-complexity mobile scenes.

[0250] Furthermore, since related technologies only utilize mirror reverberation to simulate reverberation in scenarios where the sound source and receiver are relatively displaced, the reverberation effect is poor, resulting in poor sound wave quality received by the receiver. The solution provided in this application, however, is applicable to situations where the sound source and receiver move relative to each other, avoiding the inclusion of noise in the reverberated sound wave due to this relative movement. This ensures the quality of the target sound wave and guarantees a better and more realistic reverberation effect.

[0251] Based on the embodiments shown above, the acoustic reverberation scheme provided in this application can be applied to various scenarios, such as game scenarios or model training scenarios.

[0252] Taking a game scenario as an example, this application provides a method for sound wave reverberation, which includes: a terminal running a game application, the terminal participating in a virtual game through the game application, and during the virtual game, such as... Figure 12 As shown, when microphone indicator 1201 is enabled, the terminal collects the user's voice through the microphone and sends the voice to the game server. The game server uses the voice as a sound source and emits a voice signal. For example, if the voice sent by the terminal is 10 seconds long, it is equivalent to the sound source emitting a 10-second voice signal. Taking sound waves as the voice signal, the first sound wave is the first voice signal, the second sound wave is the second voice signal, and the target sound wave is the target voice signal. Following steps 1001-1010, multiple target voice signals at first sampling moments are acquired. Based on the target voice signals at multiple first sampling moments, a target voice is generated. This target voice has the same duration as the voice collected by the terminal, and the target voice is the voice after reverberation of the voice collected by the terminal. The game server sends the target voice to the terminals participating in the virtual game, so that the terminals participating in the virtual game automatically play the target voice through their speakers when speaker indicator 1202 is enabled, thus realizing a reverberation scheme for the user's voice in the game scene.

[0253] In a model training scenario, taking sound waves as the speech signal as an example, a microphone can be used to collect speech in real time. The collected speech is equivalent to dry sound. Following steps 1001-1010 above, reverberation is applied to the collected speech to obtain target speech signals at multiple first sampling moments. These target speech signals are equivalent to reverberated wet sound. Based on these target speech signals at multiple first sampling moments, target speech is generated. This target speech has the same duration as the speech collected by the terminal, and it is the reverberated speech collected by the terminal. This target speech serves as data for subsequent model training, such as training a speech recognition model or a reverberation processing model.

[0254] Figure 13This is a schematic diagram of the structure of a sound reverberation device provided in an embodiment of this application, as shown below. Figure 13 As shown, the device includes:

[0255] The acquisition module 1301 is used to acquire the attenuation parameters and delay duration of multiple mirror sound sources corresponding to the sound source. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver.

[0256] The determining module 1302 is used to determine the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source;

[0257] The convolution module 1303 is used to convolve the first sound wave, the attenuation parameter of the mirror sound source and the impulse response of the mirror sound source for each mirror sound source to obtain a second sound wave. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver.

[0258] The superposition module 1304 is used to superimpose multiple second sound waves to obtain the target sound wave.

[0259] In one possible implementation, the acquisition module 1301 is used to acquire the absorption rate corresponding to the mirror sound source, the absorption rate indicating the intensity of the sound wave emitted by the mirror sound source; and to determine the attenuation parameter of the mirror sound source based on the distance between the receiver and the mirror sound source and the absorption rate.

[0260] In another possible implementation, the acquisition module 1301 is used to determine the ratio of the absorption rate to the distance as the attenuation parameter of the mirror sound source; or, to determine the product of the distance and the target value, and to determine the ratio of the absorption rate to the product as the attenuation parameter of the mirror sound source.

[0261] In another possible implementation, the acquisition module 1301 is used to determine the ratio of the distance between the receiver and the mirror sound source to the sound wave transmission speed as the delay duration of the mirror sound source.

[0262] In another possible implementation, the determining module 1302 is used to call the pulse function to calculate the delay duration and target duration of the mirror sound source to obtain the pulse response of the mirror sound source, wherein the target duration is the time taken for the sound wave emitted by the sound source without reflection to reach the receiver.

[0263] In another possible implementation, the determining module 1302 is used to call the pulse function to calculate the delay time of the first sound wave and each mirror sound source to obtain the pulse response of each mirror sound source.

[0264] In another possible implementation, the convolution module 1303 is used to determine the product of the first sound wave and the attenuation parameter of the mirror sound source; and to convolve the product and the impulse response to obtain the second sound wave.

[0265] In another possible implementation, the superposition module 1304 is used to superimpose the first sound wave and the plurality of second sound waves to obtain the target sound wave.

[0266] In another possible implementation, the acquisition module 1301 is used to acquire the attenuation parameters and delay duration of the plurality of mirror sound sources at a plurality of first sampling times;

[0267] The convolution module 1303 is used to convolve the first sound wave, the attenuation parameter of the mirror sound source at the first sampling time, and the impulse response of the mirror sound source at the first sampling time to obtain the second sound wave of the mirror sound source at the first sampling time. The impulse response of the mirror sound source at the first sampling time is determined based on the impulse function and the delay time of the mirror sound source at the first sampling time.

[0268] The superposition module 1304 is used to superimpose the second sound waves of the multiple mirror sound sources at the same first sampling time to obtain the target sound waves at the multiple first sampling times.

[0269] In another possible implementation, the plurality of mirror sound sources include a first mirror sound source and a second mirror sound source, wherein the distance between the first mirror sound source and the sound source is less than the distance between the second mirror sound source and the sound source; the acquisition module 1301 is configured to acquire, based on a first sampling rate, attenuation parameters of the first mirror sound source at a plurality of first sampling times, wherein the first sampling rate indicates the number of samples per unit time; acquire, based on a second sampling rate, attenuation parameters of the second mirror sound source at a plurality of second sampling times, wherein the second sampling rate indicates the number of samples per unit time, wherein the first sampling rate is higher than the second sampling rate; acquire, based on the second sampling rate, delay durations of the plurality of mirror sound sources at a plurality of second sampling times; upsample the attenuation parameters of the second mirror sound source at a plurality of second sampling times to obtain the attenuation parameters of the second mirror sound source at a plurality of first sampling times; upsample the delay durations of the plurality of mirror sound sources at a plurality of second sampling times to obtain the delay durations of the plurality of mirror sound sources at a plurality of first sampling times.

[0270] In another possible implementation, the acquisition module 1301 is configured to acquire the position of the sound source at a plurality of first sampling times from the motion trajectory of the sound source based on the first sampling rate; determine the position of the first mirror sound source at each first sampling time based on the position of the sound source at each first sampling time; and acquire the attenuation parameter of the first mirror sound source at each first sampling time based on the position of the first mirror sound source at each first sampling time and the position of the receiver.

[0271] In another possible implementation, the acquisition module 1301 is configured to acquire the position of the sound source at each of the plurality of second sampling times from the motion trajectory of the sound source based on the second sampling rate; determine the position of the plurality of mirror sound sources at each of the second sampling times based on the position of the sound source at each of the second sampling times; and acquire the delay duration of the plurality of mirror sound sources at each of the second sampling times based on the position of the plurality of mirror sound sources at each of the second sampling times and the position of the receiver.

[0272] It should be noted that the sound reverberation device provided in the above embodiments is only an example of the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the sound reverberation device and the sound reverberation method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0273] This application also provides a computer device, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to perform the operations performed by the acoustic reverberation method of the above embodiments.

[0274] Optionally, the computer device is provided as a terminal. Figure 14 A structural block diagram of a terminal 1400 provided in an exemplary embodiment of this application is shown. The terminal 1400 includes a processor 1401 and a memory 1402.

[0275] Processor 1401 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1401 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1401 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1401 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0276] The memory 1402 may include one or more computer-readable storage media, which may be non-transitory. The memory 1402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1402 are used to store at least one computer program, which is executed by the processor 1401 to implement the acoustic reverberation method provided in the method embodiments of this application.

[0277] In some embodiments, the terminal 1400 may also optionally include a peripheral device interface 1403 and at least one peripheral device. The processor 1401, memory 1402, and peripheral device interface 1403 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1403 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1404, a display screen 1405, a camera assembly 1406, an audio circuit 1407, and a power supply 1408.

[0278] Peripheral device interface 1403 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1401 and memory 1402. In some embodiments, processor 1401, memory 1402 and peripheral device interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1401, memory 1402 and peripheral device interface 1403 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0279] The radio frequency (RF) circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1404 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1404 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1404 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1404 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0280] Display screen 1405 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1405 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1401 for processing. In this case, display screen 1405 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1405, disposed on the front panel of terminal 1400; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 1400 or in a folded design; in still other embodiments, display screen 1405 may be a flexible display screen, disposed on a curved or folded surface of terminal 1400. Furthermore, display screen 1405 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0281] The camera assembly 1406 is used to acquire images or videos. Optionally, the camera assembly 1406 includes a front-facing camera and a rear-facing camera. The front-facing camera is disposed on the front panel of the terminal, and the rear-facing camera is disposed on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1406 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.

[0282] The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1401 for processing, or input to the radio frequency circuit 1404 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1400. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0283] Power supply 1408 is used to power the various components in terminal 1400. Power supply 1408 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1408 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0284] Those skilled in the art will understand that Figure 14 The structure shown does not constitute a limitation on terminal 1400 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0285] Optionally, the computer equipment is provided as a server. Figure 15 This is a schematic diagram of a server structure provided in an embodiment of this application. The server 1500 can vary significantly due to different configurations or performance. It may include one or more Central Processing Units (CPUs) 1501 and one or more memories 1502. The memories 1502 store at least one computer program, which is loaded and executed by the processor 1501 to implement the methods provided in the above-described method embodiments. Of course, the server may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be elaborated upon here.

[0286] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to implement the operations performed by the acoustic reverberation method of the above embodiments.

[0287] This application also provides a computer program product, including a computer program that, when executed by a processor, performs the operations performed by the acoustic reverberation method of the above embodiments.

[0288] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0289] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present application should be included within the protection scope of the present application.

Claims

1. A method for sound wave reverberation, characterized in that, The method includes: The attenuation parameters and delay durations of multiple mirror sound sources corresponding to the sound source are obtained. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver. The impulse response of each mirror sound source is determined based on the impulse function and the delay duration of each mirror sound source. For each mirror sound source, a second sound wave is obtained by convolving the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver. The multiple second sound waves obtained are superimposed to obtain the target sound wave.

2. The method according to claim 1, characterized in that, Obtain the attenuation parameters of multiple mirror sound sources corresponding to the sound source, including: Obtain the absorption rate corresponding to the mirror sound source, wherein the absorption rate indicates the intensity of the sound wave emitted by the mirror sound source; The attenuation parameters of the mirror sound source are determined based on the distance between the receiver and the mirror sound source and the absorption rate.

3. The method according to claim 2, characterized in that, The determination of the attenuation parameters of the mirror sound source based on the distance between the receiver and the mirror sound source and the absorption rate includes: The ratio of the absorption rate to the distance is determined as the attenuation parameter of the mirror sound source; or, The product of the distance and the target value is determined, and the ratio of the absorption rate to the product is determined as the attenuation parameter of the mirror sound source.

4. The method according to claim 1, characterized in that, Obtain the delay duration of multiple mirror sound sources corresponding to the sound source, including: The ratio of the distance between the receiver and the mirror sound source to the speed of sound wave transmission is determined as the delay time of the mirror sound source.

5. The method according to claim 1, characterized in that, The determination of the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source includes: The pulse function is invoked to calculate the delay time and target duration of the mirror sound source, thereby obtaining the pulse response of the mirror sound source. The target duration is the time it takes for the sound wave emitted by the sound source without reflection to reach the receiver.

6. The method according to claim 1, characterized in that, For each mirror sound source, the second sound wave is obtained by convolving the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source, including: Determine the product of the attenuation parameter of the first sound wave and the mirror sound source; The second sound wave is obtained by convolving the product and the impulse response.

7. The method according to claim 1, characterized in that, The process of superimposing the multiple second sound waves to obtain the target sound wave includes: The first sound wave and the plurality of second sound waves are superimposed to obtain the target sound wave.

8. The method according to claim 1, characterized in that, The acquisition of attenuation parameters and delay durations of multiple mirror sound sources corresponding to the sound source includes: Obtain the attenuation parameters and delay duration of the multiple mirror sound sources at multiple first sampling times; For each mirror sound source, the second sound wave is obtained by convolving the first sound wave, the attenuation parameter of the mirror sound source, and the impulse response of the mirror sound source, including: The first sound wave, the attenuation parameter of the mirror sound source at the first sampling time, and the impulse response of the mirror sound source at the first sampling time are convolved to obtain the second sound wave of the mirror sound source at the first sampling time. The impulse response of the mirror sound source at the first sampling time is determined based on the impulse function and the delay time of the mirror sound source at the first sampling time. The process of superimposing the multiple second sound waves to obtain the target sound wave includes: The second sound waves from the multiple mirror sound sources are superimposed at the same first sampling time to obtain the target sound waves at the multiple first sampling times.

9. The method according to claim 8, characterized in that, The plurality of mirror sound sources include a first mirror sound source and a second mirror sound source, wherein the distance between the first mirror sound source and the sound source is smaller than the distance between the second mirror sound source and the sound source; The step of obtaining the attenuation parameters and delay durations of the multiple mirror sound sources at multiple first sampling times includes: Based on the first sampling rate, the attenuation parameters of the first mirror sound source at the plurality of first sampling times are obtained, wherein the first sampling rate indicates the number of samples per unit time. Based on the second sampling rate, the attenuation parameters of the second mirror sound source at multiple second sampling times are obtained. The second sampling rate indicates the number of samples per unit time. The first sampling rate is higher than the second sampling rate. Based on the second sampling rate, the delay duration of the plurality of mirror sound sources at the plurality of second sampling times is obtained; The attenuation parameters of the second mirror sound source at the plurality of second sampling times are upsampled to obtain the attenuation parameters of the second mirror sound source at the plurality of first sampling times; The delay durations of the multiple mirror sound sources at the multiple second sampling times are upsampled to obtain the delay durations of the multiple mirror sound sources at the multiple first sampling times.

10. The method according to claim 9, characterized in that, The step of obtaining the attenuation parameters of the first mirror sound source at the plurality of first sampling times based on the first sampling rate includes: Based on the first sampling rate, the position of the sound source at the plurality of first sampling times is obtained from the motion trajectory of the sound source; Based on the position of the sound source at each first sampling time, the position of the first mirror sound source at each first sampling time is determined; Based on the position of the first mirror sound source at each first sampling moment and the position of the receiver, the attenuation parameter of the first mirror sound source at each first sampling moment is obtained.

11. The method according to claim 9, characterized in that, The step of obtaining the delay duration of the plurality of mirror sound sources at the plurality of second sampling times based on the second sampling rate includes: Based on the second sampling rate, the position of the sound source at the plurality of second sampling times is obtained from the motion trajectory of the sound source; Based on the position of the sound source at each second sampling time, the positions of the plurality of mirror sound sources at each second sampling time are determined; Based on the positions of the multiple mirror sound sources at each second sampling time and the position of the receiver, the delay duration of the multiple mirror sound sources at each second sampling time is obtained.

12. A sound reverberation device, characterized in that, The device includes: The acquisition module is used to acquire the attenuation parameters and delay duration of multiple mirror sound sources corresponding to the sound source. The mirror sound sources are used to simulate the sound waves emitted by the sound source and reaching the receiver after reflection. The attenuation parameters indicate the intensity of the sound waves emitted by the mirror sound source and received by the receiver. The delay duration is the time it takes for the sound waves emitted by the mirror sound source to reach the receiver. The determination module is used to determine the impulse response of each mirror sound source based on the impulse function and the delay duration of each mirror sound source; The convolution module is used to convolve the first sound wave, the attenuation parameter of the mirror sound source and the impulse response of the mirror sound source for each mirror sound source to obtain a second sound wave. The first sound wave is the sound wave emitted by the sound source and received by the receiver, and the second sound wave is the sound wave emitted by the mirror sound source and received by the receiver. The superposition module is used to superimpose multiple second sound waves to obtain the target sound wave.

13. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to perform the operations performed by the acoustic reverberation method as claimed in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to perform the operations of the acoustic reverberation method as described in any one of claims 1 to 11.

15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it performs the operations of the acoustic reverberation method as described in any one of claims 1 to 11.

Images