Pulse feedback sequence generation method, device, equipment and medium for spatial model

Abstract

The present application provides a method, device, equipment and medium for generating a pulse feedback sequence of a spatial model, which belongs to the field of computer technology. The method includes: in the spatial model, performing same-path sound wave tracking on sound waves of multiple frequency bands respectively; during the sound wave tracking process, if the sound waves of multiple frequency bands are reflected by an obstacle, then based on the reflection parameters of the obstacles for the sound waves of multiple frequency bands, the sound wave parameters of the sound waves of multiple frequency bands are updated respectively; when the sound waves of multiple frequency bands reach the sound receiver in the spatial model, the current sound wave parameters and arrival time of the sound waves of multiple frequency bands are recorded; based on the sound wave parameters and arrival time of the direct, early reflected and post-reflected sound waves of multiple frequency bands received by the sound receiver, a pulse feedback sequence of the spatial model is generated. This solution improves the accuracy of the pulse feedback sequence and can more accurately simulate the reverberation effect.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, equipment and medium for generating a pulse feedback sequence of a spatial model. Background Art

[0002] Reverberation is the phenomenon in which sound waves, when traveling, are reflected by obstacles and then absorbed multiple times, resulting in the persistence of sound even after the source stops producing. Currently, reverberation is often added to sound in fields such as song production and film soundtrack post-production to enhance the realism of the sound.

[0003] Related technologies use wave tracing techniques similar to ray tracing to estimate the arrival times and sound pressures of direct, early, and late reflected sound waves from a sound source to a receiver in a spatial model. These arrival pressures are converted into digital pulse signals, which are then stored in a pulse feedback sequence with corresponding arrival times as the scale. This pulse feedback sequence is then used to process the sound, simulating the reverberation effect of the sound within the spatial model.

[0004] Since sound waves are affected by reflections differently from light waves, using sound wave tracing techniques like ray tracing to generate pulse feedback sequences results in poor accuracy of the pulse feedback sequences. Summary of the Invention

[0005] The present invention provides a method, apparatus, device, and medium for generating a pulse feedback sequence for a spatial model, which improves the accuracy of the pulse feedback sequence and can more accurately simulate reverberation effects. The technical solution is as follows:

[0006] In one aspect, a method for generating a pulse feedback sequence of a spatial model is provided, the method comprising:

[0007] Obtaining reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands, where the reflection parameters of the obstacles for sound waves of any frequency band represent the effect of the sound waves of the frequency band on the sound waves of the frequency band when reflected by the obstacle;

[0008] Acquire sound wave parameters of a first sound wave output by a sound source in the spatial model, where the first sound wave includes sound waves in the multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of the sound waves in the multiple frequency bands;

[0009] In the spatial model, same-path acoustic wave tracing is performed on the sound waves of the multiple frequency bands respectively. During the acoustic wave tracing process, if the sound waves of the multiple frequency bands are reflected by the obstacle, the acoustic wave parameters of the sound waves of the multiple frequency bands are updated respectively based on the reflection parameters of the obstacle for the sound waves of the multiple frequency bands, wherein the tracing paths of the multiple frequency bands under the same-path acoustic wave tracing are the same;

[0010] When the sound waves of the multiple frequency bands reach the sound receiver in the space model, recording current sound wave parameters and arrival times of the sound waves of the multiple frequency bands;

[0011] Based on the sound wave parameters and arrival times of the direct, early reflected and post-reflected sound waves of the multiple frequency bands received by the sound receiver, a pulse feedback sequence of the space model is generated, and the pulse feedback sequence is used to simulate the sound reverberation effect of the space model.

[0012] In one possible implementation, the reflection parameters of the obstacle for sound waves in any frequency band are used to represent the effect of the sound waves in the frequency band on the sound pressure and phase of the sound waves in the frequency band after being reflected by the obstacle; the sound wave parameters are used to represent the sound pressure and phase of the sound waves;

[0013] The updating of the sound wave parameters of the sound waves in the multiple frequency bands based on the reflection parameters of the obstacles for the sound waves in the multiple frequency bands respectively includes:

[0014] For sound waves in any frequency band, the sound pressure and phase of the sound waves in the frequency band are adjusted based on the reflection parameters of the obstacle on the frequency band to obtain updated sound pressure and phase.

[0015] In a possible implementation, the sound wave parameter is represented by a complex number, and the sound wave parameter is expressed as SIG(N)=[real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], wherein SIG(N) represents the sound wave parameter of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, and the initial energy is used to represent the sound pressure. 0 represents the initial phase of the sound wave, COS is a cosine function, and SIN is a sine function.

[0016] The reflection parameter is represented by a complex number, and is represented by: REF(N)=[real part: R N *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R Nrepresents the effect of the sound wave of the Nth frequency band on the sound pressure of the sound wave of the Nth frequency band after being reflected by the obstacle, P N It represents the influence of the sound wave in the Nth frequency band on the phase of the sound wave in the Nth frequency band after being reflected by the obstacle. COS is the cosine function and SIN is the sine function.

[0017] In one possible implementation, adjusting the sound pressure and phase of the sound waves in the frequency band based on the reflection parameters of the sound waves in the frequency band by the obstacle to obtain updated sound pressure and phase includes:

[0018] The product of the reflection parameter of the obstacle to the sound wave in the frequency band and the sound wave parameter of the sound wave in the frequency band is used as the updated sound wave parameter, and the updated sound wave parameter is used to represent the updated sound pressure and phase.

[0019] In one possible implementation, generating the pulse feedback sequence of the spatial model based on the sound wave parameters and arrival times of the direct, early-reflected, and post-reflected sound waves of the multiple frequency bands received by the sound receiver includes:

[0020] fusing the acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain a first acoustic wave pulse feature corresponding to the arrival time;

[0021] Based on the first acoustic wave pulse feature corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0022] In a possible implementation, the acoustic pulse feature includes multiple feature values; and generating the pulse feedback sequence of the spatial model based on the first acoustic pulse feature corresponding to each arrival time includes:

[0023] generating a random sequence based on the number of multiple characteristic values ​​in the first acoustic wave pulse characteristic, wherein the random sequence includes the same number of random numbers;

[0024] Based on the random sequence, performing random loss simulation on the first acoustic wave pulse characteristic to obtain a second acoustic wave pulse characteristic;

[0025] Based on the second acoustic wave pulse characteristics corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0026] In a possible implementation, generating the pulse feedback sequence of the spatial model based on the first acoustic wave pulse feature corresponding to each arrival time includes:

[0027] If the sound waves of the multiple frequency bands are back-reflected sound waves, using the arrival time as a scale, adding the second sound wave pulse feature corresponding to the arrival time to the pulse feedback sequence;

[0028] If the sound waves of the multiple frequency bands are direct or early reflected sound waves, the first sound wave pulse feature corresponding to the arrival time is directly added to the pulse feedback sequence based on the arrival time.

[0029] In a possible implementation, performing random loss simulation on the first acoustic wave pulse characteristic based on the random sequence to obtain the second acoustic wave pulse characteristic includes:

[0030] For any characteristic value in the first acoustic wave pulse characteristic, the characteristic value is multiplied by a random number of the same arrangement position in the random sequence, and the product is used as the characteristic value in the second acoustic wave pulse characteristic.

[0031] In one possible implementation, fusing the sound wave parameters of the sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain the first sound wave pulse feature corresponding to the arrival time includes:

[0032] generating a frequency spectrum based on the sound wave parameters of the sound waves in the plurality of frequency bands;

[0033] Perform an inverse Fourier transform on the frequency spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time.

[0034] In a possible implementation, the sound wave parameters are represented by complex numbers; and generating a spectrum based on the sound wave parameters of the sound waves in the multiple frequency bands includes:

[0035] splicing the sound wave parameters of the sound waves in the multiple frequency bands in order of frequency to obtain a complex spectrum;

[0036] The performing an inverse Fourier transform on the spectrum to obtain the first acoustic wave pulse feature corresponding to the arrival time includes:

[0037] Perform an inverse real Fourier transform on the complex spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time, wherein the first acoustic wave pulse feature includes multiple eigenvalues, and any eigenvalue is a real number.

[0038] In one possible implementation, generating the pulse feedback sequence of the spatial model based on the sound wave parameters and arrival times of the direct, early-reflected, and post-reflected sound waves of the multiple frequency bands received by the sound receiver includes:

[0039] For sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, determining at least one of propagation time of the sound waves of the multiple frequency bands in the space model, air humidity of the space model, and air temperature of the space model;

[0040] determining an air absorption parameter based on at least one of propagation time of the sound waves of the multiple frequency bands in the space model, air humidity of the space model, and air temperature of the space model;

[0041] Using the air absorption parameters, updating the sound wave parameters of the sound waves in the multiple frequency bands to obtain updated sound wave parameters;

[0042] A pulse feedback sequence of the spatial model is generated based on the updated acoustic wave parameters and the arrival time.

[0043] In a possible implementation, when the sound waves in the multiple frequency bands reach the sound receiver in the space model, recording current sound wave parameters and arrival times of the sound waves in the multiple frequency bands includes:

[0044] When the sound waves of the multiple frequency bands reach the sound receiver in the space model, determining arrival times of the sound waves of the multiple frequency bands based on propagation paths of the sound waves of the multiple frequency bands in the space model;

[0045] The current sound wave parameters and arrival times of the sound waves in the multiple frequency bands are recorded.

[0046] On the other hand, a device for generating a pulse feedback sequence of a spatial model is provided, the device comprising:

[0047] a parameter acquisition module, configured to acquire reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands, wherein the reflection parameters of obstacles for sound waves of any frequency band represent the effect of the sound waves of the frequency band on the sound waves of the frequency band when reflected by the obstacle;

[0048] The parameter acquisition module is further configured to acquire sound wave parameters of a first sound wave output by a sound source in the spatial model, wherein the first sound wave includes sound waves in the multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of the sound waves in the multiple frequency bands;

[0049] an updating module, configured to perform same-path acoustic wave tracking on the sound waves of the multiple frequency bands in the spatial model, and update the acoustic wave parameters of the sound waves of the multiple frequency bands based on the reflection parameters of the sound waves of the multiple frequency bands by the obstacle if the sound waves of the multiple frequency bands are reflected by the obstacle, wherein the tracking paths of the multiple frequency bands in the same-path acoustic wave tracking are the same;

[0050] a recording module, configured to record current sound wave parameters and arrival times of the sound waves in the multiple frequency bands when the sound waves in the multiple frequency bands arrive at the sound receiver in the space model;

[0051] A generation module is used to generate a pulse feedback sequence of the spatial model based on the sound wave parameters and arrival time of the direct, early reflected and post-reflected sound waves of the multiple frequency bands received by the sound receiver, and the pulse feedback sequence is used to simulate the sound reverberation effect of the spatial model.

[0052] In one possible implementation, the reflection parameters of the obstacle for sound waves in any frequency band are used to represent the impact of the sound waves in the frequency band on the sound pressure and phase of the sound waves in the frequency band after being reflected by the obstacle; the sound wave parameters are used to represent the sound pressure and phase of the sound waves; and the update module is used to adjust the sound pressure and phase of the sound waves in any frequency band based on the reflection parameters of the obstacle for the frequency band to obtain updated sound pressure and phase.

[0053] In a possible implementation, the sound wave parameter is represented by a complex number, and the sound wave parameter is expressed as SIG(N)=[real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], wherein SIG(N) represents the sound wave parameter of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, and the initial energy is used to represent the sound pressure. 0 represents the initial phase of the sound wave, COS is a cosine function, and SIN is a sine function.

[0054] The reflection parameter is represented by a complex number, and is represented by: REF(N)=[real part: R N *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R N represents the effect of the sound wave of the Nth frequency band on the sound pressure of the sound wave of the Nth frequency band after being reflected by the obstacle, P N It represents the influence of the sound wave in the Nth frequency band on the phase of the sound wave in the Nth frequency band after being reflected by the obstacle. COS is the cosine function and SIN is the sine function.

[0055] In one possible implementation, the updating module is used to take the product of the reflection parameters of the obstacle to the sound waves in the frequency band and the sound wave parameters of the sound waves in the frequency band as the updated sound wave parameters, and the updated sound wave parameters are used to represent the updated sound pressure and phase.

[0056] In a possible implementation, the generating module includes:

[0057] a fusion unit, configured to fuse the acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain a first acoustic wave pulse feature corresponding to the arrival time;

[0058] A generating unit is configured to generate a pulse feedback sequence of the spatial model based on a first acoustic wave pulse feature corresponding to each arrival time.

[0059] In one possible implementation, the acoustic wave pulse characteristic includes multiple characteristic values; the generation unit is used to generate a random sequence based on the number of multiple characteristic values ​​in the first acoustic wave pulse characteristic, and the random sequence includes the same number of random numbers; based on the random sequence, the first acoustic wave pulse characteristic is subjected to random loss simulation to obtain a second acoustic wave pulse characteristic; based on the second acoustic wave pulse characteristic corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0060] In one possible implementation, the generating unit is configured to, if the sound waves of the multiple frequency bands are post-reflected sound waves, use the arrival time as a scale to add the second sound wave pulse characteristics corresponding to the arrival time to the pulse feedback sequence; if the sound waves of the multiple frequency bands are direct or early-reflected sound waves, use the arrival time as a scale to directly add the first sound wave pulse characteristics corresponding to the arrival time to the pulse feedback sequence.

[0061] In one possible implementation, the generating unit is configured to multiply any characteristic value in the first acoustic wave pulse characteristic by a random number of the same arrangement position in the random sequence, and use the product as the characteristic value in the second acoustic wave pulse characteristic.

[0062] In a possible implementation, the fusion unit is configured to generate a frequency spectrum based on the acoustic wave parameters of the multiple frequency bands; and perform an inverse Fourier transform on the frequency spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time.

[0063] In one possible implementation, the acoustic wave parameters are represented by complex numbers; the fusion unit is used to splice the acoustic wave parameters of the sound waves of the multiple frequency bands in order of frequency to obtain a complex spectrum; the complex spectrum is subjected to an inverse real Fourier transform to obtain a first acoustic wave pulse feature corresponding to the arrival time, wherein the first acoustic wave pulse feature includes multiple eigenvalues, and any eigenvalue is a real number.

[0064] In one possible implementation, the generation module is used to determine, for sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, at least one of the propagation duration of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model, and the air temperature of the spatial model; determine air absorption parameters based on at least one of the propagation duration of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model, and the air temperature of the spatial model; use the air absorption parameters to update the sound wave parameters of the sound waves of the multiple frequency bands to obtain updated sound wave parameters; and generate a pulse feedback sequence of the spatial model based on the updated sound wave parameters and the arrival time.

[0065] In one possible implementation, the recording module is used to determine the arrival time of the sound waves of the multiple frequency bands based on the propagation paths of the sound waves of the multiple frequency bands within the spatial model when the sound waves of the multiple frequency bands reach the sound receiver within the spatial model; and record the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands.

[0066] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the pulse feedback sequence generation method for the spatial model as described in any of the above implementation methods.

[0067] On the other hand, a computer-readable storage medium is provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to implement the pulse feedback sequence generation method for the spatial model as described in any of the above implementation methods.

[0068] On the other hand, a computer program product is provided, comprising at least one program code, wherein the at least one program code is loaded and executed by a processor to implement the pulse feedback sequence generation method for a spatial model as described in any of the above implementations.

[0069] The beneficial effects of the technical solutions provided by the embodiments of the present application include at least:

[0070] An embodiment of the present application provides a method for generating a pulse feedback sequence of a spatial model. Taking into account that sound waves in different frequency bands are affected differently by reflection, the embodiment of the present application obtains the reflection parameters of obstacles on sound waves in different frequency bands, and divides the sound waves output by the sound source into multiple frequency bands. In the process of tracking the sound waves, the sound wave parameters of the sound waves in different frequency bands are updated based on the reflection parameters of obstacles on sound waves in different frequency bands, so that the calculated sound wave parameters of the sound waves in multiple frequency bands received by the sound receiver are more accurate, and the generated pulse feedback sequence is also more accurate, thereby improving the accuracy of the pulse feedback sequence. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0072] Figure 1 This is a flow chart of a method for generating a pulse feedback sequence of a spatial model provided in an embodiment of the present application;

[0073] Figure 2 This is a flow chart of a method for generating a pulse feedback sequence of a spatial model provided in an embodiment of the present application;

[0074] Figure 3 This is a schematic structural diagram of a pulse feedback sequence generating device for a spatial model provided in an embodiment of the present application;

[0075] Figure 4 This is a schematic structural diagram of a pulse feedback sequence generating device for a spatial model provided in an embodiment of the present application;

[0076] Figure 5 This is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0077] Figure 6 This is a structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0078] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0079] The terms "first," "second," "third," and "fourth," etc. in the specification and claims of this application and the accompanying drawings are used to distinguish different objects, not to describe a specific order. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0080] The pulse feedback sequence generation method of the spatial model provided in the embodiment of the present application can be applied to any scene that needs to add reverberation. For example, it can be applied to add reverberation to the sound in the game: a spatial model can be constructed based on the virtual scene provided by the game, and the pulse feedback sequence of the spatial model can be generated by using the method provided in the embodiment of the present application. Subsequently, the sound in the game can be convolved with the pulse feedback sequence of the spatial model so that the processed sound has the reverberation effect that matches the virtual scene. For another example, in the post-production of a movie soundtrack, a spatial model can be constructed based on the scene in the movie, and the pulse feedback sequence of the spatial model can be generated by using the method provided in the embodiment of the present application. Subsequently, the sound in the movie can be convolved with the pulse feedback sequence of the spatial model so that the processed sound has the reverberation effect that matches the scene.

[0081] Figure 1 This is a flow chart of a method for generating a pulse feedback sequence of a spatial model provided by an embodiment of the present application. This embodiment of the present application is illustrated by taking a computer device as an example. Figure 1 , the method comprising:

[0082] 101. The computer device obtains reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands. The reflection parameters of obstacles for sound waves of any frequency band are used to represent the impact of the sound waves of the frequency band on the sound waves of the frequency band when they are reflected by the obstacle.

[0083] A spatial model can be a user-built model used to represent any space. For example, the spatial model can be a room model, a street model, or a forest model. The present embodiments do not limit the spatial model. In some embodiments, a user can build a spatial model based on a scene that requires reverberation. For example, when adding reverberation to sounds in a game, a spatial model can be built based on a virtual scene in the game, so that the space represented by the spatial model is consistent with the virtual space provided in the game.

[0084] Optionally, the user constructs a spatial model by inputting model configuration parameters. These model configuration parameters are parameters used to describe the physical characteristics of the spatial model. For example, model configuration parameters are used to describe the number, location, and reflection parameters of obstacles in the spatial model. They can also be used to describe the location of sound sources, the location of sound receivers, and the humidity and temperature of the air. This embodiment of the application does not limit the model configuration parameters.

[0085] It should be noted that sound waves have longer wavelengths than light waves, and therefore exhibit different properties when affected by reflection. While light waves in different frequency bands are affected in almost the same way by reflection, sound waves in different frequency bands are affected differently. Therefore, to more accurately simulate a realistic reverberation effect, the present embodiment divides the sound waves into different frequency bands and processes them separately.

[0086] It should be noted that when dividing sound waves into multiple frequency bands, the embodiments of the present application do not limit the number of frequency bands and the intervals corresponding to each frequency band. The following examples are used for illustrative purposes only. For example, the sound waves are divided into five frequency bands, the first frequency band is 0-100 Hz (Hertz), the second frequency band is 100-500 Hz, the third frequency band is 500-2000 Hz, the fourth frequency band is 2000-4000 Hz, and the fifth frequency band is 4000-16000 Hz.

[0087] 102. The computer device obtains sound wave parameters of a first sound wave output by a sound source in a spatial model, where the first sound wave includes sound waves in multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of sound waves in multiple frequency bands.

[0088] It should be noted that the method provided in the embodiment of the present application simulates the reverberation process of sound waves in a spatial model. Therefore, the sound source in the spatial model does not actually output the first sound wave, but the computer device generates the sound wave parameters of the first sound wave and uses the first sound wave as the sound wave output by the sound source.

[0089] 103. The computer device performs same-path sound wave tracking on sound waves of multiple frequency bands in a spatial model. During the sound wave tracking process, if the sound waves of multiple frequency bands are reflected by an obstacle, the sound wave parameters of the sound waves of the multiple frequency bands are updated based on the reflection parameters of the obstacle for the sound waves of the multiple frequency bands. The tracking paths of the multiple frequency bands under the same-path sound wave tracking are the same.

[0090] Sound waves have a propagation direction. Computer equipment can track sound waves based on the propagation direction of the sound waves and determine the propagation path of the sound waves.

[0091] In some embodiments, the first sound wave can be regarded as multiple sound waves extending in all directions from the sound source position. When the computer device performs sound wave tracking in the spatial model, it will simultaneously track sound waves in multiple directions and divide the sound waves in each direction into multiple frequency bands to perform same-path sound wave tracking.

[0092] 104. When the sound waves of the multiple frequency bands arrive at the sound receiver in the space model, the computer device records the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands.

[0093] Since the computer device will constantly update the sound wave parameters based on the reflection of the sound wave by obstacles during the propagation of the sound wave, when the sound wave reaches the sound receiver in the spatial model, the current sound wave parameters of the sound wave can be regarded as the sound wave parameters of the sound wave received by the sound receiver.

[0094] 105. The computer device generates a pulse feedback sequence of the space model based on the sound wave parameters and arrival time of the direct, early reflected and post-reflected sound waves in multiple frequency bands received by the microphone. The pulse feedback sequence is used to simulate the sound reverberation effect of the space model.

[0095] Since sound reverberation refers to the phenomenon that when sound waves propagate, they will be reflected by obstacles they encounter. After multiple reflections and absorptions, the sound waves still exist after the sound source stops making sound. Therefore, in order to simulate the sound reverberation effect of the spatial model, a sound receiver is required to receive direct, early-reflected and post-reflected sound waves, and simulate the sound reverberation effect based on the sound wave parameters of the direct, early-reflected and post-reflected sound waves.

[0096] Among them, the direct sound waves of multiple frequency bands refer to: the sound waves of these multiple frequency bands reach the sound receiver directly from the sound source without being reflected. The early reflected sound waves of multiple frequency bands refer to: the sound waves of these multiple frequency bands have been reflected in the process of reaching the sound receiver from the sound source, and the number of reflections does not exceed the first number threshold. The late reflected sound waves of multiple frequency bands refer to: the sound waves of these multiple frequency bands have been reflected in the process of reaching the sound receiver from the sound source, and the number of reflections exceeds the first number threshold. It should be noted that the first number threshold can be any positive integer, for example, 3, 5, etc., and the embodiment of the present application does not limit the first number threshold. In some embodiments, the first number threshold can be an empirical value or set by a technician, and the embodiment of the present application does not limit this.

[0097] The pulse feedback sequence generation method for the spatial model provided in the embodiment of the present application takes into account that sound waves in different frequency bands are affected differently by reflection. Therefore, the embodiment of the present application obtains the reflection parameters of obstacles to sound waves in different frequency bands, divides the sound waves output by the sound source into multiple frequency bands, and in the process of tracking the sound waves, updates the sound wave parameters of the sound waves in different frequency bands based on the reflection parameters of obstacles to sound waves in different frequency bands, so that the calculated sound wave parameters of the sound waves in multiple frequency bands received by the sound receiver are more accurate, and the generated pulse feedback sequence is also more accurate, thereby improving the accuracy of the pulse feedback sequence.

[0098] In one possible implementation, the reflection parameter of an obstacle for a sound wave of any frequency band is used to represent the effect of the sound wave of the frequency band on the sound pressure and phase of the sound wave of the frequency band after being reflected by the obstacle; the sound wave parameter is used to represent the sound pressure and phase of the sound wave;

[0099] Based on the reflection parameters of the obstacles for the sound waves in the multiple frequency bands, the sound wave parameters of the sound waves in the multiple frequency bands are updated respectively, including:

[0100] For sound waves in any frequency band, the sound pressure and phase of the sound waves in the frequency band are adjusted based on the reflection parameters of the frequency band by the obstacle to obtain updated sound pressure and phase.

[0101] In one possible implementation, the sound wave parameters are represented by complex numbers, and the sound wave parameters are represented as SIG(N)=[real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], where SIG(N) represents the sound wave parameters of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, the initial energy is used to represent the sound pressure, 0 represents the initial phase of the sound wave, COS is the cosine function, and SIN is the sine function;

[0102] The reflection parameter is expressed as a complex number, which is expressed as: REF(N) = [real part: R N *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R N P represents the effect of the sound pressure of the Nth frequency band sound wave after it is reflected by an obstacle on the sound pressure of the Nth frequency band sound wave. N It represents the effect of the sound wave of the Nth frequency band on the phase of the sound wave of the Nth frequency band after being reflected by an obstacle. COS is the cosine function and SIN is the sine function.

[0103] In one possible implementation, adjusting the sound pressure and phase of the sound waves in the frequency band based on the reflection parameters of the sound waves in the frequency band caused by the obstacle to obtain updated sound pressure and phase includes:

[0104] The product of the reflection parameter of the obstacle to the frequency band and the sound wave parameter of the sound wave in the frequency band is used as the updated sound wave parameter. The updated sound wave parameter is used to represent the updated sound pressure and phase.

[0105] In one possible implementation, a pulse feedback sequence of a spatial model is generated based on the acoustic wave parameters and arrival times of direct, early-reflected, and post-reflected sound waves of multiple frequency bands received by a sound receiver, including:

[0106] The acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time are fused to obtain the first acoustic wave pulse characteristics corresponding to the arrival time;

[0107] Based on the first acoustic wave pulse characteristics corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0108] In one possible implementation, the acoustic pulse feature includes multiple feature values; generating a pulse feedback sequence of the spatial model based on the first acoustic pulse feature corresponding to each arrival time includes:

[0109] generating a random sequence based on the number of multiple characteristic values ​​in the first acoustic wave pulse characteristic, the random sequence including the same number of random numbers;

[0110] Based on the random sequence, random loss simulation is performed on the first acoustic wave pulse characteristic to obtain the second acoustic wave pulse characteristic;

[0111] Based on the second acoustic wave pulse characteristics corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0112] In one possible implementation, generating a pulse feedback sequence of the spatial model based on the first acoustic wave pulse characteristics corresponding to each arrival time includes:

[0113] If the sound waves of multiple frequency bands are post-reflected sound waves, the second sound wave pulse characteristics corresponding to the arrival time are added to the pulse feedback sequence based on the arrival time;

[0114] If the sound waves of multiple frequency bands are direct or early reflected sound waves, the arrival time is used as the scale, and the first sound wave pulse feature corresponding to the arrival time is directly added to the pulse feedback sequence.

[0115] In one possible implementation, random loss simulation is performed on the first acoustic wave pulse characteristic based on a random sequence to obtain the second acoustic wave pulse characteristic, including:

[0116] For any eigenvalue in the first acoustic pulse feature, multiply the eigenvalue by a random number with the same arrangement position in the random sequence. If the random number is greater than a first threshold, the product is the eigenvalue. If the random number is not greater than the first threshold, the product is 0, and the product is used as the eigenvalue in the second acoustic pulse feature.

[0117] In one possible implementation, acoustic wave parameters of acoustic waves of multiple frequency bands arriving at a sound receiver at the same arrival time are fused to obtain a first acoustic wave pulse feature corresponding to the arrival time, including:

[0118] generating a frequency spectrum based on sound wave parameters of the sound waves in multiple frequency bands;

[0119] The spectrum is inverse Fourier transformed to obtain the first sound wave pulse characteristics corresponding to the arrival time.

[0120] In one possible implementation, the sound wave parameters are represented by complex numbers; and a spectrum is generated based on the sound wave parameters of the sound waves in multiple frequency bands, including:

[0121] The sound wave parameters of the sound waves of multiple frequency bands are spliced ​​in the order of frequency to obtain a complex spectrum;

[0122] Perform an inverse Fourier transform on the spectrum to obtain the first acoustic wave pulse characteristics corresponding to the arrival time, including:

[0123] Perform an inverse real number Fourier transform on the complex spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time. The first acoustic wave pulse feature includes multiple eigenvalues, and any eigenvalue is a real number.

[0124] In one possible implementation, a pulse feedback sequence of a spatial model is generated based on the acoustic wave parameters and arrival times of direct, early-reflected, and post-reflected sound waves of multiple frequency bands received by a sound receiver, including:

[0125] For sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, determining at least one of propagation time of the sound waves of the multiple frequency bands in the space model, air humidity of the space model, and air temperature of the space model;

[0126] determining an air absorption parameter based on at least one of propagation time of sound waves of multiple frequency bands in the space model, air humidity in the space model, and air temperature in the space model;

[0127] Using air absorption parameters, the sound wave parameters of the sound waves in multiple frequency bands are updated to obtain updated sound wave parameters;

[0128] Based on the updated acoustic wave parameters and arrival times, a pulse feedback sequence of the spatial model is generated.

[0129] In one possible implementation, when sound waves of multiple frequency bands arrive at a sound receiver in the space model, current sound wave parameters and arrival times of the sound waves of the multiple frequency bands are recorded, including:

[0130] When the sound waves of the multiple frequency bands reach the sound receiver in the space model, determining the arrival time of the sound waves of the multiple frequency bands based on the propagation paths of the sound waves of the multiple frequency bands in the space model;

[0131] Record the current sound wave parameters and arrival time of sound waves in multiple frequency bands.

[0132] All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described in detail here.

[0133] Figure 2 This is a flow chart of a method for generating a pulse feedback sequence of a spatial model provided in an embodiment of the present application. The embodiment of the present application is illustrated by taking a computer device as an example. Figure 2 , the method comprising:

[0134] 201. A computer device obtains reflection parameters of an obstacle in a spatial model for sound waves of multiple frequency bands. The reflection parameters of the obstacle for sound waves of any frequency band are used to represent the impact of the sound waves of the frequency band on the sound waves of the frequency band when the sound waves of the frequency band are reflected by the obstacle.

[0135] The above step 201 is similar to the above step 101 and will not be described in detail here. Only the reflection parameters are exemplified.

[0136] In some embodiments, the reflection parameters of an obstacle for a sound wave of any frequency band are used to represent the effect of the sound wave of the frequency band on the sound pressure and phase of the sound wave of the frequency band after being reflected by the obstacle. In the related art, a sound wave tracing technology similar to ray tracing is used to estimate the arrival time and arrival sound pressure of the direct sound wave, early reflected sound wave and post reflected sound wave from the sound source to the sound receiver in the spatial model, and the arrival sound pressure is converted into a digital pulse signal, and the digital pulse signal is stored in a pulse feedback sequence with the corresponding arrival time as the scale. It can be seen that in the related art, only the effect of reflection on the sound pressure of the sound wave is considered, and the effect on the phase is not considered. The embodiment of the present application not only considers the effect on the sound pressure, but also considers the effect on the phase. Based on the reflection parameters, the sound wave parameters of the sound wave are updated, which can make the updated sound wave parameters more accurate.

[0137] Optionally, the reflection parameter includes a sound pressure reflection parameter and a phase reflection parameter, wherein the sound pressure reflection parameter is used to represent the effect of the sound wave on the sound pressure after the sound wave is reflected by the obstacle, and the phase reflection parameter is used to represent the effect of the sound wave on the phase of the sound wave after the sound wave is reflected by the obstacle. Optionally, the reflection parameter is represented by a complex number, and the reflection parameter is represented as: REF(N) = [real part: RN *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R N P represents the effect of the sound pressure of the Nth frequency band sound wave after it is reflected by an obstacle on the sound pressure of the Nth frequency band sound wave. N It represents the effect of the sound wave of the Nth frequency band on the phase of the sound wave of the Nth frequency band after being reflected by an obstacle. COS is the cosine function and SIN is the sine function.

[0138] It should be noted that the embodiment of the present application only uses "the reflection parameter is used to represent the influence of the sound wave on the sound pressure and phase of the sound wave after it is reflected by an obstacle" as an example to illustrate the reflection parameter. Of course, in other embodiments, the reflection parameter is also used to represent the influence of the sound wave on other properties of the sound wave after it is reflected by an obstacle, or the reflection parameter is only used to represent the influence of the sound wave on the sound pressure of the sound wave after it is reflected by an obstacle. The embodiment of the present application does not limit this.

[0139] 202. The computer device obtains sound wave parameters of a first sound wave output by a sound source in a spatial model, where the first sound wave includes sound waves in multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of sound waves in multiple frequency bands.

[0140] Among them, the acoustic wave parameters are parameters used to describe the acoustic wave, and the embodiments of the present application do not limit the acoustic wave parameters. In some embodiments, the acoustic wave parameters are used to represent the sound pressure and phase of the acoustic wave. Optionally, the acoustic wave parameters include sound pressure parameters and phase parameters. Optionally, the acoustic wave parameters are represented by complex numbers, and the acoustic wave parameters are represented as SIG(N) = [real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], wherein SIG(N) represents the acoustic wave parameters of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, the initial energy is used to represent the sound pressure, 0 represents the initial phase of the sound wave, COS is the cosine function, and SIN is the sine function.

[0141] It should be noted that the embodiments of the present application only use "sound wave parameters include sound pressure parameters and phase parameters" and "sound wave parameters are expressed as SIG(N) = [real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)]" as examples to illustrate the sound wave parameters, and do not limit the sound wave parameters.

[0142] 203. The computer device performs same-path sound wave tracking on sound waves of multiple frequency bands in a spatial model. During the sound wave tracking process, if the sound waves of multiple frequency bands are reflected by an obstacle, the sound wave parameters of the sound waves of the multiple frequency bands are updated based on the reflection parameters of the obstacle for the sound waves of the multiple frequency bands. The tracking paths of the multiple frequency bands under the same-path sound wave tracking are the same.

[0143] Although the embodiment of the present application performs sound wave tracking on sound waves of multiple frequency bands separately, since the sound waves of multiple frequency bands belong to the same propagation direction and are only divided according to the frequency bands, the propagation directions of the sound waves of multiple frequency bands are the same, and the propagation paths of the sound waves of multiple frequency bands are also the same. Therefore, the same-path sound wave tracking is performed on the sound waves of multiple frequency bands separately.

[0144] For example, the first sound wave is divided into four sound waves according to the propagation direction, and propagates in the four directions of east, west, south and north respectively. Each of these four sound waves can be divided into sound waves of multiple frequency bands. For each of these four sound waves, the propagation paths of the corresponding multiple frequency bands are the same.

[0145] In some embodiments, the reflection parameters of an obstacle for sound waves in any frequency band represent the effect of the sound waves in that frequency band on the sound pressure and phase of the sound waves in that frequency band after being reflected by the obstacle. The sound wave parameters represent the sound pressure and phase of the sound waves. Based on the reflection parameters of the obstacle for the sound waves in the multiple frequency bands, the computer device updates the sound wave parameters of the sound waves in the multiple frequency bands, including adjusting the sound pressure and phase of the sound waves in any frequency band based on the reflection parameters of the obstacle for the frequency band, thereby obtaining updated sound pressure and phase.

[0146] In some embodiments, when adjusting the sound wave parameters of a sound wave based on the reflection parameters of an obstacle for a frequency band, the reflection parameters may be multiplied by the sound wave parameters as a coefficient. For example, the computer device may adjust the sound pressure and phase of the sound wave in the frequency band based on the reflection parameters of the obstacle for the frequency band to obtain updated sound pressure and phase, including: multiplying the product of the reflection parameters of the obstacle for the frequency band and the sound wave parameters of the sound wave in the frequency band as the updated sound wave parameters, where the updated sound wave parameters are used to represent the updated sound pressure and phase.

[0147] For example, the acoustic wave parameter is expressed as SIG(N) = [real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], and the reflection parameter is expressed as REF(N) = [real part: R N *COS(P N ), imaginary part: R N *SIN(P N )], the updated sound wave parameters = SIG(N)*REF(N).

[0148] 204. When the sound waves of the multiple frequency bands arrive at the sound receiver in the space model, the computer device records the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands.

[0149] In some embodiments, when the computer device simulates the propagation of sound waves in the spatial model, it can simulate according to the actual sound wave propagation speed. Therefore, when the sound wave reaches the sound receiver of the spatial model, the current time can be recorded as the arrival time of the sound wave. In other embodiments, since the computer device simulates the propagation of sound waves in the spatial model, in order to make the recorded arrival time accurate, the embodiment of the present application can calculate the arrival time of the sound wave based on the propagation path of the sound wave. Optionally, when the sound waves of multiple frequency bands arrive at the sound receiver in the spatial model, the computer device records the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands, including: when the sound waves of multiple frequency bands arrive at the sound receiver in the spatial model, based on the propagation path of the sound waves of the multiple frequency bands in the spatial model, the arrival time of the sound waves of the multiple frequency bands is determined; and the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands are recorded. Wherein, arrival time = length of the propagation path / speed of sound.

[0150] 205. The computer device fuses the sound wave parameters of the sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain a first sound wave pulse feature corresponding to the arrival time.

[0151] The embodiment of the present application divides the sound waves into multiple frequency bands and processes them separately in order to more accurately simulate the loss of sound waves when they are reflected. Subsequently, in order to more accurately represent the characteristics of the sound received by the microphone at a certain moment, the sound wave parameters of the sound waves in multiple frequency bands that arrive at the microphone at the same arrival time can also be fused.

[0152] It should be noted that the embodiment of the present application does not limit the fusion method of the acoustic wave parameters, and is only illustrated by the following example:

[0153] In one possible implementation, a computer device fuses the acoustic wave parameters of sound waves in multiple frequency bands that arrive at a sound receiver at the same arrival time to obtain a first acoustic wave pulse characteristic corresponding to the arrival time, including: generating a spectrum based on the acoustic wave parameters of the sound waves in the multiple frequency bands; and performing an inverse Fourier transform on the spectrum to obtain the first acoustic wave pulse characteristic corresponding to the arrival time. The computer device fuses the acoustic wave parameters of the sound waves in the multiple frequency bands by generating the spectrum, and obtains the first acoustic wave pulse characteristic corresponding to the arrival time by performing an inverse Fourier transform on the spectrum.

[0154] Optionally, the sound wave parameters are represented by complex numbers; the computer device generates a spectrum based on the sound wave parameters of sound waves in multiple frequency bands, including: splicing the sound wave parameters of sound waves in multiple frequency bands in order of frequency to obtain a complex spectrum; performing an inverse Fourier transform on the spectrum to obtain a first sound wave pulse feature corresponding to the arrival time, including: performing an inverse real number Fourier transform on the complex spectrum to obtain a first sound wave pulse feature corresponding to the arrival time, the first sound wave pulse feature including multiple eigenvalues, any eigenvalue being a real number.

[0155] Among them, the sound wave parameters are spliced ​​in the order of frequency, which can be from low to high or from high to bottom. The embodiment of the present application does not limit this.

[0156] It should be noted that since direct, early-reflected, and late-reflected sound waves have different propagation paths and arrive at the receiver at different times, the computer device can immediately generate a first sound wave pulse signature at the corresponding arrival time based on the sound wave parameters of the sound waves in multiple frequency bands after receiving the sound waves in these multiple frequency bands. For example, if the sound wave is divided into five frequency bands and the sound wave parameters are represented by complex numbers, the sound receiver can obtain the five complex numbers and then concatenate them in ascending frequency order to obtain a complex spectrum. This complex spectrum is then subjected to an inverse real Fourier transform to obtain the first sound wave pulse signature.

[0157] In order to improve the resolution of the complex spectrum, the spline interpolation method can be used to insert more complex numbers in the complex spectrum (interpolate the real part and the imaginary part respectively). The embodiment of the present application does not limit the specific number of complex numbers inserted. Optionally, the cubic spline interpolation method is used to interpolate 5 complex numbers to obtain 17 complex numbers. The complex spectrum is subjected to an inverse real Fourier transform, and 32 real numbers are obtained from the 17 complex numbers, which is the first acoustic wave pulse feature. (In the real Fourier transform, N real numbers will obtain N complex numbers, but the last N / 2-1 complex numbers of the N complex numbers are symmetrical with the first N / 2 complex numbers. Therefore, the symmetrical complex part will be omitted in both conventional RFFT and IRFFT transforms, that is, N real numbers obtain N / 2+1 complex numbers, and N / 2+1 complex numbers obtain N real numbers).

[0158] In an embodiment of the present application, after receiving sound waves of multiple frequency bands, the sound wave parameters based on the sound waves of the multiple frequency bands can be immediately executed to generate the first sound wave pulse characteristics of the corresponding arrival time. Alternatively, after receiving the sound waves of multiple frequency bands of direct, early reflected and post-reflected, fusion processing can be performed together. For example, the sound receiver splices the obtained multiple complex numbers (sound wave parameters of direct, early reflected and post-reflected sound waves) in order from low to high frequency to obtain a complex spectrum (because the complex spectrum contains multiple complex numbers, it is not necessary to use the spline interpolation method to insert more complex numbers), and performs an inverse real Fourier transform on the complex spectrum to obtain multiple real numbers. Since the inverse real Fourier transform converts the sound wave signal from the frequency domain to the time domain, the multiple real numbers obtained correspond to time information. Based on the time information corresponding to the multiple real numbers, it can be determined which are the real numbers corresponding to the direct wave, which are the real numbers corresponding to the early reflected wave, and which are the real numbers corresponding to the post-reflected wave.

[0159] 206. The computer device generates a pulse feedback sequence of the spatial model based on the first sound wave pulse characteristics corresponding to each arrival time.

[0160] Among them, when the computer device generates a pulse feedback sequence of the spatial model based on the first acoustic wave pulse characteristics corresponding to each arrival time, the first acoustic wave pulse characteristics can be directly written into the pulse feedback sequence, or the first acoustic wave pulse characteristics can be processed and then written into the pulse feedback sequence. This embodiment of the present application does not limit this.

[0161] In some embodiments, during propagation, sound waves not only experience losses due to reflection but also other random losses. Therefore, to simulate such losses and make the sound wave pulse characteristics more accurate, a computer device generates a pulse feedback sequence for a spatial model based on a first sound wave pulse characteristic corresponding to each arrival time, including: generating a random sequence based on the number of multiple characteristic values ​​in the first sound wave pulse characteristic, the random sequence including the same number of random numbers; performing random loss simulation on the first sound wave pulse characteristic based on the random sequence to obtain a second sound wave pulse characteristic; and generating a pulse feedback sequence for the spatial model based on the second sound wave pulse characteristic corresponding to each arrival time.

[0162] Optionally, the computer device performs random loss simulation on the first acoustic wave pulse characteristic based on a random sequence to obtain a second acoustic wave pulse characteristic, including: for any characteristic value in the first acoustic wave pulse characteristic, multiplying the characteristic value with a random number of the same arrangement position in the random sequence, and using the product as the characteristic value in the second acoustic wave pulse characteristic.

[0163] Optionally, the computer device generates a random sequence based on the number of multiple eigenvalues ​​in the first acoustic pulse feature, including: generating a first sequence based on the number of multiple eigenvalues ​​in the first acoustic pulse feature, the first sequence including the same number of elements, each element having a value of 1; starting from the second element, determining a random number in the range of 0 to 1.0 for each element, if the determined random number is greater than the first threshold, the current element is kept unchanged, if the determined random number is not greater than the first threshold, the value of the current element is changed to 0, until a random number is determined for the last element, and the last element is updated based on the determined random number to obtain a random sequence. Among them, the first threshold can be any value in the range of 0 to 1.0, and the embodiment of the present application does not limit the first threshold. Optionally, the first threshold is 0.5. Setting the first threshold to 0.5 can make the probability of the element being 1.0 or 0 as equal as possible, thereby achieving a better random loss simulation effect.

[0164] For example, the first sound wave pulse feature includes 8 real numbers, so a sequence containing 8 1.0s is generated: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0], and starting from the second 1.0, a random number is determined for each 1.0. If the determined random number is greater than 0.5, 1.0 is kept unchanged. If the determined random number is not greater than 0.5, 1.0 is updated to 0. Finally, the random sequence is as follows: [1.0, 0, 1.0, 1.0, 0, 0, 1.0, 1.0].

[0165] In some embodiments, the human ear can usually hear direct and early reflected sound waves, but the human ear can only distinguish the total length of the post-reflection time due to the weak sound waves of the post-reflection sound waves, but cannot distinguish the individual post-reflection signals. Therefore, random loss simulation can be performed only on the post-reflection sound waves. The computer device generates a pulse feedback sequence of the spatial model based on the first sound wave pulse characteristics corresponding to each arrival time, including: if the sound waves of multiple frequency bands are post-reflected sound waves, the second sound wave pulse characteristics corresponding to the arrival time are added to the pulse feedback sequence based on the arrival time; if the sound waves of multiple frequency bands are direct or early reflected sound waves, the first sound wave pulse characteristics corresponding to the arrival time are directly added to the pulse feedback sequence based on the arrival time.

[0166] It should be noted that sound waves will also be affected by the air during the propagation process. Therefore, in order to more accurately simulate the reverberation effect, the influence of air can also be taken into account. In some embodiments, based on the sound wave parameters and arrival times of the direct, early reflected and post-reflected sound waves of multiple frequency bands received by the sound receiver, a pulse feedback sequence of the spatial model is generated, including: for the sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, determining at least one of the propagation time of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model and the air temperature of the spatial model; determining the air absorption parameter based on at least one of the propagation time of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model and the air temperature of the spatial model; using the air absorption parameter, updating the sound wave parameters of the sound waves of the multiple frequency bands to obtain updated sound wave parameters; generating the pulse feedback sequence of the spatial model based on the updated sound wave parameters and arrival time.

[0167] Among them, the computer equipment uses air absorption parameters. When updating the sound wave parameters, the sound wave parameters can be directly adjusted, and a first sound wave pulse sequence is generated based on the adjusted sound wave parameters, and a pulse feedback sequence of the spatial model is generated based on the first sound wave pulse; or the first sound wave pulse can be first generated based on the sound wave parameters, and then the first sound wave pulse is adjusted to obtain a third sound wave pulse, and a pulse feedback sequence of the spatial model is generated based on the third sound wave pulse. The embodiments of the present application do not limit this.

[0168] For example, after the computer device generates the first sound wave pulse characteristic, the influence of the air on the sound wave is applied to the first sound wave pulse characteristic, that is, U*(10^(-A / 20)) is calculated, where U represents the first sound wave pulse characteristic, A represents the air absorption parameter, * represents linear multiplication, ^ represents power operation, -A represents taking the negative of A, and / represents linear division. If the post-reflected sound wave is included, the characteristic value corresponding to the post-reflected sound wave is operated with the random sequence, and then added to the sound wave pulse feedback sequence.

[0169] The pulse feedback sequence generation method for the spatial model provided in the embodiment of the present application takes into account that sound waves in different frequency bands are affected differently by reflection. Therefore, the embodiment of the present application will obtain the reflection parameters of obstacles on sound waves in different frequency bands, and divide the sound waves output by the sound source into multiple frequency bands. In the process of tracking the sound waves, the sound wave parameters of the sound waves in different frequency bands are updated based on the reflection parameters of obstacles on sound waves in different frequency bands, so that the calculated sound wave parameters of the sound waves in multiple frequency bands received by the sound receiver are more accurate, and the generated pulse feedback sequence is also more accurate, thereby improving the accuracy of the pulse feedback sequence. The subsequent use of the pulse feedback sequence to add reverberation effect can improve the realism of the reverberation.

[0170] Moreover, the method provided in the embodiment of the present application, when calculating the influence of reflection on sound waves, not only takes into account the influence on sound pressure, but also takes into account the influence on phase. It can more accurately calculate the sound wave parameters of the sound waves received by the microphone, and thus obtain a more accurate pulse feedback sequence. The subsequent use of this pulse feedback sequence to add reverberation effects can improve the realism of the reverberation.

[0171] Furthermore, the embodiments of the present application also take into account that the human ear can usually hear direct and early-reflected sound waves, but because the back-reflected sound waves are weaker, the human ear can only distinguish the total length of the back-reflection, but cannot distinguish individual back-reflected signals. Therefore, random loss simulation is performed on the acoustic pulse characteristics of the back-reflected sound waves, making the processed acoustic pulse characteristics more consistent with the real situation. The generated pulse feedback sequence is also more accurate, improving the accuracy of the pulse feedback sequence. Subsequent use of this pulse feedback sequence to add reverberation effects can improve the realism of the reverberation.

[0172] It should be noted that the embodiments of this application are only based on Figure 2 The illustrated embodiment provides an exemplary description of a method for generating a pulse feedback sequence for a spatial model. In other embodiments, the computer device may not divide the sound wave into multiple frequency bands, but may instead track a complete sound wave. When calculating the effect of reflection on the sound wave, the reflection parameters and sound wave parameters in the embodiment of the present application may be used to consider the effect of reflection on the sound pressure and phase of the sound wave, thereby calculating more accurate sound wave parameters. Alternatively, when generating a pulse feedback sequence based on the sound wave parameters obtained by the sound receiver, a random sequence may be introduced to simulate random losses. In other words, the three schemes of dividing the sound wave into multiple frequency bands for separate processing, considering the effect of reflection on sound pressure and phase, and simulating random losses in the embodiment of the present application may be selected one by one or a combination of multiple schemes, and the embodiment of the present application does not limit this.

[0173] Figure 3 This is a schematic diagram of the structure of a pulse feedback sequence generating device for a spatial model provided in an embodiment of the present application. Figure 3 As shown, the device includes:

[0174] Parameter acquisition module 301, used to obtain reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands. The reflection parameters of obstacles for sound waves of any frequency band are used to represent the impact of sound waves of the frequency band on the sound waves of the frequency band when they are reflected by the obstacle.

[0175] The parameter acquisition module 301 is further configured to acquire sound wave parameters of a first sound wave output by a sound source in the spatial model, wherein the first sound wave includes sound waves of multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of sound waves of multiple frequency bands;

[0176] An updating module 302 is configured to perform same-path acoustic wave tracking on sound waves of multiple frequency bands in the spatial model. During the acoustic wave tracking process, if the sound waves of the multiple frequency bands are reflected by an obstacle, the acoustic wave parameters of the sound waves of the multiple frequency bands are updated based on the reflection parameters of the obstacle for the sound waves of the multiple frequency bands. In the same-path acoustic wave tracking, the tracking paths of the multiple frequency bands are the same.

[0177] The recording module 303 is configured to record the current sound wave parameters and arrival time of the sound waves of the multiple frequency bands when the sound waves of the multiple frequency bands arrive at the sound receiver in the space model;

[0178] The generation module 304 is used to generate a pulse feedback sequence of the space model based on the sound wave parameters and arrival time of the direct, early reflected and post-reflected sound waves in multiple frequency bands received by the sound receiver. The pulse feedback sequence is used to simulate the sound reverberation effect of the space model.

[0179] In one possible implementation, reflection parameters of an obstacle for sound waves in any frequency band are used to represent the effect of the sound waves in the frequency band on the sound pressure and phase of the sound waves in the frequency band after being reflected by the obstacle; the sound wave parameters are used to represent the sound pressure and phase of the sound waves; and the updating module 302 is used to adjust the sound pressure and phase of the sound waves in the frequency band based on the reflection parameters of the obstacle for the frequency band to obtain updated sound pressure and phase.

[0180] In one possible implementation, the sound wave parameters are represented by complex numbers, and the sound wave parameters are represented as SIG(N)=[real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], where SIG(N) represents the sound wave parameters of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, the initial energy is used to represent the sound pressure, 0 represents the initial phase of the sound wave, COS is the cosine function, and SIN is the sine function;

[0181] The reflection parameter is expressed as a complex number, which is expressed as: REF(N) = [real part: R N *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R N P represents the effect of the sound pressure of the Nth frequency band sound wave after it is reflected by an obstacle on the sound pressure of the Nth frequency band sound wave. N It represents the effect of the sound wave of the Nth frequency band on the phase of the sound wave of the Nth frequency band after being reflected by an obstacle. COS is the cosine function and SIN is the sine function.

[0182] In a possible implementation, the updating module 302 is configured to multiply the reflection parameter of the obstacle to the frequency band by the sound wave parameter of the sound wave in the frequency band as the updated sound wave parameter, and the updated sound wave parameter is used to represent the updated sound pressure and phase.

[0183] like Figure 4 As shown, in a possible implementation, the generating module 304 includes:

[0184] A fusion unit 3041 is configured to fuse the acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain a first acoustic wave pulse feature corresponding to the arrival time;

[0185] The generating unit 3042 is configured to generate a pulse feedback sequence of the spatial model based on the first acoustic wave pulse feature corresponding to each arrival time.

[0186] In one possible implementation, the acoustic wave pulse characteristic includes multiple characteristic values; the generation unit 3042 is used to generate a random sequence based on the number of multiple characteristic values ​​in the first acoustic wave pulse characteristic, and the random sequence includes the same number of random numbers; based on the random sequence, a random loss simulation is performed on the first acoustic wave pulse characteristic to obtain a second acoustic wave pulse characteristic; based on the second acoustic wave pulse characteristic corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

[0187] In one possible implementation, the generation unit 3042 is used to add the second sound wave pulse characteristics corresponding to the arrival time to the pulse feedback sequence based on the arrival time if the sound waves of multiple frequency bands are post-reflected sound waves; if the sound waves of multiple frequency bands are direct or early-reflected sound waves, then the generation unit 3042 is used to directly add the first sound wave pulse characteristics corresponding to the arrival time to the pulse feedback sequence based on the arrival time.

[0188] In one possible implementation, the generating unit 3042 is configured to multiply any characteristic value in the first acoustic pulse characteristic by a random number of the same order in the random sequence, and use the product as the characteristic value in the second acoustic pulse characteristic.

[0189] In a possible implementation, the fusion unit 3041 is configured to generate a spectrum based on acoustic wave parameters of multiple frequency bands; and perform an inverse Fourier transform on the spectrum to obtain a first acoustic wave pulse feature corresponding to an arrival time.

[0190] In one possible implementation, the sound wave parameters are represented by complex numbers; the fusion unit 3041 is used to splice the sound wave parameters of sound waves in multiple frequency bands in order of frequency to obtain a complex spectrum; the complex spectrum is inversely transformed into a real Fourier transform to obtain a first sound wave pulse feature corresponding to the arrival time, and the first sound wave pulse feature includes multiple eigenvalues, and any eigenvalue is a real number.

[0191] In one possible implementation, the generation module 304 is used to determine, for sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, at least one of the propagation time of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model, and the air temperature of the spatial model; determine air absorption parameters based on at least one of the propagation time of the sound waves of the multiple frequency bands in the spatial model, the air humidity of the spatial model, and the air temperature of the spatial model; use the air absorption parameters to update the sound wave parameters of the sound waves of the multiple frequency bands to obtain updated sound wave parameters; and generate a pulse feedback sequence of the spatial model based on the updated sound wave parameters and the arrival time.

[0192] In one possible implementation, the recording module 303 is used to determine the arrival time of the sound waves of multiple frequency bands based on the propagation paths of the sound waves of multiple frequency bands in the spatial model when the sound waves of multiple frequency bands reach the sound receiver in the spatial model; and record the current sound wave parameters and arrival time of the sound waves of multiple frequency bands.

[0193] It should be noted that the pulse feedback sequence generation for a spatial model provided in the above-mentioned embodiments is illustrated only by the division of the aforementioned functional modules. In actual applications, the aforementioned functions can be assigned to different functional modules as needed, i.e., the internal structure of a computer device can be divided into different functional modules to perform all or part of the functions described above. Furthermore, the pulse feedback sequence generation apparatus for a spatial model provided in the above-mentioned embodiments and the pulse feedback sequence generation method for a spatial model are based on the same concept. The specific implementation process is detailed in the method embodiments and will not be further described here.

[0194] In some embodiments, the computer device is provided as a terminal. Figure 5 This is a block diagram of a terminal provided by an embodiment of the present application. The terminal 500 includes: a processor 501 and a memory 502.

[0195] The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 501 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 501 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0196] Memory 502 may include one or more computer-readable storage media, which may be non-transitory. Memory 502 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in memory 502 is used to store at least one program code, which is executed by processor 501 to implement the pulse feedback sequence generation method for a spatial model provided in the method embodiment of the present application.

[0197] In some embodiments, terminal 500 may optionally include a peripheral device interface 503 and at least one peripheral device. Processor 501, memory 502, and peripheral device interface 503 may be connected via a bus or signal lines. Each peripheral device may be connected to peripheral device interface 503 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 504, a display screen 505, a camera 506, an audio circuit 507, a positioning component 508, and a power supply 509.

[0198] The peripheral device interface 503 can be used to connect at least one I / O (Input / Output)-related peripheral device to the processor 501 and the memory 502. In some embodiments, the processor 501, the memory 502, and the peripheral device interface 503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 501, the memory 502, and the peripheral device interface 503 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0199] Display screen 505 is used to display a user interface (UI). This UI may include graphics, text, icons, videos, or any combination thereof. When display screen 505 is a touchscreen display, it is also capable of collecting touch signals on or above the surface of display screen 505. These touch signals can be input as control signals to processor 501 for processing. In this case, display screen 505 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there can be a single display screen 505, located on the front panel of terminal 500. In other embodiments, there can be at least two display screens 505, located on different surfaces of terminal 500 or in a foldable design. In still other embodiments, display screen 505 can be a flexible display screen, located on a curved or foldable surface of terminal 500. Furthermore, display screen 505 can be configured as a non-rectangular, irregular shape, i.e., a special-shaped screen. Display screen 505 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0200] Power supply 509 is used to power various components in terminal 500. Power supply 509 can be AC ​​power, DC power, disposable batteries, or rechargeable batteries. When power supply 509 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0201] Those skilled in the art will understand that Figure 5 The structure shown in the figure does not constitute a limitation on the terminal 500, and the terminal 500 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0202] In some embodiments, the computer device is provided as a server. Figure 66 is a schematic diagram of the structure of a server provided in an embodiment of the present application. The server 600 may vary significantly due to different configurations or performances, and may include one or more processors (Central Processing Units, CPUs) 601 and one or more memories 602, wherein the memories 602 store at least one program code, which is loaded and executed by the processor 601 to implement the methods provided in the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be described in detail here.

[0203] The server 600 is used to execute the steps executed by the server in the above method embodiment.

[0204] An embodiment of the present application also provides a computer-readable storage medium, which stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the voice wake-up test method as described in any of the above implementations.

[0205] An embodiment of the present application also provides a computer program product, which includes at least one program code, and the at least one program code is loaded and executed by a processor to implement the voice wake-up test method as described in any of the above implementations.

[0206] In some embodiments, the computer program involved in the embodiments of the present application may be deployed and executed on a computer device, or on multiple computer devices located at one location, or on multiple computer devices distributed at multiple locations and interconnected through a communication network. Multiple computer devices distributed at multiple locations and interconnected through a communication network may constitute a blockchain system.

[0207] The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A method for generating a pulse feedback sequence of a spatial model, characterized in that: The method comprises: Obtaining reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands, where the reflection parameters of the obstacles for sound waves of any frequency band represent the effect of the sound waves of the frequency band on the sound waves of the frequency band when reflected by the obstacle; Acquire sound wave parameters of a first sound wave output by a sound source in the spatial model, where the first sound wave includes sound waves in the multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of the sound waves in the multiple frequency bands; In the spatial model, same-path acoustic wave tracing is performed on the sound waves of the multiple frequency bands respectively. During the acoustic wave tracing process, if the sound waves of the multiple frequency bands are reflected by the obstacle, the acoustic wave parameters of the sound waves of the multiple frequency bands are updated respectively based on the reflection parameters of the obstacle for the sound waves of the multiple frequency bands, wherein the tracing paths of the multiple frequency bands under the same-path acoustic wave tracing are the same; When the sound waves of the multiple frequency bands reach the sound receiver in the space model, recording current sound wave parameters and arrival times of the sound waves of the multiple frequency bands; Based on the sound wave parameters and arrival times of the direct, early reflected and post-reflected sound waves of the multiple frequency bands received by the sound receiver, a pulse feedback sequence of the space model is generated, and the pulse feedback sequence is used to simulate the sound reverberation effect of the space model.

2. The method according to claim 1, characterized in that The reflection parameters of the obstacle for the sound waves of any frequency band are used to represent the influence of the sound waves of the frequency band on the sound pressure and phase of the sound waves of the frequency band after being reflected by the obstacle; the sound wave parameters are used to represent the sound pressure and phase of the sound waves; The updating of the sound wave parameters of the sound waves in the multiple frequency bands based on the reflection parameters of the obstacles for the sound waves in the multiple frequency bands respectively includes: For sound waves in any frequency band, the sound pressure and phase of the sound waves in the frequency band are adjusted based on the reflection parameters of the obstacle on the sound waves in the frequency band to obtain updated sound pressure and phase.

3. The method according to claim 2, characterized in that The acoustic wave parameters are represented by complex numbers, and the acoustic wave parameters are represented as SIG(N)=[real part: 1.0*COS(0), imaginary part: 1.0*SIN(0)], wherein SIG(N) represents the acoustic wave parameters of the sound wave in the Nth frequency band, 1.0 represents the initial energy of the sound wave, and the initial energy is used to represent the sound pressure, 0 represents the initial phase of the sound wave, COS is the cosine function, and SIN is the sine function; The reflection parameter is represented by a complex number, and is represented by: REF(N)=[real part: R N *COS(P N ), imaginary part: R N *SIN(P N )]; where REF is the reflection parameter, N represents the Nth frequency band, N is any positive integer, REF(N) represents the reflection parameter of the obstacle for the sound wave of the Nth frequency band, R N represents the effect of the sound wave of the Nth frequency band on the sound pressure of the sound wave of the Nth frequency band after being reflected by the obstacle, P N It represents the influence of the sound wave in the Nth frequency band on the phase of the sound wave in the Nth frequency band after being reflected by the obstacle. COS is the cosine function and SIN is the sine function.

4. The method according to claim 2 or 3, characterized in that The adjusting the sound pressure and phase of the sound waves in the frequency band based on the reflection parameters of the sound waves in the frequency band by the obstacle to obtain updated sound pressure and phase includes: The product of the reflection parameter of the obstacle to the sound wave in the frequency band and the sound wave parameter of the sound wave in the frequency band is used as the updated sound wave parameter, and the updated sound wave parameter is used to represent the updated sound pressure and phase.

5. The method according to claim 1, wherein The step of generating a pulse feedback sequence of the spatial model based on the sound wave parameters and arrival times of the direct, early reflected, and post-reflected sound waves of the multiple frequency bands received by the sound receiver comprises: fusing the acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain a first acoustic wave pulse feature corresponding to the arrival time; Based on the first acoustic wave pulse characteristics corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

6. The method according to claim 5, characterized in that The acoustic pulse characteristics include a plurality of characteristic values; The step of generating a pulse feedback sequence of the spatial model based on the first acoustic wave pulse feature corresponding to each arrival time includes: generating a random sequence based on the number of multiple characteristic values ​​in the first acoustic wave pulse characteristic, wherein the random sequence includes the same number of random numbers; Based on the random sequence, performing random loss simulation on the first acoustic wave pulse characteristic to obtain a second acoustic wave pulse characteristic; Based on the second acoustic wave pulse characteristics corresponding to each arrival time, a pulse feedback sequence of the spatial model is generated.

7. The method according to claim 6, characterized in that The step of generating a pulse feedback sequence of the spatial model based on the first acoustic wave pulse feature corresponding to each arrival time includes: If the sound waves of the multiple frequency bands are back-reflected sound waves, using the arrival time as a scale, adding the second sound wave pulse feature corresponding to the arrival time to the pulse feedback sequence; If the sound waves of the multiple frequency bands are direct or early reflected sound waves, the first sound wave pulse feature corresponding to the arrival time is directly added to the pulse feedback sequence based on the arrival time.

8. The method according to claim 6, characterized in that The step of performing random loss simulation on the first acoustic wave pulse characteristic based on the random sequence to obtain a second acoustic wave pulse characteristic includes: For any characteristic value in the first acoustic wave pulse characteristic, the characteristic value is multiplied by a random number of the same arrangement position in the random sequence, and the product is used as the characteristic value in the second acoustic wave pulse characteristic.

9. The method according to claim 5, characterized in that The fusing of the acoustic wave parameters of the acoustic waves of multiple frequency bands arriving at the sound receiver at the same arrival time to obtain the first acoustic wave pulse feature corresponding to the arrival time includes: generating a frequency spectrum based on the sound wave parameters of the sound waves in the plurality of frequency bands; Perform an inverse Fourier transform on the frequency spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time.

10. The method according to claim 9, characterized in that The sound wave parameters are represented by complex numbers; and the sound wave parameters based on the sound waves of the multiple frequency bands are used to generate a spectrum, including: splicing the sound wave parameters of the sound waves in the multiple frequency bands in order of frequency to obtain a complex spectrum; The performing an inverse Fourier transform on the spectrum to obtain the first acoustic wave pulse feature corresponding to the arrival time includes: Perform an inverse real Fourier transform on the complex spectrum to obtain a first acoustic wave pulse feature corresponding to the arrival time, wherein the first acoustic wave pulse feature includes multiple eigenvalues, and any eigenvalue is a real number.

11. The method according to any one of claims 1 to 10, characterized in that The step of generating a pulse feedback sequence of the spatial model based on the sound wave parameters and arrival times of the direct, early reflected, and post-reflected sound waves of the multiple frequency bands received by the sound receiver comprises: For sound waves of multiple frequency bands arriving at the sound receiver at the same arrival time, determining at least one of propagation time of the sound waves of the multiple frequency bands in the space model, air humidity of the space model, and air temperature of the space model; determining an air absorption parameter based on at least one of propagation time of the sound waves of the multiple frequency bands in the space model, air humidity of the space model, and air temperature of the space model; Using the air absorption parameters, updating the sound wave parameters of the sound waves in the multiple frequency bands to obtain updated sound wave parameters; A pulse feedback sequence of the spatial model is generated based on the updated acoustic wave parameters and the arrival time.

12. The method according to claim 1, characterized in that When the sound waves in the multiple frequency bands reach the sound receiver in the space model, recording current sound wave parameters and arrival times of the sound waves in the multiple frequency bands includes: When the sound waves of the multiple frequency bands reach the sound receiver in the space model, determining arrival times of the sound waves of the multiple frequency bands based on propagation paths of the sound waves of the multiple frequency bands in the space model; The current sound wave parameters and arrival times of the sound waves in the multiple frequency bands are recorded.

13. A pulse feedback sequence generating device for a spatial model, characterized in that: The device comprises: a parameter acquisition module, configured to acquire reflection parameters of obstacles in the spatial model for sound waves of multiple frequency bands, wherein the reflection parameters of obstacles for sound waves of any frequency band represent the effect of the sound waves of the frequency band on the sound waves of the frequency band when reflected by the obstacle; The parameter acquisition module is further configured to acquire sound wave parameters of a first sound wave output by a sound source in the spatial model, wherein the first sound wave includes sound waves in the multiple frequency bands, and the sound wave parameters of the first sound wave include sound wave parameters of the sound waves in the multiple frequency bands; an updating module, configured to perform same-path acoustic wave tracking on the sound waves of the multiple frequency bands in the spatial model, and update the acoustic wave parameters of the sound waves of the multiple frequency bands based on the reflection parameters of the sound waves of the multiple frequency bands by the obstacle if the sound waves of the multiple frequency bands are reflected by the obstacle, wherein the tracking paths of the multiple frequency bands in the same-path acoustic wave tracking are the same; a recording module, configured to record current sound wave parameters and arrival times of the sound waves in the multiple frequency bands when the sound waves in the multiple frequency bands arrive at the sound receiver in the space model; A generation module is used to generate a pulse feedback sequence of the spatial model based on the sound wave parameters and arrival time of the direct, early reflected and post-reflected sound waves of the multiple frequency bands received by the sound receiver, and the pulse feedback sequence is used to simulate the sound reverberation effect of the spatial model.

14. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the pulse feedback sequence generation method for the spatial model according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the pulse feedback sequence generation method for the spatial model according to any one of claims 1 to 12.

Images