Method for generating surround sound, computer device and computer storage medium

Abstract

Embodiments of the present application disclose a surround sound generation method, a computer device and a computer storage medium. The computer device acquires sound source signals of multiple channels of original audio, adjusts the sound source signals of the multiple channels in orientation, so that the sound source signals of each channel of the multiple channels are distributed in a preset orientation, adds spatial acoustic characteristics to the sound source signals of each channel, performs binaural rendering on the sound source signals of each channel which have been adjusted in orientation and have added the spatial acoustic characteristics to obtain rendering signals, and adds the rendering signals of the multiple channels to obtain a stereo signal output. Since the multiple sound source signals of the original audio are constructed and the modulation orientations of each sound source signal are different from each other, the clarity of the audio can be ensured when the audio is output, and the sound source signals are binaurally rendered according to the spatial acoustic characteristics, so that the spatial surround effect of the audio is improved, the original tone of the audio is not changed, and the fidelity is higher.

Description

Technical Field

[0001] This application relates to the field of audio processing, specifically to a method for generating surround sound effects, a computer device, and a computer storage medium. Background Technology

[0002] Existing surround enhancement technology directly applies reverberation to stereo signals. The reverberators used in this technology include artificial reverberation and impulse reverberation. They directly apply reverberation to the left and right channel signals of the input stereo song separately, or apply stereo reverberation to the stereo signal.

[0003] However, this technique reduces the clarity of the original signal because it generates the same sound source information at different times, which is a common problem with reverb processors. Furthermore, both artificial reverb and impulse reverb utilize multipath effects to simulate the coloration of a sound source within a room. Multipath effects, in fact, alter the original timbre, resulting in a change in the timbre of the processed song. Summary of the Invention

[0004] This application provides a method for generating surround sound effects, a computer device, and a computer storage medium, which are used to achieve surround sound effects for audio while ensuring the clarity of the audio and not changing the original timbre of the audio.

[0005] The first aspect of this application provides a method for generating surround sound effects, the method comprising:

[0006] The sound source signals of multiple channels are determined based on the original audio.

[0007] The orientation of the sound source signals of the multiple channels is adjusted so that the sound source signals of each channel are distributed in a preset orientation.

[0008] Determine the spatial acoustic characteristics and superimpose them onto the sound source signal of each channel;

[0009] The sound source signal, which has been azimuth modulated and superimposed with the spatial acoustic characteristics of each channel, is rendered by binaural rendering to obtain the rendering signal of each channel.

[0010] The rendering signals from multiple channels are superimposed into a stereo signal, and the stereo signal is output.

[0011] A second aspect of this application provides a computer device, the computer device comprising:

[0012] The determination unit is used to determine the sound source signals of multiple channels based on the original audio.

[0013] A modulation unit is used to adjust the orientation of the sound source signals of the multiple channels so that the sound source signal of each channel of the multiple channels is distributed in a preset orientation.

[0014] A processing unit is used to determine spatial acoustic characteristics and superimpose the spatial acoustic characteristics onto the sound source signal of each channel;

[0015] The rendering unit is used to perform binaural rendering on the sound source signal of each channel, which has been azimuthally modulated and superimposed with the spatial acoustic characteristics, to obtain the rendering signal of each channel.

[0016] The output unit is used to superimpose the rendering signals from multiple channels into a stereo signal and output the stereo signal.

[0017] A third aspect of this application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the method of the first aspect described above.

[0018] A fourth aspect of this application provides a computer storage medium storing instructions that, when executed on a computer, cause the computer to perform the method described in the first aspect.

[0019] A fifth aspect of this application provides a computer program product that, when run on a computer device, causes the computer device to perform the method described in the first aspect.

[0020] As can be seen from the above technical solutions, the embodiments of this application have the following advantages:

[0021] The computer device acquires sound source signals from multiple channels of the original audio and adjusts the orientation of these signals so that each channel's signal is distributed in a preset orientation. Spatial acoustic characteristics are then superimposed on each channel's signal. This directionally modulated and spatially acoustically superimposed signal is then subjected to binaural rendering to obtain a rendered signal. Finally, the rendered signals from multiple channels are superimposed to form a stereo signal for output. Because multiple sound source signals are constructed from the original audio, and the modulation orientation of each signal is different, audio clarity is ensured during output. Furthermore, binaural rendering of the sound source signals based on spatial acoustic characteristics enhances the spatial surround effect while avoiding alteration of the original timbre, resulting in higher fidelity. Attached Figure Description

[0022] Figure 1 This is a schematic diagram of the network framework in an embodiment of this application;

[0023] Figure 2This is a flowchart illustrating the method for generating surround sound effects in an embodiment of this application.

[0024] Figure 3 This is another flowchart illustrating the method for generating surround sound effects in this application embodiment;

[0025] Figure 4 This is an exemplary schematic diagram illustrating the modulation orientation of each sound source signal in an embodiment of this application;

[0026] Figure 5 This is a schematic diagram of a computer device in an embodiment of this application. Detailed Implementation

[0027] This application provides a method for generating surround sound effects, a computer device, and a computer storage medium, which are used to achieve surround sound effects for audio while ensuring the clarity of the audio and not changing the original timbre of the audio.

[0028] For details of the system framework used in this embodiment, please refer to [link / reference needed]. Figure 1 As shown, it may specifically include: a computer device 01 and a number of audio playback devices 02 that establish a communication connection with the computer device 01. The audio playback devices 02 may include speakers (such as home theater systems), headphones, user terminals, etc.; the computer device 01 may be a PC, a server, or a terminal device (such as a smartphone), etc.

[0029] For example, one application scenario of this application embodiment is that a user uses a smartphone and headphones connected to the smartphone to listen to songs, watch videos, or other audio files. For instance, when listening to music, the user can input an audio surround effect setting command into the smartphone, and the smartphone will then set the surround effect of the song based on the method of this application embodiment and play it through the headphones.

[0030] The following will combine Figure 1 The network framework described herein is used to describe the method for generating surround sound effects in the embodiments of this application:

[0031] Please see Figure 2 One embodiment of the surround sound generation method in this application includes:

[0032] 201. Determine the sound source signals of multiple channels based on the original audio;

[0033] The method of this embodiment can be applied to a computer device, which may be... Figure 1 The computer device in the network framework shown can acquire raw audio and determine the sound source signals of multiple channels corresponding to the raw audio based on the raw audio.

[0034] 202. Adjust the orientation of the sound source signals of the multiple channels so that the sound source signals of each channel are distributed in a preset orientation;

[0035] In this embodiment, the listener's position, i.e., the listening position, can be predetermined. This position can be the center point of the space formed by the audio playback device (such as headphones). Therefore, to achieve a surround sound effect, after acquiring the sound source signal of each channel of the original audio, the sound source signals of multiple channels are directional modulated so that the sound source signal of each channel is distributed in a preset direction. For example, the sound source signals of the multiple channels can be modulated in different directions at the listening position, so that the sound source signals of the multiple channels surround the listening position from multiple directions, forming a surround sound effect.

[0036] 203. Determine the spatial acoustic characteristics and superimpose the spatial acoustic characteristics onto the sound source signal of each channel;

[0037] To further enhance the spatial surround sound effect, computer devices can determine spatial acoustic characteristics and superimpose these characteristics onto the sound source signal of each channel. For example, the computer device determines spatial acoustic characteristics based on a pre-defined listening scenario and superimposes these characteristics onto the sound source signal of each channel. These spatial acoustic characteristics reflect the sound propagation characteristics within a specific spatial range. For example, these spatial acoustic characteristics may include reverberation time, high-frequency attenuation, reverberation bandwidth, and sound propagation characteristics such as early reflections or direct sound.

[0038] 204. Perform binaural rendering on the sound source signal that has been azimuth modulated and superimposed with the spatial acoustic characteristics for each channel to obtain the rendering signal for each channel;

[0039] After superimposing spatial acoustic characteristics, binaural rendering can be performed on the azimuth-modulated sound source signal with the superimposed spatial acoustic characteristics for each channel, resulting in the rendered signal for each channel. Binaural rendering can be performed by applying Head-Related Transfer Function (HRTF) or BRIR convolution processing to the azimuth-modulated sound source signal with the superimposed spatial acoustic characteristics to obtain the binaural rendered signal. Binaural rendering is used to convert the audio signal to be rendered into a binaural signal for playback through headphones.

[0040] 205. Superimpose the rendering signals from multiple channels into a stereo signal and output the stereo signal;

[0041] After obtaining the rendering signal for each channel, the rendering signals of the multiple channels obtained from the original audio can be superimposed into a stereo signal and output. Since the rendering signals of multiple channels are output from different directions and surround the listening position, the playback effect of the original audio can have a spatial surround effect.

[0042] In this embodiment, the computer device acquires sound source signals from multiple channels of the original audio, adjusts the orientation of these signals so that the sound source signals of each channel are distributed in a preset orientation, and superimposes spatial acoustic characteristics onto each channel's sound source signal. The rendered signal is then obtained by binaural rendering of each channel's sound source signal, which has been oriented and superimposed with spatial acoustic characteristics. Finally, the rendered signals from multiple channels are superimposed to form a stereo signal for output. Because multiple sound source signals of the original audio are constructed, and the modulation orientation of each sound source signal is different, the clarity of the audio can be ensured during audio output. Furthermore, binaural rendering of the sound source signals based on spatial acoustic characteristics enhances the spatial surround effect of the audio while avoiding alteration of the original timbre, resulting in higher fidelity.

[0043] The following will be discussed in the preceding text. Figure 2 Based on the illustrated embodiments, embodiments of this application will be described in further detail. Please refer to [link to relevant documentation]. Figure 3 Another embodiment of the surround sound generation method in this application includes:

[0044] 301. Determine the sound source signals of multiple channels based on the original audio;

[0045] In this embodiment, the sound source signals of multiple channels of the original audio are determined based on the original audio. This can be done by the original audio being stereo, thus obtaining the left channel signal and the right channel signal of the original audio. Furthermore, in order to achieve a surround effect of the original audio and make it more stereo, this embodiment also constructs the center signal, surround signal and rear reverberation signal of the original audio based on the left channel signal and the right channel signal.

[0046] Specifically, center left and center right signals can be constructed based on the left and right channel signals, surround left and surround right signals can be constructed based on the left and right channel signals, and rear reverb left and rear reverb right signals can be constructed based on the left and right channel signals.

[0047] One method for constructing the center left signal and the center right signal is to use the product of the left channel signal and the preset weighting factor alpha, and the product of the right channel signal and 1-alpha as the center left signal, where 0 < alpha < 1; and to use the product of the left channel signal and 1-alpha, and the product of the right channel signal and alpha as the center right signal.

[0048] The left and right surround signals can be constructed by taking the ratio of the difference between the left and right channel signals and a preset value as the left surround signal, and taking the ratio of the difference between the right and left channel signals and a preset value as the right surround signal.

[0049] This preset value is used to adjust the energy level of the surround signal; a larger value results in a smaller surround signal energy, and a smaller value results in a larger surround signal energy. This preset value can be any value other than 0 and can be adjusted according to the actual surround effect. For example, if the preset value is 2, the expression for constructing the left and right surround signals can be expressed as:

[0050] LeftSur = (Left - Right) / 2.0;

[0051] RightSur=(Right-Left) / 2.0.

[0052] Left refers to the left channel signal, Right refers to the right channel signal, LeftSur refers to the left surround signal, and RightSur refers to the right surround signal.

[0053] Furthermore, since the surround levels of the original audio differ, the loudness of the extracted left and right surround signals also differs. Therefore, the loudness of the left and right surround signals can be normalized to adjust them to a reasonable range. Thus, the expression for normalizing the left and right surround signals can be expressed as:

[0054] LeftSurNorm=norm(LeftSur);

[0055] RightSurNorm=norm(RightSur).

[0056] Here, LeftSurNorm refers to the normalized left surround signal, RightSurNorm refers to the normalized right surround signal, and the function norm() refers to the loudness normalization function.

[0057] The left and right rear reverb signals can be constructed as follows: A computer device acquires a stereo reverb unit, and a first equalizer and a second equalizer with different parameters. The stereo reverb unit is used to reverb the left channel signal, and the first equalizer is used to process the output of the stereo reverb unit to obtain the left rear reverb signal. Similarly, the stereo reverb unit is used to reverb the right channel signal, and the second equalizer is used to process the output of the stereo reverb unit to obtain the right rear reverb signal. The expressions for constructing the left and right rear reverb signals can be expressed as follows:

[0058] [LeftReverb, RightReverb]=stereoReverb(Left,Right);

[0059] LeftReverb=EQ1(LeftReverb);

[0060] RightReverb=EQ2(RightReverb).

[0061] LeftReverb refers to the left rear reverb signal, and RightReverb refers to the right rear reverb signal. The function stereoReverb() represents a stereo reverb unit, and the functions EQ1 and EQ2 represent the first and second equalizers, respectively. The parameters of the first and second equalizers are different, which can further reduce the correlation between the left and right rear reverb signals, thereby ensuring the width of the rear sound image's sound field.

[0062] This embodiment innovatively considers the construction of rear sound source signals, constructing 100% refracted and reflected signals, and then combining spatial orientation modulation rendering to achieve a rendering effect different from traditional ones. The left and right channel signals of the original audio are generated by a stereo reverberator to obtain a two-channel 100% reverberated wet signal, which can simulate the reflected sound of the room. In the spatial arrangement, the rear reverberation left signal and rear reverberation right signal are placed at the left rear and right rear respectively, thus making the rear sound image in the 360-degree spatial surround more concrete.

[0063] 302. Adjust the orientation of the sound source signals of the multiple channels so that the sound source signals of each channel are distributed in a preset orientation;

[0064] The directional modulation of the sound source signal is key to creating a sense of spatial surround sound. In this embodiment, continuing the standard two-channel listening characteristics, the left and right channel signals are modulated to the left and right front of the listening position, respectively. The center left and center right signals are modulated directly in front of the listening position, located between the positions of the left and right channel signals, to fill the sound image gap between the angles of the left and right channel signals. The surround left and surround right signals are modulated to the left and right sides of the listening position, respectively, to enhance the perception of sound images above the horizontal plane. The rear reverberation left and rear reverberation right signals are modulated to the left and right rear of the listening position, respectively, to simulate the surround reverberation signal after the sound source signal is reflected by the room.

[0065] For example, after obtaining the left channel signal L, the right channel signal R, and constructing the center left signal LeftMid, the center right signal RightMid, the surround left signal LeftSurNorm, the surround right signal RightSurNorm, the rear reverb left signal LeftReverb, and the rear reverb right signal RightReverb in the above steps, each signal can be modulated to its corresponding position, such as... Figure 4 As shown, the left channel signal L and the right channel signal R are modulated to the left front and right front of the listening position, respectively. The center left signal LeftMid and the center right signal RightMid are modulated directly in front of the listening position and located between the positions of the left channel signal L and the right channel signal R. The surround left signal LeftSurNorm and the surround right signal RightSurNorm are modulated to the left and right sides of the listening position, respectively. The rear reverb left signal LeftReverb and the rear reverb right signal RightReverb are modulated to the left rear and right rear of the listening position, respectively.

[0066] 303. Determine the spatial acoustic characteristics and superimpose the spatial acoustic characteristics onto the sound source signal of each channel;

[0067] In this embodiment, the listening scenario can be any audio playback scenario, such as a concert, music festival, or conference. The corresponding room type could be a concert hall, conference room, or similar room type. The room acoustic parameters for the concert hall or conference room can be pre-acquired, and these parameters can be determined according to industry standards. Therefore, the computer device can determine the room acoustic parameters corresponding to a given listening scenario, and then determine the spatial acoustic characteristics based on these parameters. The given listening scenario can be set by user input commands. For example, if a user needs to play a song in a concert scenario, their input command instructs the computer device to render the surround sound effect of the song according to the concert scenario.

[0068] For example, this spatial acoustic characteristic can be reverberation time, and the following is Illing's formula for calculating reverberation time:

[0069]

[0070] Where V represents the room volume and S represents the total surface area. This represents the average sound absorption coefficient of the room. As can be seen from this formula, in a real sound field, sound sources at different locations will have different reverberation times due to their different propagation characteristics in different directions and the varying degrees of sound absorption by building materials at different frequency bands. Therefore, after determining the listening scenario, we can determine the corresponding room (e.g., a concert hall for a concert scenario), and then determine the room's acoustic parameters according to the relevant standards, such as the room volume and total surface area mentioned above. The corresponding reverberation time can then be calculated based on these room acoustic parameters.

[0071] Of course, the above formula is only one of the formulas for calculating reverberation time. In fact, other formulas can also be used to calculate reverberation time, but this embodiment does not limit this.

[0072] After determining the spatial acoustic characteristics corresponding to the listening scenario, these spatial acoustic characteristics can be superimposed onto each sound source signal. For example, when room acoustic parameters such as room size and room decoration materials, as well as spatial acoustic characteristics such as reverberation time, reverberation bandwidth range, and high-frequency attenuation, are known, these parameters can be used to construct an acoustic mathematical model, derive difference equations, and construct filters to achieve a reverberation superposition effect, so that each sound source signal is accompanied by room sound field characteristics.

[0073] Specifically, in a preferred embodiment, the spatial acoustic characteristics are superimposed onto the sound source signal of each channel. One method is to construct an acoustic model based on the wave equation and the spatial acoustic characteristics, determine the room impulse response (RIR) corresponding to the acoustic model, convolve the head-related transfer function (HRTF) with the room impulse response RIR corresponding to the acoustic model to obtain the binaural room impulse response (BRIR), and convolve the binaural room impulse response BRIR at a preset orientation with the sound source signal of each channel to obtain the sound source signal of each channel superimposed with the spatial acoustic characteristics.

[0074] 304. Perform binaural rendering on the sound source signal that has been azimuth modulated and superimposed with the spatial acoustic characteristics for each channel to obtain the rendering signal for each channel;

[0075] In this embodiment, when performing binaural rendering on a sound source signal that has been azimuthally modulated and superimposed with spatial acoustic characteristics, the specific implementation method may be as follows: for the sound source signal of each channel, according to the distance and angle between the azimuth of the sound source signal and the listening position, binaural rendering is performed on the sound source signal that has been azimuthally modulated and superimposed with spatial acoustic characteristics to obtain the rendering signal corresponding to the sound source signal.

[0076] For example, such as Figure 4As shown, for the center left signal LeftMid, the distance between its modulated azimuth and the listening position can be determined, as well as the angle formed by the line connecting the modulated azimuth and the listening position and the horizontal line where the listening position is located. Based on this distance and angle, the center left signal LeftMid, which has been azimuthally modulated and superimposed with spatial acoustic characteristics, is rendered in both ears to obtain the rendered signal corresponding to LeftMid. Similarly, the rendered signals corresponding to each sound source signal can be rendered sequentially.

[0077] Therefore, by rendering the signals from each sound source, acoustic information differences between them can be constructed. This difference in acoustic information is reflected in the human ear's spatial perception of the sound source signals, thereby widening the depth of the sound field and creating a layered surround sound localization effect. The directional modulation of the sound image combined with the rendering of spatial acoustic characteristics allows the hearing of multiple sound sources to simultaneously possess both a sense of direction and space.

[0078] 305. Superimpose the rendering signals from multiple channels into a stereo signal and output the stereo signal;

[0079] After obtaining the rendering signals corresponding to each sound source signal, since each sound source signal has been modulated with the corresponding orientation, the rendering signals of the multiple channels can be superimposed into a stereo signal and output as a stereo signal, thereby producing the surround sound effect of the original audio.

[0080] Specifically, after obtaining the rendered signals of the multiple pairs of sound source signals, for each pair, the rendered signal of the left signal is superimposed with the rendered signal of the right signal. For example, the rendered signal of the center left signal is superimposed with the rendered signal of the center right signal. Then, after processing by an equalizer and a compressor, it is made to achieve the same loudness as the original audio, and then output for playback at the corresponding modulation direction. At the same time, the compressor processing can prevent the final output signal from clipping distortion, signal distortion, etc. due to overload.

[0081] In this embodiment, by constructing a reverberation signal (reflected sound signal) and combining it with spatial orientation modulation and spatial acoustic characteristic rendering, a rear sound image can be simulated, thereby creating a more realistic room sound field characteristic. New center channel, surround, and rear reverberation signals are constructed through signal processing of the left and right channels. Furthermore, a method for rendering spatial acoustic characteristics based on sound source signals with different placements is proposed, thereby establishing a more three-dimensional sense of reverberation difference. A weighting parameter alpha is introduced into the generation of the center channel signal to minimize signal cancellation caused by superposition with the surround signal, further enhancing the spatial surround effect of the original audio.

[0082] Secondly, the method of this embodiment can be executed on a computer device, such as directly processing and generating surround sound effects on a mobile phone. It can directly output and play the processed audio file without the need to generate and store new audio files offline, which greatly improves the user experience. Furthermore, it can generate surround sound effects for all two-channel stereo file formats, making it highly practical.

[0083] The computer device in the embodiments of this application is described below. Please refer to [link / reference]. Figure 5 One embodiment of the computer device in this application includes:

[0084] The computer device 500 may include one or more central processing units (CPUs) 501 and a memory 505, in which one or more applications or data are stored.

[0085] The memory 505 can be volatile or persistent storage. The program stored in the memory 505 can include one or more modules, each module including a series of instruction operations on the computer device. Furthermore, the central processing unit 501 can be configured to communicate with the memory 505 and execute the series of instruction operations stored in the memory 505 on the computer device 500.

[0086] Computer device 500 may also include one or more power supplies 502, one or more wired or wireless network interfaces 503, one or more input / output interfaces 504, and / or one or more operating systems, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0087] The central processing unit 501 can perform the aforementioned... Figures 2 to 3 The specific operations performed by the computer device in the illustrated embodiment will not be described in detail here.

[0088] This application also provides a computer storage medium, one embodiment of which includes: the computer storage medium storing instructions, which, when executed on a computer, cause the computer to perform the aforementioned... Figures 2 to 3 The operations performed by the computer device in the illustrated embodiment.

[0089] This application also provides a computer program product, one embodiment of which includes: when the computer program product is run on a computer device, causing the computer device to perform the aforementioned... Figures 2 to 3 The operations performed by the computer device in the illustrated embodiment.

[0090] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0091] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0092] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0093] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0094] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for generating surround sound effects, characterized in that, The method includes: Identify the sound source signals from multiple channels based on the original audio; The orientation of the sound source signals of the multiple channels is adjusted so that the sound source signals of each channel are distributed in a preset orientation. Determine the spatial acoustic characteristics and superimpose them onto the sound source signal of each channel; The sound source signal, which has been azimuth modulated and superimposed with the spatial acoustic characteristics of each channel, is rendered by binaural rendering to obtain the rendering signal of each channel. The rendering signals from multiple channels are superimposed into a stereo signal, and the stereo signal is output. The superposition of the spatial acoustic characteristics onto the sound source signal of each channel includes: An acoustic model is constructed based on the wave equation and the spatial acoustic characteristics. The room impulse response corresponding to the acoustic model is determined. The head-related transfer function is convolved with the room impulse response corresponding to the acoustic model to obtain the binaural room impulse response. The binaural room impulse response at a preset orientation is convolved with the sound source signal of each channel to obtain the sound source signal superimposed with the spatial acoustic characteristics.

2. The method according to claim 1, characterized in that, The process of determining multiple channels of sound source signals based on the original audio includes: Obtain the left and right channel signals of the original audio; The center signal, surround signal, and rear reverb signal are constructed based on the left channel signal and the right channel signal.

3. The method according to claim 2, characterized in that, The construction of the center signal, surround signal, and rear reverberation signal based on the left channel signal and the right channel signal includes: Construct a center left signal and a center right signal based on the left channel signal and the right channel signal; Construct a surround left signal and a surround right signal based on the left channel signal and the right channel signal; The left and right reverberation signals are constructed based on the left and right channel signals.

4. The method according to claim 3, characterized in that, The step of adjusting the orientation of the sound source signals from the multiple channels includes: The left channel signal and the right channel signal are respectively modulated to the left front and right front of the listening position, which is the listener's position; The center left signal and the center right signal are respectively modulated in front of the listening position and located between the position of the left channel signal and the position of the right channel signal; The left surround signal and the right surround signal are respectively modulated to the left and right sides of the listening position; The left rear reverb signal and the right rear reverb signal are modulated to the left and right rear of the listening position, respectively.

5. The method according to claim 3, characterized in that, The construction of the center left signal and center right signal based on the left channel signal and the right channel signal includes: The product of the left channel signal and the preset weighting factor alpha, and the product of the right channel signal and 1-alpha, are used as the center left signal; where 0 < alpha < 1. The sum of the product of the left channel signal and 1-alpha, and the product of the right channel signal and alpha, is taken as the center right signal.

6. The method according to claim 3, characterized in that, The construction of the surround left signal and surround right signal based on the left channel signal and the right channel signal includes: The ratio of the difference between the left channel signal and the right channel signal to a preset value is used as the surround left signal; The ratio of the difference between the right channel signal and the left channel signal to the preset value is used as the surround right signal.

7. The method according to claim 3, characterized in that, The construction of the left rear reverberation signal and the right rear reverberation signal based on the left channel signal and the right channel signal includes: Obtain a stereo reverb unit, and obtain a first equalizer and a second equalizer with different parameters; The stereo reverberator is used to reverberate the left channel signal, and the first equalizer is used to process the output of the stereo reverberator to obtain the rear reverberated left signal. The stereo reverberator is used to reverberate the right channel signal, and the second equalizer is used to process the output of the stereo reverberator to obtain the rear reverberated right signal.

8. The method according to claim 1, characterized in that, The step of performing binaural rendering on the sound source signal that has been azimuthally modulated and superimposed with the spatial acoustic characteristics for each channel includes: For each of the aforementioned channels, based on the distance and angle between the modulated azimuth of the sound source signal and the listening position, binaural rendering is performed on the sound source signal that has been azimuthally modulated and superimposed with the spatial acoustic characteristics to obtain the rendering signal corresponding to the sound source signal; wherein, the listening position is the position of the listener.

9. The method according to claim 1, characterized in that, The determination of spatial acoustic characteristics includes: Determine the room acoustic parameters corresponding to the listening scenario, and determine the spatial acoustic characteristics based on the room acoustic parameters.

10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 9.

11. A computer storage medium, characterized in that, The computer storage medium stores instructions that, when executed on the computer, cause the computer to perform the method as described in any one of claims 1 to 9.

Images