Method and device for generating surround sound, intelligent terminal and storage medium

Abstract

The application discloses a surround sound generation method and device, an intelligent terminal and a storage medium. The generation method comprises the following steps: acquiring a cross-talk cancellation parameter corresponding to a to-be-processed sound source signal; performing smoothing processing on the cross-talk cancellation parameter to obtain a smoothed cross-talk cancellation parameter; and determining a surround sound source signal corresponding to the to-be-processed sound source signal based on the smoothed cross-talk cancellation parameter and the to-be-processed sound source signal. According to the application, the cross-talk cancellation parameter used for cancelling cross-talk is adjusted smoothly to remove interference points in the cross-talk cancellation parameter, thereby improving the stability of the cross-talk cancellation parameter. Therefore, when the surround sound source signal is determined based on the cross-talk cancellation parameter, the influence of the cross-talk cancellation parameter on the stability of the surround sound source signal can be avoided, and the surround sound source signal with high stability can be obtained.

Description

Technical Field

[0001] This application relates to the field of multimedia technology, and in particular to a method, apparatus, smart terminal, and storage medium for generating surround sound effects. Background Technology

[0002] With the development of science and technology, people's requirements for multimedia playback devices are gradually increasing. For example, for audio playback devices, people hope that they can achieve surround sound. Surround sound, usually compared to two-channel stereo, refers to a playback method where the sound seems to surround the listener. The reproduced sound field produced by this method has a sense of enclosure and expansion. When listening to surround sound, the listener can distinguish sounds from the front, back, left, and right, resulting in a better experience. However, existing terminal devices (TV speakers or external soundbars) generally have two channels, which requires processing the sound source to generate a simulated stereo sound field so that the listener can experience the surround sound effect. However, the surround sound source signals generated by existing simulated stereo sound fields generally suffer from signal instability, thus causing inconvenience to users.

[0003] Therefore, existing technologies still need improvement and development. Summary of the Invention

[0004] The main purpose of this application is to provide a method, apparatus, smart terminal and storage medium for generating surround sound effects, which aims to solve the problem that the crosstalk cancellation parameters calculated in the prior art are unstable, resulting in unstable de-crosstalk filters, which is not conducive to providing users with stable surround sound and improving user experience.

[0005] To achieve the above objectives, the first aspect of this application provides a method for generating surround sound effects, the method comprising:

[0006] Obtain the crosstalk cancellation parameters corresponding to the sound source signal to be processed;

[0007] The crosstalk cancellation parameters are smoothed to obtain smoothed crosstalk cancellation parameters;

[0008] Based on the smooth crosstalk cancellation parameters and the sound source signal to be processed, the surround sound source signal corresponding to the sound source signal to be processed is determined.

[0009] The method for generating surround sound effects, wherein obtaining the crosstalk cancellation parameters corresponding to the sound source signal to be processed specifically includes:

[0010] Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed;

[0011] Based on the location information and the preset location information, the interference surround sound source signal and the desired surround sound source signal corresponding to the sound source signal to be processed are determined.

[0012] Based on the desired surround sound source signal and the interfering surround sound source signal, the crosstalk cancellation parameters corresponding to the sound signal to be processed are determined, wherein the preset position information is the position information of the surround sound source signal relative to the received position information.

[0013] The method for generating surround sound effects, wherein smoothing the crosstalk cancellation parameters to obtain smooth crosstalk cancellation parameters specifically includes:

[0014] Obtain several center frequencies corresponding to the sound source signal to be processed;

[0015] Based on the aforementioned center frequencies, each matrix element in the crosstalk cancellation parameters is smoothed to obtain smoothed crosstalk cancellation parameters.

[0016] The method for generating surround sound effects, wherein obtaining the plurality of center frequencies corresponding to the sound source signal to be processed specifically includes:

[0017] The sound source signal to be processed is divided into several sub-sound source signals;

[0018] For each of the several sub-sound source signals, obtain the frequency value of the center frequency point of each of the several sub-sound source signals to obtain several center frequencies.

[0019] The method for generating surround sound effects, wherein determining the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed specifically includes:

[0020] Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed;

[0021] Based on the location information and the preset location information, the crosstalk surround sound source signal corresponding to the sound source signal to be processed is determined;

[0022] Based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal, the surround sound source signal corresponding to the sound source signal to be processed is determined.

[0023] The method for generating surround sound effects, wherein determining the surround sound source signal corresponding to the sound source signal to be processed, based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal, specifically includes:

[0024] Obtain the target weight value corresponding to each signal frequency point in the crosstalk surround sound source signal, wherein there are at least two signal frequency points in the crosstalk surround sound source signal, and the target weight values ​​corresponding to the two signal frequency points are different.

[0025] Based on the target weights corresponding to each signal frequency point and the smooth crosstalk cancellation parameters, the signal frequencies are adjusted to obtain the surround sound source signal corresponding to the sound source signal to be processed.

[0026] The method for generating surround sound effects, wherein obtaining the target weights corresponding to each signal frequency point in the crosstalk surround sound source signal specifically includes:

[0027] The high-frequency and low-frequency signal points in the crosstalk surround sound source signal are determined based on a preset frequency threshold.

[0028] The first weight is used as the target weight corresponding to each high-frequency parameter signal frequency point, and the second weight is used as the target weight corresponding to each low-frequency signal frequency point, so as to obtain the target weight corresponding to each signal frequency point.

[0029] The second aspect of this embodiment provides a surround sound generation device, the generation device comprising:

[0030] The acquisition module is used to acquire the crosstalk cancellation parameters corresponding to the sound source signal to be processed;

[0031] A smoothing module is used to smooth the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters;

[0032] The determination module is used to determine the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed.

[0033] A third aspect of this application provides a smart terminal, which includes: a memory, a processor, and a virtual surround sound implementation program stored in the memory and executable on the processor. When the virtual surround sound implementation program is executed by the processor, it implements the steps of any of the above-mentioned surround sound effect generation methods.

[0034] A fourth aspect of this application provides a computer-readable storage medium storing a virtual surround sound implementation program, wherein when the virtual surround sound implementation program is executed by a processor, it implements the steps of any of the above-described surround sound effect generation methods.

[0035] As can be seen from the above, this application provides a method, apparatus, smart terminal, and storage medium for generating surround sound effects. The generation method includes: acquiring crosstalk cancellation parameters corresponding to a sound source signal to be processed; smoothing the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters; and determining the surround sound source signal corresponding to the sound source signal to be processed based on the smoothed crosstalk cancellation parameters and the sound source signal to be processed. This application's solution smoothly adjusts the crosstalk cancellation parameters used for crosstalk cancellation to remove interference points in the crosstalk cancellation parameters, improving the stability of the crosstalk cancellation parameters. Therefore, when determining the surround sound source signal based on the crosstalk cancellation parameters, the influence of the crosstalk cancellation parameters on the stability of the surround sound source signal can be avoided, thereby obtaining a highly stable surround sound source signal. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 This is a schematic diagram of a prior art device arrangement for implementing 5.1 channel surround sound, provided in an embodiment of this application.

[0038] Figure 2 This is a flowchart illustrating a method for generating surround sound effects according to an embodiment of this application;

[0039] Figure 3 This is a schematic diagram of the desired surround sound source signal generation process without considering crosstalk, provided in an embodiment of this application.

[0040] Figure 4 This is a schematic diagram of a crosstalk surround sound source signal generation process considering crosstalk, provided in an embodiment of this application.

[0041] Figure 5 This is a schematic diagram of the structure of a surround sound generation device provided in an embodiment of this application;

[0042] Figure 6 This is a block diagram illustrating the internal structure of a smart terminal provided in an embodiment of this application. Detailed Implementation

[0043] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods are omitted so as not to obscure the description of this application with unnecessary detail.

[0044] It should be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0045] It should also be understood that the terminology used in this application specification is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this application specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0046] It should also be further understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0047] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0048] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the same meaning as in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined as herein.

[0049] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0050] Many specific details are set forth in the following description in order to provide a full understanding of this application. However, this application may also be implemented in other ways different from those described herein. Those skilled in the art can make similar extensions without departing from the spirit of this application. Therefore, this application is not limited to the specific embodiments disclosed below.

[0051] With the development of science and technology, people's requirements for multimedia playback devices are gradually increasing. They generally hope that audio playback devices can achieve surround sound, which is typically achieved by setting up multiple playback devices. For example... Figure 1 As shown, the International Telecommunication Union (ITU) recommends that 5.1-channel surround sound requires six playback devices (e.g., speakers). Here, C is the center channel, facing the user; L is the front left channel, 30° to the user's left front; R is the front right channel, 30° to the user's right front; LS is the rear left channel, 30° to the user's left rear; RS is the rear right channel, 30° to the user's right rear; and LFE is the subwoofer, positioned next to the center channel C. However, currently, most playback devices (e.g., TV speakers, external soundbars) have only two channels to achieve a 5.1-channel surround sound effect. Therefore, existing playback devices generally use virtual surround sound technology to achieve multi-channel surround sound, providing a 5.1-channel surround sound effect without adding channels and speakers. However, existing surround sound source signals generated in simulated stereo environments generally suffer from signal instability, causing inconvenience for users. For example, if a certain frequency in the crosstalk cancellation parameter used to generate a simulated stereo sound field is infinite, it can lead to instability in the surround sound source signal.

[0052] To address the aforementioned issues, this application embodiment involves obtaining crosstalk cancellation parameters corresponding to the sound source signal to be processed; smoothing the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters; and determining the surround sound source signal corresponding to the sound source signal to be processed based on the smoothed crosstalk cancellation parameters and the sound source signal to be processed. This application's solution smoothly adjusts the crosstalk cancellation parameters used for crosstalk cancellation to remove interference points, improving the stability of the crosstalk cancellation parameters. Therefore, when determining the surround sound source signal based on the crosstalk cancellation parameters, the influence of the crosstalk cancellation parameters on the stability of the surround sound source signal can be avoided, resulting in a highly stable surround sound source signal.

[0053] The application content will be further explained below with reference to the accompanying drawings and through the description of the embodiments.

[0054] Exemplary methods

[0055] This application provides a method for generating surround sound effects, such as... Figure 2 As shown, the method for generating the surround sound effect includes:

[0056] S10. Obtain the crosstalk cancellation parameters corresponding to the sound source signal to be processed.

[0057] Specifically, the sound source signal to be processed is an audio signal to be played through a playback device, and the crosstalk cancellation parameter is used to eliminate crosstalk generated during the transmission of the sound source signal to be processed, for example, such as... Figure 3 As shown, when a sound source signal is played through a speaker, the speaker is generally in an open sound field. The sound emitted by the left speaker will be heard by the user's right ear, and vice versa. As a result, crosstalk occurs in the sound played by the speaker. The crosstalk cancellation parameter is used to eliminate the crosstalk that occurs when the audio player transmits the audio to the user.

[0058] In one implementation of this embodiment, obtaining the crosstalk cancellation parameters corresponding to the sound source signal to be processed specifically includes:

[0059] S11. Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed;

[0060] S12. Based on the location information and the preset location information, determine the interference surround sound source signal and the desired surround sound source signal corresponding to the sound source signal to be processed;

[0061] S13. Based on the desired surround sound source signal and the interfering surround sound source signal, determine the crosstalk cancellation parameters corresponding to the sound signal to be processed, wherein the preset position information is the position information of the surround sound source signal relative to the received position information.

[0062] Specifically, the playback end of the sound source signal to be processed is used to play the sound source signal, such as a speaker, etc., and the receiving end of the sound source to be processed is used to listen to the sound formed by the sound source signal, such as a microphone, a listener, etc. The position information is used to reflect the relative positions of the playback end and the receiving end, with the receiving end serving as the reference point for the playback end. For example, if the playback end is a speaker and the receiving end is the listener, then the listener is the reference point, and the position information is the position information of the speaker relative to the listener. In one specific implementation, the position information can be the azimuth angle of the playback end relative to the receiving end, used to reflect the direction information of the playback end relative to the receiving end. For example, if the playback end is a speaker and the receiving end is the listener, and the speaker is 30° to the left and in front of the listener, then the position information is 30° to the left and in front.

[0063] The preset position information is pre-set and refers to the position information of the surround sound source signal relative to the received source. In other words, the preset position information is the expected position information of the surround sound source signal relative to the receiving end for the received surround sound effect, reflecting the relative position of the surround sound source signal and the receiving end. The receiving end is the reference point for the surround sound source signal; for example, if the receiving end is the listener, then the listener is the reference point, and the preset position information is the position information of the surround sound source signal relative to the listener. In a specific implementation, the preset position information can be the azimuth angle of the surround sound source signal relative to the receiving end, reflecting the direction information of the surround sound source signal relative to the receiving end. For example, if the receiving end is the listener, and the surround sound source signal is 30° to the right and in front of the listener, then the preset position information is 30° to the right and in front.

[0064] In one implementation of this embodiment, after obtaining the location information and preset location information, the spatial transfer function corresponding to the sound source signal to be processed can be determined based on the preset location information. The spatial transfer function can be a head-related function for a pre-set application scenario (e.g., a room), or it can be obtained through pre-measurement. The spatial transfer function is used to describe the transmission path of the spatial sound source signal to the eardrum, and is also known as the head-related transfer function (HRTF). Therefore, for the same sound source signal, after obtaining the spatial transfer functions corresponding to different spatial locations, the sound effect of the sound source at different locations can be virtually generated based on the spatial transfer functions. For example, when it is necessary to provide 5.1 channel surround sound to the listener, if the location information (target azimuth angle) of each sound source signal in the 5.1 channel to be implemented is known, the surround sound source signal can be generated based on the spatial transfer function corresponding to each location information. In one implementation of this embodiment, the correspondence between the spatial transfer function and the preset location information can be pre-configured. After obtaining the preset location signal, the spatial transfer function corresponding to the preset location information can be determined based on the preset location information and the correspondence between the spatial transfer function and the preset location information. For example, the preset position information is θ, and the corresponding left spatial transfer function is α0(θ,f), and the right spatial transfer function is β0(θ,f).

[0065] The location information is used to determine the crosstalk spatial transfer function of the audio source signal to be processed. After obtaining the location information, the crosstalk spatial transfer function corresponding to the audio source signal to be processed can be determined based on the location information. The correspondence between the crosstalk spatial transfer function and the location information can be pre-configured. After obtaining the location signal, the crosstalk spatial transfer function corresponding to the preset location information can be determined based on the location information and the correspondence between the crosstalk spatial transfer function and the location information. In addition, in this embodiment, the playback end includes two playback ends, referred to as the first playback end and the second playback end, respectively. Then the crosstalk spatial transfer function includes the crosstalk spatial transfer function α1(θ1,f) from the left front playback end with location information θ1 to the listener's left ear and the crosstalk spatial transfer function β1(θ1,f) to the right ear, and the crosstalk spatial transfer function α2(θ2,f) from the right front playback end with location information θ2 to the listener's left ear and the crosstalk spatial transfer function β2(θ2,f) to the right ear. Of course, in practical applications, the playback terminal may also include other numbers of playback terminals, such as 3 or 4, which will not be described in detail here.

[0066] The desired surround sound source signal is a surround sound source signal without considering crosstalk. The desired surround sound source signal can be determined based on the left spatial transfer function α0(θ,f), the right spatial transfer function β0(θ,f), and the sound source signal to be processed. The representation of the surround sound source signal can be as follows:

[0067]

[0068] Where L1 is the sound source signal received by the listener's left ear without considering crosstalk, R1 is the sound source signal received by the listener's right ear without considering crosstalk, E(f) is the sound source signal to be processed, α0(θ,f) is the left spatial transfer function, β0(θ,f) is the right spatial transfer function, and θ is the preset position information.

[0069] For example: Assume E is an omnidirectional point sound source, the preset position signal is angle θ, and the receiver is a pair of headphones for receiving dual-channel signals, such as... Figure 3 As shown, a point sound source E with a preset position signal of θ is processed by the left ear head correlation transfer function α0(θ,f) at angle θ and played to the left ear of the earphone. After being processed by the right ear correlation transfer function β0(θ,f) at angle θ, it is played to the right ear of the earphone. Then the listener can hear a virtual surround sound source at angle θ.

[0070] In the above example, the physical pathways to the left and right ears of the headphones are basically isolated; it is virtually impossible for the left ear to hear a sound from the right ear, and vice versa. However, in actual use, the playback device used to play sound source signals is generally not physically enclosed, but rather has an open sound field, for example, as shown in... Figure 4 As shown, the playback end includes a left speaker and a right speaker. The sound emitted by the left speaker can be heard by the right ear, and vice versa, the sound emitted by the right speaker can be heard by the left ear, thus creating crosstalk. Therefore, when determining the surround sound source signal based on the left spatial transfer function α0(θ,f) and the right spatial transfer function β0(θ,f), the crosstalk signal needs to be considered. In other words, when determining the surround sound source signal based on the left spatial transfer function α0(θ,f) and the right spatial transfer function β0(θ,f), the signal transmitted by the crosstalk spatial transfer function needs to be considered. Therefore, considering crosstalk, the crosstalk surround sound source signal can be expressed as follows:

[0071]

[0072] Where L is the sound source signal received by the listener's left ear considering crosstalk, R is the sound source signal received by the listener's right ear considering crosstalk, E(f) is the sound source signal to be processed, α0(θ,f) is the left spatial transfer function, β0(θ,f) is the right spatial transfer function, θ is the preset position information, α1(θ1,f) is the crosstalk spatial transfer function from the left front playback end of position information θ1 to the listener's left ear, β1(θ1,f) is the crosstalk spatial transfer function from the left front playback end of position information θ1 to the listener's right ear, α2(θ2,f) is the crosstalk spatial transfer function from the left front playback end of position information θ2 to the listener's left ear, and β2(θ2,f) is the crosstalk spatial transfer function from the left front playback end of position information θ2 to the listener's right ear.

[0073] Furthermore, the expression of the crosstalk surrounding sound source signal, considering crosstalk, can be converted into matrix form as follows:

[0074]

[0075] As can be seen from the matrix form of the crosstalk surround sound source signal considering crosstalk, a crosstalk cancellation matrix A can be removed from the crosstalk surround sound source signal considering crosstalk to eliminate the effect of crosstalk. This transforms the expression of the crosstalk surround sound source signal considering crosstalk into the expression of the desired surround sound source signal without considering crosstalk, thereby eliminating crosstalk in the surround sound source signal considering crosstalk.

[0076] Based on this, after obtaining the matrix form of the crosstalk surrounding sound source signal considering crosstalk, the matrix form can be solved to satisfy the following: The crosstalk cancellation matrix A is given, and A is used as the crosstalk cancellation parameter, where A... 11 A 12 A 21 and A 22 These are the matrix elements of the crosstalk cancellation matrix A. Furthermore, when the crosstalk cancellation matrix A is applied to a surround sound source signal considering crosstalk, we can obtain:

[0077]

[0078] In one implementation of this embodiment, when obtaining the crosstalk cancellation matrix, if multiple playback devices are used to simulate multi-source surround sound signals, the matrix expression for the surround sound signal indicates that it is necessary to solve for the inverse of an n*m matrix, where n is the number of rows and m is the number of columns in the crosstalk cancellation matrix A. In this embodiment, considering the case of two sound sources, n = m = 2, the calculation method for the crosstalk cancellation matrix A is as follows:

[0079]

[0080] Using the crosstalk cancellation matrix obtained by the above formula as a crosstalk filter can eliminate crosstalk formed by the target sound source signal during transmission and improve the sound effect of the virtual surround sound source signal.

[0081] S20. The crosstalk cancellation parameters are smoothed to obtain smooth crosstalk cancellation parameters.

[0082] Specifically, the smoothing process is used to remove the instability of the crosstalk cancellation parameters, which are the crosstalk cancellation parameters after balancing. The crosstalk cancellation parameters ensure that the acquired surround sound source signal has stable frequency points. For example, when a frequency point f satisfies |α1(θ1,f)α2(θ2,f)-β1(θ1,f)β2(θ2,f)|≈0, the calculated crosstalk cancellation parameters at that frequency point f will be infinitely large, thus affecting the sound effect of the surround sound source signal. Furthermore, when using a multi-channel virtual surround sound source signal, it is necessary to solve for the inverse or pseudo-inverse of an n*m matrix, where n is the number of rows and m is the number of columns of the crosstalk cancellation matrix A. Especially when n is not equal to m, finding the inverse is equivalent to solving a system of equations with an unequal number of equations and unknowns, which may have infinitely many solutions or no solutions at all. In this case, only an approximate solution can be obtained, and the approximate solution will affect the sound effect of the virtual surround sound.

[0083] In one implementation of this embodiment, the smoothing process of the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters specifically includes:

[0084] Obtain several center frequencies corresponding to the sound source signal to be processed;

[0085] The matrix elements in the crosstalk cancellation parameters are smoothed based on several center frequencies to obtain smoothed crosstalk cancellation parameters.

[0086] Specifically, each of the several center frequencies is a frequency value of a frequency point in the sound source signal to be processed, and the frequency points corresponding to each of the several center frequencies are different. For example, the several center frequencies include center frequency A and center frequency B. Center frequency A corresponds to frequency point a in the sound source signal to be processed, and center frequency B corresponds to frequency point b in the sound source signal to be processed. Then, frequency point a and frequency point b are different.

[0087] In one implementation of this embodiment, obtaining the plurality of center frequencies corresponding to the sound source signal to be processed specifically includes:

[0088] The sound source signal to be processed is divided into several sub-sound source signals;

[0089] For each of the several sub-sound source signals, obtain the frequency value of the center frequency point of each of the several sub-sound source signals to obtain several center frequencies.

[0090] Specifically, each of the several sub-sound source signals is a sub-band of the sound source signal to be processed, and the sub-bands corresponding to each sub-sound source signal are different. When dividing the sound source signal to be processed, it can be based on a preset sub-band threshold. The frequency domain of the sound source signal to be processed is divided into several sub-bands based on the sub-band threshold to obtain several sub-sound source signals. The sub-band threshold can be one or more preset frequency thresholds, which can be set and adjusted according to actual needs, and are not specifically limited here. Dividing the frequency domain of the sound source signal to be processed into multiple sub-bands based on the sub-band threshold, and using the center frequency of each sub-band as the center frequency, ensures that the frequencies corresponding to each sub-band are similar, avoiding the occurrence of infinitely large frequency points.

[0091] In one specific implementation of this embodiment, after obtaining several center frequencies, the features of each sub-band of the sound source signal to be processed can be extracted using methods such as Fast Fourier Transform or Mel-frequency spectroscopy. Then, based on several center frequency pairs, mean filtering or median filtering is applied to each signal frequency point in the aforementioned crosstalk cancellation parameters. Other smoothing methods are also possible and are not specifically limited here. This embodiment, by smoothing and adjusting the obtained crosstalk cancellation parameters, can remove unstable solutions in the frequency points, improve the stability of the crosstalk removal filter, provide users with more stable surround sound, and thus improve sound quality. Furthermore, in practical applications, after dividing the sound source signal to be processed into several sub-sound source signals, smoothing processing can be performed on each sub-sound source signal separately. This can also be done on each sub-band separately to improve the speed of smoothing processing.

[0092] S30. Based on the smooth crosstalk cancellation parameters and the sound source signal to be processed, determine the surround sound source signal corresponding to the sound source signal to be processed.

[0093] Specifically, the surround sound source signal is a crosstalk-free sound source signal, which is obtained by eliminating crosstalk in the crosstalk surround sound source signal. It is understood that crosstalk in the crosstalk surround sound source signal can be eliminated by applying a smoothing crosstalk cancellation parameter to the crosstalk surround sound source signal to obtain the surround sound source signal. Therefore, in one implementation of this embodiment,

[0094] The step of determining the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed specifically includes:

[0095] Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed;

[0096] Based on the location information and the preset location information, the crosstalk surround sound source signal corresponding to the sound source signal to be processed is determined;

[0097] Based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal, the surround sound source signal corresponding to the sound source signal to be processed is determined.

[0098] Specifically, the crosstalk surround sound source signal is the same as the crosstalk surround sound source signal in the crosstalk cancellation parameters mentioned above. The position information and the preset position information are also the same as the position information and the preset position information in the crosstalk cancellation parameters mentioned above. Therefore, they will not be repeated here. Please refer to the above description for details.

[0099] In one implementation of this embodiment, determining the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal specifically includes:

[0100] Obtain the target weight value corresponding to each signal frequency point in the crosstalk surround sound source signal, wherein there are at least two signal frequency points in the crosstalk surround sound source signal, and the target weight values ​​corresponding to the two signal frequency points are different.

[0101] The frequency points of each signal are adjusted based on the target weights corresponding to each signal frequency point and the smooth crosstalk cancellation parameters to obtain the surround sound source signal corresponding to the sound source signal to be processed.

[0102] Specifically, the crosstalk surround sound source signal contains at least two signal frequencies, each with a different target weight. For example, the smoothing crosstalk cancellation parameters contain at least a first signal frequency and a second signal frequency, where the target weight corresponding to the first signal frequency is different from that corresponding to the second signal frequency. The target weight corresponding to each signal frequency can be preset based on experimental results or set and adjusted according to actual needs.

[0103] In one implementation of this embodiment, obtaining the target weights corresponding to each signal frequency point in the crosstalk surround sound source signal specifically includes:

[0104] The high-frequency and low-frequency signal points in the crosstalk surround sound source signal are determined based on a preset frequency threshold.

[0105] The first weight is used as the target weight corresponding to each high-frequency parameter signal frequency point, and the second weight is used as the target weight corresponding to each low-frequency signal frequency point, so as to obtain the target weight corresponding to each signal frequency point.

[0106] Specifically, the preset frequency threshold is a pre-set threshold used to distinguish between high and low frequencies. It can be set and adjusted according to actual needs. In this embodiment, it can be set to 8000 Hz. The high-frequency signal point is the signal point whose value is greater than the frequency threshold, and the low-frequency signal point is the signal point whose value is greater than the frequency threshold. By configuring different weights for the low-frequency and high-frequency signal points, better sound effects can be obtained by adjusting the directional properties of the high-frequency and low-frequency signal points. The first weight and the second weight are different, and the first weight and the second weight can be preset values ​​or weighted values ​​calculated according to a preset formula and the values ​​of corresponding elements. No specific limitation is made here.

[0107] In one implementation of this embodiment, after obtaining the target weights corresponding to each signal frequency point, for each signal frequency point, the signal frequency point and the smooth crosstalk cancellation parameter can be multiplied together, and the product obtained by multiplication can be used as the filtering coefficient corresponding to the signal frequency point. The filtering coefficient is then used to filter the signal frequency point (for example, multiplying the filtering coefficient with the signal frequency point) to obtain the filtered signal frequency points. The sound source signal composed of the filtered signal frequency points is then used as the surround sound signal corresponding to the sound source signal to be processed.

[0108] In summary, this application provides a method for generating surround sound effects. The method includes: obtaining crosstalk cancellation parameters corresponding to a sound source signal to be processed; smoothing the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters; and determining the surround sound source signal corresponding to the sound source signal to be processed based on the smoothed crosstalk cancellation parameters and the sound source signal to be processed. This application's solution smoothly adjusts the crosstalk cancellation parameters used for crosstalk cancellation to remove interference points in the parameters, improving their stability. Therefore, when determining the surround sound source signal based on the crosstalk cancellation parameters, the influence of the crosstalk cancellation parameters on the stability of the surround sound source signal can be avoided, resulting in a highly stable surround sound source signal.

[0109] Exemplary device

[0110] Corresponding to the above-described method for generating surround sound effects, this application also provides an apparatus for generating surround sound effects, such as... Figure 5 As shown, the surround sound generation device includes:

[0111] The acquisition module 100 is used to acquire the crosstalk cancellation parameters corresponding to the sound source signal to be processed.

[0112] The smoothing module 200 is used to smooth the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters;

[0113] The determining module 300 is used to determine the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed.

[0114] Furthermore, the working process of each functional module in the surround sound generation device provided in this embodiment is the same as the working process of the surround sound generation method described above. For details, please refer to the working process of the surround sound generation method, which will not be repeated here.

[0115] Based on the above-described method for generating surround sound effects, this application also provides a smart terminal, which includes a processor, a memory, and a display. Figure 6 Only some components of the smart terminal are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0116] The aforementioned memory can be an internal storage unit and / or an external storage unit of the aforementioned smart terminal. The memory stores a virtual surround sound implementation program, which can be executed by a processor. When executed by the processor, the virtual surround sound implementation program implements the steps of the aforementioned surround sound effect generation method. In some embodiments, the processor can be a central processing unit, a microprocessor, or other data processing chip, used to run the program code stored in the memory or process data. In some embodiments, the display can be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED touchscreen, etc. The display is used to display information from the smart terminal and to display a visual user interface. The components of the aforementioned smart terminal communicate with each other via a system bus.

[0117] In one embodiment, when the processor executes the virtual surround sound implementation program in the aforementioned memory, the following steps are performed:

[0118] Obtain the crosstalk cancellation parameters corresponding to the sound source signal to be processed;

[0119] The crosstalk cancellation parameters are smoothed to obtain smoothed crosstalk cancellation parameters;

[0120] Based on the smooth crosstalk cancellation parameters and the sound source signal to be processed, the surround sound source signal corresponding to the sound source signal to be processed is determined.

[0121] Based on the above-described method for generating surround sound effects, this application also provides a computer-readable storage medium storing a virtual surround sound implementation program. When the virtual surround sound implementation program is executed by a processor, it implements any of the steps of the above-described method for generating surround sound effects.

[0122] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0123] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the above device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0124] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0125] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0126] In the embodiments provided in this application, it should be understood that the disclosed apparatus / terminal devices and methods can be implemented in other ways. For example, the apparatus / terminal device embodiments described above are merely illustrative. For instance, the division of the modules or units described above is merely a logical functional division, and in actual implementation, it can be divided in other ways. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0127] If the integrated modules / units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction.

[0128] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions are not in essence a departure from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for generating surround sound effects, characterized in that, The method includes: Obtain the crosstalk cancellation parameters corresponding to the sound source signal to be processed; The crosstalk cancellation parameters are smoothed to obtain smoothed crosstalk cancellation parameters; Based on the smooth crosstalk cancellation parameters and the sound source signal to be processed, the surround sound source signal corresponding to the sound source signal to be processed is determined; The smoothing process of the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters specifically includes: Obtain several center frequencies corresponding to the sound source signal to be processed; Based on the aforementioned center frequencies, each matrix element in the crosstalk cancellation parameters is smoothed to obtain smoothed crosstalk cancellation parameters. The specific steps of acquiring the several center frequencies corresponding to the sound source signal to be processed include: The sound source signal to be processed is divided into several sub-sound source signals; For each of the several sub-sound source signals, obtain the frequency value of the center frequency point of each of the several sub-sound source signals to obtain several center frequencies; Before the step of smoothing each matrix element in the crosstalk cancellation parameters based on the several center frequencies to obtain smoothed crosstalk cancellation parameters, the method further includes extracting the features of each sub-source signal of the sound source signal to be processed by fast Fourier transform or Mel spectrum method.

2. The method for generating surround sound effects according to claim 1, characterized in that, The specific steps for obtaining the crosstalk cancellation parameters corresponding to the sound source signal to be processed include: Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed; Based on the location information and the preset location information, the interference surround sound source signal and the desired surround sound source signal corresponding to the sound source signal to be processed are determined. Based on the desired surround sound source signal and the interfering surround sound source signal, the crosstalk cancellation parameters corresponding to the sound source signal to be processed are determined, wherein the preset position information is the position information of the surround sound source signal relative to the received position information.

3. The method for generating surround sound effects according to claim 1, characterized in that, The step of determining the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed specifically includes: Obtain the position information of the playback end of the sound source signal to be processed relative to the receiving end of the sound source to be processed; Based on the location information and the preset location information, the crosstalk surround sound source signal corresponding to the sound source signal to be processed is determined; Based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal, the surround sound source signal corresponding to the sound source signal to be processed is determined.

4. The method for generating surround sound effects according to claim 3, characterized in that, Based on the smooth crosstalk cancellation parameters and the crosstalk surround sound source signal, determining the surround sound source signal corresponding to the sound source signal to be processed specifically includes: Obtain the target weight value corresponding to each signal frequency point in the crosstalk surround sound source signal, wherein there are at least two signal frequency points in the crosstalk surround sound source signal, and the target weight values ​​corresponding to the two signal frequency points are different. Based on the target weights corresponding to each signal frequency point and the smooth crosstalk cancellation parameters, the signal frequencies are adjusted to obtain the surround sound source signal corresponding to the sound source signal to be processed.

5. The method for generating surround sound effects according to claim 4, characterized in that, The specific steps of obtaining the target weights corresponding to each frequency point of the crosstalk surround sound source signal include: The high-frequency and low-frequency signal points in the crosstalk surround sound source signal are determined based on a preset frequency threshold. The first weight is used as the target weight corresponding to each high-frequency parameter signal frequency point, and the second weight is used as the target weight corresponding to each low-frequency signal frequency point, so as to obtain the target weight corresponding to each signal frequency point.

6. A surround sound generation apparatus, used in implementing the surround sound generation method as described in any one of claims 1-5, characterized in that, The generating apparatus includes: The acquisition module is used to acquire the crosstalk cancellation parameters corresponding to the sound source signal to be processed; A smoothing module is used to smooth the crosstalk cancellation parameters to obtain smoothed crosstalk cancellation parameters; The determination module is used to determine the surround sound source signal corresponding to the sound source signal to be processed based on the smooth crosstalk cancellation parameters and the sound source signal to be processed.

7. A smart terminal, characterized in that, The smart terminal includes: a memory, a processor, and a virtual surround sound implementation program stored in the memory and executable on the processor. When the virtual surround sound implementation program is executed by the processor, it implements the steps of the surround sound effect generation method as described in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a virtual surround sound implementation program, which, when executed by a processor, implements the steps of the surround sound generation method as described in any one of claims 1-5.

Images