Digital audio sound field effect processing method and speaker device

Abstract

The present application discloses a sound field effect processing method for digital audio and a speaker device. The method performs a first frequency compensation operation on a first audio signal and a second audio signal respectively, and then splits the compensated signals and performs second frequency compensation, mixing and other operations for adjusting the sound field effect according to the different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear, thereby reducing the complexity of the algorithm, so that the processing process of the digital audio can achieve a better sound field effect with a lower amount of calculation, which is conducive to improving the adaptability of the processing method on hardware platforms with lower performance, thereby improving the sound field effect and the degree of restoration of the low-performance platform during use.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a method for processing sound field effects of digital audio and a speaker device. Background Art

[0002] The goal of audio-visual electronic products is to restore the state of the sound source during live recording. However, due to the limitations of the product's speaker structure (such as the number and distribution of speakers), the product's sound field effect is often far from the live state of the sound source, resulting in a poor experience.

[0003] The sound playback environment on the market adopts multi-directional placement of speakers to achieve better on-site effects, but this type of product is not widely used in actual applications, and two-channel speakers are still the main ones. For two-channel speakers, more optimization solutions are to use head-related transfer functions to process the sound to enhance the on-site sense of the product sound. However, there are also many problems with the head-related transfer function. For example, the head model and ear model used in testing the head-related transfer function are quite different from people in different regions, and the restoration effect varies from person to person. Secondly, when using the head-related transfer function for sound processing, digital filters are generally used to approximate the desired effect, but when a closer effect is required, the order of the filter will be very large, resulting in a large amount of calculation.

[0004] For example, the commonly used head-related function solution needs to use the impulse response invariance method to find the filter parameters of the target speaker orientation, and then use the obtained filter to process the audio information. Taking the IIR filter as an example, the filter order must reach about 30 to approach the target response. The more speaker channels there are, the greater the amount of calculation. In addition, an environment without sound reflection is required to test the impulse response of the target speaker, which places high requirements on the equipment and environment.

[0005] Therefore, it is difficult to apply existing sound field effect optimization algorithms on hardware platforms with lower performance, and it is impossible to effectively improve the degree of restoration of the sound field effects during the use of the above platforms. Summary of the invention

[0006] The present application provides a sound field effect processing method and a speaker device for digital audio, which can reduce the amount of algorithm calculation and improve the degree of restoration of the sound field effect during use of a low-performance platform.

[0007] In a first aspect, the present application discloses a method for processing sound field effects of digital audio, the method comprising:

[0008] Obtaining a first audio signal and a second audio signal to be processed by the left and right speakers respectively;

[0009] Performing a first frequency compensation operation for adjusting a sound field effect on the first audio signal and the second audio signal respectively;

[0010] The first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branched signals and second branched signals; wherein the first branched signal is sent to the back end, and the second branched signal performs a second frequency compensation operation for adjusting the sound field effect according to different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear;

[0011] Mixing the second branch signal obtained after the second frequency compensation operation with the second branch signal corresponding to the speaker on the other side to obtain a mixed second branch signal;

[0012] The first branch signal and the mixed second branch signal are mixed again to obtain a first output signal and a second output signal for outputting to speakers on both sides after adjusting the sound field effect.

[0013] In one embodiment, the second branch signal includes a first component signal and a second component signal; the first component signal is a signal from a left speaker reaching a left ear or a right ear, and the second component signal is a signal from a right speaker reaching a left ear or a right ear; the second frequency compensation includes first component compensation and second component compensation;

[0014] The second branch signal performs a second frequency compensation operation for adjusting the sound field effect according to different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear, respectively, including:

[0015] performing the first component compensation on the first component signal;

[0016] performing the second component compensation on the second component signal;

[0017] The compensation parameter of the first component compensation is different from the compensation parameter of the second component compensation.

[0018] In one embodiment, mixing at least two second branch signals obtained after the second frequency compensation operation to obtain two second branch signals corresponding to the left ear and the right ear includes:

[0019] Mixing a first component signal corresponding to the first audio signal after the first component compensation and a second component signal corresponding to the second audio signal after the second component compensation to obtain a mixed second branch signal corresponding to the first audio signal;

[0020] The second component signal corresponding to the first audio signal and compensated by the second component is mixed with the first component signal corresponding to the second audio signal and compensated by the first component to obtain a mixed second branch signal corresponding to the second audio signal.

[0021] In one embodiment, the first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branched signals and second branched signals, respectively, including:

[0022] The signal branch includes a first branch, a second branch and a third branch;

[0023] The first branch is amplified by a first amplification coefficient K1 of the first channel to obtain a first branch signal;

[0024] The second branch is amplified by a second amplification coefficient K2 of the second channel to obtain a first component signal of the second branch signal;

[0025] The third branch is amplified by the third amplification coefficient K3 of the third channel to obtain a second component signal of the second branch signal.

[0026] In one embodiment, the first channel is used to adjust the intensity of sound output to the left ear or the right ear on the same side as the speaker;

[0027] The second channel is used to adjust the intensity of the sound output to the ear on the same side as the speaker;

[0028] The third channel is used to adjust the intensity of the sound output to the ear on the different side from the speaker.

[0029] In one embodiment, mixing at least two second branch signals obtained after the second frequency compensation operation to obtain two second branch signals corresponding to the left ear and the right ear includes:

[0030] adjusting a second amplification factor of the second channel and a compensation parameter of the first component compensation;

[0031] adjusting a third amplification factor of the third channel and a compensation parameter of the second component compensation;

[0032] Through the above adjustment, the target sound field formed by the second branch signal is brought forward relative to the original sound field.

[0033] In one embodiment, the step of remixing the first branch signal and the mixed second branch signal to obtain a first output signal and a second output signal for speaker output further includes:

[0034] Performing delay processing on the mixed second branch signal;

[0035] The delayed second branch signal is mixed again with the first branch signal on the corresponding side.

[0036] In one embodiment, the method further comprises:

[0037] In one embodiment, the method further comprises:

[0038] Obtain a standard response curve of a standard speaker at a target opening angle;

[0039] Obtaining a product response curve of the product speaker measured at a target opening angle according to the standard response curve;

[0040] Obtaining a current response curve of a product speaker, and obtaining an expected curve difference based on the current response curve and the product response curve;

[0041] Compensation parameters corresponding to the first frequency compensation operation and the second frequency compensation operation are obtained according to the expected curve difference.

[0042] In one embodiment, the method further comprises:

[0043] Obtain the frequency response curves of product speakers and standard speakers;

[0044] Adjusting the frequency response curve corresponding to the product speaker so that the frequency response curves of the product speaker and the standard speaker are aligned at a preset frequency;

[0045] Calculate and obtain the ideal curve difference between the frequency response curves of the product speaker and the standard speaker;

[0046] The step of obtaining a product response curve measured by the product speaker at a target opening angle according to the standard response curve includes:

[0047] Obtain a standard response curve of a standard speaker at a target opening angle;

[0048] The standard response curve of the standard horn at the target opening angle is superimposed with the difference between the ideal curve to obtain the product response curve of the product horn measured at the target opening angle.

[0049] In a second aspect, the present application further discloses a speaker device, the speaker device comprising:

[0050] Processor; and

[0051] a memory electrically connected to the processor;

[0052] The memory stores machine-readable instructions executable by the processor, and the processor executes the machine-readable instructions to perform the sound field effect processing method of digital audio as described in any one of the above items.

[0053] As can be seen from the above, the sound field effect processing method and speaker device of digital audio in the present application, by performing a first frequency compensation operation on the first audio signal and the second audio signal respectively, and then branching the compensated signals and performing compensation and mixing operations, reduce the complexity of the algorithm, so that the digital audio processing process can achieve better sound field effects with a lower amount of calculation, which is conducive to improving the adaptability of the processing method on hardware platforms with lower performance, and thus improving the sound field effect and the degree of restoration of the low-performance platform during use. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 This is a flowchart of the implementation of the sound field effect processing method of digital audio provided in an embodiment of the present application.

[0055] Figure 2 A sound field schematic diagram of a sound field effect processing method for digital audio provided in an embodiment of the present application.

[0056] Figure 3 This is an application scenario diagram of the sound field effect processing method of digital audio provided in an embodiment of the present application.

[0057] Figure 4 This is another application scenario diagram of the digital audio sound field effect processing method provided in an embodiment of the present application.

[0058] Figure 5 A flowchart for obtaining compensation parameters provided in an embodiment of the present application.

[0059] Figure 6 Schematic diagram of frequency response curves of a standard speaker and a product speaker provided in an embodiment of the present application.

[0060] Figure 7 A schematic diagram of the difference between the ideal curves of the standard speaker and the product speaker provided in the embodiment of the present application.

[0061] Figure 8 A schematic diagram of a standard response curve on the left and a product response curve on the left provided in an embodiment of the present application.

[0062] Fig. 9 A schematic diagram of the structure of a speaker device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The technical solution of the present application is further described below in conjunction with the accompanying drawings and embodiments.

[0064] The embodiment of the present application provides a method for processing sound field effects of digital audio, which is applied to a speaker device.

[0065] Among them, the sound-speaking device can be a device with a speaker (or called a loudspeaker, a loudspeaker), including an independent speaker, headphones, a computer with integrated / external speakers, a television, or other similar devices that can play digital audio signals through at least two speakers. This application does not limit the specific form of the sound-speaking device.

[0066] See also Figure 1 , the figure shows the implementation process of the sound field effect processing method of digital audio provided by an embodiment of the present application.

[0067] like Figure 1 As shown, the digital audio sound field effect processing method can be applied to the above-mentioned speaker device, and the method includes:

[0068] 101. Obtain a first audio signal and a second audio signal to be processed from left and right speakers respectively.

[0069] The first audio signal is the input audio signal of the left speaker, and the second audio signal is the input audio signal of the right speaker. Of course, the positions of the two may be swapped, or they may represent the input audio signals corresponding to the speakers on the other two opposite sides.

[0070] The speaker is set up under preset parameter standards and preset opening angles. The preset parameter standards can be based on parameter standards set by oneself in order to obtain ideal effects. The specific effects to be achieved and their parameter standards can be determined based on actual conditions, and this application does not limit this.

[0071] The first audio signal and the second audio signal are both digital audio signals obtained through initial decoding, and can be obtained by a speaker device reading a corresponding audio file in the device, or can be obtained through other means such as the Internet, and the acquisition means are not limited.

[0072] 102. Perform a first frequency compensation operation for adjusting a sound field effect on the first audio signal and the second audio signal respectively.

[0073] The first frequency compensation operation is used to perform frequency response compensation on the first audio signal and the second audio signal respectively, so that the frequency response characteristics corresponding to the first audio signal and the second audio signal meet the desired sound field effect.

[0074] Please combine Figure 2 , the figure shows a sound field schematic diagram of the sound field effect processing method of digital audio provided by an embodiment of the present application.

[0075] like Figure 2As shown, in one embodiment, in order to obtain a wider sound field effect, the preset positions of the standard speaker are position L and position R, the compensation positions of the standard speaker desired to be obtained after the first frequency compensation operation are position L' and position R', and the position of the dummy head model is position M.

[0076] Specifically, LL is the frequency response measured at the left ear when the left channel sound is not processed by any algorithm. And LL' is the frequency response measured at the left ear when the speaker is moved from the L position to the L' position. As long as the difference between LL and LL' and between LR and LR' is obtained, the amplitudes of the first audio signal and the second audio signal at different frequencies are amplified or attenuated through the first frequency compensation operation, so that the sound field effect of setting the standard speaker at the position L' and the position R' is obtained.

[0077] Of course, the compensation parameters used in the first frequency compensation operation can be set according to needs using past experience values ​​or existing algorithms, and the present application does not limit the specific values ​​of the compensation parameters and the method for obtaining them.

[0078] 103. Perform signal branching on the first audio signal and the second audio signal obtained after the first frequency compensation operation, and obtain corresponding first branch signals and second branch signals respectively; wherein, the first branch signal is sent to the back end, and the second branch signal performs a second frequency compensation operation for adjusting the sound field effect according to the different sound propagation paths of the speakers on different sides reaching the left ear or the right ear.

[0079] Among them, the audio signal is branched to obtain a first branch signal and a second branch signal. Different signals can be compensated according to the different sound propagation paths heard by the actual listener in the left ear and the right ear, so as to obtain a more realistic and more desired sound field effect.

[0080] Specific, combined Figure 2 The listening effect of the left ear is LL+RL, and the listening effect of the right ear is RR+LR. The signals corresponding to the above different sound sources can be compensated respectively, so that the listening effect of the left ear can be processed into LL'+RL', and the listening effect of the right ear can be processed into RR'+LR' as much as possible.

[0081] Combination Figure 3 , the figure shows the application scenario of the sound field effect processing method of digital audio of the present application.

[0082] like Figure 3 As shown, in one implementation, the second branch signal includes a first component signal and a second component signal. The first component signal is a signal from the left speaker to the left ear or the right ear, and the second component signal is a signal from the right speaker to the left ear or the right ear. The second frequency compensation includes first component compensation and second component compensation.

[0083] The steps of performing a second frequency compensation operation for adjusting the sound field effect respectively according to the different sound propagation paths of the second branch signal reaching the position of the left ear or the right ear through the speakers on different sides include:

[0084] A first component compensation is performed on the first component signal; and a second component compensation is performed on the second component signal; wherein a compensation parameter of the first component compensation is different from a compensation parameter of the second component compensation.

[0085] For example, the first component signal in the second branch signal is the listening effect LL of the left speaker received by the left ear, and the second component signal in the second branch signal is the listening effect RL of the right speaker received by the left ear. Because the audio transmission paths of the speakers on different sides are different, for example, the right speaker needs to bypass the face to the left ear, which will affect the listening effect. At this time, the corresponding frequency response compensation can be performed according to the influence characteristics obtained by testing the product speaker or the standard speaker.

[0086] In practical applications, the purpose of the second frequency compensation is to compensate the listening effect of the different side speakers from LL, LR, RL and RR to the approximate effect of LL', LR', RL' and RR. Among them, from the sound spectrum amplitude diagram output by the head-to-head transfer correlation transfer function, the frequency gain of the sound part of LR' should be reduced compared with LR, so it is necessary to compensate this part through the second frequency compensation operation to obtain a better sound field effect.

[0087] 104. Mix the second branch signal obtained after the second frequency compensation operation with the second branch signal corresponding to the speaker on the other side to obtain a mixed second branch signal.

[0088] Combination Figure 3 In one implementation, the second branch signal includes a first component signal and a second component signal. The first component signal is a signal from a left speaker to a left ear or a right ear, and the second component signal is a signal from a right speaker to a left ear or a right ear. The second frequency compensation includes first component compensation and second component compensation.

[0089] The at least two second branch signals obtained after the second frequency compensation operation are mixed to obtain two second branch signals corresponding to the left ear and the right ear, including:

[0090] A first component signal corresponding to the first audio signal after first component compensation is mixed with a second component signal corresponding to the second audio signal after second component compensation to obtain a mixed second branch signal corresponding to the first audio signal; and a second component signal corresponding to the first audio signal after second component compensation is mixed with a first component signal corresponding to the second audio signal after first component compensation to obtain a mixed second branch signal corresponding to the second audio signal.

[0091] The first component signal of the first audio signal is the sound component generated by the left speaker at the left ear, and the second component signal of the first audio signal is the sound component generated by the left speaker at the right ear. The first component signal of the second audio signal is the sound component generated by the right speaker at the left ear, and the second component signal of the second audio signal is the sound component generated by the right speaker at the right ear.

[0092] In fact, the second branch signal after frequency compensation of the speaker on one side is mixed with the second branch signal corresponding to the speaker on the other side, that is, the second branch signal of the left speaker corresponding to the left ear can be mixed with the second branch signal of the right speaker corresponding to the left ear, and the second branch signal of the left speaker corresponding to the right ear can be mixed with the second branch signal of the right speaker corresponding to the right ear.

[0093] In this way, the audio signal corresponding to the speaker on the other side can be used to adjust the impact of the sound of the speaker on the other side on the sound field of the current ear, so as to achieve a listening effect that is closer to the expanded sound field.

[0094] It can be understood that the distinction between the listening effects of different side speakers and different side ears represented by the above-mentioned different component signals is only for example, and its definition can be adjusted in actual application.

[0095] By mixing the above, the listening effects of different-side speakers on different-side ears can be unified, and the sound field effect can be improved through a simple compensation method.

[0096] In one embodiment, the second frequency compensation operation can set compensation parameters according to the actual sound field effect required. For example, if you want to hear the human voice in the front, you can adjust the compensation parameters of the first branch compensation and the second branch compensation, and gain or reduce some frequencies of the intermediate and high frequencies, so as to achieve the listening experience of the human voice in the front. Of course, in addition to the above scheme, it can also be set to the compensation parameters required for the sound field effects of the recording studio, concert site, etc., so as to obtain the corresponding listening experience.

[0097] It is understandable that the listening experience can be achieved by using a compensation method commonly used in the art to compensate for the second branch signal according to actual conditions, and the present application does not limit this.

[0098] 105. Mix the first branch signal and the mixed second branch signal again to obtain a first output signal and a second output signal for outputting to speakers on both sides after adjusting the sound field effect.

[0099] Among them, the first output signal and the second output signal can be output through the left speaker and the right speaker respectively, so that the listener can obtain a listening effect with a higher degree of sound field restoration through the speakers on both sides.

[0100] After mixing the second branch signal, the first branch signal and the mixed second branch signal are mixed again, so that the output audio signal can be specifically adjusted for the listening effects of ears on different sides according to the speakers on different sides, and the obtained digital audio signal has a better sound field effect after being played by the speaker.

[0101] As can be seen from the above, the sound field effect processing method and speaker device of digital audio in the present application, by performing a first frequency compensation operation on the first audio signal and the second audio signal respectively, and then branching the compensated signals and performing compensation and mixing operations, reduce the complexity of the algorithm, so that the digital audio processing process can achieve better sound field effects with a lower amount of calculation, which is conducive to improving the adaptability of the processing method on hardware platforms with lower performance, and thus improving the sound field effect and the degree of restoration of the low-performance platform during use.

[0102] See also Figure 4 , the figure shows another application scenario diagram of the sound field effect processing method of digital audio provided by an embodiment of the present application.

[0103] like Figure 4 As shown, in another implementation, the first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branched signals and second branched signals, including:

[0104] The signal branch includes a first branch, a second branch and a third branch; the first branch is amplified by the first amplification coefficient K1 of the first channel to obtain a first branch signal; the second branch is amplified by the second amplification coefficient K2 of the second channel to obtain a first component signal of the second branch signal; the third branch is amplified by the third amplification coefficient K3 of the third channel to obtain a second component signal of the second branch signal.

[0105] Furthermore, the first channel is used to adjust the sound intensity output to the left ear or right ear on the same side as the speaker; the second channel is used to adjust the sound intensity output to the ear on the same side as the speaker; and the third channel is used to adjust the sound intensity output to the ear on a different side from the speaker.

[0106] By distinguishing the different adjustment purposes of the above-mentioned different channels, the sound effects of different components can be adjusted more specifically, thereby improving the restoration of the sound field.

[0107] Through the amplification of the above three amplification coefficients K1-K3, the sound field effect corresponding to each audio signal can be further adjusted. For example, for the left ear, the listening intensity of the left speaker is greater than the listening intensity of the right speaker. Through the amplification and adjustment of the above second branch and third branch, the sound field effect corresponding to the audio signal can be restored to the actual sound field effect.

[0108] Specifically, after testing the frequency response curve of the standard speaker at a specific opening angle, the coefficients of K1, K2 and K3 can be preliminarily determined by comparing the average amplitudes of the LL and LR curves. For example, if the average amplitude value of LL is a and the average amplitude value of LR is b, then the amplification coefficient K1 is K1-a / (a+b). The amplification coefficients K2-K3 can be adjusted by referring to the average amplitude value ratio of LR.

[0109] In some implementations, mixing the at least two second branch signals obtained after the second frequency compensation operation to obtain two second branch signals corresponding to the left ear and the right ear includes:

[0110] Adjust the second amplification factor of the second channel and the compensation parameter of the first component compensation; adjust the third amplification factor of the third channel and the compensation parameter of the second component compensation; through the above adjustment, the target sound field formed by the second branch signal is brought forward relative to the original sound field.

[0111] The settings of the amplification factors K1-K3 can also be adjusted considering the desired listening effect. For example, if you want to improve the clarity of the sound and reduce the hollow feeling of the sound, you can adjust the parameters of the second channel and the first component compensation, and based on the above adjustment, adaptively adjust the parameters of the third channel and the second component compensation to make the sound imaging more forward.

[0112] For another example, in order to enhance the effect of human voice in the sound, the amplification factor K2 can be appropriately increased so that the sound imaging is closer to the middle. It can be understood that the coefficient values ​​of the amplification factors K1-K3 can be set according to the different adjustment effects required, and this application does not make specific limitations on this.

[0113] Please continue to refer to Figure 4 At this time, in order to improve the degree of restoration of the sound field effect, the mixed second branch signal can be delayed after the second branch signal is compensated, and the delayed second branch signal can be mixed again with the first branch signal on the corresponding side.

[0114] Specifically, a delay device can be used to implement delay processing to compensate for the time difference between the sound of the speaker on one side reaching the left ear and the right ear. The delay time is 0 to 128 samples at the same time as required. Similarly, the above method can improve the degree of restoration of the sound field effect.

[0115] based on Figure 4 The frequency compensation Q1 in the figure is the first frequency compensation operation, the frequency compensation Q2 is the first component compensation, and the frequency compensation Q3 is the second component compensation; the first audio signal is L-IN, and the second audio signal is R-IN; the first output signal is L-OUT, and the second output signal is R-OUT.

[0116] In one embodiment, the frequency response of the amplification factor K3 of the third channel is negative or positive according to the requirements of the final output effect. When the sound field needs to be widened, it is negative, otherwise it is positive. For example, the effect of LR' is equivalent to DL(H Q1 (H Q2 (L-IN*K2)+H Q3 (R-IN*K3)) or DL(H Q1 (H Q2 (L-IN*K2)-H Q3 (R-IN*K3)).

[0117] The formulas of the first output signal and the second output signal finally obtained are as follows:

[0118] L-OUT=H Q1 (L-IN*K1)+DL(H Q1 (HQ2(L-IN*K2)+H Q3 (R-IN*K3)))

[0119] R-OUT=H Q1 (R-IN*K1)+DL(H Q1 (HQ2(R-IN*K2)+H Q3 (L-IN*K3)))

[0120] Among them, DL is a delay device.

[0121] It can be seen that the above implementation method can further improve the sound field effect in the dual-speaker scenario with a relatively simple amount of calculation, and obtain a higher degree of sound field effect restoration. In addition, the above method uses the first channel, the second channel and the third channel, and combines them with multiple compensation modules to improve the flexibility of sound field effect adjustment.

[0122] See also Figure 5 , the figure shows an implementation flow chart of obtaining compensation parameters provided by an embodiment of the present application.

[0123] In one implementation, the digital audio sound field effect processing method further includes the following steps.

[0124] 201. Obtain a standard response curve of a standard speaker at a target opening angle.

[0125] The target opening angle may be an expected value, for example, the original opening angle is 50°, and the target opening angle desired to be achieved in order to widen the sound field is 70°, which is larger than the original opening angle. The target opening angle may be determined according to actual conditions, and this application does not limit it.

[0126] In one embodiment, it can be assumed by default that the left and right speakers have the same effect on the left and right ears of the listener. The frequency response of the left speaker output on the left ear and the frequency response curve of the left speaker output on the right ear at different opening angles can be tested in advance using a standard speaker and a dummy head model, and a database can be formed for later use. The preset opening angle can be related to the speaker arrangement of the sound device. For example, if a device is used at a longer distance and the relative distance between the speakers is small, a smaller opening angle, such as 10°, can be set; and if a device is used at a closer distance or the relative distance between the speakers is large, a larger opening angle, such as 50°, can be set. The preset opening angle in this application can be set according to actual needs.

[0127] The frequency response curve H0 of the standard speaker at the target opening angle can be obtained by searching the database. Here, the standard response curve includes the standard response curve corresponding to the left speaker and the standard response curve corresponding to the right speaker, both of which can be obtained from a database pre-stored with the frequency response curves of the standard speaker at multiple opening angles, and the database can be stored in a local device or a network device.

[0128] 202. Obtain a product response curve of the product speaker measured at a target opening angle according to the standard response curve.

[0129] Combination Figure 2 and Figure 6-8 ; Figure 6 The frequency response curves of the standard speaker and the product speaker of the present application are shown in FIG. Figure 7 A schematic diagram of the difference between the ideal curves of the standard speaker and the product speaker provided in the embodiment of the present application is shown in FIG. Figure 8 A schematic diagram of a standard response curve on the left and a product response curve on the left provided in an embodiment of the present application.

[0130] Before the speaker product is introduced into the method, the method further comprises:

[0131] Obtain frequency response curves of the product speaker and the standard speaker; adjust the frequency response curve corresponding to the product speaker so that the frequency response curves of the product speaker and the standard speaker are aligned at a preset frequency; calculate and obtain an ideal curve difference between the frequency response curves of the product speaker and the standard speaker.

[0132] First, you need to test the frequency response curves Hf of the left and right speakers in the original state of the speaker product, and obtain the frequency response curve Hr of the standard speaker, that is, Figure 6 shown.

[0133] Then, taking the frequency response curve of the standard speaker at 1KHz as the reference, the frequency response curve of the product speaker is increased or decreased to align the two curves at 1KHz. Afterwards, the ideal curve difference between the two frequency response curves of the standard speaker and the product speaker at 1KHz can be obtained by calculation, that is, Figure 7 shown.

[0134] The 1 kHz reference point is only used for reference in this embodiment, and other frequency response points may be used as reference points for aligning the two curves, which is not limited in this application.

[0135] After obtaining the ideal curve difference, the frequency response curve H0 of the standard speaker at the target opening angle obtained in advance can be retrieved, that is, the ideal response curve of the standard speaker at the target opening angle. The frequency response curve H0 of the standard speaker at the target opening angle is superimposed with the ideal curve difference to obtain the frequency response curve LL' of the product speaker at the target opening angle (here, the audio response curve of the left speaker at the left ear is taken as an example), that is, the product response curve of the product speaker at the target opening angle.

[0136] 203. Obtain a current response curve of the product speaker, and obtain an expected curve difference based on the current response curve and the product response curve.

[0137] Taking the left speaker as an example, the frequency response of the left speaker output at the left ear under the dummy head model is retrieved, that is, the frequency response curve LL.

[0138] At this time, the frequency response curve LL of the product speaker at the original opening angle is obtained, and the difference between the frequency response curve LL of the product speaker at the original opening angle and the frequency response curve LL' of the product speaker at the target opening angle is calculated, so that the expected curve difference can be obtained, that is, Figure 8 shown.

[0139] 204. Obtain compensation parameters corresponding to the first frequency compensation operation and the second frequency compensation operation according to the expected curve difference.

[0140] The first frequency compensation operation and the second frequency compensation operation are both for adjusting the sound field effect of the audio signal so that the sound field effect can be Figure 2 The signal corresponding to the above different sound sources is respectively compensated, so that the listening effect of the left ear is processed into LL'+RL', and the listening effect of the right ear is processed into RR'+LR' as much as possible, so as to enhance the sound field effect of the speaker device and make the sound field effect have a higher degree of restoration.

[0141] After the expected curve difference is obtained, corresponding compensation parameters can be generated according to the response characteristics of the expected curve difference at different frequencies, so as to provide the digital audio sound field processing method to perform the first frequency compensation and the second frequency compensation operations corresponding to any of the above embodiments. It can be understood that the specific parameter values ​​of the above compensation parameters need to be determined according to the actual calculation situation, and this application does not limit this.

[0142] See also Fig. 9 , the figure shows the structure of the speaker device provided in the embodiment of the present application.

[0143] Among them, the sound-speaking device can be a device with a speaker (or called a loudspeaker, a loudspeaker), including an independent speaker, headphones, a computer with integrated / external speakers, a television, or other similar devices that can play digital audio signals through at least two speakers. This application does not limit the specific form of the sound-speaking device.

[0144] like Fig. 9 As shown, the speaker device 3 may include: a processor 31 and a memory 32. These components communicate via one or more buses. Those skilled in the art will appreciate that the structure of the speaker device 3 shown in the figure does not constitute a limitation on the present application, and it may be a bus structure or a star structure, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0145] The processor 31 is the control center of the speaker device 3. It uses various interfaces and lines to connect various parts of the entire speaker device 3. It runs or executes software programs and / or modules stored in the memory 32, and calls data stored in the memory to perform various functions and / or process data of the speaker device 3. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs with the same or different functions. For example, the processor 31 can only include a central processing unit (CPU). In the construction completion method of this application, the CPU can be a single computing core or multiple computing cores.

[0146] Among them, the memory 32 can be used to store the execution instructions of the processor 31, and the memory 32 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0147] When the execution instructions in the memory 32 are executed by the processor 31, the speaker device 3 can execute some or all of the steps in the above-mentioned digital audio sound field effect processing method embodiment, for example:

[0148] Based on the standard speakers and dummy head model including left and right sides, a first audio signal output to the left ear and a second audio signal output to the right ear are obtained at a preset opening angle; a first frequency compensation operation for adjusting the sound field effect is performed on the first audio signal and the second audio signal respectively; the first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branch signals and second branch signals respectively; wherein, the first branch signal is sent to the back end, and the second branch signal performs a second frequency compensation operation for adjusting the sound field effect according to the different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear; the second branch signal obtained after the second frequency compensation operation is mixed with the second branch signal corresponding to the other ear to obtain a mixed second branch signal; the first branch signal and the mixed second branch signal are mixed again to obtain a first output signal and a second output signal for speaker output after adjusting the sound field effect.

[0149] In one embodiment, the processor 31 may be configured to execute:

[0150] The first component compensation is performed on the first component signal; and the second component compensation is performed on the second component signal; wherein a compensation parameter of the first component compensation is different from a compensation parameter of the second component compensation.

[0151] In one embodiment, the processor 31 may be configured to execute:

[0152] A first component signal corresponding to the first audio signal and compensated by the first component is mixed with a second component signal corresponding to the second audio signal and compensated by the second component to obtain a mixed second branch signal corresponding to the first audio signal; and a second component signal corresponding to the first audio signal and compensated by the second component is mixed with a first component signal corresponding to the second audio signal and compensated by the first component to obtain a mixed second branch signal corresponding to the second audio signal.

[0153] In one embodiment, the processor 31 may be configured to execute:

[0154] The signal branch includes a first branch, a second branch and a third branch; the first branch is amplified by the first amplification coefficient K1 of the first channel to obtain a first branch signal; the second branch is amplified by the second amplification coefficient K2 of the second channel to obtain a first component signal of the second branch signal; the third branch is amplified by the third amplification coefficient K3 of the third channel to obtain a second component signal of the second branch signal.

[0155] In one embodiment, the processor 31 may be configured to execute:

[0156] Adjust the second amplification factor of the second channel and the compensation parameters of the first component compensation; adjust the third amplification factor of the third channel and the compensation parameters of the second component compensation; through the above adjustment, the target sound field formed by the second branch signal is brought forward relative to the original sound field.

[0157] In one embodiment, the processor 31 may be configured to execute:

[0158] The mixed second branch signal is delayed; and the delayed second branch signal is mixed again with the first branch signal on the corresponding side.

[0159] In one embodiment, the processor 31 may be configured to execute:

[0160] Obtain a standard response curve of a standard speaker at a target opening angle; obtain a product response curve of a product speaker measured at the target opening angle based on the standard response curve; obtain a current response curve of the product speaker, and obtain an expected curve difference based on the current response curve and the product response curve; obtain compensation parameters corresponding to a first frequency compensation operation and a second frequency compensation operation based on the expected curve difference.

[0161] In one embodiment, the processor 31 may be configured to execute:

[0162] Obtain frequency response curves of a product speaker and a standard speaker; adjust the frequency response curve corresponding to the product speaker so that the frequency response curves of the product speaker and the standard speaker are aligned at a preset frequency; calculate and obtain an ideal curve difference between the frequency response curves of the product speaker and the standard speaker; obtain a frequency response curve of the left ear at a target opening angle of the standard speaker, and a frequency response curve of the right ear at a target opening angle of the standard speaker; superimpose the frequency response curve of the left ear at the target opening angle of the standard speaker, and the frequency response curve of the right ear at the target opening angle of the standard speaker with the ideal curve difference, respectively, to obtain the left standard response curve and the right standard response curve.

[0163] As can be seen from the above, the sound field effect processing method and speaker device of digital audio in the present application, by performing a first frequency compensation operation on the first audio signal and the second audio signal respectively, and then branching the compensated signals and performing compensation and mixing operations, reduce the complexity of the algorithm, so that the digital audio processing process can achieve better sound field effects with a lower amount of calculation, which is conducive to improving the adaptability of the processing method on hardware platforms with lower performance, and thus improving the sound field effect and the degree of restoration of the low-performance platform during use.

[0164] The present application also provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is run by a processor, the program may execute some or all of the steps in the embodiments provided in the present application, for example:

[0165] Based on the standard speakers and dummy head model including left and right sides, a first audio signal output to the left ear and a second audio signal output to the right ear are obtained at a preset opening angle; a first frequency compensation operation for adjusting the sound field effect is performed on the first audio signal and the second audio signal respectively; the first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branch signals and second branch signals respectively; wherein, the first branch signal is sent to the back end, and the second branch signal performs a second frequency compensation operation for adjusting the sound field effect according to the different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear; the second branch signal obtained after the second frequency compensation operation is mixed with the second branch signal corresponding to the other ear to obtain a mixed second branch signal; the first branch signal and the mixed second branch signal are mixed again to obtain a first output signal and a second output signal for speaker output after adjusting the sound field effect.

[0166] The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0167] In the embodiment of the present application, the speaker device and the digital audio sound field effect processing method in the above embodiment belong to the same concept, and any method step provided in the embodiment of the digital audio sound field effect processing method can be run on the speaker device. The specific implementation process is detailed in the embodiment of the digital audio sound field effect processing method, and any combination can be used to form an optional embodiment of the present application, which will not be repeated here.

[0168] Obviously, the above embodiments of the present application are merely examples for clearly illustrating the present application, and are not intended to limit the construction completion methods of the present application. For ordinary technicians in the relevant field, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the construction completion methods here. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present application should be included in the protection scope of the claims of the present application.

Claims

1. A method for processing sound field effects of digital audio, characterized in that: The method comprises: Obtaining a first audio signal and a second audio signal to be processed by the left and right speakers respectively; Performing a first frequency compensation operation for adjusting a sound field effect on the first audio signal and the second audio signal respectively; The first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branched signals and second branched signals; wherein the first branched signal is sent to the back end, and the second branched signal performs a second frequency compensation operation for adjusting the sound field effect according to different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear; Mixing the second branch signal obtained after the second frequency compensation operation with the second branch signal corresponding to the speaker on the other side to obtain a mixed second branch signal; The first branch signal and the mixed second branch signal are mixed again to obtain a first output signal and a second output signal for outputting to speakers on both sides after adjusting the sound field effect; The second branch signal includes a first component signal and a second component signal; the first component signal is a signal from a left speaker reaching a left ear or a right ear, and the second component signal is a signal from a right speaker reaching a left ear or a right ear; the second frequency compensation includes first component compensation and second component compensation; The second branch signal performs a second frequency compensation operation for adjusting the sound field effect according to different sound propagation paths of the speakers on different sides reaching the positions of the left ear or the right ear, respectively, including: performing the first component compensation on the first component signal; performing the second component compensation on the second component signal; The compensation parameter of the first component compensation is different from the compensation parameter of the second component compensation.

2. The method for processing sound field effects of digital audio according to claim 1, characterized in that: The at least two second branch signals obtained after the second frequency compensation operation are mixed to obtain two second branch signals corresponding to the left ear and the right ear, comprising: Mixing a first component signal corresponding to the first audio signal after the first component compensation and a second component signal corresponding to the second audio signal after the second component compensation to obtain a mixed second branch signal corresponding to the first audio signal; The second component signal corresponding to the first audio signal and compensated by the second component is mixed with the first component signal corresponding to the second audio signal and compensated by the first component to obtain a mixed second branch signal corresponding to the second audio signal.

3. The method for processing sound field effects of digital audio according to claim 1, characterized in that: The first audio signal and the second audio signal obtained after the first frequency compensation operation are respectively branched to obtain corresponding first branched signals and second branched signals, respectively, including: The signal branch includes a first branch, a second branch and a third branch; The first branch is amplified by a first amplification coefficient K1 of the first channel to obtain a first branch signal; The second branch is amplified by a second amplification coefficient K2 of the second channel to obtain a first component signal of the second branch signal; The third branch is amplified by the third amplification coefficient K3 of the third channel to obtain a second component signal of the second branch signal.

4. The method for processing sound field effects of digital audio according to claim 3, characterized in that: The first channel is used to adjust the sound intensity output to the left ear or the right ear on the same side as the speaker; The second channel is used to adjust the intensity of the sound output to the ear on the same side as the speaker; The third channel is used to adjust the intensity of the sound output to the ear on the different side from the speaker.

5. The method for processing sound field effects of digital audio according to claim 3 or 4, characterized in that: The at least two second branch signals obtained after the second frequency compensation operation are mixed to obtain two second branch signals corresponding to the left ear and the right ear, comprising: adjusting a second amplification factor of the second channel and a compensation parameter of the first component compensation; adjusting a third amplification factor of the third channel and a compensation parameter of the second component compensation; Through the above adjustment, the target sound field formed by the second branch signal is brought forward relative to the original sound field.

6. The method for processing sound field effects of digital audio according to claim 1, characterized in that: The first branch signal and the mixed second branch signal are mixed again to obtain a first output signal and a second output signal for speaker output, and further includes: Performing delay processing on the mixed second branch signal; The delayed second branch signal is mixed again with the first branch signal on the corresponding side.

7. The method for processing sound field effects of digital audio according to claim 1, characterized in that: The method further comprises: Obtain a standard response curve of a standard speaker at a target opening angle; Obtaining a product response curve of the product speaker measured at a target opening angle according to the standard response curve; Obtaining a current response curve of a product speaker, and obtaining an expected curve difference based on the current response curve and the product response curve; Compensation parameters corresponding to the first frequency compensation operation and the second frequency compensation operation are obtained according to the expected curve difference.

8. The method for processing sound field effects of digital audio according to claim 7, characterized in that: The method further comprises: Obtain the frequency response curves of product speakers and standard speakers; Adjusting the frequency response curve corresponding to the product speaker so that the frequency response curves of the product speaker and the standard speaker are aligned at a preset frequency; Calculate and obtain the ideal curve difference between the frequency response curves of the product speaker and the standard speaker; The step of obtaining a product response curve measured by the product speaker at a target opening angle according to the standard response curve includes: Obtain a standard response curve of a standard speaker at a target opening angle; The standard response curve of the standard horn at the target opening angle is superimposed with the difference between the ideal curve to obtain the product response curve of the product horn measured at the target opening angle.

9. A sound-speaking device, characterized in that: The speaker device comprises: Processor; and a memory electrically connected to the processor; The memory stores machine-readable instructions executable by the processor, and the processor executes the machine-readable instructions to perform the sound field effect processing method for digital audio as described in any one of claims 1-8.

Images