Audio signal processing method and device, computer equipment and storage medium

By calculating the phase difference of the audio signal and determining the target device, the problem of rough output of stereo signal in multi-channel environment of home theaters is solved, achieving better sound effects and user experience.

CN119012111APending Publication Date: 2024-11-22SHENZHEN SKYWORTH INT TRADE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410973734.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-18
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In the multi-channel hardware environment of home theaters, it is difficult to effectively adapt to stereo program sources, resulting in rough audio signal output effects, which cannot meet the sound characteristics of the SoundBar+TV combination mode, affecting the user experience.

Method used

By obtaining the left and right channel signals of the audio signal, the phase difference between each frequency point is calculated, and the target device is determined based on the phase difference, and the frequency point is output to different channels to realize multi-channel division of audio and better sound effects.

Benefits of technology

It improves the sound effect of the device playing stereo, improves the user experience, and achieves accurate multi-channel division and sound quality improvement of audio signals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119012111A_ABST
    Figure CN119012111A_ABST
Patent Text Reader

Abstract

The embodiment of the invention relates to an audio signal processing method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a first signal of an audio signal in a left sound channel, and obtaining a second signal of the audio signal in a right sound channel; determining a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point and each second frequency point are in one-to-one correspondence; determining a target device according to the phase difference, wherein the target device is used for outputting a first frequency point and a second frequency point through different sound channels; and outputting the first frequency point and the second frequency point to target equipment. Therefore, the phase difference between every two corresponding frequency points can be determined according to the signals in the two sound channels, each frequency point is output to the determined different sound channels of the target device according to the phase difference, multi-sound-channel division of the audio is achieved, the sound effect of the device for playing stereophonic sound is improved through multi-sound-channel playing, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of audio processing technology, and in particular to an audio signal processing method, apparatus, computer equipment and storage medium. Background Art

[0002] In the current multi-channel hardware environment of home theaters, in addition to playing back movie sources based on special multi-channel mixing, there are also a large number of stereo program sources. In order to adapt to the hardware environment or obtain better listening effects, the industry has several mainstream algorithms for upmixing stereo to multi-channel. Taking the early Dolby Surround Decoder as an example, the principle of its upmixing algorithm is to take the difference between the left and right sides to obtain the same-direction signal, and the remaining signal is copied once and reversed as the surround signal.

[0003] The M / S recording and mixing technique commonly used in record production is to point a cardioid microphone directly in front of the sound source as the center pickup, which is the Mid in M / S, and an 8-shaped microphone perpendicular to the sound source as the side pickup, which is the Side in M / S. After adjustment, it is modulated back to stereo through time domain signal addition and subtraction. Among them, Mid refers to the two channels that output the center signal, and Side refers to the two channels that output the two side signals. For the combination mode of SoundBar+TV (for example, sound bar audio + TV equipment), considering the sound characteristics of each part, it is believed that the M / S format is better for playing back stereo content. Among them, SoundBar is the device that outputs the center signal, and TV is the device that outputs the two side signals.

[0004] However, the mature commercial algorithms of the above two technologies are not suitable for the sound characteristics of the current combination mode. On the other hand, the simple addition and subtraction of stereo signals in the time domain is too rough. Therefore, how to output stereo audio signals as multi-channel signals to improve user experience has become an urgent problem to be solved. Summary of the invention

[0005] In view of this, in order to solve the above technical problems or part of the technical problems, the embodiments of the present invention provide an audio signal processing method, apparatus, computer equipment and storage medium.

[0006] In a first aspect, an embodiment of the present invention provides an audio signal processing method, including:

[0007] Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel;

[0008] Determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner;

[0009] determining a target device in a device set according to the phase difference, wherein the target device is used to output the first frequency point and the second frequency point through different channels;

[0010] The first frequency point and the second frequency point are output to the target device.

[0011] In a possible implementation manner, determining the phase difference between each first frequency point of the first signal and each second frequency point of the second signal includes:

[0012] Determine a first phase angle of each first frequency point of the first signal, and determine a second phase angle of each second frequency point of the second signal;

[0013] determining a difference between the first phase angle and the second phase angle;

[0014] The absolute value of the difference is taken as the phase difference.

[0015] In a possible implementation manner, determining a first phase angle of each first frequency point of the first signal, and determining a second phase angle of each second frequency point of the second signal includes:

[0016] Convert the first signal and the second signal into frequency domain signals by fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal;

[0017] A first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

[0018] In a possible implementation manner, determining a target device in a device set according to the phase difference includes:

[0019] When the phase difference is less than a preset threshold, determining that the target device is a central signal device;

[0020] When the phase difference is greater than or equal to a preset threshold, it is determined that the target device is a two-side signal device, and both the center signal device and the two-side signal device include two channels for simultaneously playing the audio signal.

[0021] In a possible implementation manner, outputting the first frequency point and the second frequency point to a target channel of the target device includes:

[0022] When the target device is a central signal device, the first frequency point is output to the left channel of the central signal device, and the second frequency point is output to the right channel of the central signal device;

[0023] When the target device is a double-sided signal device, the first frequency point is output to a left channel of the double-sided signal device, and the second frequency point is output to a right channel of the double-sided signal device.

[0024] In a possible implementation, the method further includes:

[0025] When the center signal device outputs the first frequency point and the second frequency point, controlling the target channels of the two side signal devices to be empty;

[0026] When the two side signal devices output the first frequency point and the second frequency point, the target channel of the center signal device is controlled to be blank.

[0027] In a possible implementation manner, the two side signal devices include: a video playback device, and the central signal device includes: an audio device connected to the video playback device.

[0028] In a second aspect, an embodiment of the present invention provides an audio signal processing device, including:

[0029] An acquisition module, used to acquire a first signal of the audio signal in the left channel, and to acquire a second signal of the audio signal in the right channel;

[0030] a determination module, configured to determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner;

[0031] The determination module is further configured to determine a target device in a device set according to the phase difference, wherein the target device is configured to output the first frequency point and the second frequency point through different channels;

[0032] An output module is used to output the first frequency point and the second frequency point to the target device.

[0033] In a third aspect, an embodiment of the present invention provides a computer device, comprising: a processor and a memory, wherein the processor is used to execute an audio signal processing program stored in the memory to implement the audio signal processing method described in any one of the first aspects above.

[0034] In a fourth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the audio signal processing method described in any one of the first aspects above.

[0035] The audio signal processing solution provided by the embodiment of the present invention obtains the first signal of the audio signal in the left channel, and obtains the second signal of the audio signal in the right channel; determines the phase difference between each first frequency point of the first signal and each second frequency point of the second signal, and each first frequency point corresponds to each second frequency point; determines the target device in the device set according to the phase difference, and the target device is used to output the first frequency point and the second frequency point through different channels; outputs the first frequency point and the second frequency point to the target device. In this way, the phase difference between each two corresponding frequency points can be determined for the signals in the two channels, and each frequency point can be output to different channels of the determined target device according to the phase difference, so as to realize multi-channel division of the audio, and improve the stereo sound effect of the device through multi-channel playback, thereby enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A flowchart of an audio signal processing method provided by an embodiment of the present invention;

[0037] Figure 2 A schematic flow chart of another audio signal processing method provided by an embodiment of the present invention;

[0038] Figure 3 A schematic diagram of the structure of an audio signal processing device provided by an embodiment of the present invention;

[0039] Figure 4 A schematic diagram of the structure of a computer device provided by an embodiment of the present invention;

[0040] Figure 5 A schematic diagram of an audio signal separation result provided by an embodiment of the present invention;

[0041] Figure 6 A schematic diagram of another audio signal separation result provided by an embodiment of the present invention;

[0042] Figure 7 A schematic diagram of an audio signal provided by an embodiment of the present invention;

[0043] Figure 8 A schematic diagram of two-side signals provided by an embodiment of the present invention;

[0044] Fig. 9 A schematic diagram of a central signal provided by an embodiment of the present invention;

[0045] Fig.10 A schematic flow chart of another audio signal processing method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0047] To facilitate understanding of the embodiments of the present invention, specific embodiments will be further explained below in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present invention.

[0048] Figure 1 A flowchart of an audio signal processing method provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method specifically includes:

[0049] S11. Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel.

[0050] The audio signal processing method provided in the embodiment of the present invention is applied to a computer device, which may include but is not limited to: a server, a desktop computer, a central processing unit, etc., for calculating and processing an audio signal, and sending the processed signal to a target device for output. Specifically, the phase difference between each two corresponding frequency points is determined for the signals in the two channels, and each frequency point is output to a different channel of the determined target device according to the phase difference.

[0051] In this embodiment, the audio signal is the sound source to be played, which can be stereo audio. A stereo audio PCM (pulse code modulation) signal data column is input, and the left channel is defined as the first channel and the right channel is defined as the second channel. The target signal is input into the two channels, the first signal of the audio signal is input into the left channel, and the second signal of the audio signal is input into the right channel, and the first signal of the left channel and the second signal of the right channel are obtained respectively.

[0052] S12. Determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal.

[0053] In this embodiment, the first signal and the second signal are time domain signals, which are converted into frequency domain signals using a fast Fourier transform method, and the phase of each same frequency point of the first channel and the second channel is compared to determine the phase difference.

[0054] Specifically, each first frequency point in the first signal corresponds to each second frequency point in the second signal. The method for determining the first frequency point and the second frequency point may be to sample the first signal and the second signal at a preset sampling frequency, obtain multiple first frequency points of the first signal after sampling, and obtain multiple second frequency points of the second signal. Determine the first phase angle of each first frequency point according to the Euler formula, and determine the second phase angle of each second frequency point, and use the absolute value of the difference between the first phase angle and the corresponding second phase angle as the phase difference.

[0055] S13: Determine a target device in the device set according to the phase difference.

[0056] In this embodiment, the output channel format is reconstructed to define four channels and two pairs of stereo channels corresponding to two devices, and the channels corresponding to each device are a center stereo channel and a side stereo channel. The phase differences corresponding to all frequency points are compared with the threshold range and selected to be allocated to the center channel or the side channel.

[0057] Specifically, the device set includes: a device that outputs a center signal through a center stereo channel (e.g., a SoundBar) and a device that outputs side signals through side stereo channels (e.g., a TV), different target devices corresponding to different threshold ranges of phase difference are pre-set, and target devices corresponding to the first frequency point and the second frequency point of the current phase difference are determined according to the threshold range of the phase difference, and the target devices are used to output the first frequency point and the second frequency point through different channels. When the threshold range of the currently calculated phase difference changes, different target devices are switched to output the signals corresponding to the first frequency point and the second frequency point.

[0058] S14: output the first frequency point and the second frequency point to the target device.

[0059] In this embodiment, after the corresponding target devices are determined for the signals corresponding to all frequency points, the frequency domain signals are converted into time domain signals using an inverse fast Fourier transform (IFFT), and after obtaining the PCM signals, they are output to the corresponding target devices for playback.

[0060] Specifically, since the frequencies in the first signal and the second signal correspond one to one, the first frequencies and the second frequencies corresponding to each other in different positions may be output by different target devices, for example, the first frequencies and the second frequencies at position A are output by two channels of a television device, and the first frequencies and the second frequencies at position B are output by two channels of an audio device. By outputting different frequencies by different target devices, real-time switching of the output of the first signal and the second signal by different devices can be achieved.

[0061] Each target device includes two channels, a left channel and a right channel, and the first frequency point and the corresponding second frequency point are simultaneously output through different channels of the determined target device. Specifically, the first signal can be preset to correspond to the left channel of each target device, and the second signal can be preset to correspond to the right channel of each target device. When the target device is determined, the first frequency point is output to the left channel of the corresponding target device, and the second frequency point is output to the right channel of the corresponding target device.

[0062] The audio signal processing method provided by the embodiment of the present invention obtains the first signal of the audio signal in the left channel, and obtains the second signal of the audio signal in the right channel; determines the phase difference between each first frequency point of the first signal and each second frequency point of the second signal, and each first frequency point corresponds to each second frequency point; determines the target device in the device set according to the phase difference, and the target device is used to output the first frequency point and the second frequency point through different channels; outputs the first frequency point and the second frequency point to the target device. In this way, it is possible to determine the phase difference between each two corresponding frequency points for the signals in the two channels, and output each frequency point to different channels of the determined target device according to the phase difference, thereby realizing multi-channel division of the audio, and improving the stereo sound effect of the device through multi-channel playback, thereby improving the user experience.

[0063] Figure 2 A flowchart of another audio signal processing method provided by an embodiment of the present invention is shown as follows: Figure 2 As shown, the method specifically includes:

[0064] S21. Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel.

[0065] In this embodiment, similar to step S11, the specific Figure 1 For the sake of brevity, the relevant content will not be elaborated here.

[0066] S22. Determine a first phase angle of each first frequency point of the first signal, and determine a second phase angle of each second frequency point of the second signal; determine a difference between the first phase angle and the second phase angle; and use the absolute value of the difference as the phase difference.

[0067] In this embodiment, determining a first phase angle of each first frequency point of the first signal, and determining a second phase angle of each second frequency point of the second signal, includes:

[0068] The first signal and the second signal are converted into frequency domain signals through fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal; a first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

[0069] The first signal and the second signal are time domain signals, and the time domain signals are converted into frequency domain signals using the FFT (Fast Fourier Transform) method to obtain a first spectrum and a second spectrum; the phase angle of a first frequency point in the first spectrum and a second frequency point in the second spectrum corresponding to the first frequency point are compared,

[0070] The phase angle of each frequency point is determined by the Euler formula: ix =(cosx+isinx) where i is the imaginary part of the complex number. The phase angle corresponding to the value can be obtained by converting the real part u and the imaginary part v using trigonometric functions. The result is in radians.

[0071]

[0072] The audio signal is a PCM signal, which is a discrete signal. The FFT input is N data points with a sampling rate of Ts. The algorithm takes N data points for processing at one time, and the imaginary exponential term can be obtained by calculation. The N harmonic components represented by:

[0073]

[0074]

[0075] According to the coefficient C of each imaginary exponential term n , the discrete Fourier transform of the periodic sequence is defined as:

[0076]

[0077] Further, an absolute value of a difference between the first phase angle and the second phase angle is determined as a phase difference between the first frequency point and the second frequency point.

[0078] S23. When the phase difference is less than a preset threshold, the target device is determined as a center signal device in the device set; when the phase difference is greater than or equal to the preset threshold, the target device is determined as a side signal device in the device set, and both the center signal device and the side signal device include two channels for simultaneously playing the audio signal.

[0079] In this embodiment, a preset threshold is set to determine the range of the phase difference (for example, the preset threshold can be a phase difference of 30 degrees. Within 30 degrees, it is generally a human voice concentration area or a main instrument concentration area, which can be set as the sound source output to the center signal, and the rest of the content is considered to be sound field information such as reverberation sound and ambient sound, which can be used as the sound source output to the two side signals). When the phase difference is less than the preset threshold, the target device is determined to be a center signal device, that is, the device currently outputting the first frequency point and the second frequency point is determined to be the device outputting the center signal. When the phase difference is greater than or equal to the preset threshold, the target device is determined to be a two side signal device, that is, the device currently outputting the first frequency point and the second frequency point is determined to be the device outputting the two side signals. Among them, the center signal device is Mid in the M / S mixing process, the two side signal devices are Side in the M / S mixing process, and the two side signal devices include: a video playback device, such as a TV device, and the center signal device includes: an audio device connected to the video playback device, such as a soundbar device. Each target device includes two channels, namely the left channel and the right channel, which correspond to an output frequency point respectively. During the continuous output process, the central signal device and the two side signal devices alternately output signals corresponding to different frequency points, that is, the audio signal is output through four channels.

[0080] Further, when it is determined that the current frequency point corresponds to the central signal device, step S24 is executed, and when it is determined that the current frequency point corresponds to the two side signal devices, step S25 is executed.

[0081] In one possible implementation, the number of target devices is not specifically limited. The larger the number, the more channels that can output audio signals, and the more three-dimensional the output sound. Multiple output channels can be determined according to the number of target devices currently playing audio. When there are multiple target devices, each target device has two channels, a left channel and a right channel. Each target device corresponds to a threshold range of a phase difference. The target devices corresponding to the current two frequency points can be determined according to the current threshold range of the phase difference, and the two frequency points can be output respectively through the left channel and the right channel of the target device.

[0082] S24. When the target device is a central signal device, output the first frequency point to a left channel of the central signal device, and output the second frequency point to a right channel of the central signal device.

[0083] In this embodiment, after the corresponding target device is determined for each first frequency point and the second frequency point, the frequency domain signal is converted into a time domain signal using an inverse fast Fourier transform and then output to the target device for playback.

[0084] When the target device is a central signal device, the signals corresponding to the current first frequency and second frequency are output to the central signal device, the signal corresponding to the first frequency is output through the left channel of the central signal device, and the signal corresponding to the second frequency is output through the right channel of the central signal device.

[0085] S25. When the target device is a double-sided signal device, output the first frequency point to a left channel of the double-sided signal device, and output the second frequency point to a right channel of the double-sided signal device.

[0086] In this embodiment, when the target device is a double-sided signal device, the signals corresponding to the current first frequency and second frequency are output to the double-sided signal devices, the signal corresponding to the first frequency is output through the left channel of the double-sided signal devices, and the signal corresponding to the second frequency is output through the right channel of the double-sided signal devices.

[0087] In a possible implementation, when the central signal device outputs the first frequency point and the second frequency point, the target channels of the signal devices on both sides are controlled to be empty; when the signal devices on both sides output the first frequency point and the second frequency point, the target channels of the central signal device are controlled to be empty. The target channels are the left channel and the right channel of the target device, and the two target devices will not output the signals corresponding to the frequency points at the same time. When one target device outputs the signal corresponding to the frequency point, the two channels corresponding to the other target device are empty.

[0088] As an example, taking the center signal device as SoundBar and the two side signal devices as TV, the SoundBar+TV can be used to make sound together. This embodiment is a phase screening based on the frequency domain of the audio signal. The phase angles of all frequency points are calculated by FFT, and then the phase angles of the two channels at the same time and frequency point are different. The channel position of the target device corresponding to each frequency point signal is assigned according to the comparison result between the obtained phase difference and the preset threshold. The purpose is to separate the signals within the specified phase angle range (such as the center and the two sides) in front. In this embodiment, the input channels are 2 in and 4 out, and the 4 outputs are in the form of two independent stereo groups, one group is the left channel and the right channel of the center signal device, and the other group is the left channel and the right channel of the two side signals.

[0089] Taking a group of pure tone signals as an example, the first signal of the first channel and the second signal of the second channel correspond to the left channel and the right channel of the stereo channel respectively. The signal content of the first channel is a pure tone signal with a phase angle of 0° at 1KHz, and the signal content of the second channel is a pure tone signal with a phase angle of 60° at 1KHz.

[0090] After the difference between the 1KHz frequency phase of the first channel and the 1KHz frequency phase of the second channel is calculated and the absolute value is taken, the result is compared with the preset threshold value 30. If it is greater than the preset threshold value, the 1KHz signal is allocated to the two side channels, and the center channel is left blank.

[0091] For general signals, FFT is performed on the first channel and the second channel respectively to obtain the first spectrum (a data group composed of frequency points) and the second spectrum respectively. The frequency points with the same position in the first spectrum and the second spectrum are taken, and the phase angle of the frequency point signal can be obtained according to the complex data of the frequency point using the Euler formula.

[0092] like Figure 5 FIG. 1 is a schematic diagram of an audio signal separation result provided by an embodiment of the present invention. Figure 6 FIG. 1 is another schematic diagram of audio signal separation results provided by an embodiment of the present invention. According to the method in this embodiment, after an audio signal is input, a first signal of a left channel (such as Figure 5 The top signal in the middle), and the second signal in the right channel (such as Figure 5 The two vertical lines represent the phase difference between the two frequency points corresponding to the first signal and the second signal. According to the phase difference, the elliptical image on the right can be obtained. Further, after separating the audio signal, the separation result of the center signal and the two side signals of the stereo signal with a phase difference of 60 degrees can be obtained with 30 degrees as the boundary (as shown in Figure 1). Figure 6 shown).

[0093] Figure 7 FIG. 1 is a schematic diagram of an audio signal provided by an embodiment of the present invention. Figure 8 FIG. 1 is a schematic diagram of a two-side signal provided by an embodiment of the present invention. Fig. 9 FIG. 1 is a schematic diagram of a center signal provided by an embodiment of the present invention. Figure 7 After all the audio signals are separated, the following can be separated: Figure 8 and Fig. 9 The Lissajous plot of the center signal and the signals on both sides shows a clear separation effect.

[0094] As another example, Fig.10The figure is a flow chart of another audio signal processing method provided by an embodiment of the present invention. The sound source is input through the L channel and the R channel, and the phase difference between each two corresponding frequency points is obtained by fast Fourier transform and Euler formula. When the phase difference is less than the set value, the output m of the central signal device is 1, that is, the L channel and the R channel of the central signal device output the original signal, the output s of the two side signal devices is 0, and the L channel and R channel outputs of the two side signal devices are set to zero. When the phase difference is greater than or equal to the set value, the output m of the central signal device is 0, that is, the L channel and the R channel outputs of the central signal device are set to zero, the output s of the two side signal devices is 1, and the L channel and R channel of the two side signal devices output the original signal. Thus, four output conditions of mL, mR, sL, and sR can be obtained. When m or s is 0, the corresponding L and R channels are set to zero. When m or s is 1, the corresponding L and R channels output the original signal.

[0095] The audio signal processing method provided by the embodiment of the present invention obtains the first signal of the audio signal in the left channel and obtains the second signal of the audio signal in the right channel. Determine the first phase angle of each first frequency point of the first signal and determine the second phase angle of each second frequency point of the second signal; determine the difference between the first phase angle and the second phase angle; and use the absolute value of the difference as the phase difference. When the phase difference is less than the preset threshold, the target device is determined to be a center signal device; when the phase difference is greater than or equal to the preset threshold, the target device is determined to be a side signal device. When the target device is a center signal device, the first frequency point is output to the left channel of the center signal device, and the second frequency point is output to the right channel of the center signal device. When the target device is a side signal device, the first frequency point is output to the left channel of the side signal device, and the second frequency point is output to the right channel of the side signal device. Thus, the phase difference of the corresponding frequency points in different channels can be used to allocate the center and side signals to achieve center and side signal separation, and better sound quality and effect can be obtained while ensuring real-time processing. By separating the audio signal, the audio signal can be accurately divided, and the separated signal has complete phase restoration capability without losing any original signal sound field information. The traditional M / S solution cannot distinguish the phase information on both sides of LR after signal processing, which means that the signal after M / S processing can no longer be restored to stereo without loss. The present invention completely retains all phase information, and the stereo signal can be completely restored after the center and the two side signals are added. The naturalness of the sense of hearing, the degree of sound and image restoration, and the delicateness of the sound quality are significantly higher than the traditional M / S solution. The present invention can also take into account the general situation of different SoundBars with different TVs, and specially open the separation angle setting, that is, the fade-in and fade-out angle parameter design on both sides of the center, and the parameters can be adjusted in a targeted manner to obtain the best combination effect. The number of channels can be freely configured. The algorithm is highly open, not only can 2-channel stereo be expanded to 4 channels, but also any channel can be expanded according to needs, and it can be freely used according to the purpose to adapt to more channel situations and more complex combination modes. Improve the user's auditory experience.

[0096] Figure 3 A schematic diagram of the structure of an audio signal processing device provided by an embodiment of the present invention is shown in FIG. Figure 3 As shown, the device specifically includes:

[0097] An acquisition module 31, configured to acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel;

[0098] A determination module 32, configured to determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner;

[0099] The determination module is further configured to determine a target device in a device set according to the phase difference, wherein the target device is configured to output the first frequency point and the second frequency point through different channels;

[0100] The output module 33 is used to output the first frequency point and the second frequency point to the target device.

[0101] In a possible implementation manner, the determination module is specifically configured to determine a first phase angle of each first frequency point of the first signal, and determine a second phase angle of each second frequency point of the second signal;

[0102] determining a difference between the first phase angle and the second phase angle;

[0103] The absolute value of the difference is taken as the phase difference.

[0104] In a possible implementation manner, the determination module is specifically configured to convert the first signal and the second signal into frequency domain signals by fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal;

[0105] A first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

[0106] In a possible implementation manner, the determination module is specifically configured to determine, in a device set, that the target device is a central signal device when the phase difference is less than a preset threshold;

[0107] When the phase difference is greater than or equal to a preset threshold, the target device is determined to be a two-side signal device in the device set, and both the center signal device and the two-side signal device include two channels for simultaneously playing the audio signal.

[0108] In a possible implementation manner, the output module is specifically configured to, when the target device is a central signal device, output the first frequency point to a left channel of the central signal device, and output the second frequency point to a right channel of the central signal device;

[0109] When the target device is a double-sided signal device, the first frequency point is output to a left channel of the double-sided signal device, and the second frequency point is output to a right channel of the double-sided signal device.

[0110] In a possible implementation manner, the control module 34 is configured to control the target channels of the two side signal devices to be blank when the center signal device outputs the first frequency point and the second frequency point;

[0111] When the two side signal devices output the first frequency point and the second frequency point, the target channel of the center signal device is controlled to be blank.

[0112] The device provided in this embodiment can be as follows Figure 3 The device shown in FIG. 1 may perform the following steps: Figure 1-2 All the steps of the method in Figure 1-2 For details on the technical effects of the method shown, please refer to Figure 1-2 For the sake of brevity, the relevant description is not repeated here.

[0113] Figure 4 A schematic diagram of the structure of a computer device provided by an embodiment of the present invention, Figure 4 The computer device 400 shown includes: at least one processor 401, a memory 402, at least one network interface 404 and other user interfaces 403. The various components in the computer device 400 are coupled together via a bus system 405. It is understood that the bus system 405 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 405 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 405 is not shown in FIG. Figure 4 Various buses are labeled as bus system 405 .

[0114] The user interface 403 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0115] It can be understood that the memory 402 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 402 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0116] In some implementations, the memory 402 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 4021 and application programs 4022 .

[0117] The operating system 4021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 4022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 4022.

[0118] In the embodiment of the present invention, by calling the program or instruction stored in the memory 402, specifically, the program or instruction stored in the application 4022, the processor 401 is used to execute the method steps provided by each method embodiment, for example, including:

[0119] Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel;

[0120] Determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner;

[0121] determining a target device in a device set according to the phase difference, wherein the target device is used to output the first frequency point and the second frequency point through different channels;

[0122] The first frequency point and the second frequency point are output to the target device.

[0123] In a possible implementation manner, a first phase angle of each first frequency point of the first signal is determined, and a second phase angle of each second frequency point of the second signal is determined;

[0124] determining a difference between the first phase angle and the second phase angle;

[0125] The absolute value of the difference is taken as the phase difference.

[0126] In a possible implementation manner, the first signal and the second signal are converted into frequency domain signals by fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal;

[0127] A first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

[0128] In a possible implementation, when the phase difference is less than a preset threshold, determining the target device as a central signal device in the device set;

[0129] When the phase difference is greater than or equal to a preset threshold, the target device is determined to be a two-side signal device in the device set, and both the center signal device and the two-side signal device include two channels for simultaneously playing the audio signal.

[0130] In a possible implementation manner, when the target device is a central signal device, the first frequency point is output to a left channel of the central signal device, and the second frequency point is output to a right channel of the central signal device;

[0131] When the target device is a double-sided signal device, the first frequency point is output to a left channel of the double-sided signal device, and the second frequency point is output to a right channel of the double-sided signal device.

[0132] In a possible implementation manner, when the center signal device outputs the first frequency point and the second frequency point, the target channels of the two side signal devices are controlled to be blank;

[0133] When the two side signal devices output the first frequency point and the second frequency point, the target channel of the center signal device is controlled to be blank.

[0134] In a possible implementation manner, the two side signal devices include: a video playback device, and the central signal device includes: an audio device connected to the video playback device.

[0135] The method disclosed in the above embodiment of the present invention can be applied to the processor 401, or implemented by the processor 401. The processor 401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 401 or the instruction in the form of software. The above processor 401 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 402, and the processor 401 reads the information in the memory 402 and completes the steps of the above method in combination with its hardware.

[0136] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.

[0137] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0138] The computer device provided in this embodiment may be Figure 4 The computer device shown in , can execute Figure 1-2 All steps of the audio signal processing method are realized Figure 1-2 For details, please refer to Figure 1-2 For the sake of brevity, the relevant description is not repeated here.

[0139] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0140] When one or more programs in the storage medium can be executed by one or more processors, the audio signal processing method executed on the device side can be implemented.

[0141] The processor is used to execute the audio signal processing program stored in the memory to implement the following steps of the audio signal processing method performed on the device side:

[0142] Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel;

[0143] Determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner;

[0144] determining a target device in a device set according to the phase difference, wherein the target device is used to output the first frequency point and the second frequency point through different channels;

[0145] The first frequency point and the second frequency point are output to the target device.

[0146] In a possible implementation manner, a first phase angle of each first frequency point of the first signal is determined, and a second phase angle of each second frequency point of the second signal is determined;

[0147] determining a difference between the first phase angle and the second phase angle;

[0148] The absolute value of the difference is taken as the phase difference.

[0149] In a possible implementation manner, the first signal and the second signal are converted into frequency domain signals by fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal;

[0150] A first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

[0151] In a possible implementation, when the phase difference is less than a preset threshold, determining the target device as a central signal device in the device set;

[0152] When the phase difference is greater than or equal to a preset threshold, the target device is determined to be a two-side signal device in the device set, and both the center signal device and the two-side signal device include two channels for simultaneously playing the audio signal.

[0153] In a possible implementation manner, when the target device is a central signal device, the first frequency point is output to a left channel of the central signal device, and the second frequency point is output to a right channel of the central signal device;

[0154] When the target device is a double-sided signal device, the first frequency point is output to a left channel of the double-sided signal device, and the second frequency point is output to a right channel of the double-sided signal device.

[0155] In a possible implementation manner, when the center signal device outputs the first frequency point and the second frequency point, the target channels of the two side signal devices are controlled to be blank;

[0156] When the two side signal devices output the first frequency point and the second frequency point, the target channel of the center signal device is controlled to be blank.

[0157] In a possible implementation manner, the two side signal devices include: a video playback device, and the central signal device includes: an audio device connected to the video playback device.

[0158] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0159] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0160] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An audio signal processing method, characterized in that: include: Acquire a first signal of the audio signal in a left channel, and acquire a second signal of the audio signal in a right channel; Determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner; determining a target device in a device set according to the phase difference, wherein the target device is used to output the first frequency point and the second frequency point through different channels; The first frequency point and the second frequency point are output to the target device.

2. The method according to claim 1, characterized in that: The determining a phase difference between each first frequency point of the first signal and each second frequency point of the second signal includes: Determine a first phase angle of each first frequency point of the first signal, and determine a second phase angle of each second frequency point of the second signal; determining a difference between the first phase angle and the second phase angle; The absolute value of the difference is taken as the phase difference.

3. The method according to claim 2, characterized in that The determining of a first phase angle of each first frequency point of the first signal, and determining a second phase angle of each second frequency point of the second signal, comprises: Convert the first signal and the second signal into frequency domain signals by fast Fourier transform to obtain a first spectrum corresponding to the first signal and a second spectrum corresponding to the second signal; A first phase angle corresponding to a first frequency point in the first spectrum is determined according to the Euler formula, and a second phase angle corresponding to a second frequency point in the second spectrum is determined.

4. The method according to claim 1, characterized in that: The step of determining a target device in a set of devices according to the phase difference comprises: When the phase difference is less than a preset threshold, determining the target device as a central signal device in the device set; When the phase difference is greater than or equal to a preset threshold, the target device is determined to be a two-side signal device in the device set, and both the center signal device and the two-side signal device include two channels for simultaneously playing the audio signal.

5. The method according to claim 3, characterized in that: The outputting the first frequency point and the second frequency point to the target device includes: When the target device is a central signal device, the first frequency point is output to the left channel of the central signal device, and the second frequency point is output to the right channel of the central signal device; When the target device is a double-sided signal device, the first frequency point is output to a left channel of the double-sided signal device, and the second frequency point is output to a right channel of the double-sided signal device.

6. The method according to claim 5, characterized in that The method further comprises: When the center signal device outputs the first frequency point and the second frequency point, controlling the target channels of the two side signal devices to be empty; When the two side signal devices output the first frequency point and the second frequency point, the target channel of the center signal device is controlled to be blank.

7. The method according to claim 6, characterized in that The two side signal devices include: a video playback device, and the central signal device includes: an audio device connected to the video playback device.

8. An audio signal processing device, characterized in that: include: An acquisition module, used to acquire a first signal of the audio signal in the left channel, and to acquire a second signal of the audio signal in the right channel; a determination module, configured to determine a phase difference between each first frequency point of the first signal and each second frequency point of the second signal, wherein each first frequency point corresponds to each second frequency point in a one-to-one manner; The determination module is further configured to determine a target device in a device set according to the phase difference, wherein the target device is configured to output the first frequency point and the second frequency point through different channels; An output module is used to output the first frequency point and the second frequency point to the target device.

9. A computer device, characterized in that: include: A processor and a memory, wherein the processor is used to execute an audio signal processing program stored in the memory to implement the audio signal processing method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the audio signal processing method according to any one of claims 1 to 7.