Dual-track audio adjusting method and device and audio playing equipment

Abstract

The invention provides a dual-track audio adjustment method and device and audio playing equipment, and relates to the field of audio adjustment, and the method comprises the steps that the audio playing equipment receives a positioning signal from user equipment under the condition that communication connection is established between the audio playing equipment and the user equipment; according to the positioning signal, position information is determined, and the position information is used for indicating the position relation between the audio playing equipment and the user equipment; determining whether the position of the user equipment is changed according to the position information; and under the condition that the position of the user equipment is changed, adjusting an audio parameter of the audio playing equipment according to the position information so as to carry out spatial audio rendering on an area where the user equipment is located. Therefore, the audio playing equipment can adjust the played audio according to the position of the user when the user carrying the user equipment moves, so that the hearing experience of the user is improved.

Description

Technical Field

[0001] This application belongs to the field of audio adjustment, and particularly relates to a method and device for adjusting stereo audio and an audio playback device. Background Art

[0002] With the development of technology, audio playback devices have been widely used in daily life. For example, people can use audio playback devices such as mobile phones and tablets to play broadcasts. Another example is that music venues and dance studios can use audio playback devices such as speakers to play music for users.

[0003] However, when an audio playback device plays audio, it often cannot effectively adjust the played audio according to the user's behavior, which may greatly reduce the user's listening experience. Therefore, how to improve the user experience of using an audio playback device is a hot issue currently under discussion. Summary of the Invention

[0004] In view of this, the purpose of this application is to provide a method and device for adjusting stereo audio and an audio playback device, which can adjust the played audio according to the user's location when the user moves, so as to improve the audio effect at the user's location and further improve the user's listening experience.

[0005] The embodiments of this application are implemented as follows:

[0006] In a first aspect, an embodiment of this application provides a method for adjusting stereo audio, which is applied to an audio playback device. The method includes: receiving a positioning signal from a user device when a communication connection has been established between the audio playback device and the user device; determining position information according to the positioning signal, where the position information is used to indicate the positional relationship between the audio playback device and the user device; determining whether the position of the user device has changed according to the position information; and when the position of the user device has changed, adjusting the audio parameters of the audio playback device according to the position information to perform spatial audio rendering on the area where the user device is located.

[0007] It can be understood that the above user device is a device with wireless communication function carried by the user, such as a mobile phone, a tablet computer, a smart watch, smart glasses, a smart ring, etc.

[0008] As can be seen from the method of the first aspect, when the audio playback device determines that the position of the user device has changed based on the positioning signal sent by the user device, it performs spatial audio rendering on the area where the user device is located by adjusting the audio parameters. Exemplarily, the audio playback device can obtain information such as the distance of the user device and the angle of the user device relative to the audio playback device based on the positioning signal, and based on this information, determine whether the position of the user device has changed. When the position of the user device has changed, that is, when the user carrying the user device moves, spatial audio rendering is performed on the area where the user is located by adjusting the audio parameters. In this way, the audio effect at the user's location can be enhanced, bringing the user an immersive sound effect experience, thereby improving the user's listening experience. In addition, the audio playback device determines the position of the user device through the positioning signal, and can maintain high positioning accuracy and real-time performance in high-complexity environmental scenarios such as insufficient light and line-of-sight occlusion, thereby avoiding the influence of high-complexity environmental scenarios on positioning.

[0009] Combined with the technical solution provided in the above first aspect, in some possible implementation manners, the determining the position information according to the positioning signal includes: determining the position information according to the positioning signal and a wireless positioning algorithm, where the wireless positioning algorithm includes at least one of the following: a matched filtering algorithm, a fast Fourier transform algorithm, a multiple signal classification algorithm, or a signal parameter estimation algorithm based on rotational invariance techniques. That is, the audio playback device can use the wireless positioning algorithm to process the positioning signal to obtain the position information. Compared with the method of determining the position relationship between the audio playback device and the user device by the signal transmission and reception time, the audio playback device using the wireless positioning algorithm to process the positioning signal can more accurately determine the position information.

[0010] Combined with the technical solution provided in the above first aspect, in some possible implementation manners, the wireless positioning algorithm includes a fast Fourier transform algorithm, and the determining the position information according to the positioning signal includes: performing a Fourier transform on the positioning signal to obtain frequency-domain symbols; determining the sensed channel information according to the frequency-domain symbols and the frequency-domain signal, where the frequency-domain signal is determined according to the time-frequency domain position of the received positioning signal, and the sensed channel information is used to sense the user device; performing a fast Fourier transform on the sensed channel information to obtain a range-Doppler spectrum; determining the position information according to the range-Doppler spectrum, where the position information includes range information and actual angle information, where the range information is used to indicate the distance between the audio playback device and the user device, and the actual angle information is used to indicate the angle of the user device relative to the audio playback device. In this way, the audio playback device can accurately determine the position information.

[0011] Combined with the technical solution provided in the first aspect above, in some possible implementation manners, the position information includes actual angle information, which is used to indicate the angle of the user equipment relative to the audio playback device. The adjustment of the audio parameters of the audio playback device according to the position information includes: obtaining first dual-channel audio data; dividing the first dual-channel audio data into first mid (M) channel data and first side (S) channel data; determining the ipsilateral HRTF and the contralateral HRTF from the head related transfer functions (HRTF) library according to the actual angle information and the virtual angle information; based on the ipsilateral HRTF and the contralateral HRTF, using the sum HRTF to adjust the first M channel data to obtain second M channel data; based on the ipsilateral HRTF and the contralateral HRTF, using the difference HRTF to adjust the first S channel data to obtain second S channel data. Adjusting the first M channel data using the sum HRTF can make the sound played by the audio playback device meet the expected audio scene requirements in terms of sound localization and timbre in space. Adjusting the first S channel data using the difference HRTF can further distinguish the characteristics of the sound played by the audio playback device in different directions, enhancing the effect of spatial audio. For example, when implementing stereo expansion or virtual surround sound, it can more accurately control the spatial distribution and sense of direction of the sound, enabling the listener to better perceive the position and ambient atmosphere of the sound.

[0012] Combined with the technical solution provided in the first aspect above, in some possible implementation manners, before adjusting the first M channel data using the sum HRTF and adjusting the first S channel data using the difference HRTF, the method described in the first aspect further includes: performing phase modulation on the first M channel data using a first phase modulation function to obtain third M channel data; performing phase modulation on the first S channel data using a second phase modulation function to obtain third S channel data; the adjustment of the first M channel data using the sum HRTF includes: adjusting the third M channel data using the sum HRTF; the adjustment of the first S channel data using the difference HRTF includes: adjusting the third S channel data using the difference HRTF. Introducing phase modulation functions in the M path and the S path respectively to perform phase modulation on the path data can generate a more obvious sense of space when the adjusted data is recombined into the left and right channels, that is, it can expand the sound field.

[0013] Combined with the technical solution provided in the first aspect above, in some possible implementation manners, the first phase modulation function includes at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function; and / or, the second phase modulation function includes at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function.

[0014] It can be understood that the linear phase modulation function can give people a feeling that the sound moves or fades gradually in space in terms of spatial effect, and the position change of the sound is relatively uniform and linear; and in terms of auditory experience, the phase changes linearly with time, which will make the sound produce a relatively stable and continuous pitch change or a sense of spatial position movement, without obvious mutations or fluctuations, and can be used to create a stable and soothing sound effect change, such as simulating the effect of the sound approaching or moving away from a distance at a constant speed. The sine phase modulation function can create a feeling that the sound oscillates or swings in space according to the sine law in terms of spatial effect, as if the sound moves back and forth within a specific spatial range, with obvious periodicity; in terms of auditory experience, it can bring a periodic and regular change in pitch and spatial sense, and the ups and downs and fluctuations of the sound are more obvious, giving people a dynamic and lively feeling, and can be used to create a sound effect with a sense of rhythm and rhythm, such as simulating a certain periodic sound wave or the echo oscillation in space. The exponential phase modulation function can produce a spatial sense that the sound suddenly accelerates from a relatively static or slowly changing state in terms of spatial effect, with strong dynamic variability; in terms of auditory experience, the sound change is not obvious at the beginning, and then there will be effects such as rapid pitch increase or decrease and sudden spatial position change, and can be used to create sudden sound effect changes, strong impacts or a sense of tension, such as simulating a sudden sharp sound or the instantaneous burst of sound.

[0015] It can also be understood that the phases of the first phase modulation function and the second phase modulation function can be fixed phases, or can be dynamically adjusted according to time and frequency changes to produce a more rich and variable sound field effect, which can be specifically set flexibly according to the actual situation and is not limited here.

[0016] Combined with the technical solution provided in the first aspect, in some possible implementation manners, after adjusting the first M-channel data by using the and HRTF and adjusting the first S-channel data by using the difference HRTF, the method described in the first aspect further includes: restoring the second M-channel data and the second S-channel data to the second stereo data; convolving the left-channel data and the right-channel data in the second stereo audio data with a crosstalk cancellation function respectively. In this way, the mutual coupling interference generated by the left and right channel speakers during the propagation process can be avoided.

[0017] Combined with the technical solution provided in the first aspect above, in some possible implementation manners, the position of the above user equipment changes, including: the user equipment leaves the first area, and the area covered by the audio playback device for playing audio includes the first area and the second area, and the audio effect in the first area is stronger than the audio effect in the second area. That is, when the user equipment is located in the first area, the user carrying the user equipment can obtain a better audio effect, or in other words, the user can have a better listening experience. When the user equipment moves outside the first area, such as when the user equipment moves to the second area, the audio effect obtained by the user carrying the user equipment decreases, or in other words, the user's listening experience will be reduced. In this case, by adjusting the audio parameters, the audio playback device performs spatial audio rendering on the area where the user is located, which can enhance the audio effect at the user's location and bring the user an immersive sound effect experience, thereby improving the user's listening experience.

[0018] Combined with the technical solution provided in the first aspect above, in some possible implementation manners, the sequence corresponding to the above positioning signal is any of the following sequences: a maximum length (M) sequence, or a Zadoff-Chu (ZC) sequence. It can be understood that both the M sequence and the ZC sequence have good autocorrelation and cross-correlation, which can facilitate the audio playback device to detect the positioning signal using the wireless positioning algorithm and can resist noise interference.

[0019] In a second aspect, an embodiment of the present application further provides a two-channel audio adjustment device, which is applied to an audio playback device. The audio adjustment device includes: a wireless communication module, configured to receive a positioning signal from a user equipment when a communication connection has been established between the audio playback device and the user equipment; a wireless positioning module, configured to determine position information according to the positioning signal, and determine whether the position of the user equipment has changed according to the position information, where the position information is used to indicate the position relationship between the audio playback device and the user equipment; a spatial audio rendering module, configured to adjust the audio parameters of the audio playback device according to the position information when the position of the user equipment changes, so as to perform spatial audio rendering on the area where the user equipment is located.

[0020] In a third aspect, an embodiment of the present application further provides an audio playback device, including: a processor, configured to execute the two-channel audio adjustment method described in any item of the first aspect; a speaker, connected to the processor. Description of the Drawings

[0021] To more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings required in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application and should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0022] Figure 1 Schematic flowchart of the dual-channel audio adjustment method provided by the embodiments of the present application;

[0023] Figure 2 Schematic diagram of the area covered by the audio played by the audio playback device provided by the embodiments of the present application;

[0024] Figure 3 Schematic diagram of the left and right channel HRTF and crosstalk cancellation of the audio playback device provided by the embodiments of the present application;

[0025] Figure 4 Schematic diagram of the audio parameter adjustment of the audio playback device provided by the embodiments of the present application;

[0026] Figure 5 Schematic diagram of the dual-channel audio adjustment device provided by the embodiments of the present application;

[0027] Figure 6 Schematic diagram of the structure of the audio playback device provided by the embodiments of the present application. Detailed implementation manners

[0028] The following will describe the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The following embodiments can be used as examples to more clearly illustrate the technical solutions of the present application, but cannot be used to limit the protection scope of the present application. Those skilled in the art can understand that, without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0029] It should be noted that similar reference numerals and letters denote similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. At the same time, in the description of the present application, relational terms such as "first", "second", etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device.

[0030] Furthermore, the term "and / or" in the present application is only a relational term describing the associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0031] In the description of the embodiments of the present application, unless otherwise clearly specified and limited, the technical term "connection" may be a direct connection or an indirect connection through an intermediate medium.

[0032] The embodiments of the present application provide a method for adjusting stereo audio. The method for adjusting stereo audio can be applied to an audio playback device, which includes a processor and a speaker. The processor is configured to execute the method for adjusting stereo audio provided by the embodiments of the present application (introduced below), and the speaker is connected to the processor.

[0033] Please refer to Figure 1 , Figure 1 which is a flowchart of a method for adjusting stereo audio provided by the embodiments of the present application. The method for adjusting stereo audio includes:

[0034] S101, when a communication connection has been established between the audio playback device and the user device, the user device sends a positioning signal to the audio playback device. Correspondingly, the audio playback device receives the positioning signal from the user device.

[0035] The above-mentioned audio playback device is a device capable of playing audio. The audio playback device in the embodiments of the present application may be a device dedicated to audio playback such as headphones and speakers, or a device such as a mobile phone and a tablet computer configured with a processor and a speaker, without limitation.

[0036] The above user equipment (UE) is a device with wireless communication function carried by the user; or rather, the above user equipment is a device with transceiver function. The user equipment can also be called subscriber unit, mobile device, user terminal, terminal, wireless communication device, user device. The user equipment in the embodiments of the present application can be devices such as mobile phone, cellular phone, smart phone, tablet (Pad), smart watch, smart glasses, smart ring, etc.

[0037] That the audio playback device has established a communication connection with the user equipment can be understood as that the audio playback device and the user equipment can communicate with each other, or rather, the audio playback device and the user equipment can send and receive signals or messages. In this case, the user equipment can send a signal or message to the audio device, and correspondingly, the audio device can receive the signal or the message from the user equipment; or, the audio device can send a signal or message to the user equipment, and correspondingly, the user equipment can receive the signal or the message from the audio playback device.

[0038] The positioning signal can be used to determine the location information of the user equipment (introduced at S102 below), that is, the positioning signal can represent the location of the user equipment or the user carrying the user equipment. The sequence corresponding to the positioning signal can be pre-agreed by the user equipment and the audio playback device or predefined by the protocol. That is to say, the sequence corresponding to the positioning signal is known to the audio playback device.

[0039] Exemplarily, the sequence corresponding to the positioning signal is any one of the following sequences: M sequence, or ZC sequence. Both the M sequence and the ZC sequence have good autocorrelation and cross-correlation, which can facilitate the audio playback device to receive and detect the positioning signal.

[0040] It can be understood that the user equipment and the audio playback device can pre-agree or be predefined by the protocol with one or more sequences, and the user equipment and the audio playback device can agree or be predefined by the protocol with the time-frequency domain positions of the signals corresponding to these one or more sequences when sending and receiving. When the user equipment and the audio playback device pre-agree or are predefined by the protocol with a sequence, the user equipment can use the sequence to generate a positioning signal and send the positioning signal at the time-frequency domain position corresponding to the sequence. Correspondingly, the audio playback device can receive the positioning signal at the time-frequency domain position corresponding to the sequence. When the user equipment and the audio playback device pre-agree or are predefined by the protocol with multiple sequences, the user equipment can use any one of the multiple sequences to generate a positioning signal and send the positioning signal at the time-frequency domain position corresponding to the sequence it uses. Correspondingly, the audio playback device can receive the positioning signal at the time-frequency domain positions corresponding to these multiple sequences.

[0041] For example, the user equipment and the audio playback device pre-agree that the positioning signal uses M sequence #1, and the M sequence #1 is sent and received in time-frequency domain #1. When a communication connection has been established between the audio playback device and the user equipment, the user equipment can generate a positioning signal according to the M sequence #1 and send the positioning signal in time-frequency domain #1; correspondingly, the audio playback device can receive the positioning signal in time-frequency domain #1.

[0042] For another example, the user equipment and the audio playback device pre-agree that the positioning signal can use any of the following sequences: M sequence #2 or ZC sequence #2; and the M sequence #2 is sent and received in time-frequency domain #1, and the ZC sequence #2 is sent and received in time-frequency domain #2. When a communication connection has been established between the audio playback device and the user equipment, the user equipment can generate a positioning signal according to the M sequence #2 and send the positioning signal in time-frequency domain #1; correspondingly, the audio playback device can receive signals in time-frequency domain #1 and time-frequency domain #2, and receive the positioning signal in time-frequency domain #1.

[0043] It can also be understood that in the process of generating the positioning signal, the user equipment can also adopt low-order modulation methods such as binary shift keying (BSK) and quadrature amplitude modulation (QAM), so as to maintain good signal-to-noise ratio and anti-interference characteristics.

[0044] In addition, the user equipment can send a positioning signal to the audio playback device immediately after completing the communication connection with the audio playback device. The user equipment can also send a positioning signal to the audio playback device after a preset time period after completing the communication connection with the audio playback device. The preset time period can be 5 seconds (s), 30 s, or 1 minute (min), without limitation. It can be understood that the specific time point for the user equipment to send the positioning signal can be flexibly set according to the actual situation, and the embodiments of the present application do not limit this.

[0045] Optionally, before the user equipment sends a positioning signal to the audio playback device, the above-mentioned two-channel audio adjustment method may further include: the audio playback device sends a request signal to the user equipment, and correspondingly, the user equipment receives the request signal from the audio playback device, where the request signal is used to request the user equipment to report the position of the user equipment; the user equipment sending a positioning signal to the audio playback device may specifically include: the user equipment sends a positioning signal to the audio playback device based on the above request signal.

[0046] That is, the audio playback device can trigger the user device to send a positioning signal through a request signal, so as to determine the location where the user device is located based on the positioning signal. In this way, when the location of the user device is required, the audio playback device can actively request the location of the user device from the user device, so that the location of the user device can be obtained in a timely manner, and the audio parameters can be adjusted in a timely manner based on the location of the user device.

[0047] Optionally, before the user device sends a positioning signal to the audio playback device, or before the audio playback device receives a positioning signal from the user device, the above-mentioned stereo audio adjustment method may further include: establishing a communication connection between the audio playback device and the user device (denoted as S100).

[0048] Exemplarily, the audio playback device may send (or broadcast) a broadcast signal. This broadcast signal is used for the user equipment to initiate an application for a wireless communication connection, that is, after receiving the broadcast signal, the user equipment may initiate a communication connection to the audio playback device based on this broadcast signal. The broadcast signal may be a preamble or pilot in the Bluetooth protocol, or a preamble or pilot in the wireless fidelity (Wi-Fi) protocol, or may also be a synchronization signal and physical broadcast channel (PBCH) block (SSB), a demodulation reference signal (DM-RS) in the physical downlink control channel (PDCCH), a channel state information-reference signal (CSI-RS), DM-RS in the physical downlink shared channel (PDSCH), a DM-RS or phase-tracking reference signal (PT-RS) in the physical uplink shared channel (PUSCH), a DM-RS and PT-RS, or a sounding reference signal (SRS) in the physical uplink control channel (PUCCH). Specifically, it can be flexibly set according to the actual situation without limitation. After receiving the broadcast signal, the user equipment may perform a wireless communication connection based on this broadcast signal. The specific implementation principle of the wireless communication connection through the broadcast signal may refer to the relevant introduction in the prior art and will not be elaborated here.

[0049] S102. The audio playback device determines the location information according to the positioning signal.

[0050] The above position information is used to indicate the positional relationship between the audio playback device and the user device, that is, the audio playback device can determine the position of the user device based on this position information.

[0051] The above determination of the position information according to the positioning signal may specifically include: determining the position information according to the positioning signal and a wireless positioning algorithm, where the wireless positioning algorithm includes at least one of the following: a matched filtering algorithm, a fast Fourier transform (FFT) algorithm, a multiple signal classification (MUSIC) algorithm, or an estimation of signal parameters via rotational invariance techniques (ESPRIT) algorithm. Of course, the audio playback device may also use other wireless positioning algorithms to determine the position information without limitation. It can be understood that compared with the method of determining the positional relationship between the audio playback device and the user device by the signal transmission and reception time, the audio playback device uses the wireless positioning algorithm to process the positioning signal, which can more accurately determine the positional relationship between the audio playback device and the user device.

[0052] Optionally, the above wireless positioning algorithm includes a fast Fourier transform algorithm. The determination of the position information according to the positioning signal may specifically include: performing a Fourier transform on the positioning signal to obtain frequency-domain symbols; determining the sensing channel information according to the frequency-domain symbols and the frequency-domain signal, where the frequency-domain signal is determined according to the time-frequency domain position of the received positioning signal, and the sensing channel information is used to sense the user device; performing a fast Fourier transform on the sensing channel information to obtain a range-Doppler spectrum; and determining the position information according to the range-Doppler spectrum, where the position information includes range information and actual angle information, the range information is used to indicate the distance between the audio playback device and the user device, and the actual angle information is used to indicate the angle of the user device relative to the audio playback device.

[0053] Exemplarily, the user device sends a positioning signal #1 at the time-frequency domain position I r correspondingly, the audio playback device receives the positioning signal #2 at the frequency domain position I r

[0054] The above time-frequency domain position I r is a position pre-agreed or pre-defined by protocol between the audio playback device and the user device. The above positioning signal #1 is a positioning signal pre-agreed or pre-defined by protocol between the user device and the audio playback device at the time-frequency domain position I r and the time-frequency domain position I r ​The positioning signal #1 can be understood with reference to the relevant introduction in the foregoing S101, and will not be elaborated here.

[0055] After the audio playback device receives the positioning signal #2, it can determine the time-frequency domain position I r where it receives the positioning signal #2. r corresponding frequency-domain signal X(n, μ), where n is the time sequence index, μ is the frequency-domain sequence index, and (n, μ) ∈ I r The time-frequency domain position I r corresponding frequency-domain signal X(n, μ) refers to the frequency-domain signal X(n, μ) of the positioning signal (i.e., the above-mentioned positioning signal #1) that is pre-agreed or pre-defined by protocol between the audio playback device and the user device at the time-frequency domain position I r and sent.

[0056] It can be understood that when the user device sends the positioning signal #1, it can transform the frequency-domain signal X(n, μ) corresponding to the positioning signal #1 through an inverse fast Fourier transform (IFFT) into a time-domain signal x(t) for transmission. After the audio device and the user device establish a communication connection, the positioning signal y(t) (i.e., the above-mentioned positioning signal #2) received by the audio playback device after being scattered by N t point targets is:

[0057]

[0058] where b l represents the attenuation coefficient of the reflected echo of the positioning signal in the multipath l, τ l represents the time delay of the reflected echo of the positioning signal in the multipath l, f d,l represents the Doppler frequency shift of the reflected echo of the positioning signal in the multipath l, where l = 0 represents the direct path, that is, the positioning signal is directly sent from the user device to the audio device, and l > 0 represents the multipath, that is, the positioning signal is sent to the audio device after being reflected by other objects. n(t) is Gaussian white noise with a variance of , t represents the time variable, x represents the time-domain signal sent by the user device, e represents the base of the natural logarithm, j represents the imaginary unit, f d,l t represents the phase change of f d,l with respect to time, and σ n represents the standard variance of the Gaussian white noise.

[0059] Assuming the subcarrier spacing is Δf and the number of subcarriers is N c , the positioning signal #2 received by the audio playback device, after a sampling interval of T s = 1 / (N cAfter time-domain sampling and Fourier transform of Δf), the frequency-domain symbol of the positioning signal #2 can be expressed as:

[0060]

[0061] where N(n, μ) represents white Gaussian noise in the frequency domain, n represents the frequency index, μ represents the time index, N c represents the number of subcarriers, T s represents the sampling interval, and X(n, μ) represents the value of the time-domain signal sent by the user equipment at discrete time n and frequency μ.

[0062] Since in the frequency domain and time domain, the resource element positions for transmitting the reference signal (RS) (i.e., the above X(n, μ)) are known, and the transmission sequence of the RS signal is also known, the audio playback device can, according to the time-frequency domain position I r extract the received RS, eliminate the influence of the randomness of the transmission sequence through dot division, and obtain the sensing channel information H rad . That is, after the audio playback device obtains X(n, μ) (i.e., the above frequency-domain signal) and Y(n, μ) (i.e., the above frequency-domain symbol), it can eliminate the influence of the randomness of the sequence through dot division and obtain the sensing channel information. The formula for the sensing channel information is as follows:

[0063]

[0064] It can be understood that the sensing channel information H rad (n, μ) can sense the user equipment. For example, the sensing channel information can reflect information such as the number of reflected multipaths between the user equipment and the audio player, the distance of each reflected multipath, the moving speed of the user equipment, and the arrival angle of the signal sent by the equipment.

[0065] After performing FFT transform on the sensing channel information H rad (n, μ) obtained after dot division, the range-doppler (RD) can be obtained. The formula for the RD spectrum is as follows:

[0066]

[0067] where p = 0, 1, …, N′ c -1, q = 0, 1, …, N′ s -1, N′ c and N′ s are the number of points for the two Fourier transforms respectively, N s represents the number of time-domain sampling points, and N c represents the number of subcarriers. By searching the RD spectrum values, the distance between the audio playback device and the user equipment can be determined as That is, the above distance information is where \(c_0\) represents the speed of light, \(l\) represents the index of the multipath, and \(\Delta\) f represents the subcarrier spacing. It can be understood that the shortest path corresponding to the peak on the RD spectrum is the direct path, and the direct path can reflect the distance between the audio playback device and the user device. In addition, the specific implementation principle for the above audio playback device to obtain the distance between the audio playback device and the user device can refer to the prior art and will not be elaborated here.

[0068] Similarly, the audio playback device can also perform FFT along the spatial domain to obtain the angle of the user device relative to the audio playback device, that is, the above actual angle information. The specific implementation principle can refer to the prior art and will not be elaborated here.

[0069] It can be understood that if the audio playback device obtains the positioning signal by sending a request signal to the user device, the audio playback device can also determine the distance between the audio device and the user device according to the time when it sends the request signal and the time when it receives the positioning signal. Exemplarily, the audio playback device sends a request signal to the user device at time \(t_1\) and receives the positioning signal at time \(t_2\), then the distance between the audio playback device and the user device is where \(c\) is the propagation speed of the wireless signal. After the audio playback device obtains this distance, it can take the average of this distance and the distance obtained by the above wireless positioning algorithm to determine the distance between the audio playback device and the user device, that is, the distance information. In this way, the accuracy of the calculated distance between the audio playback device and the user device can be improved.

[0070] S103. The audio playback device determines whether the position of the user device has changed according to the position information.

[0071] There can be various situations for whether the position of the user device has changed, such as whether the user has left the first area, or whether the user has left the preset position. The following will introduce these situations separately.

[0072] Situation 1:

[0073] Whether the position of the user device has changed can be understood as whether the user has left the first area. Please refer to Figure 2 , the area covered by the audio playback device for playing audio includes the first area and the second area, and the audio effect in the first area is stronger than that in the second area. It can be understood that the first area is usually located at the center of the area covered by the audio playback device for playing audio. Of course, the specific position of the first area can also be adjusted according to the actual situation without limitation.

[0074] When the user carrying the user device is located in the first area, the user can obtain a better listening experience, and at this time, the audio playback device does not need to adjust the audio parameters to improve the user's listening experience. When the user carrying the user device leaves the first area, or when the user carrying the user device moves outside the first area, or when the user carrying the user device moves to the second area, the user's listening experience deteriorates, and at this time, the audio playback device needs to adjust the audio parameters to improve the user's listening experience.

[0075] It can be understood that after obtaining the above distance information and actual angle information, the audio playback device can determine whether the user device is in the first area according to the distance information and the actual angle information. Exemplarily, the audio playback device can set a distance threshold d based on the first area th and an angle threshold θ th ; when the distance indicated by the distance information is less than the distance threshold d th , and the angle indicated by the actual angle information is less than the angle threshold θ th , the audio playback device can determine that the user device is in the first area; when the distance indicated by the distance information is greater than or equal to the distance threshold d th , or when the angle indicated by the actual angle information is greater than or equal to the angle threshold θ th , the audio playback device can determine that the user device has left the first area. The specific principle of the audio playback device setting the distance threshold d th and the angle threshold θ th with reference to the first area can refer to the prior art and will not be elaborated here.

[0076] Case 2:

[0077] Whether the position of the user device changes can be understood as whether the user leaves the preset position. The preset position is the best listening position in the area covered by the audio playback device for playing audio. That is to say, the audio effect at this preset position is the best in the area covered by the audio playback device for playing audio; or, the audio effect at this preset position is stronger than the audio effects at other positions in the area except this preset position, and this area is the area covered by the audio playback device for playing audio.

[0078] When the user carrying the user device is located at the preset position, the user can obtain the best listening experience, and at this time, the audio playback device does not need to adjust the audio parameters to improve the user's listening experience. When the user carrying the user device leaves the preset position, the user's listening experience deteriorates, and at this time, the audio playback device needs to adjust the audio parameters to improve the user's listening experience.

[0079] It can be understood that after the audio playback device obtains the above distance information and the above actual angle information, it can determine whether the user device is in a preset position according to the distance information and the actual angle information. Exemplarily, the audio playback device can determine the specific position of the user device according to the distance information and the above actual angle information, and determine whether the user device is in the preset position by comparing the specific position with the preset position.

[0080] S104. When the position of the user device changes, adjust the audio parameters of the audio playback device according to the position information to perform spatial audio rendering on the area where the user device is located.

[0081] The change in the position of the user device can be understood as the user carrying the user device moving to a position with a poor sound effect.

[0082] For the above situation 1, the change in the position of the user device can specifically include: the user device leaving the first area; or, the user device moving outside the first area; or, the user moving to the second area.

[0083] For the above situation 2, the change in the position of the user device can specifically include: the user device leaving the preset position.

[0084] The above adjustment of the audio parameters of the audio playback device according to the position information can specifically include: obtaining first dual-channel audio data; dividing the first dual-channel audio data into first M-channel data and first S-channel data; determining the ipsilateral HRTF and the contralateral HRTF from the HRTF library according to the actual angle information and the virtual angle information, where the virtual angle information is used to indicate the virtual angle of the extended sound field corresponding to the audio playback device; based on the ipsilateral HRTF and the contralateral HRTF, using the sum HRTF to adjust the first M-channel data to obtain second M-channel data; based on the ipsilateral HRTF and the contralateral HRTF, using the difference HRTF to adjust the first S-channel data to obtain second S-channel data.

[0085] The audio playback device can process the first dual-channel audio data through MS coding to obtain first M-channel data and first S-channel data. In this case, the expression of the first M-channel data can be: m(t) = 0.5 * (l(t) + r(t)), and the expression of the first S-channel data can be: s(t) = 0.5 * (l(t) - r(t)), where l(t) is the left-channel data in the first dual-channel audio data, and r(t) is the right-channel data in the first dual-channel audio data.

[0086] The above virtual angle information is used to indicate the virtual angle of the extended sound field; or rather, the above virtual angle information is used to indicate the virtual angle preset by the audio playback device; or rather, the above virtual angle information is used to indicate the virtual angles corresponding to the left and right channels of the virtual audio playback device corresponding to the audio playback device. It can be understood that the determination method of the virtual angle information can refer to the relevant introduction in the prior art and will not be elaborated here.

[0087] The expression of the above sum HRTF is as follows: The expression of the above difference HRTF is as follows: Where, H i (θ s ) and H i (θ Vs ) are the ipsilateral HRTFs, H c (θ s ) and H c (θ vs ) are the contralateral HRTFs, θ s is the angle indicated by the above actual angle information, and θ vs is the angle indicated by the above virtual angle information. It can be understood that the specific implementation principle of determining the ipsilateral HRTF and the contralateral HRTF from the HRTF library according to the actual angle information and the virtual angle information can refer to the prior art and will not be elaborated here.

[0088] In the embodiments of the present application, using the sum HRTF to adjust the audio parameters can make the sound played by the audio playback device meet the expected audio scene requirements in terms of spatial positioning and timbre, etc.; using the difference HRTF helps to further distinguish the characteristics of the sound in different directions and enhance the effect of spatial audio. For example, when implementing stereo expansion or virtual surround sound, it can more accurately control the spatial distribution and sense of direction of the sound, enabling users to better perceive the position and environmental atmosphere of the sound.

[0089] Optionally, before using the sum HRTF to adjust the first M-channel data and using the difference HRTF to adjust the first S-channel data, the above audio adjustment method may further include: using the first phase modulation function to perform phase modulation on the first M-channel data to obtain the third M-channel data; using the second phase modulation function to perform phase modulation on the first S-channel data to obtain the third S-channel data; the above use of the sum HRTF to adjust the first M-channel data may specifically include: using the sum HRTF to adjust the third M-channel data; the above use of the difference HRTF to adjust the first S-channel data may specifically include: using the difference HRTF to adjust the third S-channel data.

[0090] The above first phase modulation function may include at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function. These phase modulation functions will be introduced separately below.

[0091] The linear phase modulation function is φ(t) = kt, where k affects the speed of phase fluctuation. This linear phase modulation function can give people a feeling that the sound moves smoothly or gradually in space in terms of spatial effect, and the position change of the sound is relatively uniform and linear. In addition, in terms of auditory experience, the phase changes linearly with time, which can make the sound produce a relatively stable and continuous pitch change or a sense of spatial position movement, without obvious mutations or fluctuations, and can be used to create a stable and soothing sound effect change, such as simulating the effect of a sound approaching or moving away uniformly from a distance.

[0092] The sine phase modulation function is A affects the intensity of the fluctuation amplitude, and ω affects the speed of the fluctuation. is the starting position of the phase change. This sine phase modulation function can create a feeling that the sound oscillates or swings in space according to a sine law in terms of spatial effect, as if the sound moves back and forth within a specific spatial range, with obvious periodicity. And in terms of auditory experience, it can bring a periodic and regular change in pitch and spatial sense, the ups and downs and fluctuations of the sound are more obvious, giving people a dynamic and lively feeling, and can be used to create a rhythmic sound effect, such as simulating the effect of a certain periodic sound fluctuation or an echo oscillation in space.

[0093] The exponential phase modulation function is A affects the intensity of the fluctuation amplitude, and ω affects the speed of the fluctuation. is the starting position of the phase change. The initial phase change of this exponential phase modulation function may be relatively slow, and as time goes by, the phase change will become faster and faster. In terms of spatial effect, it can produce a sense of space where the sound suddenly accelerates from a relatively static or slowly changing state, with strong dynamic variability. And in terms of auditory experience, at the beginning, the sound change is not obvious, and then there will be effects such as a rapid increase or decrease in pitch and a sharp change in spatial position, which are often used to create sudden sound effects, strong impacts or a sense of tension, such as simulating a sudden sharp sound or an instantaneous outburst of sound.

[0094] It can be understood that the specific principles of the above linear phase adjustment linear phase modulation function, sine phase modulation function, and exponential phase modulation function can refer to the prior art and will not be elaborated here.

[0095] The first phase modulation function can be one or more. For example, the first phase modulation function is a linear phase modulation function. Another example is that the first phase modulation function is a sine phase modulation function and an exponential phase modulation function. Specifically, it can be flexibly set according to the actual situation without limitation. In addition, the first phase modulation function can also be a function with a fixed phase, or the phase can be dynamically adjusted according to time and frequency without limitation. It can be understood that the first phase modulation function can also be other functions, which can be flexibly set according to the actual situation without limitation.

[0096] The above-mentioned second phase modulation function can include at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function. The second phase modulation function can be one or more. It can be understood that the second phase modulation function is similar to the first phase modulation function, and can be understood by referring to the introduction of the above first phase function, which will not be elaborated here. In addition, the second phase modulation function and the first phase modulation function can be the same or different, and can be flexibly set according to the actual situation without limitation.

[0097] In the embodiments of the present application, by adjusting the phase difference between the M channel and the S channel, different degrees of phase offsets can be applied to the M channel data (i.e., the above-mentioned first M channel data) and the S channel data (i.e., the above-mentioned first S channel data). In this way, when the M channel data (i.e., the above-mentioned second M channel data) and the S channel data (i.e., the above-mentioned second S channel data) are recombined into left and right channels, a more obvious sense of space can be generated, thereby enhancing the spatial audio effect of the sound played by the audio playback device, and further improving the user's listening experience.

[0098] In addition, after the audio playback device obtains the second M channel data and the second S channel data, it can restore the left and right stereo channel data through MS decoding and play the restored left and right stereo channel data. It can be understood that the audio playback device can adjust the first M channel data through the sum HRTF and adjust the first S channel data through the difference HRTF to obtain the second M channel data and the second S channel data. The audio playback device can also first adjust the first M channel data and the first S channel data through the phase modulation function, and then adjust the adjusted M channel data and S channel data through the sum HRTF and the difference HRTF respectively to obtain the second M channel data and the second S channel data.

[0099] Furthermore, after adjusting the first M channel data using the sum HRTF and adjusting the first S channel data using the difference HRTF, the above audio adjustment method can further include: restoring the second M channel data and the second S channel data to the second stereo channel data; convolving the left channel data and the right channel data in the second stereo audio data with a crosstalk cancellation function respectively.

[0100] The audio playback device can restore the left and right stereo data through MS decoding. In this case, the left-channel data in the second stereo data can be: LS(t) = m'(t) + s'(t), and the right-channel data in the second stereo data can be: RS(t) = m'(t) - s'(t), where m'(t) is the above-mentioned second M-channel data and s'(t) is the above-mentioned second s-channel data.

[0101] The expression of the crosstalk cancellation (CTC) function is: Where H i (θ s ) is the ipsilateral HRTF, H c (θ s ) is the contralateral HRTF, θ s is the angle indicated by the above actual angle information, and θ Vs is the angle indicated by the above virtual angle information.

[0102] In the embodiments of the present application, convolving the left and right channel data with the CTC function respectively can avoid the mutual coupling interference generated by the left and right channel speakers during propagation, thereby improving the audio playback effect of the audio playback device and further enhancing the user's listening experience.

[0103] It can be understood that the above content introduces different ways for the audio playback device to adjust audio parameters. Next, through an example, a specific way for the audio playback device to adjust audio parameters is introduced.

[0104] Please refer to Figure 3 and Figure 4 , the audio playback device obtains the stereo audio data #1, and the stereo audio data #1 includes the left-channel data l(t) and the right-channel data r(t). Through MS encoding, the stereo data #1 is divided into the M-channel data #1 and the S-channel data #1. The M-channel data #1 is m(t) = 0.5 * (l(t) + r(t)), and the S-channel data #1 is s(t) = 0.5 * (l(t) - r(t)).

[0105] Introduce the phase modulation function in the M path to obtain the M-path data #2, and the M-path data #2 is Introduce the phase modulation function in the S path to obtain the S-path data #2, and the S-path data #2 is

[0106] Apply and adjust the M-path data #2 using the HRTF formula to obtain the M-path data #3, that is, m″(t); apply and adjust the S-path data #2 using the difference HRTF formula to obtain the S-path data #3, that is, s″(t).

[0107] After MS decoding, the M-channel data #3 and the S-channel data #3 are restored to the stereo audio data #2. The stereo audio data #2 includes the left-channel data and the right-channel data. The left-channel data LS(t) = m″(t) + s″(t), and the right-channel data RS(t) = m″(t) - s″(t).

[0108] The left-channel data LS(t) and the right-channel data RS(t) are respectively convolved with the CTC function to obtain the final left-channel data S L and the right-channel data S R , that is, the stereo audio data #3.

[0109] It can be understood that after obtaining the stereo audio data #3, the audio playback device can play based on the stereo audio data #3.

[0110] In summary, in the embodiments of the present application, when the position of the user where the user device is carried changes, the audio playback device can adjust the audio parameters, so as to enhance the audio effect at the user's position, bring the user an immersive sound effect experience, and then improve the user's listening experience. In addition, the audio playback device determines the user's position through a wireless signal (i.e., the above positioning signal), which can avoid the influence of high-complexity environmental scenarios on positioning, thereby ensuring the accuracy of audio parameter adjustment.

[0111] It can be understood that when the position of the user device (or the user carrying the user device) does not change, the audio playback device may not adjust the audio parameters, that is, the audio playback device may use the original audio parameters to process the stereo audio data and perform audio playback based on the processed stereo audio data. The position of the user device not changing may be that the user device is located in the first area or that the user device is located at a preset position, which can be specifically determined according to the actual situation without limitation.

[0112] It can also be understood that the audio playback device can adjust the audio parameters periodically. That is to say, the audio playback device can periodically adjust the audio parameters according to the position of the user device (or the user carrying the user device).

[0113] Exemplarily, the user device may periodically send a positioning signal to the audio playback device. Correspondingly, the audio playback device may periodically receive the positioning signal. For example, after the user device sends a positioning signal to the audio playback device for the first time, it sends a positioning signal to the audio playback device every 1 minute; correspondingly, after the audio playback device receives the positioning signal from the user device for the first time, it receives the positioning signal from the user device every 1 minute.

[0114] Exemplarily, the audio playback device may periodically request a positioning signal from the user device. For example, the audio playback device periodically sends a request signal to the user device. After receiving the request signal, the user device may send a positioning signal to the audio playback device based on the request signal. For example, after the audio playback device receives the positioning signal for the first time, it sends a request signal to the audio playback device every 30 s. After receiving the request signal, the user device sends a positioning signal to the audio playback device based on the request signal. Correspondingly, the audio playback device receives the positioning signal.

[0115] The audio playback device may also obtain speed information based on the received positioning signal. The speed information is used to indicate the moving speed of the user device. Based on the speed information, it is determined whether the user device is in a moving state, that is, whether the user carrying the user device is in a moving state. When it is determined that the user device is in a moving state, the configuration parameters (such as the interval time for periodically sending the positioning signal) are updated based on the speed information. After sending the updated configuration parameters to the user device, the positioning signal is periodically received according to the updated configuration parameters.

[0116] Exemplarily, when the audio device determines that the user device is in a moving state based on the speed information, it may shorten the interval time for receiving the positioning signal in the configuration parameters of the positioning signal from 1 min to 5 s. In this way, the audio playback device can receive the positioning signal faster and adjust the audio parameters based on the positioning signal, so as to improve the user's listening experience by timely adjusting the audio parameters during the user's movement.

[0117] It can be understood that the audio playback device may obtain speed information when obtaining position information. For example, after obtaining the above RD spectrum, the RD spectrum is searched to determine the speed information, that is, the speed information is f c indicating the center frequency point. For other parameters, please refer to the relevant introduction in the foregoing S102 and will not be elaborated here. Of course, the audio playback device may also obtain speed information based on the positioning signal in other ways, and the embodiments of the present application do not limit this.

[0118] In addition, the above content introduces the operations of the audio playback device for one user device. If there are multiple user devices in the scenario, the audio playback device may perform the above operations for each user device among the multiple user devices. In addition, if there are multiple audio playback devices in the scenario, these multiple audio playback devices can all perform the above operations for each user device in at least one user device.

[0119] Based on the same inventive concept, the embodiments of the present application further provide a two-channel audio adjustment device 500. Please refer to Figure 5 , Figure 5Schematic diagram of a dual-channel audio adjustment device 500 provided by an embodiment of the present application. The dual-channel audio adjustment device 500 includes: a wireless communication module 510, a wireless positioning module 520, and a spatial audio rendering module 530. The dual-channel audio adjustment device 500 may further include a wireless tracking module 540.

[0120] The wireless communication module 510 is configured to receive a positioning signal from the user device when a communication connection has been established between the audio playback device and the user device.

[0121] The wireless positioning module 520 is configured to determine position information according to the positioning signal, and determine whether the position of the user device has changed according to the position information, where the position information is used to indicate the positional relationship between the audio playback device and the user device.

[0122] The spatial audio rendering module 530 is configured to adjust the audio parameters of the audio playback device according to the position information when the position of the user device changes, so as to perform spatial audio rendering on the area where the user device is located.

[0123] In some possible implementation manners, the wireless positioning module 520 is specifically configured to determine position information according to the positioning signal and a wireless positioning algorithm, and the wireless positioning algorithm includes at least one of the following: a matched filtering algorithm, a fast Fourier transform algorithm, a multiple signal classification algorithm, or a signal parameter estimation algorithm based on rotational invariance technique.

[0124] In some possible implementation manners, the wireless positioning algorithm includes a fast Fourier transform algorithm, and the wireless positioning module 520 is specifically configured to perform a Fourier transform on the positioning signal to obtain a frequency-domain symbol; determine sensing channel information according to the frequency-domain symbol and a frequency-domain signal, where the frequency-domain signal is determined according to the time-frequency domain position of the received positioning signal, and the sensing channel information is used to sense the user device; perform a fast Fourier transform on the sensing channel information to obtain a range-Doppler spectrum; and determine position information according to the range-Doppler spectrum, where the position information includes range information and actual angle information, the range information is used to indicate the distance between the audio playback device and the user device, and the actual angle information is used to indicate the angle of the user device relative to the audio playback device.

[0125] In some possible implementation manners, the location information includes actual angle information, and the actual angle information is used to indicate the angle of the user equipment relative to the audio playback device. Specifically, the spatial audio rendering module 530 is configured to obtain first dual-channel audio data; divide the first dual-channel audio data into first center M-channel data and first side S-channel data; determine a same-side HRTF and an opposite-side HRTF from a head-related transfer function (HRTF) library according to the actual angle information and virtual angle information, where the virtual angle information is used to indicate the virtual angle of an extended sound field corresponding to the audio playback device; based on the same-side HRTF and the opposite-side HRTF, use a sum HRTF to adjust the first M-channel data to obtain second M-channel data; and based on the same-side HRTF and the opposite-side HRTF, use a difference HRTF to adjust the first S-channel data to obtain second S-channel data.

[0126] In some possible implementation manners, before using the sum HRTF to adjust the first M-channel data and using the difference HRTF to adjust the first S-channel data, the spatial audio rendering module 530 is further configured to perform phase modulation on the first M-channel data by using a first phase modulation function to obtain third M-channel data; perform phase modulation on the first S-channel data by using a second phase modulation function to obtain third S-channel data; and specifically, the spatial audio rendering module 630 is configured to use the sum HRTF to adjust the third M-channel data and use the difference HRTF to adjust the third S-channel data.

[0127] In some possible implementation manners, the first phase modulation function includes at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function; and / or, the second phase modulation function includes at least one of the following: a linear phase modulation function, a sine phase modulation function, or an exponential phase modulation function.

[0128] In some possible implementation manners, after using the sum HRTF to adjust the first M-channel data and using the difference HRTF to adjust the first S-channel data, the spatial audio rendering module 530 is further configured to restore the second M-channel data and the second S-channel data to second dual-channel data; and convolve the left-channel data and the right-channel data in the second dual-channel audio data with a crosstalk cancellation function respectively.

[0129] In some possible implementation manners, a change in the location of the user equipment includes: the user equipment leaves a first area, and the area covered by the audio played by the audio playback device includes the first area and a second area, and the audio effect in the first area is stronger than that in the second area.

[0130] In some possible implementation manners, the sequence corresponding to the positioning signal is any one of the following sequences: an M-sequence or a ZC-sequence.

[0131] In some possible implementations, the wireless tracking module 540 is used to periodically trigger the wireless communication module 510 to receive a positioning signal from a user device.

[0132] In some possible implementations, the wireless tracking module 540 is used to update configuration parameters based on speed information, where the configuration parameters are related to the transceiver of the positioning signal.

[0133] In some possible implementations, the wireless tracking module 540 is used to trigger the wireless communication module 510 to send the updated configuration parameters to the user device.

[0134] Please refer to Figure 6 , based on the same inventive concept, an embodiment of the present application further provides an audio playback device 600, including: a processor 610 and a speaker 620. The processor 610 is used to execute the dual-channel audio adjustment method provided in the foregoing embodiments of the present application, and the speaker 620 is connected to the processor 610. The audio playback device in the embodiment of the present application may be a headset, a mobile phone, a tablet computer, a smart speaker, or other devices with a built-in speaker and a processor, without limitation.

[0135] Based on the same inventive concept, an embodiment of the present application further provides a readable storage medium, in which instructions are stored, and the instructions can be executed by one or more processors to implement the dual-channel audio adjustment method provided in the foregoing embodiments.

[0136] The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that integrates one or more available media. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a DVD (digital videodisc)), or a semiconductor medium (such as an SSD (Solid State Disk)).

[0137] An embodiment of the present application further provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by a computer, it executes the storage space allocation method as described above.

[0138] It should be noted that the embodiments in this specification are all described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The same or similar parts among the embodiments can be referred to each other.

[0139] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions, and operations of devices, methods, and computer program products according to multiple embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0140] The above detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application claimed, but merely represents selected embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts belong to the scope of protection of the present application.

[0141] It should be noted that similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0142] In the description of the present application, it should also be noted that unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meaning of the above terms in the present application can be understood according to specific circumstances.

[0143] In addition, in each embodiment of the present application, the functional modules can be integrated together to form an independent part, or each module can exist alone, or two or more modules can be integrated to form an independent part.

[0144] When the above-mentioned functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a computer-readable storage medium and includes several instructions for causing a computer device (which may be a personal computer, a laptop, a server, or an electronic device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned computer-readable storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0145] As described above, the above are only specific embodiments of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed in this application can easily think of changes or substitutions, which should all be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

1. A dual-channel audio adjustment method, applied to an audio playback device, characterized in that: The method comprises: When the audio playback device has established a communication connection with the user device, receiving a positioning signal from the user device; Determine location information according to the positioning signal, where the location information is used to indicate a location relationship between the audio playback device and the user equipment; Determining, according to the location information, whether the location of the user equipment has changed; When the location of the user equipment changes, the audio parameters of the audio playback device are adjusted according to the location information to perform spatial audio rendering on the area where the user equipment is located.

2. The method according to claim 1, characterized in that The determining of the location information according to the positioning signal includes: The location information is determined based on the positioning signal and a wireless positioning algorithm, wherein the wireless positioning algorithm includes at least one of the following: a matched filtering algorithm, a fast Fourier transform algorithm, a multiple signal classification algorithm, or a signal parameter estimation algorithm based on rotational invariance technology.

3. The method according to claim 2, characterized in that The wireless positioning algorithm includes a fast Fourier transform algorithm, and determining the location information according to the positioning signal includes: Performing Fourier transform on the positioning signal to obtain frequency domain symbols; Determine, according to the frequency domain symbol and the frequency domain signal, the perception channel information, wherein the frequency domain signal is determined according to the time-frequency domain position of receiving the positioning signal, and the perception channel information is used to perceive the user equipment; Perform fast Fourier transform on the perceived channel information to obtain the range Doppler spectrum; The position information is determined according to the range Doppler spectrum, where the position information includes distance information and actual angle information, the distance information is used to indicate the distance between the audio playback device and the user device, and the actual angle information is used to indicate the angle of the user device relative to the audio playback device.

4. The method according to claims 1-3, characterized in that: The position information includes actual angle information, where the actual angle information is used to indicate an angle of the user equipment relative to the audio playback device, and adjusting the audio parameters of the audio playback device according to the position information includes: Acquire first two-channel audio data; dividing the first two-channel audio data into first center M channel data and first side S channel data; Determine the ipsilateral HRTF and the heterolateral HRTF from a head-related transfer function HRTF library according to the actual angle information and the virtual angle information, wherein the virtual angle information is used to indicate a virtual angle of the extended sound field corresponding to the audio playback device; Based on the ipsilateral HRTF and the heterolateral HRTF, adjusting the first M channel data using the sum HRTF to obtain second M channel data; Based on the ipsilateral HRTF and the occlusal HRTF, the first S channel data is adjusted using a difference HRTF to obtain second S channel data.

5. The method according to claim 4, characterized in that Before adjusting the first M channel data by using the sum HRTF and adjusting the first S channel data by using the difference HRTF, the method further includes: Phase modulating the first M channel data using a first phase modulation function to obtain third M channel data; Phase modulating the first S channel data using a second phase modulation function to obtain third S channel data; The adjusting the first M channel data by using HRTF includes: Using the sum HRTF to adjust the third M channel data; The adjusting the first S channel data by using the difference HRTF includes: The third S channel data is adjusted using the difference HRTF.

6. The method according to claim 5, characterized in that The first phase modulation function includes at least one of the following: a linear phase modulation function, a sinusoidal phase modulation function, or an exponential phase modulation function; and / or, The second phase modulation function includes at least one of the following: a linear phase modulation function, a sinusoidal phase modulation function, or an exponential phase modulation function.

7. The method according to any one of claims 4 to 6, characterized in that: After adjusting the first M channel data by using the sum HRTF and adjusting the first S channel data by using the difference HRTF, the method further includes: Restoring the second M channel data and the second S channel data into second dual-channel data; The left channel data and the right channel data in the second two-channel audio data are convolved with a crosstalk cancellation function respectively.

8. The method according to any one of claims 1 to 7, characterized in that The location of the user equipment changes, including: The user equipment leaves the first area, and the area covered by the audio playing device playing audio includes the first area and the second area, and the audio effect of the first area is stronger than the audio effect of the second area.

9. The method according to any one of claims 1 to 8, characterized in that The sequence corresponding to the positioning signal is any one of the following sequences: an M sequence or a ZC sequence.

10. A dual-channel audio adjustment device, characterized in that: Applied to an audio playback device, the audio adjustment device comprises: A wireless communication module, configured to receive a positioning signal from the user equipment when the audio playback device has established a communication connection with the user equipment; A wireless positioning module, used to determine location information according to the positioning signal, and determine whether the location of the user equipment has changed according to the location information, wherein the location information is used to indicate the location relationship between the audio playback device and the user equipment; The spatial audio rendering module is used to adjust the audio parameters of the audio playback device according to the position information when the position of the user equipment changes, so as to perform spatial audio rendering on the area where the user equipment is located.

11. An audio playback device, characterized in that: include: A processor, configured to execute the dual-channel audio adjustment method according to any one of claims 1 to 9; A speaker is connected to the processor.

Images