Audio playing method, device, system and storage medium

Abstract

The present disclosure provides a playing method, device, system and storage medium of audio; applied to an audio playing system, the audio playing system comprises at least one main sound box and at least one subwoofer corresponding to each main sound box, wherein the method comprises: in the audio playing process of any target main sound box, collecting the current position of the target terminal device according to the specified frequency; wherein the target main sound box is any main sound box; for each collected current position, judging whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition; if the preset correction condition is met, obtaining a target delay parameter, the target delay parameter comprising a parameter causing a time difference in receiving audio signals from the target main sound box and the corresponding subwoofer at the current position; according to the target delay parameter, the subwoofer corresponding to the target main sound box is compensated for delay and played synchronously. The present disclosure can reduce the limitations of the optimal listening position and improve the listening experience.

Description

Technical Field

[0001] This disclosure relates to the field of audio processing technology, and in particular to an audio playback method, apparatus, system, and storage medium. Background Technology

[0002] Modern audio playback systems increasingly pursue a surround-sound, all-around listening experience. Subwoofers, as low-frequency sound enhancers, can work in conjunction with main speakers to make the bass effects during audio playback more powerful and immersive.

[0003] When the main speaker and subwoofer play audio simultaneously as different audio playback devices, they are prone to desynchronization issues due to factors such as equipment, network, and environment. Existing technologies usually calibrate the main speaker and subwoofer based on a single sweet spot (such as the center of the sofa) or a combination of multiple fixed positions. This approach is too limiting, often restricting the best listening position to one or more fixed locations in the space, resulting in a poor user experience. Summary of the Invention

[0004] In view of this, the purpose of this disclosure is to provide an audio playback method, apparatus, system, and storage medium to reduce the limitations of the optimal listening position and improve the listening experience.

[0005] In a first aspect, embodiments of this disclosure provide an audio playback method applied to an audio playback system, the audio playback system including at least one main speaker and at least one subwoofer corresponding to each main speaker, the method including: during audio playback of any target main speaker, acquiring the current position of a target terminal device at a specified frequency; wherein, the target main speaker is any of the main speakers; for each acquired current position, determining whether the playback delay between the target main speaker and the corresponding subwoofer meets a preset correction condition; if it meets the preset correction condition, acquiring a target delay parameter, the target delay parameter including a parameter that causes a time difference in the current position receiving audio signals from the target main speaker and the corresponding subwoofer; and performing delayed compensation synchronous playback on the subwoofer corresponding to the target main speaker according to the target delay parameter.

[0006] Secondly, embodiments of this disclosure provide an audio playback device applied to an audio playback system. The audio playback system includes at least one main speaker and at least one subwoofer corresponding to each main speaker. The device includes: a acquisition module, used to acquire the current position of a target terminal device at a specified frequency during audio playback from any target main speaker; wherein the target main speaker is any one of the main speakers; a judgment module, used to determine, for each acquired current position, whether the playback delay between the target main speaker and the corresponding subwoofer meets a preset correction condition; an acquisition module, used to acquire a target delay parameter if the preset correction condition is met, the target delay parameter including a parameter that causes a time difference in the reception of audio signals from the target main speaker and the corresponding subwoofer at the current position; and a compensation module, used to perform delayed compensation synchronous playback on the subwoofer corresponding to the target main speaker according to the target delay parameter.

[0007] Thirdly, embodiments of this disclosure provide a system including at least one main speaker, at least one subwoofer corresponding to each main speaker, a processor, and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-described audio playback method.

[0008] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are invoked and executed by a processor, the computer-executable instructions cause the processor to implement the aforementioned audio playback method.

[0009] The embodiments disclosed herein bring the following beneficial effects:

[0010] The aforementioned audio playback method, device, system, and storage medium periodically collect the position of the terminal device when the system plays audio, and preliminarily determine whether to trigger delay compensation for the subwoofer based on the collected position. If the triggering condition is met, the delay compensation amount is accurately calculated based on the delay parameters and synchronous playback is performed, so that the optimal listening position of the system can dynamically change with the movement of the device, improving flexibility and providing a better listening experience for the user.

[0011] Other features and advantages of this disclosure will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the disclosure. The objects and other advantages of this disclosure are realized and obtained through the structures particularly pointed out in the description, claims and drawings.

[0012] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0013] To more clearly illustrate the technical solutions in the specific embodiments of this disclosure or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0014] Figure 1 This is a flowchart of one embodiment of the audio playback method in this disclosure;

[0015] Figure 2 A schematic diagram of an audio playback device provided in an embodiment of this disclosure;

[0016] Figure 3 This is a schematic diagram of a system provided in an embodiment of the present disclosure. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0018] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in this disclosure, claims, and accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” or “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0019] For ease of understanding, the specific process of the embodiments of this disclosure is described below. The audio playback system includes at least one main speaker and at least one subwoofer corresponding to each main speaker. Please refer to [link / reference]. Figure 1 One embodiment of the audio playback method in this disclosure includes:

[0020] Step S10: During the audio playback of any target main speaker, collect the current position of the target terminal device at a specified frequency; wherein, the target main speaker is any main speaker.

[0021] An audio playback system may include one or more main speakers. The main speakers are the core components of the audio playback system, responsible for reproducing the mid-to-high frequency range (usually 80Hz-20kHz) of music, movies, and other content. They complement the subwoofer (which is responsible for low frequencies). The main speakers handle more than 80% of the sound energy output of the audio content and are the foundation for sound field construction.

[0022] In an audio playback system, the number of main speakers can be determined based on the system's objectives, the characteristics of the space, budget, and functional requirements; no specific limit is set here. In an audio playback system, any main speaker currently playing audio is considered a target main speaker, and the number of target main speakers can be one or more; no specific limit is set here.

[0023] In an audio playback system, the subwoofer is the core cooperating device with the main speakers. The subwoofer and main speakers work together through frequency band division, time synchronization, and energy complementarity to deliver a more powerful and immersive listening experience. In an audio playback system, each main speaker corresponds to at least one subwoofer. The number of subwoofers can be determined based on the acoustic characteristics of the space where the audio playback system is located, system goals, budget, and listening preferences; no specific limit is set here.

[0024] The correspondence between the subwoofer and the main speaker can be pre-bound or dynamically determined. In the case of dynamic determination, the target main speaker can be matched with a subwoofer based on the placement of the main speaker and the subwoofer, as well as the characteristics of the audio currently being played by the target main speaker, thereby determining at least one subwoofer corresponding to the target main speaker.

[0025] It should be noted that the subwoofer's delay / phase compensation is based on the corresponding target main speaker as the time reference, and the subwoofer's delay time is referenced to the direct sound of the corresponding target main speaker. By adjusting the subwoofer's delay time, it is made to arrive at the listening position synchronously with the sound waves of the corresponding target main speaker, thereby achieving a better listening effect.

[0026] The audio playback system may also include other components, such as audio playback devices such as a center speaker, surround speakers, and ultra-high frequency loudspeakers, as well as auxiliary devices such as a central controller and audio source devices. All audio playback devices in the audio playback system can use the audio playback technology provided in this embodiment to play audio synchronously, so that the audio playback system can achieve a better listening effect. Specific details are not elaborated here.

[0027] The target terminal device can be any mobile device or equipment with positioning, sound acquisition, and communication functions, such as an integrated chip, mobile phone, watch, bracelet, or any device with the aforementioned integrated chip built-in; no specific limitation is made here. The number of target terminal devices can be one or more. The target terminal devices can be bound and associated with the target main speaker, so that the audio playback of the target main speaker can be synchronized with the location of the target terminal device with delay compensation.

[0028] In this embodiment, collecting the current location of the target terminal device at a specified frequency means acquiring the spatial coordinates of the target terminal device at fixed time intervals. Specifically, this can be achieved using a GPS module, an indoor positioning system, or Bluetooth beacon triangulation technology, which is used to continuously track the user's movement trajectory in the sound field.

[0029] Step S20: For each current location captured, determine whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0030] Based on the current location, it can be preliminarily determined whether delay compensation between the target main speaker and the corresponding subwoofer is triggered, so that audio delay compensation can be achieved with low power consumption. This avoids the waste of resources and system performance degradation caused by excessively frequent delay compensation processing, and is a technical means that can balance resource consumption and performance.

[0031] In one implementation, the current location collected each time can be compared with the location collected in the previous time or multiple times in history to obtain position change information such as the moving distance, moving direction, or moving trajectory of the target terminal device. Based on the position change information, it can be determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0032] Furthermore, if the position change of the target terminal device is determined to exceed a certain threshold or meet certain conditions based on the position change information, it can be determined that the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions, thereby triggering subsequent delay compensation processing. This allows the delay compensation processing between the subwoofer and the main speaker to be dynamically adjusted, rather than only achieving fixed delay compensation at a fixed position, resulting in a better listening effect.

[0033] Step S30: If the preset correction conditions are met, the target delay parameters are obtained. The target delay parameters include parameters that cause the current position to receive audio signals from the target main speaker and the corresponding subwoofer to generate a time difference.

[0034] It is understandable that the parameter that causes the time difference between the same audio signals received at different locations from the target main speaker and the corresponding subwoofer can be used as the target delay parameter. The same audio signal can be a specified test signal, such as a chirp signal, the maximum length sequence (MLS), etc., which is not limited here.

[0035] The target delay parameter is a dynamic parameter. A fixed parameter is a parameter that causes a time difference between the same audio signals received at different locations from the target main speaker and the corresponding subwoofer. It can eliminate the impact on synchronization when performing initial calibration of the audio playback system. However, the asynchrony caused by the listener being in different locations needs to be corrected by the target delay parameter, such as the parameters of the signal transmission link, environmental characteristic parameters, etc., which are not specified here.

[0036] The target delay parameter is a composite parameter that includes the difference in sound wave propagation path and the device processing delay. Specifically, it can be achieved through sound speed calculation and network latency detection, and is used to quantify the amount of time difference compensation at different locations.

[0037] Step S40: Based on the target delay parameters, perform delayed compensation and synchronized playback on the subwoofer corresponding to the target main speaker.

[0038] Different parameters in the target delay parameters can be used to calculate different corresponding compensation amounts. The compensation amount can be positive, negative, or 0. A positive compensation amount indicates that the subwoofer's playback progress is slower than that of the corresponding target main speaker. Conversely, a negative compensation amount indicates that the subwoofer's playback progress is faster than that of the corresponding target main speaker. A compensation amount of 0 indicates that the subwoofer's playback progress is the same as that of the corresponding target main speaker, and no compensation is required.

[0039] For example, based on the signal transmission link parameters in the target delay parameters, calculate the first delay compensation amount for the subwoofer corresponding to the target main speaker; then, based on the environmental characteristic parameters in the target delay parameters, calculate the second delay compensation amount for the subwoofer corresponding to the target main speaker; by superimposing the first delay compensation amount and the second delay compensation amount, the target delay compensation amount can be obtained; and by using the target delay compensation amount, the subwoofer corresponding to the target main speaker can be synchronously played with delay compensation.

[0040] The audio playback method provided in the above embodiments periodically collects the position of the terminal device when the system plays audio, and preliminarily determines whether to trigger delay compensation for the subwoofer based on the collected position. If the triggering condition is met, the delay compensation amount is accurately calculated based on the delay parameters and synchronous playback is performed, so that the optimal listening position of the system can dynamically change with the movement of the device, improving flexibility and providing a better listening experience for the user.

[0041] Next, we will explain the specific playback method for the audio.

[0042] In one implementation, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions for each current location sampled includes: determining whether the current location of the target terminal device and the location of the previous sampled location belong to different phase compensation regions; wherein, the phase compensation region is a designated region in a preset phase compensation matrix, and the phase compensation matrix is ​​determined based on the sound field formed by the target main speaker and the corresponding subwoofer; if they belong to different phase compensation regions, the audio being played by the target main speaker and the corresponding subwoofer is spread-spectrum hidden mixed with a preset test signal to obtain spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively; the target main speaker and the corresponding subwoofer sequentially emit the corresponding spread-spectrum hidden signals, and the phase difference between the target main speaker and the corresponding subwoofer is calculated; based on the phase difference, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0043] The phase compensation matrix is ​​determined in advance based on the sound field formed between the target main speaker and the corresponding subwoofer. The phase compensation matrix consists of multiple phase compensation regions. The phase compensation matrix is ​​a physical spatial division of the sound field. In the same phase compensation region of the phase compensation matrix, the phase difference between the target main speaker and the corresponding subwoofer can belong to the same numerical range or have the same phase characteristics. Phase differences with different numerical ranges or phase characteristics correspond to different phase compensation regions, which are not specifically limited here.

[0044] The phase compensation matrix can predetermine the relative positions of the target main speaker and the corresponding subwoofer in the sound field formed between the target main speaker and the corresponding subwoofer. For example, the target main speaker and the two subwoofers are arranged in a triangular pattern, the two target main speakers and the two subwoofers are arranged in a rectangular pattern, etc. The specifics are not limited here.

[0045] Specifically, the sound field can be pre-divided into multiple grids. Based on the physical positions of the target main speaker and the corresponding subwoofer in the sound field, the path difference between the target main speaker and the corresponding subwoofer and different grids in the sound field can be calculated. Then, the time difference can be calculated based on the path difference. Finally, the phase difference between the target main speaker and the corresponding subwoofer and different grids in the sound field can be calculated based on the time difference. Based on the phase difference, the sound field can be divided into phase compensation regions to obtain the phase compensation matrix.

[0046] The pre-division of the phase compensation matrix can quickly determine the possibility of auditory delay caused by changes in the position of the terminal device. Based on this possibility, it is possible to further determine whether to perform more refined phase difference calculations, so that the delay compensation between the main speaker and the subwoofer can be triggered at a more reasonable time, reducing the waste of computing resources while improving the user's listening experience.

[0047] In this embodiment, if the target terminal device is detected to have moved from one phase compensation area to a new phase compensation area, it can be preliminarily determined whether further confirmation is needed to trigger subsequent delay compensation processing. If the target terminal device is detected to have moved without changing the phase compensation area, it can be directly determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions, without the need for subsequent delay compensation processing, thereby reducing the waste of computing resources.

[0048] In this embodiment, if the current location of the target terminal device is in a different phase compensation region than the location of the last acquisition, a spread spectrum hidden mixing technology is used to mix the test signal with the audio being played. This allows for accurate phase difference measurement without interrupting the user's listening experience, solving the real-time and covert problems of delay correction in mobile scenarios.

[0049] The mixed spread spectrum hidden signal can be used as the playback audio of the corresponding target main speaker and subwoofer. The target terminal device collects the audio played by the target main speaker and the corresponding subwoofer through the sound acquisition function, and separates the test signal from it. Based on the separated test signal, the phase difference between the target main speaker and the corresponding subwoofer is calculated, thereby determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0050] This implementation method can automatically identify the delay correction requirements of different sound field areas during user movement, activate the detection mechanism only when switching areas, reduce computing resource consumption, and achieve non-intrusive phase difference measurement through concealed test signals, ensuring audio playback continuity. Overall, it realizes multi-position dynamic delay compensation, so that the subwoofer and main speaker remain synchronized in different listening positions, improving the listening experience in mobile scenarios.

[0051] In one implementation, before determining whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions for each acquisition, the method further includes: calculating the phase difference of multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer to obtain sound field phase difference data; clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

[0052] In this embodiment, multiple measurement locations are pre-deployed within the sound field range where the target main speaker and subwoofer work together to measure the phase difference. For example, 50-100 sampling points are arranged in a grid pattern in the room. Each point collects the test signals emitted by the target main speaker and the corresponding subwoofer, calculates the phase difference value between the two reaching that point, and forms a phase difference dataset (i.e., sound field phase difference data) covering the entire sound field.

[0053] Subsequently, a clustering algorithm is used to analyze the dataset, automatically grouping adjacent locations with similar phase difference values ​​into the same compensation region. For example, when the phase difference fluctuation range of a certain region is less than a preset threshold, that region will be marked as the same phase compensation region. The final generated phase compensation matrix divides the sound field into multiple dynamic regions, each corresponding to a set of phase compensation parameters. When the user moves their terminal device to different phase compensation regions, the system automatically triggers the calibration process, without relying on a fixed reference position.

[0054] In this embodiment, the phase compensation region refers to the physical spatial region divided according to the clustering of sound field phase difference data. Specifically, it can be implemented using a multi-point phase difference data clustering algorithm based on sound field measurements, such as using the K-means clustering method to group measurement locations with similar phase differences into the same region. This division method can dynamically reflect the phase characteristic differences at different locations in the sound field, providing a basis for region change detection.

[0055] When calculating the phase difference, the time difference between the audio signals generated by the target main speaker and the corresponding subwoofer at different measurement positions in the sound field is measured. Specifically, a microphone array can be used to collect the arrival time of the signals at different measurement positions. Then, combined with the signal emission time of the corresponding target main speaker or subwoofer, the phase difference at different measurement positions can be calculated, thereby obtaining the sound field phase difference data, which provides basic data support for subsequent area division.

[0056] Sound field phase difference data refers to the set of phase differences between the target main speaker and the corresponding subwoofer audio signal at different measurement positions. It can also be used to perform periodic measurements at preset grid points through multi-channel acquisition equipment, and the average of multiple measurement results can be used to calculate the phase difference, forming a multidimensional dataset that reflects the characteristics of the sound field.

[0057] Clustering sound field phase difference data refers to classifying measurement locations with similar phase difference characteristics into the same group. Specifically, K-means algorithm or hierarchical clustering algorithm can be used for clustering. By calculating data similarity, the sound field is divided into multiple logical regions with unified compensation requirements, namely phase compensation regions. This enables the system to quickly identify cross-regions based on real-time location, so as to perform delay compensation processing when the phase difference span is large.

[0058] When clustering sound field phase difference data, the phase difference weights between different measurement positions can be calculated, and measurement positions with phase difference weights less than a certain threshold can be assigned to the same phase compensation region. Specifically, the phase difference weight W(i,j) between measurement position i and measurement position j is:

[0059]

[0060] in, Let d(i,j) represent the phase difference change between measurement position i and measurement position j, d(i,j) be the Euclidean distance between measurement position i and measurement position j, C(i,j) be the preset acoustic continuity coefficient between measurement position i and measurement position j, and α, β, and γ represent weighting coefficients, where α+β+γ=1.

[0061] For example, assuming the phase difference between the center position (2.5,2) and the left position (1.5,2) of the sofa is 5°, the Euclidean distance is 1m, and the acoustic continuity is good (C=0.9), then the phase difference weight between these two positions is W=0.4×5+0.3×1+0.3×0.9=2.57.

[0062] This clustering method can improve the accuracy of region division, reduce unnecessary compensation triggers, and avoid repeated calibration at locations with similar acoustic characteristics by taking acoustic continuity into account, thus reducing the overall system computational load by 30%-40%.

[0063] Compared to existing technologies, traditional calibration methods only perform phase measurements at a single fixed point, resulting in compensation parameters that cannot adapt to the sound field characteristics of other locations. This solution, however, establishes a dynamic, zoned compensation mechanism through global sound field measurement and data clustering, extending the calibration range from discrete fixed points to continuous areas. For example, in a home theater setting, traditional technology can only guarantee optimal listening experience at the center of the sofa, while this solution automatically provides appropriate phase compensation to different areas such as the left and right sides of the sofa and the back rows of the viewing area, eliminating audio desynchronization issues caused by positional changes.

[0064] This implementation achieves dynamic adaptation of the phase compensation strategy within the sound field area, solving the limitation of the listening area caused by traditional fixed-point calibration. During user movement, the system can automatically adjust the subwoofer delay parameters according to the phase compensation area of ​​the user's real-time location, ensuring that the main speaker and subwoofer audio signals remain synchronized in different areas, thus achieving a phase-consistent playback effect from any listening position.

[0065] In one embodiment, the step of spreading and hiding the audio being played by the target main speaker and the corresponding subwoofer with a preset test signal to obtain spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively includes: spreading the preset test signal with a preset pseudo-random code to obtain a spread-spectrum signal; wherein the test signal is the longest sequence code; reducing the amplitude of the spread-spectrum signal sequentially to a value less than the amplitude of each currently playing audio to obtain a reduced amplitude signal corresponding to the target main speaker and the corresponding subwoofer respectively; wherein each currently playing audio is used for at least the audio being played by the target main speaker and the corresponding subwoofer; mixing the audio being played by the target main speaker and the corresponding subwoofer with their respective reduced amplitude signals and outputting the result, which is the spread-spectrum hidden signal corresponding to the target main speaker and the corresponding subwoofer respectively.

[0066] In this embodiment, the test signal is first spectrally spread using a pseudo-random code to generate a spread spectrum signal with wideband characteristics. This step distributes the energy of the low-frequency test signal across a wider frequency range, making it complementary to the main audio signal in the frequency domain. Next, the spread spectrum signal undergoes amplitude attenuation processing, reducing its peak level to a preset threshold below that of the main audio signal, for example, controlling it within 30%-50% of the main audio signal's amplitude. Finally, the attenuated test signal is linearly superimposed on the real-time played main audio to form a composite signal containing hidden test information. This composite signal maintains the waveform characteristics of the main audio in the time domain and hides the test signal energy below the background noise level in the frequency domain, making the calibration signal imperceptible to the user.

[0067] Pseudo-random codes are digital sequences that have statistical characteristics of approximate random noise. Specifically, pseudo-random sequences such as Gold codes or m-sequence codes can be used to spread the spectrum of test signals to enhance their anti-interference capabilities.

[0068] The longest sequence code refers to the linear feedback shift register sequence with the largest length, specifically a sequence of length 2. n-1The autocorrelation properties of the binary sequence help improve signal detection accuracy. In this embodiment, the test signal is the Longest Sequence Code (MLS), which has excellent autocorrelation properties and is easy to despread and extract later. When spreading the spectrum using pseudo-random codes, the narrowband test signal can be multiplied by a wideband pseudo-random code to achieve spectrum spreading. Specifically, direct sequence spreading technology can be used to ensure the concealment of the test signal.

[0069] After obtaining the spread spectrum signal, it can be amplitude-reduced to lower the amplitude of the spread test signal (i.e., the spread spectrum signal) to a value lower than the playing audio, allowing the spread spectrum signal to be better hidden within the playing audio. This can be achieved using a dynamic range compression algorithm. For example, the amplitude of the spread spectrum signal can be set to 1 / 10 to 1 / 5 of the playing audio amplitude, or set to be 20dB lower than the playing audio amplitude; the specific setting is not limited here.

[0070] When performing amplitude reduction processing on a spread spectrum signal, the amplitude reduction can be calculated based on the amplitude of the currently played audio, the signal-to-noise ratio of the current frequency band, and the instantaneous rate of change of the audio signal, following the dynamic changes of the currently played audio. Specifically, the amplitude reduction A(hidden) of the spread spectrum signal is:

[0071] A(hidden)=A(audio)×[k0-k1·SNR(f)-k2·V(t)]

[0072] Where A(audio) represents the amplitude of the currently playing audio, SNR(f) represents the signal-to-noise ratio of the current frequency band, V(t) represents the instantaneous rate of change of the current audio signal, k0 represents the basic attenuation coefficient (usually 0.3-0.5), and k1 and k2 are adaptive adjustment coefficients.

[0073] For example, when playing intense rock music, the audio amplitude is large and changes drastically. At this time, V(t) may be 0.8, and the signal-to-noise ratio is good (SNR = 25dB). Then the reduction A(hidden) of the spread spectrum signal is: A(audio) × [0.4 - 0.01 × 25 - 0.1 × 0.8] = 0.07 × A(audio), which can ensure that the test signal is completely hidden in the music.

[0074] By using the above-mentioned amplitude reduction processing method, true imperceptible calibration can be achieved. Users will not be able to detect the test signal at all. The amplitude reduction is dynamically adjusted according to the audio content, which improves the detection accuracy by 15-25%, thereby avoiding the impact of excessively strong hidden signals on sound quality.

[0075] Understandably, traditional methods typically involve interrupting audio playback and sending separate test pulses to detect whether delay compensation is needed between the main speaker and subwoofer, leading to noticeable audio interruptions or noise interference during calibration. In this embodiment, however, by embedding a concealed test signal into the normal playback signal, parallel operation of real-time phase detection and continuous audio playback is achieved. Through spread spectrum technology and dynamic amplitude control, interference from the test signal to the main audio signal is effectively avoided.

[0076] This implementation method automatically triggers the generation and embedding of hidden test signals when user movement causes the phase compensation area to switch, providing a reliable signal source for dynamic phase difference detection. This technology injects test signals without interrupting normal audio playback, solving the audio interruption problem of existing calibration methods. Simultaneously, through spread spectrum and amplitude reduction processing, it effectively eliminates the impact of the test signal on the user's hearing, achieving seamless real-time synchronous calibration.

[0077] In one embodiment, the step of calculating the phase difference between the target main speaker and the corresponding subwoofer by sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer includes: sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, receiving the spread spectrum hiding signals through a target terminal device; despreading the spread spectrum hiding signals using a preset pseudo-random code, extracting a test signal from the despread signals, and obtaining the extracted test signal; cross-correlating the preset test signal and the extracted test signal to calculate the phase difference between the target main speaker and the corresponding subwoofer.

[0078] In this embodiment, when the target terminal device is in different phase compensation regions, the target main speaker and subwoofer sequentially emit spread spectrum hidden signals. After receiving the mixed signal (i.e., the spread spectrum hidden signal), the target terminal device performs despreading processing on the received signal using a pre-generated pseudo-random code, and recovers the hidden test signal by utilizing the correlation between the pseudo-random code and the spread spectrum signal.

[0079] Subsequently, the recovered test signal is cross-correlated with the original test signal (the aforementioned preset test signal). By calculating the difference in the maximum correlation peak position between the two on the time axis, the phase difference between the target main speaker and the subwoofer is obtained. This process enhances the anti-interference capability of the test signal through spread spectrum technology, enabling accurate extraction of the test signal for phase difference calculation even in dynamic environments with background noise or audio signal interference.

[0080] Cross-correlation refers to the similarity measurement operation between two signals in the time domain or frequency domain. Specifically, cross-correlation can be performed using sliding window convolution or fast Fourier transform algorithms. This process can accurately capture the time offset between signals, thereby calculating the phase difference between the target main speaker and the subwoofer.

[0081] Understandably, traditional phase difference measurement methods typically employ fixed-position test microphones or rely on preset static sound field models for estimation, which cannot adapt to the real-time movement of terminal devices. This implementation method achieves active detection of the sound field area where the mobile terminal is located by dynamically transmitting spread spectrum hidden signals that can carry location information, combined with real-time reception and despreading processing by the terminal device. This enables the phase difference calculation to be dynamically updated according to changes in the user's position, solving the problem of insufficient measurement accuracy of traditional methods in dynamic environments.

[0082] This implementation method can continuously acquire the actual phase difference data between the target main speaker and the subwoofer during user movement. By using spread spectrum technology, it can effectively suppress the interference of environmental noise and the played audio, ensuring the accuracy of phase difference detection. It breaks through the limitations of traditional fixed-point calibration and provides real-time and reliable phase difference data support for dynamic delay compensation, thereby significantly improving the synchronization accuracy of audio playback in mobile scenarios.

[0083] In one embodiment, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions based on the phase difference includes: if the phase difference between any target main speaker and any corresponding subwoofer is greater than a preset phase difference threshold, then determining whether the playback delay between the corresponding target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0084] In this embodiment, when a change in the position of the target terminal device causes an increase in the arrival time difference of the audio signals between the target main speaker and the corresponding subwoofer, the system extracts the phase difference between the two signals using a cross-correlation algorithm and compares this phase difference with a preset threshold in real time. If the phase difference exceeds the threshold, it is determined that the current playback delay has exceeded the acceptable range, and a delay compensation operation needs to be performed. This process replaces fixed-area calibration with a dynamic threshold mechanism. For example, when a user moves to a position closer to the subwoofer in a room, the system automatically detects the change in phase difference and triggers correction, without relying on a pre-calibrated fixed area.

[0085] The preset phase difference threshold is the minimum phase difference setting value that triggers delay correction. Specifically, it can be achieved by experimentally measuring the fluctuation range of phase difference at different positions and setting it to a fixed value or dynamically adjusting the range in combination with the listening tolerance. This threshold is used to distinguish between normal phase fluctuations and significant deviations that need to be corrected.

[0086] This implementation method dynamically triggers delay correction based on the user's actual location, avoiding judgment errors caused by dynamic changes in phase difference and improving audio synchronization accuracy at different spatial locations. Simultaneously, by filtering out minute phase fluctuations through a preset threshold, unnecessary correction operations are reduced, lowering system computational resource consumption.

[0087] In one embodiment, the step of synchronous playback with delay compensation for the subwoofer corresponding to the target main speaker based on the target delay parameter includes: calculating a first delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the phase difference between the main speaker to be calibrated and the corresponding subwoofer to be calibrated; wherein the main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer to be calibrated with a phase difference greater than a preset phase difference threshold; calculating a second delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the network transmission rate in the target delay parameter; and performing synchronous playback with delay compensation for the subwoofer to be calibrated corresponding to the main speaker to be calibrated based on the first delay compensation amount and the second delay compensation amount.

[0088] In one implementation, when the phase difference between the target main speaker and any corresponding subwoofer exceeds a preset threshold, the system automatically triggers a two-dimensional compensation mechanism: First, it calculates the sound wave path difference between the two speakers reaching the current location of the target mobile terminal using a sound field propagation model, converting the phase difference into a first delay compensation amount. Simultaneously, it monitors the network status of the audio data transmission path, obtains the current network transmission rate in real time, and calculates a second delay compensation amount. Then, it fuses the two compensation amounts to generate a target delay duration control command for the subwoofer to be calibrated, used to control the synchronous playback of the subwoofer undergoing delay compensation.

[0089] The main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer whose phase difference is greater than the preset phase difference threshold. Specifically, this can be achieved by monitoring the phase difference between the main speaker and the subwoofer in real time and comparing it with the preset threshold, which is used to filter out the device pairs that need to be delayed and compensated.

[0090] The first delay compensation amount refers to the physical delay compensation amount calculated based on the sound field phase difference. Specifically, it can be obtained by calculating the time delay difference of the sound wave reaching the target position using a cross-correlation algorithm, and is used to eliminate synchronization errors caused by different sound field propagation paths. The second delay compensation amount refers to the data transmission delay compensation amount calculated based on the network transmission rate. Specifically, it can be obtained by measuring the transmission time difference of audio data packets between the main speaker and the subwoofer, and is used to eliminate timing deviations caused by differences in network transmission paths. The target delay duration refers to the total compensation duration combining physical delay and network delay. Specifically, it can be obtained by calculating the composite compensation value using a weighted summation or nonlinear fusion algorithm, and is used to generate a precise synchronization control signal.

[0091] Understandably, traditional methods that only use a single fixed sound field delay compensation or network transmission delay compensation cannot cope with the complex synchronization problems caused by the superposition of sound field propagation path changes and network fluctuations during user movement. This implementation method establishes a joint compensation model of sound field phase difference and network transmission rate, and realizes real-time acquisition and fusion calculation of dual delay parameters at the device end. It can dynamically adapt to the dual interference caused by spatial location movement and network environment changes, and break through the limitations of the single compensation mode.

[0092] This implementation method effectively solves the problem of audio playback asynchrony caused by differences in sound field propagation paths and fluctuations in network transmission rates, achieving continuous and accurate synchronization between the main speaker and subwoofer during user movement, and improving the dynamic adaptability and overall playback quality of the multi-channel audio system.

[0093] In one embodiment, the step of synchronously playing a subwoofer corresponding to the main speaker to be calibrated with time delay compensation based on a first time delay compensation amount and a second time delay compensation amount includes: calculating a target time delay duration for the subwoofer corresponding to the main speaker to be calibrated based on the first time delay compensation amount and the second time delay compensation amount; and performing an atomic delay operation on the target time delay duration through a digital signal processing chip in the subwoofer to be calibrated, so as to synchronously play a subwoofer corresponding to the main speaker to be calibrated with time delay compensation.

[0094] In this embodiment, when calculating the target delay duration, a first delay compensation amount is first generated based on the difference in physical distance between the main speaker and the subwoofer. For example, when the two are 3 meters apart and the speed of sound is 340 meters per second, the first delay compensation amount is approximately 8.82 milliseconds. Simultaneously, a second delay compensation amount is obtained through network transmission rate testing. For example, when the network transmission delay is 15 milliseconds, the two are combined to form a total target delay duration of 23.82 milliseconds.

[0095] In one implementation, when calculating the target delay duration, the combined impact of phase difference and network transmission conditions on the environment can be considered to obtain a third delay compensation amount. The third delay compensation amount can be pre-set with different first delay compensation amounts and second delay compensation amounts. When calculating the target delay duration, the third delay compensation amount corresponding to the first delay compensation amount and the second delay compensation amount can be obtained directly.

[0096] Based on this, in one implementation, the target delay duration T is:

[0097] T=w1·T1+w2·T2+w3·T3+λ·H(T1,T2,T3)

[0098]

[0099] Where T1 is the first delay compensation amount, T2 is the second delay compensation amount, T3 is the third delay compensation amount, and w i It is the adaptive weighting coefficient, σ i λ is the estimated variance of the i-th compensation quantity, λ is the nonlinear correction coefficient, and H(T1,T2,T3) is the nonlinear interaction term of the three compensation quantities.

[0100] For example, in an unstable WiFi network environment, the network latency fluctuates greatly (σ2 = 5ms), while the phase difference measurement accuracy is high (σ1 = 1ms) and the environment is stable (σ3 = 2ms). The weight allocation is: w1 = 0.68, w2 = 0.09, w3 = 0.23. Thus, the system mainly relies on phase difference compensation, supplemented by environmental compensation, to reduce the impact of network fluctuations.

[0101] Based on this delay calculation method, the compensation accuracy can be significantly improved, the synchronization error can be reduced to less than 1ms, the robustness of the system to network fluctuations and environmental changes can be enhanced, a dynamic balance of multiple factors can be achieved, and it can adapt to complex usage scenarios.

[0102] Subsequently, the total duration is converted into instruction parameters recognizable by the digital signal processing chip and directly written into the signal processing pipeline via hardware circuitry. During this process, the digital signal processing chip completes the loading and application of delay parameters with a single-cycle instruction, ensuring that the audio signal delay compensation operation is completed within a single clock cycle. This avoids the discontinuous signal output caused by multi-threaded switching or interrupt handling in traditional software compensation.

[0103] Atomicity-based delay operations refer to indivisible and immediately effective signal processing actions. These can be implemented through hardware-level instructions in a digital signal processing chip, avoiding the step-by-step execution that may occur during software compensation. A digital signal processing chip is an integrated circuit module with real-time signal processing capabilities, which can be implemented using a dedicated audio processing chip, capable of executing delay compensation instructions with microsecond-level precision.

[0104] Understandably, existing solutions typically employ software-level delay compensation algorithms, such as gradually adjusting the playback buffer through operating system thread scheduling. This can lead to signal processing interruptions or buffer switching jitter during the compensation process. In contrast, this implementation uses hardware-level atomic operations to complete the entire signal delay processing flow within the digital signal processing chip, eliminating the inconsistency issues arising from intermediate processing steps.

[0105] For the corresponding method embodiments described above, see [link to relevant documentation]. Figure 2The diagram shows an audio playback device applied to an audio playback system. The audio playback system includes at least one main speaker and at least one subwoofer corresponding to each main speaker. The device includes: a acquisition module 22, used to acquire the current position of the target terminal device at a specified frequency during audio playback of any target main speaker; wherein, the target main speaker is any main speaker; a judgment module 24, used to determine whether the playback delay between the target main speaker and the corresponding subwoofer meets a preset correction condition for each acquired current position; an acquisition module 26, used to acquire a target delay parameter if the preset correction condition is met, the target delay parameter including a parameter that causes a time difference in the reception of audio signals from the target main speaker and the corresponding subwoofer at the current position; and a compensation module 28, used to perform delay compensation for synchronous playback of the subwoofer corresponding to the target main speaker according to the target delay parameter.

[0106] The aforementioned audio playback device periodically collects the position of the terminal device when the system plays audio, and makes a preliminary judgment on whether to trigger delay compensation for the subwoofer based on the collected position. If the triggering condition is met, the delay compensation amount is accurately calculated based on the delay parameters and synchronous playback is performed, so that the optimal listening position of the system can dynamically change with the movement of the device, improving flexibility and providing a better listening experience for the user.

[0107] Optionally, the aforementioned judgment module 24 includes: a first judgment unit, used to determine whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions for each acquisition; wherein, the phase compensation region is a designated region in a preset phase compensation matrix, and the phase compensation matrix is ​​determined based on the sound field formed by the target main speaker and the corresponding subwoofer; a spread spectrum hiding unit, used to spread spectrum hiding and mix the audio being played by the target main speaker and the corresponding subwoofer with a preset test signal if they belong to different phase compensation regions, to obtain spread spectrum hiding signals corresponding to the target main speaker and the corresponding subwoofer respectively; a phase calculation unit, used to calculate the phase difference between the target main speaker and the corresponding subwoofer by sequentially transmitting the corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer; and a second judgment unit, used to determine whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions based on the phase difference.

[0108] Optionally, the above device further includes: a calculation module, used to calculate the phase difference of multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer, and obtain sound field phase difference data; a clustering module, used to cluster the sound field phase difference data to obtain a phase compensation matrix; wherein, at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

[0109] Optionally, the aforementioned spread spectrum concealment unit is specifically used for: spreading a preset test signal using a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is the longest sequence code; sequentially reducing the amplitude of the spread spectrum signal to a value less than the amplitude of each currently playing audio to obtain the amplitude reduction signals corresponding to the target main speaker and the corresponding subwoofer respectively; wherein each currently playing audio is used for at least the audio being played by the target main speaker and the corresponding subwoofer; mixing the audio being played by the target main speaker and the corresponding subwoofer with their respective amplitude reduction signals and outputting the result, which is the spread spectrum concealment signal corresponding to the target main speaker and the corresponding subwoofer respectively.

[0110] Optionally, the phase calculation unit is specifically used for: sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, and receiving the spread spectrum hiding signals through the target terminal device; despreading the spread spectrum hiding signals using a preset pseudo-random code, extracting test signals from the despread signals, and obtaining the extracted test signals; cross-correlating the preset test signals and the extracted test signals to calculate the phase difference between the target main speaker and the corresponding subwoofer.

[0111] Optionally, the second judgment unit is specifically used to: if the phase difference between any target main speaker and the corresponding subwoofer is greater than a preset phase difference threshold, then determine whether the playback delay between the corresponding target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0112] Optionally, the compensation module 28 includes: a first calculation unit, used to calculate a first delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the phase difference between the main speaker to be calibrated and the corresponding subwoofer to be calibrated; wherein, the main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer with a phase difference greater than a preset phase difference threshold; a second calculation unit, used to calculate a second delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the network transmission rate in the target delay parameters; and a delay compensation unit, used to perform synchronous playback with delay compensation for the subwoofer to be calibrated corresponding to the main speaker to be calibrated based on the first delay compensation amount and the second delay compensation amount.

[0113] Optionally, the aforementioned delay compensation unit is specifically used to: calculate the target delay duration of the subwoofer to be calibrated corresponding to the main speaker to be calibrated based on the first delay compensation amount and the second delay compensation amount; and perform an atomic delay operation on the target delay duration through the digital signal processing chip in the subwoofer to be calibrated, so as to synchronize the playback of the subwoofer to be calibrated corresponding to the main speaker to be calibrated with delay compensation.

[0114] This embodiment also provides a system including at least one main speaker, at least one subwoofer corresponding to each main speaker, a processor, and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-described audio playback method. This system can be a server or a terminal device.

[0115] See Figure 3 As shown, the system includes a processor 100 and a memory 101, which stores machine-executable instructions that can be executed by the processor 100. The processor 100 executes the machine-executable instructions to implement the above-described audio playback method.

[0116] Furthermore, Figure 3 The system shown also includes a bus 102 and a communication interface 103, with the processor 100, communication interface 103 and memory 101 connected via the bus 102.

[0117] The memory 101 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 103 (which can be wired or wireless), such as the Internet, wide area network, local area network, or metropolitan area network. The bus 102 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 3 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0118] The processor 100 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 100 or by instructions in software form. The processor 100 may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this disclosure can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a readily available storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 101. The processor 100 reads information from memory 101 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments, for example:

[0119] During audio playback on any target main speaker, the current position of the target terminal device is collected at a specified frequency; where the target main speaker is any main speaker; for each collected current position, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions; if it meets the preset correction conditions, the target delay parameter is obtained, which includes parameters that cause a time difference in the reception of audio signals from the target main speaker and the corresponding subwoofer at the current position; based on the target delay parameter, synchronous playback with delay compensation is performed on the subwoofer corresponding to the target main speaker.

[0120] In this method, the position of the terminal device is periodically collected when the system plays audio. Based on the collected position, it is initially determined whether to trigger delay compensation for the subwoofer. If the triggering condition is met, the delay compensation amount is accurately calculated based on the delay parameters and synchronized playback is performed. This allows the optimal listening position of the system to dynamically change with the movement of the device, improving flexibility and providing a better listening experience for the user.

[0121] Optionally, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions for each current location sampled includes: determining whether the current location of the target terminal device and the location of the previous sampled location belong to different phase compensation regions; wherein, the phase compensation region is a designated region in a preset phase compensation matrix, and the phase compensation matrix is ​​determined based on the sound field formed by the target main speaker and the corresponding subwoofer; if they belong to different phase compensation regions, the audio being played by the target main speaker and the corresponding subwoofer is spread-spectrum hidden mixed with a preset test signal to obtain spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively; the target main speaker and the corresponding subwoofer sequentially emit the corresponding spread-spectrum hidden signals, and the phase difference between the target main speaker and the corresponding subwoofer is calculated; based on the phase difference, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0122] Optionally, before determining whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions for each acquisition, the method further includes: calculating the phase difference of multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer to obtain sound field phase difference data; clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

[0123] Optionally, the step of spreading and hiding the audio being played by the target main speaker and the corresponding subwoofer with a preset test signal to obtain the spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer includes: spreading the preset test signal with a preset pseudo-random code to obtain a spread-spectrum signal; wherein the test signal is the longest sequence code; reducing the amplitude of the spread-spectrum signal sequentially to a value less than the amplitude of each currently playing audio to obtain the amplitude reduction signals corresponding to the target main speaker and the corresponding subwoofer respectively; wherein each currently playing audio is used for at least the audio being played by the target main speaker and the corresponding subwoofer; mixing the audio being played by the target main speaker and the corresponding subwoofer with their respective amplitude reduction signals and outputting the result, which is the spread-spectrum hidden signal corresponding to the target main speaker and the corresponding subwoofer respectively.

[0124] Optionally, the step of sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, and calculating the phase difference between the target main speaker and the corresponding subwoofer, includes: sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, and receiving the spread spectrum hiding signals through the target terminal device; despreading the spread spectrum hiding signals using a preset pseudo-random code, extracting a test signal from the despread signals, and obtaining the extracted test signal; cross-correlating the preset test signal and the extracted test signal to calculate the phase difference between the target main speaker and the corresponding subwoofer.

[0125] Optionally, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions based on the phase difference includes: if the phase difference between any target main speaker and any corresponding subwoofer is greater than a preset phase difference threshold, then determining whether the playback delay between the corresponding target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0126] Optionally, the step of synchronous playback with delay compensation for the subwoofer corresponding to the target main speaker based on the target delay parameters includes: calculating a first delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the phase difference between the main speaker to be calibrated and the corresponding subwoofer to be calibrated; wherein, the main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer to be calibrated with a phase difference greater than a preset phase difference threshold; calculating a second delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the network transmission rate in the target delay parameters; and performing synchronous playback with delay compensation for the subwoofer to be calibrated corresponding to the main speaker to be calibrated based on the first delay compensation amount and the second delay compensation amount.

[0127] Optionally, the step of synchronously playing the subwoofer corresponding to the main speaker to be calibrated, based on the first delay compensation amount and the second delay compensation amount, includes: calculating the target delay duration of the subwoofer corresponding to the main speaker to be calibrated, based on the first delay compensation amount and the second delay compensation amount; and performing an atomic delay operation on the target delay duration through the digital signal processing chip in the subwoofer to be calibrated, so as to synchronously play the subwoofer corresponding to the main speaker to be calibrated, based on the delay compensation amount.

[0128] This embodiment also provides a computer-readable storage medium storing computer-executable instructions. When these computer-executable instructions are invoked and executed by a processor, they cause the processor to implement the aforementioned audio playback method, for example:

[0129] During audio playback on any target main speaker, the current position of the target terminal device is collected at a specified frequency; where the target main speaker is any main speaker; for each collected current position, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions; if it meets the preset correction conditions, the target delay parameter is obtained, which includes parameters that cause a time difference in the reception of audio signals from the target main speaker and the corresponding subwoofer at the current position; based on the target delay parameter, synchronous playback with delay compensation is performed on the subwoofer corresponding to the target main speaker.

[0130] In this method, the position of the terminal device is periodically collected when the system plays audio. Based on the collected position, it is initially determined whether to trigger delay compensation for the subwoofer. If the triggering condition is met, the delay compensation amount is accurately calculated based on the delay parameters and synchronized playback is performed. This allows the optimal listening position of the system to dynamically change with the movement of the device, improving flexibility and providing a better listening experience for the user.

[0131] Optionally, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions for each current location sampled includes: determining whether the current location of the target terminal device and the location of the previous sampled location belong to different phase compensation regions; wherein, the phase compensation region is a designated region in a preset phase compensation matrix, and the phase compensation matrix is ​​determined based on the sound field formed by the target main speaker and the corresponding subwoofer; if they belong to different phase compensation regions, the audio being played by the target main speaker and the corresponding subwoofer is spread-spectrum hidden mixed with a preset test signal to obtain spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively; the target main speaker and the corresponding subwoofer sequentially emit the corresponding spread-spectrum hidden signals, and the phase difference between the target main speaker and the corresponding subwoofer is calculated; based on the phase difference, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0132] Optionally, before determining whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions for each acquisition, the method further includes: calculating the phase difference of multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer to obtain sound field phase difference data; clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

[0133] Optionally, the step of spreading and hiding the audio being played by the target main speaker and the corresponding subwoofer with a preset test signal to obtain the spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer includes: spreading the preset test signal with a preset pseudo-random code to obtain a spread-spectrum signal; wherein the test signal is the longest sequence code; reducing the amplitude of the spread-spectrum signal sequentially to a value less than the amplitude of each currently playing audio to obtain the amplitude reduction signals corresponding to the target main speaker and the corresponding subwoofer respectively; wherein each currently playing audio is used for at least the audio being played by the target main speaker and the corresponding subwoofer; mixing the audio being played by the target main speaker and the corresponding subwoofer with their respective amplitude reduction signals and outputting the result, which is the spread-spectrum hidden signal corresponding to the target main speaker and the corresponding subwoofer respectively.

[0134] Optionally, the step of sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, and calculating the phase difference between the target main speaker and the corresponding subwoofer, includes: sequentially transmitting corresponding spread spectrum hiding signals through the target main speaker and the corresponding subwoofer, and receiving the spread spectrum hiding signals through the target terminal device; despreading the spread spectrum hiding signals using a preset pseudo-random code, extracting a test signal from the despread signals, and obtaining the extracted test signal; cross-correlating the preset test signal and the extracted test signal to calculate the phase difference between the target main speaker and the corresponding subwoofer.

[0135] Optionally, the step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions based on the phase difference includes: if the phase difference between any target main speaker and any corresponding subwoofer is greater than a preset phase difference threshold, then determining whether the playback delay between the corresponding target main speaker and the corresponding subwoofer meets the preset correction conditions.

[0136] Optionally, the step of synchronous playback with delay compensation for the subwoofer corresponding to the target main speaker based on the target delay parameters includes: calculating a first delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the phase difference between the main speaker to be calibrated and the corresponding subwoofer to be calibrated; wherein, the main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer to be calibrated with a phase difference greater than a preset phase difference threshold; calculating a second delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated based on the network transmission rate in the target delay parameters; and performing synchronous playback with delay compensation for the subwoofer to be calibrated corresponding to the main speaker to be calibrated based on the first delay compensation amount and the second delay compensation amount.

[0137] Optionally, the step of synchronously playing the subwoofer corresponding to the main speaker to be calibrated, based on the first delay compensation amount and the second delay compensation amount, includes: calculating the target delay duration of the subwoofer corresponding to the main speaker to be calibrated, based on the first delay compensation amount and the second delay compensation amount; and performing an atomic delay operation on the target delay duration through the digital signal processing chip in the subwoofer to be calibrated, so as to synchronously play the subwoofer corresponding to the main speaker to be calibrated, based on the delay compensation amount.

[0138] The computer program product of the audio playback method, apparatus, system and storage medium provided in the embodiments of this disclosure includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods described in the preceding method embodiments. For specific implementation, please refer to the method embodiments, which will not be repeated here.

[0139] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system and apparatus described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0140] Furthermore, in the description of the embodiments of this disclosure, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this disclosure based on the specific circumstances.

[0141] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0142] In the description of this disclosure, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0143] Finally, it should be noted that the above embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. An audio playback method, applied to an audio playback system, the audio playback system comprising at least one main speaker and at least one subwoofer corresponding to each main speaker, characterized in that, The method includes: During audio playback from any target main speaker, the current position of the target terminal device is collected at a specified frequency; wherein, the target main speaker is any of the main speakers. For each current location captured, determine whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions; The step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions for each current position collected includes: For each acquisition of the current position, it is determined whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions; wherein, the phase compensation region is a designated region in a preset phase compensation matrix, and the phase compensation matrix is ​​determined based on the sound field formed by the target main speaker and the corresponding subwoofer; If they belong to different phase compensation regions, the audio being played by the target main speaker and the corresponding subwoofer is mixed with the preset test signal to obtain the spread spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively. The target main speaker and the corresponding subwoofer sequentially emit corresponding spread spectrum hidden signals, and the phase difference between the target main speaker and the corresponding subwoofer is calculated. Based on the phase difference, determine whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions; Before determining whether the current position of the target terminal device and the position of the previous acquisition belong to different phase compensation regions for each acquisition, the method further includes: calculating the phase difference for multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer to obtain sound field phase difference data; clustering the sound field phase difference data to obtain the phase compensation matrix; wherein at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region; If the preset correction conditions are met, the target delay parameter is obtained. The target delay parameter includes a parameter that causes the current position to receive audio signals from the target main speaker and the corresponding subwoofer, resulting in a time difference. Based on the target delay parameters, the subwoofer corresponding to the target main speaker is synchronously played with delay compensation.

2. The method according to claim 1, characterized in that, The step of spreading and hiding the audio being played by the target main speaker and the corresponding subwoofer with a preset test signal to obtain the spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively includes: A spread spectrum signal is obtained by spreading a preset test signal using a preset pseudo-random code; wherein the test signal is the longest sequence code. The amplitude of the spread spectrum signal is sequentially reduced to a certain value less than the amplitude of each playing audio, thereby obtaining the amplitude reduction signals corresponding to the target main speaker and the corresponding subwoofer; wherein each playing audio includes at least the audio being played by the target main speaker and the corresponding subwoofer, and the certain value is used to hide the spread spectrum signal in the playing audio; The audio being played by the target main speaker and the corresponding subwoofer is mixed with their respective amplitude reduction signals and output. The output is the spread spectrum hidden signal corresponding to the target main speaker and the corresponding subwoofer.

3. The method according to claim 1, characterized in that, The step of calculating the phase difference between the target main speaker and the corresponding subwoofer by sequentially transmitting corresponding spread spectrum hidden signals through the target main speaker and the corresponding subwoofer includes: The target main speaker and the corresponding subwoofer sequentially emit corresponding spread spectrum hidden signals, and the target terminal device receives the spread spectrum hidden signals. The spread spectrum hidden signal is despread using a preset pseudo-random code, and the test signal is extracted from the despread signal to obtain the extracted test signal. The preset test signal and the extracted test signal are cross-correlated to calculate the phase difference between the target main speaker and the corresponding subwoofer.

4. The method according to claim 1, characterized in that, The step of determining whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction conditions based on the phase difference includes: If the phase difference between any target main speaker and the corresponding subwoofer is greater than the preset phase difference threshold, then the playback delay between the corresponding target main speaker and the corresponding subwoofer is determined to meet the preset correction conditions.

5. The method according to claim 1, characterized in that, The step of synchronously playing the subwoofer corresponding to the target main speaker by delay compensation according to the target delay parameter includes: Based on the phase difference between the main speaker to be calibrated and the corresponding subwoofer to be calibrated, a first delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated is calculated; wherein, the main speaker to be calibrated and the corresponding subwoofer to be calibrated refer to the target main speaker and the corresponding subwoofer with a phase difference greater than a preset phase difference threshold. Based on the network transmission rate in the target delay parameters, calculate the second delay compensation amount between the main speaker to be calibrated and the corresponding subwoofer to be calibrated; Based on the first delay compensation amount and the second delay compensation amount, the subwoofer corresponding to the main speaker to be calibrated is synchronously played with delay compensation.

6. The method according to claim 5, characterized in that, The step of synchronously playing the subwoofer corresponding to the main speaker to be calibrated, based on the first delay compensation amount and the second delay compensation amount, includes: Based on the first delay compensation amount and the second delay compensation amount, calculate the target delay duration of the main speaker to be calibrated corresponding to the subwoofer to be calibrated; The target delay duration is atomically delayed by the digital signal processing chip in the subwoofer to be calibrated, so as to synchronize the playback of the subwoofer corresponding to the main speaker to be calibrated with delay compensation.

7. An audio playback device, applied to an audio playback system, the audio playback system comprising at least one main speaker and at least one subwoofer corresponding to each main speaker, characterized in that, The device includes: The acquisition module is used to acquire the current position of the target terminal device at a specified frequency during audio playback from any target main speaker; wherein, the target main speaker is any one of the main speakers. The judgment module is used to determine, for each sampling location, whether the playback delay between the target main speaker and the corresponding subwoofer meets a preset correction condition. This determination includes: for each sampling location, determining whether the current location of the target terminal device belongs to a different phase compensation region than the location of the previous sampling; wherein the phase compensation region is a designated region in a preset phase compensation matrix, which is determined based on the sound field formed by the target main speaker and the corresponding subwoofer; if they belong to different phase compensation regions, the audio being played by the target main speaker and the corresponding subwoofer is spread-spectrum hidden mixed with a preset test signal to obtain spread-spectrum hidden signals corresponding to the target main speaker and the corresponding subwoofer respectively; the target main speaker and the corresponding subwoofer sequentially emit the corresponding spread-spectrum hidden signals, and the phase difference between the target main speaker and the corresponding subwoofer is calculated; based on the phase difference, it is determined whether the playback delay between the target main speaker and the corresponding subwoofer meets the preset correction condition. The acquisition module is used to acquire target delay parameters if preset correction conditions are met. The target delay parameters include parameters that cause the current position to receive audio signals from the target main speaker and the corresponding subwoofer, resulting in a time difference. The compensation module is used to perform time-delay compensation for the subwoofer corresponding to the target main speaker and synchronize the playback according to the target delay parameters. The calculation module is used to calculate the phase difference of multiple measurement positions in the sound field formed by the target main speaker and the corresponding subwoofer before determining whether the current position and the previously acquired position belong to different phase compensation areas, so as to obtain sound field phase difference data. The clustering module is used to cluster the sound field phase difference data to obtain the phase compensation matrix; wherein, at least one measurement position corresponding to the same type of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

8. An audio playback system, characterized in that, The device includes at least one main speaker, at least one subwoofer corresponding to each main speaker, a processor, and a memory, wherein the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the audio playback method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the audio playback method according to any one of claims 1-6.

Images