Audio playing method, device and system and storage medium

Abstract

The invention provides an audio playing method, device and system and a storage medium. The method is applied to an audio playing system, the audio playing system comprises at least one main sound box and at least one subwoofer corresponding to each main sound box, and the method comprises the following steps: in the audio playing process of any target main sound box, collecting the current position of target terminal equipment according to a specified frequency; wherein the target main loudspeaker box is any main loudspeaker box; aiming at the current position acquired each time, judging whether the playing delay between the target main loudspeaker box and the corresponding subwoofer meets a preset correction condition or not; if the preset correction condition is met, a target delay parameter is obtained, and the target delay parameter comprises a parameter which causes a time difference to be generated when the current position receives the audio signals from the target main loudspeaker box and the corresponding subwoofer; and according to the target delay parameter, performing synchronous playing of delay compensation on a subwoofer corresponding to the target main sound box. The limitation of the optimal hearing position can be reduced, and the hearing experience is improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of audio processing, and in particular to a playing method, device, system and storage medium of audio. BACKGROUND

[0002] Modern audio playing systems increasingly pursue a surround full-range listening experience. A subwoofer, as a low-frequency sound effect enhancer, can cooperate with a main sound box to make the bass effect in the audio playing process more shocking and immersive.

[0003] When the main sound box and the subwoofer play audio at the same time as different audio playing devices, different synchronization problems are prone to occur due to factors such as devices, networks and environments. The existing technology usually calibrates the main sound box and the subwoofer based on a single emperor position (such as the center of a sofa) or a multi-fixed position trade-off. This way is too limited, and the best listening position is often limited to one or more fixed positions in space, which does not provide a good user experience. SUMMARY

[0004] Therefore, the purpose of the present disclosure is to provide a playing method, device, system and storage medium of audio to reduce the limitation of the best listening position and improve the listening experience.

[0005] In a first aspect, the embodiments of the present disclosure provide a playing method of audio, applied to an audio playing system, the audio playing system comprising at least one main sound box and at least one subwoofer corresponding to each main sound box, the method comprising: collecting a current position of a target terminal device in accordance with a specified frequency during an audio playing process of any target main sound box; wherein the target main sound box is any of the main sound boxes; judging whether a playing delay between the target main sound box and the corresponding subwoofer meets a preset correction condition for each collected current position; if the preset correction condition is met, obtaining a target delay parameter, the target delay parameter comprising a parameter causing a time difference in receiving audio signals from the target main sound box and the corresponding subwoofer at the current position; and performing delay compensation synchronization playing on the subwoofer corresponding to the target main sound box according to the target delay parameter.

[0006] In a second aspect, the embodiments of the present disclosure provide a playing device of audio, applied to an audio playing system, the audio playing system comprising at least one main sound box and at least one subwoofer corresponding to each main sound box, and the device comprising: a collecting module configured to collect a current position of a target terminal device at a specified frequency during an audio playing process of any target main sound box; wherein the target main sound box is any of the main sound boxes; a judging module configured to judge whether a playing delay between the target main sound box and the corresponding subwoofer meets a preset correction condition for each collected current position; an obtaining module configured to obtain a target delay parameter if the preset correction condition is met, the target delay parameter comprising a parameter causing a time difference in audio signals received from the target main sound box and the corresponding subwoofer at the current position; and a compensating module configured to perform delay compensation and synchronized playing on the subwoofer corresponding to the target main sound box according to the target delay parameter.

[0007] In a third aspect, the embodiments of the present disclosure provide a system comprising at least one main sound box, at least one subwoofer corresponding to each main sound box, a processor and a memory, the memory storing machine executable instructions capable of being executed by the processor, and the processor executing the machine executable instructions to implement the above-mentioned playing method of audio.

[0008] In a fourth aspect, the embodiments of the present disclosure provide a computer readable storage medium, the computer readable storage medium storing computer executable instructions, and the computer executable instructions, when invoked and executed by a processor, causing the processor to implement the above-mentioned playing method of audio.

[0009] The embodiments of the present disclosure bring the following beneficial effects:

[0010] The above-mentioned playing method of audio, device, system and storage medium periodically collect the position of the terminal device when the system plays audio, and preliminarily judge whether to trigger delay compensation for the subwoofer according to the collected position, and if the trigger condition is met, accurately calculate the delay compensation amount and perform synchronized playing according to the delay parameter, so that the best listening position of the system can dynamically change with the movement of the device, the flexibility is improved, and the user's listening experience is better.

[0011] Other features and advantages of the present disclosure will be described in the following description, and some will become apparent from the description, or will be learned from the practice of the present disclosure. The purposes and other advantages of the present disclosure will be achieved and obtained by the structures particularly pointed out in the specification, claims and drawings.

[0012] In order to make the above-mentioned purposes, features and advantages of the present disclosure more obvious and easy to understand, the following preferred embodiments are specifically described below, and the accompanying drawings are referred to for a detailed description. BRIEF DESCRIPTION OF DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the specific embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings needed to be used in the description of the specific embodiments or the prior art. Obviously, the drawings described below are some embodiments of the present disclosure, and other drawings can also be obtained by those skilled in the art without creative labor under the premise of the drawings.

[0014] Figure 1 An embodiment flowchart of the audio playing method in the embodiments of the present disclosure;

[0015] Figure 2 A schematic diagram of an audio playing device provided by the embodiments of the present disclosure;

[0016] Figure 3 A schematic diagram of a system provided by the embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions of the present disclosure will be described clearly and completely below with reference to the drawings. Obviously, the described embodiments are some of the embodiments of the present disclosure, but not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of the present disclosure.

[0018] The terms "first", "second", "third", "fourth" and the like (if any) in the description, claims and drawings of the present disclosure are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "comprise" or "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units does not have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product or device.

[0019] In order to facilitate understanding, the specific flow of the embodiments of the present disclosure will be described below. The audio playing system includes at least one main sound box and at least one subwoofer corresponding to each main sound box. Please refer to Figure 1 An embodiment of the audio playing method in the embodiments of the present disclosure includes the following steps.

[0020] Step S10, in the audio playing process of any target main sound box, the current position of the target terminal device is collected according to a specified frequency; wherein the target main sound box is any main sound box.

[0021] In the audio playback system, one or more main speakers can be included, which are the core components of the audio playback system, responsible for restoring the medium-high frequency band (usually 80Hz-20kHz) of music, movies, etc. content, complementing the subwoofer (responsible for low frequency), and the main speaker bears more than 80% of the sound energy output in the audio content, which is the basis of sound field construction.

[0022] In the audio playback system, the number of main speakers can be determined according to the target of the audio playback system, the characteristics of the space, the budget, and the functional requirements, etc. The specific place is not limited. In the audio playback system, any main speaker that is playing audio is considered a target main speaker, and the number of target main speakers can be one or more, and the specific place is not limited.

[0023] In the audio playback system, the subwoofer is the core collaborative device of the main speaker, and the subwoofer and the main speaker work together through frequency band division, time synchronization, energy complementation, etc. to make the audio playback system present a more shocking and more immersive listening experience. In the audio playback system, each main speaker corresponds to at least one subwoofer, and the number of subwoofers can also be determined according to the acoustic characteristics of the space where the audio playback system is located, the system target, the budget, and the listening preference, etc. The specific place is not limited.

[0024] The correspondence between the subwoofer and the main speaker can be pre-bound, or it can be dynamically determined. In the case of dynamic determination, the target main speaker can be matched with a subwoofer according to the placement position of the main speaker and the subwoofer, and the characteristics of the audio currently played by the target main speaker, so as to determine at least one subwoofer corresponding to the target main speaker.

[0025] It should be noted that the delay / phase compensation of the subwoofer is based on the corresponding target main speaker as the time reference, and the delay time of the subwoofer is based on the direct sound of the corresponding target main speaker as the reference. By adjusting the delay time of the subwoofer, it is synchronized with the sound wave of the corresponding target main speaker to reach the listening position, thereby achieving better listening effect.

[0026] In the audio playback system, other components such as a center speaker, surround speakers, ultrahigh frequency speakers, etc. audio playback devices, and central controllers, audio source devices, etc. auxiliary devices can also be included. Among them, all audio playback devices in the audio playback system can use the audio playback technology provided by the embodiments of the present disclosure to synchronize the playback of audio, so that the audio playback system achieves better listening effect, and the specific place is not described in detail.

[0027] The target terminal device can be any mobile device or apparatus having positioning, sound collection, and communication functions, such as an integrated chip, a mobile phone, a watch, a bracelet, or any apparatus with the integrated chip built-in, and the specific embodiments are not limited herein. The number of target terminal devices can be one or more than one, and the target terminal device can be bound to an association relationship with the target main sound box, so that the audio playback of the target main sound box can be synchronized with the position of the target terminal device after time compensation.

[0028] In the embodiment, collecting the current position of the target terminal device at a specified frequency means obtaining the spatial coordinates of the target terminal device at fixed time intervals, which can be achieved by using a GPS module, an indoor positioning system, or a Bluetooth beacon triangulation technology, for continuously tracking the moving track of the user in the sound field.

[0029] In step S20, whether the playback delay between the target main sound box and the corresponding subwoofer meets the preset correction condition is determined for each collected current position.

[0030] According to the current position, it can be preliminarily determined whether the delay compensation between the target main sound box and the corresponding subwoofer is triggered, so that the delay compensation of the audio can be achieved with lower energy consumption, avoiding resource waste and system performance degradation caused by too frequent delay compensation processing, which is a technical means that balances resource consumption and performance.

[0031] In an embodiment, the current position collected each time can be compared with the position collected last time or multiple times in history to obtain the position change information of the target terminal device, such as the moving distance, moving direction, or moving track, so as to determine whether the playback delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the position change information.

[0032] Further, if it is determined according to the position change information that the position change of the target terminal device exceeds a certain threshold or meets a certain condition, it can be determined that the playback delay between the target main sound box and the corresponding subwoofer meets the preset correction condition, so as to trigger the subsequent delay compensation processing, so that the delay compensation processing between the subwoofer and the main sound box can be dynamically adjusted, rather than only fixed delay compensation at fixed positions, and the sound listening effect is better.

[0033] In step S30, if the preset correction condition is met, the target delay parameter is obtained, and the target delay parameter includes a parameter causing a time difference in receiving the audio signal from the target main sound box and the corresponding subwoofer at the current position.

[0034] It can be understood that the parameters causing the time difference of the same audio signals received by different positions from the target main sound box and the corresponding subwoofer respectively, can be used as target delay parameters, wherein the same audio signals can be specified test signals such as chirp signals, maximum length sequences (MLS), etc., which are not limited here.

[0035] The target delay parameter is a dynamic parameter. The fixed parameter that can cause the time difference of the same audio signals received by different positions from the target main sound box and the corresponding subwoofer respectively, can eliminate the influence on synchronization during the initial calibration of the audio playback system. The different synchronization caused by the listener at different positions needs to be corrected by the target delay parameter, such as signal transmission link parameters, environmental characteristic parameters, etc., which are not limited here.

[0036] The target delay parameter is a composite parameter containing sound wave propagation path difference and equipment processing delay, which can be realized by sound speed calculation and network delay detection, and is used to quantify the time difference compensation amount of different positions.

[0037] Step S40, according to the target delay parameter, the subwoofer corresponding to the target main sound box is compensated for delay and played synchronously.

[0038] Different parameters in the target delay parameter can be calculated to obtain different corresponding compensation amounts. The compensation amount can be a positive number, a negative number, or 0. A positive compensation amount indicates that the playback progress of the subwoofer is slower than that of the corresponding target main sound box. Conversely, a negative compensation amount indicates that the playback progress of the subwoofer is faster than that of the corresponding target main sound box. A compensation amount of 0 indicates that the playback progress of the subwoofer is the same as that of the corresponding target main sound box, and no compensation is needed.

[0039] For example, according to the signal transmission link parameter in the target delay parameter, the first delay compensation amount of the subwoofer corresponding to the target main sound box is calculated. Then, according to the environmental characteristic parameter in the target delay parameter, the second delay compensation amount of the subwoofer corresponding to the target main sound box is calculated. The first delay compensation amount and the second delay compensation amount are superimposed to obtain the target delay compensation amount. The subwoofer corresponding to the target main sound box is compensated for delay and played synchronously through the target delay compensation amount.

[0040] The playing method of the audio provided by the above-mentioned embodiments periodically collects the position of the terminal device when the system plays the audio, and preliminarily judges whether to trigger the delay compensation for the subwoofer according to the collected position. If the trigger condition is met, the delay compensation amount is accurately calculated and played synchronously according to the delay parameter, so that the optimal listening position of the system can dynamically change with the movement of the device, the flexibility is improved, and the user's listening experience is better.

[0041] Next, the specific playing method of the audio is described.

[0042] In an embodiment, for each collected current position, the step of judging whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition includes: for each collected current position, judging whether the current position where the target terminal device is located and the position collected last time belong to different phase compensation regions; wherein the phase compensation region is a specified region in the preset phase compensation matrix, and the phase compensation matrix is determined based on the sound field formed by the target main sound box and the corresponding subwoofer; if they belong to different phase compensation regions, the audio being played by the target main sound box and the corresponding subwoofer is spread spectrum hidden mixed with the preset test signal to obtain the spread spectrum hidden signals corresponding to the target main sound box and the corresponding subwoofer respectively; the phase difference between the target main sound box and the corresponding subwoofer is calculated by emitting the corresponding spread spectrum hidden signals in turn by the target main sound box and the corresponding subwoofer; and whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition is judged according to the phase difference.

[0043] The phase compensation matrix is determined in advance according to the sound field formed between the target main sound box and the corresponding subwoofer. The phase compensation matrix is composed of multiple phase compensation regions. The phase compensation matrix is a division of the physical space of the sound field. In the phase compensation matrix, the phase difference between the target main sound box and the corresponding subwoofer in the same phase compensation region can belong to the same numerical range or have the same phase characteristics. Phase differences with different numerical ranges or phase characteristics correspond to different phase compensation regions. The specific details are not limited here.

[0044] The phase compensation matrix can be determined in advance according to the relative position between the target main sound box and the corresponding subwoofer in the sound field formed between the target main sound box and the corresponding subwoofer, for example, a triangular layout between one target main sound box and two subwoofers, a rectangular layout between two target main sound boxes and two subwoofers, etc. The specific details are not limited here.

[0045] Specifically, the sound field can be divided into multiple grids in advance, the sound path differences of the target main loudspeaker and the corresponding subwoofer to different grids in the sound field are calculated according to the physical positions of the target main loudspeaker and the corresponding subwoofer in the sound field, the time differences are calculated according to the sound path differences, and finally the phase differences of the target main loudspeaker and the corresponding subwoofer to different grids in the sound field are calculated according to the time differences. Based on the phase differences, the sound field can be divided into phase compensation regions, and a phase compensation matrix can be obtained.

[0046] The pre-division of the phase compensation matrix can quickly determine the possibility of a position change of the terminal device causing a listening delay, and based on the possibility, it can be further determined whether to perform more accurate phase difference calculation, so that the delay compensation between the main loudspeaker and the subwoofer can be triggered at a more reasonable time, reducing the waste of computing resources while improving the listening experience of the user.

[0047] In the embodiment, if it is detected that the position of the target terminal device crosses from one phase compensation region to a new phase compensation region, it can be preliminarily determined that it is necessary to further determine whether to trigger the subsequent delay compensation process. If it is detected that the position of the target terminal device does not change the phase compensation region, it can be directly determined whether the playing delay between the target main loudspeaker and the corresponding subwoofer meets the preset correction condition, without the need for subsequent delay compensation process, thereby reducing the waste of computing resources.

[0048] In the embodiment, if the current position of the target terminal device and the position collected last time belong to different phase compensation regions, the spread spectrum concealment mixing technology is used to mix the test signal with the audio being played, which can complete accurate phase difference measurement without interrupting the user's listening experience, solving the real-time and concealment problem of delay correction in a mobile scenario.

[0049] The mixed spread spectrum concealment signal can be used as the playing audio of the corresponding target main loudspeaker and subwoofer. The target terminal device collects the audio played by the target main loudspeaker and the corresponding subwoofer through the sound collection function, separates the test signal from the collected audio, calculates the phase difference between the target main loudspeaker and the corresponding subwoofer according to the separated test signal, and determines whether the playing delay between the target main loudspeaker and the corresponding subwoofer meets the preset correction condition.

[0050] Through the embodiment, the delay correction needs of different sound field regions can be automatically identified during user movement, and the detection mechanism is activated only when the region is switched, reducing the consumption of computing resources. The concealed test signal can realize inaudible phase difference measurement, ensuring the continuity of audio playing, and overall realizing multi-position dynamic delay compensation, so that the subwoofer and the main loudspeaker remain synchronized at different listening positions, improving the listening experience in a mobile scenario.

[0051] In an embodiment, before determining whether the current position of the target terminal device belongs to a different phase compensation region than the last collected position for each collection, the method further comprises: performing phase difference calculation on the plurality of measurement positions in the sound field formed by the target main sound box and the corresponding subwoofer to obtain sound field phase difference data; and clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same class of sound field phase difference data in the phase compensation matrix forms a same phase compensation region.

[0052] In the embodiment, a plurality of measurement positions are deployed in advance in the sound field range in which the target main sound box and the subwoofer work cooperatively to perform phase difference measurement, for example, 50-100 sampling points are arranged in a grid form in a room, and the phase difference value of the target main sound box and the corresponding subwoofer reaching each point is calculated by collecting the test signal emitted by the target main sound box and the corresponding subwoofer, to form a phase difference data set (i.e., sound field phase difference data) covering the entire sound field.

[0053] Subsequently, a clustering algorithm is used to analyze the data set, and adjacent positions with similar phase difference values are automatically classified into a same compensation region, for example, when the phase difference fluctuation range of a certain region is less than a preset threshold, the region is marked as a same phase compensation region. The finally generated phase compensation matrix divides the sound field into a plurality of dynamic regions, and each region corresponds to a group of phase compensation parameters. When a user carrying a terminal device moves to different phase compensation regions, the system automatically triggers the calibration process without relying on fixed reference positions.

[0054] In the embodiment, the phase compensation region refers to a physical space region divided according to clustering of the sound field phase difference data, and can be implemented by using a multi-point phase difference data clustering algorithm based on sound field measurement, for example, the K-means clustering method is used to classify measurement positions with similar phase differences into a same region. This division method can dynamically reflect the phase characteristic differences of different positions in the sound field and provide a basis for region change detection.

[0055] When performing phase difference calculation, the time difference of the audio signals respectively produced by the target main sound box and the corresponding subwoofer in the sound field and different measurement positions is measured, and specifically, the signal arrival time of different measurement positions is collected by using a microphone array, and then the signal emission time of the corresponding target main sound box or subwoofer is combined, so that the phase difference of different measurement positions can be calculated, thereby obtaining the sound field phase difference data and providing basic data support for subsequent region division.

[0056] The sound field phase difference data refers to a set of phase differences between the audio signals of the target main sound box and the corresponding subwoofer at different measurement positions, and can also be measured periodically at preset grid points by using a multi-channel collection device, and the mean value of multiple measurement results is taken to perform phase difference calculation, thereby forming a multi-dimensional data set reflecting the characteristics of the sound field.

[0057] Clustering the sound field phase difference data refers to classifying measurement positions with similar phase difference characteristics into the same group. Specifically, the K-means algorithm or hierarchical clustering algorithm can be used for clustering. The sound field is divided into multiple logical regions with unified compensation requirements, i.e., phase compensation regions, by calculating data similarity, so that the system can quickly identify across regions according to the real-time position, and perform delay compensation processing when the phase difference span is large.

[0058] When clustering the sound field phase difference data, the phase difference weight between different measurement positions can be calculated, and the measurement positions with a phase difference weight less than a certain threshold are divided into the same phase compensation region. Specifically, the phase difference weight W(i,j) between measurement position i and measurement position j is:

[0059]

[0060] wherein, represents the phase difference change between measurement position i and measurement position j, d(i,j) is the Euclidean distance between measurement position i and measurement position j, C(i,j) is the preset acoustic continuity coefficient between measurement position i and measurement position j, and a, b, and g represent weighting coefficients, a+b+g=1.

[0061] For example, assuming that the phase difference change between the sofa center position (2.5, 2) and the left position (1.5, 2) is 5°, the Euclidean distance is 1 m, and the acoustic continuity is good (C=0.9), the phase difference weight between the two positions is W=0.4x5+0.3x1+0.3x0.9=2.57.

[0062] Through this clustering method, the accuracy of region division can be improved, and unnecessary compensation triggering can be reduced. Since the acoustic continuity is considered, repeated calibration at positions with similar acoustic characteristics can be avoided, and the overall system calculation load can be reduced by 30%-40%.

[0063] Compared with the prior art, the traditional calibration method only measures the phase at a single fixed point, which results in compensation parameters that cannot adapt to the sound field characteristics of other positions. The present scheme establishes a dynamic zoning compensation mechanism by measuring the entire sound field and clustering data, so that the calibration range is expanded from discrete fixed points to continuous regions. For example, in a home theater scenario, the traditional technology can only ensure optimal listening at the center of the sofa, while the present scheme can automatically obtain adaptive phase compensation for different regions such as the left and right sides of the sofa and the back row of the viewing area, eliminating the problem of audio asynchronization caused by position changes.

[0064] Through the embodiment, dynamic adaptation of the phase compensation strategy in the sound field area is achieved, and the problem of listening area limitation caused by traditional fixed point calibration is solved. During user movement, the system can automatically adjust the subwoofer delay parameter according to the real-time position belonging to the phase compensation area, so that the main sound box and the subwoofer audio signal in different areas remain synchronized, thereby obtaining a phase-consistent playing effect at any listening position.

[0065] In an embodiment, the step of obtaining the spread spectrum hidden signals corresponding to the target main sound box and the corresponding subwoofer respectively, by spread spectrum hidden mixing the audio being played by the target main sound box and the corresponding subwoofer with the preset test signal, includes: spreading the preset test signal by a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is a longest sequence code; sequentially reducing the amplitude of the spread spectrum signal to a certain value less than the amplitude of each audio being played to obtain a reduced amplitude signal corresponding to the target main sound box and the corresponding subwoofer respectively; wherein each audio being played is at least the audio being played by the target main sound box and the corresponding subwoofer; mixing the audio being played by the target main sound box and the corresponding subwoofer with the corresponding reduced amplitude signal to output, which is the spread spectrum hidden signal corresponding to the target main sound box and the corresponding subwoofer respectively.

[0066] In the embodiment, first, the test signal is spectrally spread by a pseudo-random code to generate a spread spectrum signal with wideband characteristics. This step distributes the energy of the low-frequency test signal to a wider frequency range, so that it forms a complementary relationship with the main audio signal in the frequency domain. Next, the amplitude of the spread spectrum signal is attenuated so that its peak level is lower than the preset threshold of the main audio signal, for example, controlled within 30%-50% of the amplitude of the main audio signal. Finally, the amplitude-reduced test signal is linearly superimposed with the real-time played main audio to form a composite signal containing hidden test information. The composite signal maintains the waveform characteristics of the main audio in the time domain, and hides the test signal energy below the background noise level in the frequency domain, so that the user cannot perceive the existence of the calibration signal.

[0067] The pseudo-random code refers to a digital sequence with approximate random noise statistical characteristics, and can specifically use a pseudo-random sequence Gold code or a pseudo-random sequence m sequence code, etc. to spread the spectrum of the test signal to enhance the anti-interference ability.

[0068] The longest sequence code refers to a maximum length linear feedback shift register sequence, and can specifically use a longest sequence code with a length of 2 n-1The binary sequence has autocorrelation characteristics that help improve signal detection accuracy. In this embodiment, the test signal is the maximum length sequence code (MLS), which has excellent autocorrelation characteristics and is easy to extract after despreading. When spreading through pseudo-random code spreading, the narrowband test signal can be multiplied by the wideband pseudo-random code to achieve spectral expansion. Direct sequence spread spectrum technology can be used to ensure the concealment of the test signal.

[0069] After obtaining the spread spectrum signal, the amplitude of the spread spectrum signal can be reduced to a certain value lower than the amplitude of the playing audio, so that the spread spectrum signal can be better hidden in the playing audio. Dynamic range compression algorithm can be used for amplitude reduction processing. For example, the amplitude of the spread spectrum signal can be set to 1 / 10 to 1 / 5 of the amplitude of the playing audio, or 20 dB lower than the amplitude of the playing audio, and the specific value is not limited here.

[0070] When reducing the amplitude of the spread spectrum signal, the amplitude of the current playing audio, the signal-to-noise ratio of the current frequency band, and the instantaneous change rate of the audio signal can be used to calculate the amplitude reduction of the spread spectrum signal according to the dynamic changes of the current playing audio. Specifically, the amplitude reduction A(hidden) of the spread spectrum signal is:

[0071] A(hidden) = A(audio) x [k0-k1 SNR(f)-k2 V(t)]

[0072] where A(audio) represents the amplitude of the current playing audio, SNR(f) represents the signal-to-noise ratio of the current frequency band, V(t) represents the instantaneous change rate of the current audio signal, k0 represents the basic attenuation coefficient (usually 0.3-0.5), and k1 and k2 are adaptive adjustment coefficients.

[0073] For example, when playing intense rock music, the audio amplitude is large and changes dramatically. At this time, V(t) = 0.8, the signal-to-noise ratio is good (SNR = 25 dB), and the amplitude reduction A(hidden) of the spread spectrum signal is: A(audio) x [0.4-0.01 x 25-0.1 x 0.8] = 0.07 x A(audio), which can ensure that the test signal is completely hidden in the music.

[0074] Through the above amplitude reduction processing method, truly imperceptible calibration can be achieved, and the user cannot perceive the test signal. The amplitude reduction is dynamically adjusted according to the audio content, which improves the detection accuracy by 15-25%, thereby avoiding the influence of the hidden signal on the sound quality.

[0075] It can be understood that the conventional method usually adopts the way of interrupting the audio playing and sending the test pulse alone to detect whether the delay compensation needs to be performed between the main sound box and the subwoofer, resulting in perceptible audio interruption or noise interference in the calibration process. In the embodiment, by embedding the hidden test signal in the normal playing signal, the parallel operation of real-time phase detection and continuous audio playing is realized, and by the spread spectrum technology and dynamic amplitude control, the interference of the test signal on the main audio signal is effectively avoided.

[0076] Through the embodiment, the generation and embedding of the hidden test signal can be automatically triggered when the phase compensation area is switched due to user movement, providing a reliable signal source for dynamic phase difference detection. The technology completes the test signal injection without interrupting the normal audio playing, solves the audio interruption problem existing in the existing calibration method, effectively eliminates the influence of the test signal on the user's hearing through spread spectrum and amplitude reduction processing, and realizes real-time synchronous calibration without perception.

[0077] In an embodiment, the step of calculating the phase difference between the target main sound box and the corresponding subwoofer by the target main sound box and the corresponding subwoofer emitting corresponding spread spectrum hidden signals in turn includes: emitting corresponding spread spectrum hidden signals by the target main sound box and the corresponding subwoofer in turn, receiving the spread spectrum hidden signals by the target terminal device; despreading the spread spectrum hidden signals by a preset pseudo-random code, extracting the test signal from the despread signals, and obtaining the extracted test signal; performing cross-correlation on the preset test signal and the extracted test signal, and calculating the phase difference between the target main sound box and the corresponding subwoofer.

[0078] In the embodiment, when the target terminal device is in different phase compensation areas, the target main sound box and the subwoofer emit spread spectrum hidden signals in turn, and after the target terminal device receives the mixed signal (i.e. the spread spectrum hidden signal), the received signal is despread by the pre-generated pseudo-random code, and the hidden test signal is recovered by using the correlation between the pseudo-random code and the spread spectrum signal.

[0079] Subsequently, the recovered test signal and the original test signal (the preset test signal described above) are cross-correlated, the position difference of the maximum correlation peak on the time axis is calculated, and the phase difference between the target main sound box and the subwoofer is obtained. The process enhances the anti-interference ability of the test signal by spread spectrum technology, so that even if there is background noise or audio signal interference in a dynamic environment, the test signal can still be accurately extracted for phase difference calculation.

[0080] The cross-correlation operation is a similarity measurement operation in the time domain or frequency domain for two signals, and can be performed by sliding window convolution or fast Fourier transform algorithm. The processing can accurately capture the time offset between signals, so as to calculate the phase difference between the target main sound box and the subwoofer.

[0081] It can be understood that the traditional phase difference measurement method usually adopts a fixed position arrangement of test microphones or relies on a preset static sound field model for estimation, and cannot adapt to the mobile scene of the terminal device in real time. The embodiment realizes active detection of the sound field area where the mobile terminal is located by dynamically emitting a spread spectrum hidden signal carrying position information and combining real-time reception and despreading processing of the terminal device, so that the phase difference calculation can be dynamically updated following the change of the user position, and the problem of insufficient measurement accuracy of the traditional method in a dynamic environment is solved.

[0082] Through the embodiment, actual phase difference data between the target main sound box and the subwoofer can be continuously obtained during user movement, environmental noise and interference of played audio are effectively suppressed through spread spectrum technology, the accuracy of phase difference detection is ensured, the limitation of traditional fixed point calibration is broken through, real-time and reliable phase difference data support is provided for dynamic delay compensation, and the synchronization accuracy of audio playing in a mobile scene is significantly improved.

[0083] In one embodiment, according to the phase difference, whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition is determined, including: if the phase difference between any target main sound box and any corresponding subwoofer is greater than a preset phase difference threshold, whether the playing delay between the corresponding target main sound box and the corresponding subwoofer meets the preset correction condition is determined.

[0084] In the embodiment, when the position change of the target terminal device causes the time difference of audio signals between the target main sound box and the corresponding subwoofer to increase, the system extracts the phase difference of the two signals through the cross-correlation algorithm, and compares the phase difference with a preset threshold in real time. If the phase difference exceeds the threshold, it is determined that the current playing delay has exceeded the acceptable range, and a delay compensation operation needs to be performed. This process replaces the fixed area calibration through a dynamic threshold mechanism, for example, when the user moves to a position close to the subwoofer in the room, the system automatically detects the change of the phase difference and triggers the correction, without relying on pre-marked fixed areas.

[0085] The preset phase difference threshold is the minimum phase difference setting value that triggers the delay correction. It can be set as a fixed value or a dynamic adjustment range by measuring the fluctuation range of the phase difference at different positions through experiments combined with the hearing tolerance, and is used to distinguish normal phase fluctuation from significant deviation that needs to be corrected.

[0086] Through the embodiment, delay correction can be dynamically triggered according to the actual position of the user, judgment errors caused by dynamic changes of the phase difference are avoided, and the audio synchronization accuracy in different spatial positions is improved. At the same time, small phase fluctuations are filtered through the preset threshold, unnecessary correction operations are reduced, and the consumption of system computing resources is reduced.

[0087] In an embodiment, the step of synchronously playing the subwoofer corresponding to the target main speaker according to the target delay parameter includes: calculating a first delay compensation amount between the to-be-corrected main speaker and the to-be-corrected subwoofer according to the phase difference between the to-be-corrected main speaker and the to-be-corrected subwoofer; wherein the to-be-corrected main speaker and the to-be-corrected subwoofer refer to the target main speaker and the corresponding subwoofer whose phase difference is greater than a preset phase difference threshold; calculating a second delay compensation amount between the to-be-corrected main speaker and the to-be-corrected subwoofer according to the network transmission rate in the target delay parameter; and synchronously playing the to-be-corrected subwoofer corresponding to the to-be-corrected main speaker according to the first delay compensation amount and the second delay compensation amount.

[0088] In an embodiment, when it is detected that the phase difference between the target main speaker and any corresponding subwoofer exceeds a preset threshold, the system automatically triggers a two-dimensional compensation mechanism: first, the sound field propagation model is used to calculate the sound wave path difference between the two to the current position of the target mobile terminal, and the phase difference is converted into a first delay compensation amount. At the same time, the network state of the audio data transmission path is monitored to obtain the current network transmission rate in real time, and a second delay compensation amount is calculated. Subsequently, the two compensation amounts are fused to generate a target delay time length control instruction for the to-be-corrected subwoofer, which is used to control the synchronous playing of the to-be-corrected subwoofer after delay compensation.

[0089] The to-be-corrected main speaker and the to-be-corrected subwoofer refer to the target main speaker and the corresponding subwoofer whose phase difference is greater than a preset phase difference threshold, which can be realized by real-time monitoring of the phase difference between the main speaker and the subwoofer and comparing it with the preset threshold, and is used to select the device pair that needs to be compensated for delay.

[0090] The first delay compensation amount refers to the physical delay compensation amount calculated based on the sound field phase difference, which can be obtained by calculating the time delay difference value of the sound wave reaching the target position through the cross-correlation algorithm, and is used to eliminate the synchronization error caused by the difference in sound field propagation path. The second delay compensation amount refers to the data transmission delay compensation amount calculated based on the network transmission rate, which can be obtained by measuring the transmission time difference of the audio data packet between the main speaker and the subwoofer, and is used to eliminate the time sequence deviation caused by the difference in network transmission path. The target delay time length refers to the total compensation time length of the combined physical delay and network delay, which can be obtained by calculating the composite compensation value through weighted summation or nonlinear fusion algorithm, and is used to generate an accurate synchronization control signal.

[0091] It can be understood that the traditional method only uses single fixed sound field delay compensation or network transmission delay compensation, which cannot cope with the complex synchronization problem caused by the superposition of sound field propagation path changes and network fluctuations during user movement. The embodiment establishes a joint compensation model of sound field phase difference and network transmission rate, realizes real-time acquisition and fusion calculation of double delay parameters at the device end, dynamically adapts to the double interference caused by spatial position movement and network environment change, and breaks through the limitations of single compensation mode.

[0092] Through the embodiment, the audio playback synchronization problem caused by the joint of sound field propagation path difference and network transmission rate fluctuation is effectively solved, the continuous and accurate synchronization of the main sound box and the subwoofer during user movement is realized, and the dynamic adaptation ability and overall playback quality of the multi-channel audio system are improved.

[0093] In one embodiment, according to the first delay compensation amount and the second delay compensation amount, the step of synchronously playing the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box after delay compensation includes: calculating a target delay duration of the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount; and performing atomic delay operation on the target delay duration by a digital signal processing chip in the to-be-corrected subwoofer, so as to synchronously play the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box after delay compensation.

[0094] In the embodiment, when calculating the target delay duration, first, the first delay compensation amount is generated according to the physical distance difference between the main sound box and the subwoofer. For example, when the distance between the two is 3 meters and the sound speed is 340 meters per second, the first delay compensation amount is about 8.82 milliseconds. At the same time, the second delay compensation amount is obtained by testing the network transmission rate. For example, when the network transmission delay is 15 milliseconds, the total target delay duration of 23.82 milliseconds is formed after the superposition of the two.

[0095] In one embodiment, when calculating the target delay duration, the comprehensive influence of the phase difference and the network transmission on the environment can also be considered to obtain a third delay compensation amount. The third delay compensation amount can be pre-set in correspondence with different first delay compensation amounts and second delay compensation amounts. When calculating the target delay duration, the third delay compensation amount corresponding to the first delay compensation amount and the second delay compensation amount is obtained.

[0096] Based on this, in one embodiment, the target delay duration T is:

[0097] T = w1·T1 + w2·T2 + w3·T3 + λ·H(T1, T2, T3)

[0098]

[0099] wherein T1 is the first delay compensation amount, T2 is the second delay compensation amount, T3 is the third delay compensation amount, w i is an adaptive weight coefficient, σ i is the estimation variance of the i-th compensation amount, λ is a non-linear correction coefficient, and H(T1, T2, T3) is a non-linear interaction term of the three compensation amounts.

[0100] For example, in an unstable WiFi network environment, the network delay fluctuation is large (σ2=5 ms), the phase difference measurement accuracy is high (σ1=1 ms), and the environment is stable (σ3=2 ms). The weight distribution is: w1=0.68, w2=0.09, and w3=0.23, so as to mainly rely on phase difference compensation, supplemented by environmental compensation, and reduce the influence of network fluctuation.

[0101] Based on the delay calculation method, the compensation accuracy can be significantly improved, the synchronization error is reduced to within 1 ms, the robustness of the system to network fluctuation and environmental change is enhanced, multi-factor dynamic balance is achieved, and complex use scenarios are adapted.

[0102] Subsequently, the total duration is converted into instruction parameters recognizable by a digital signal processing chip, and is directly written into a signal processing pipeline through a hardware circuit. In this process, the digital signal processing chip completes the loading and application of the delay parameter with a single-cycle instruction, so that the delay compensation operation of the audio signal is completed within a single clock cycle, avoiding the incoherent signal output caused by multi-thread switching or interrupt processing in traditional software compensation.

[0103] The atomic delay operation refers to an indivisible and immediately effective signal processing action, which can be implemented through a hardware-level instruction of a digital signal processing chip, avoiding the step-by-step execution of operations that may occur in the software compensation process. The digital signal processing chip refers to an integrated circuit module with real-time signal processing capability, which can be implemented by using a special audio processing chip and can execute delay compensation instructions with microsecond-level precision.

[0104] It can be understood that the existing scheme usually adopts a software layer delay compensation algorithm, such as gradually adjusting a playback buffer through operating system thread scheduling, which will cause signal processing interruption or buffer switching jitter in the compensation process. The present embodiment completes the complete processing flow of signal delay in the digital signal processing chip through the hardware-level atomic operation, eliminating the state inconsistency problem caused by intermediate processing steps.

[0105] Corresponding to the above method embodiment, refer to Figure 2As shown in a schematic diagram of an audio playing device applied to an audio playing system, the audio playing system comprises at least one main sound box and at least one subwoofer corresponding to each main sound box, and the device comprises: a collection module 22 configured to collect a current position of a target terminal device at a specified frequency during an audio playing process of any target main sound box; wherein the target main sound box is any main sound box; a judgment module 24 configured to judge whether a playing delay between the target main sound box and the corresponding subwoofer meets a preset correction condition for each collected current position; an acquisition module 26 configured to acquire a target delay parameter if the preset correction condition is met, the target delay parameter comprising a parameter causing a time difference in receiving audio signals from the target main sound box and the corresponding subwoofer at the current position; and a compensation module 28 configured to perform delay compensation and synchronous playing on the subwoofer corresponding to the target main sound box according to the target delay parameter.

[0106] The audio playing device periodically collects the position of the terminal device when the system plays audio, and preliminarily judges whether to trigger delay compensation for the subwoofer according to the collected position. If the trigger condition is met, the delay compensation amount is accurately calculated and synchronous playing is performed according to the delay parameter, so that the optimal listening position of the system can dynamically change with the movement of the device, the flexibility is improved, and the user's listening experience is better.

[0107] Optionally, the judgment module 24 comprises: a first judgment unit configured to judge whether the current position of the target terminal device and the last collected position belong to different phase compensation regions for each collected current position; wherein the phase compensation region is a specified region in a preset phase compensation matrix, and the phase compensation matrix is determined based on a sound field formed by the target main sound box and the corresponding subwoofer; a spread spectrum hiding unit configured to perform spread spectrum hiding mixing of the audio being played by the target main sound box and the corresponding subwoofer with a preset test signal to obtain spread spectrum hiding signals corresponding to the target main sound box and the corresponding subwoofer if they belong to different phase compensation regions; a phase calculation unit configured to calculate a phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum hiding signals by the target main sound box and the corresponding subwoofer; and a second judgment unit configured to judge whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the phase difference.

[0108] Optionally, the device further comprises: a calculation module configured to perform phase difference calculation on a plurality of measurement positions in a sound field formed by the target main sound box and the corresponding subwoofer to obtain sound field phase difference data; and a clustering module configured to cluster the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same class of sound field phase difference data in the phase compensation matrix forms the same phase compensation region.

[0109] Optionally, the spread spectrum hiding unit is specifically configured to: spread a preset test signal by a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is a longest sequence code; sequentially reduce the amplitude of the spread spectrum signal to a certain value less than the amplitude of each playing audio to obtain a target main sound box and a corresponding subwoofer respectively corresponding to a reduced amplitude signal; wherein each playing audio is at least the audio being played by the target main sound box and the corresponding subwoofer; mix and output the audio being played by the target main sound box and the corresponding subwoofer and the corresponding reduced amplitude signal, and the output is the spread spectrum hiding signal corresponding to the target main sound box and the corresponding subwoofer.

[0110] Optionally, the phase calculation unit is specifically configured to: emit the corresponding spread spectrum hiding signal by the target main sound box and the corresponding subwoofer in sequence, and receive the spread spectrum hiding signal by the target terminal device; despread the spread spectrum hiding signal by a preset pseudo-random code, extract the test signal from the despread signal, and obtain the extracted test signal; and perform cross-correlation on the preset test signal and the extracted test signal to calculate the phase difference between the target main sound box and the corresponding subwoofer.

[0111] Optionally, the second judgment unit is specifically configured to: if the phase difference between any target main sound box and any corresponding subwoofer is greater than a preset phase difference threshold, determine whether the playing delay between the corresponding target main sound box and the corresponding subwoofer meets a preset correction condition.

[0112] Optionally, the compensation module 28 includes: a first calculation unit configured to calculate a first delay compensation amount between a to-be-corrected main sound box and a corresponding to-be-corrected subwoofer according to the phase difference between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer; wherein the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer refer to a target main sound box and a corresponding subwoofer whose phase difference is greater than a preset phase difference threshold; a second calculation unit configured to calculate a second delay compensation amount between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer according to the network transmission rate in the target delay parameter; and a delay compensation unit configured to perform delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount.

[0113] Optionally, the delay compensation unit is specifically configured to: calculate a target delay duration of the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount; and perform an atomic delay operation on the target delay duration by a digital signal processing chip in the to-be-corrected subwoofer to perform delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box.

[0114] The embodiment also provides a system, comprising at least one main sound box, at least one bass gun corresponding to each main sound box, a processor and a memory, the memory stores machine executable instructions capable of being executed by the processor, and the processor executes the machine executable instructions to implement the audio playing method described above. The system can be a server or a terminal device.

[0115] Referring to Figure 3 The system shown in the figure comprises a processor 100 and a memory 101, the memory 101 stores machine executable instructions capable of being executed by the processor 100, and the processor 100 executes the machine executable instructions to implement the audio playing method described above.

[0116] Further, Figure 3 The system shown in the figure further comprises a bus 102 and a communication interface 103, and the processor 100, the communication interface 103 and the memory 101 are connected through the bus 102.

[0117] The memory 101 can contain a high-speed random access memory (RAM, Random Access Memory) and can also include a non-volatile memory, for example, at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 103 (which can be wired or wireless), and the Internet, a wide area network, a local area network, a metropolitan area network, etc. can be used. The bus 102 can be an ISA bus, a PCI bus or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one bidirectional arrow is used in the figure to represent the bus, but it does not mean that there is only one bus or only one type of bus.

[0118] The processor 100 can be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method can be completed by the integrated logic circuit of hardware in the processor 100 or the instruction in the form of software. The processor 100 described above can be a general processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. Each method, step and logic block disclosed in the embodiments of the present disclosure can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiments of the present disclosure can be directly embodied as a hardware code processor for execution, or a combination of hardware and software modules in the code processor for execution. The software module can be located in a random access memory, a flash memory, a read only memory, a programmable read only memory or an electrically erasable programmable memory, a register or other mature storage medium in the art. The storage medium is located in the memory 101, and the processor 100 reads the information in the memory 101, and combines the hardware to complete the steps of the method of the above embodiments, for example:

[0119] In the process of playing audio of any target master sound box, the current position of the target terminal device is collected according to the specified frequency; wherein the target master sound box is any master sound box; for each collected current position, it is judged whether the playing delay time between the target master sound box and the corresponding bass gun meets the preset correction condition; if the preset correction condition is met, the target delay parameter is obtained, the target delay parameter includes the parameter that causes the current position to receive the audio signals from the target master sound box and the corresponding bass gun to produce a time difference; according to the target delay parameter, the corresponding bass gun of the target master sound box is compensated for delay and played synchronously.

[0120] In this way, when the system plays audio, the position of the terminal device is collected periodically, and whether to trigger the delay compensation for the bass gun is preliminarily judged according to the collected position. If the trigger condition is met, the delay compensation amount is accurately calculated and played synchronously according to the delay parameter, so that the best listening position of the system can follow the movement of the device and dynamically change, the flexibility is improved, and the user's listening experience is better.

[0121] Optionally, the step of determining whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition for each collected current position comprises: determining whether the current position where the target terminal device is located and the last collected position belong to different phase compensation areas for each collected current position; wherein the phase compensation area is a specified area in a preset phase compensation matrix, and the phase compensation matrix is determined based on a sound field formed by the target main sound box and the corresponding subwoofer; if the current position and the last collected position belong to different phase compensation areas, then performing spread spectrum hidden mixing on the audio being played by the target main sound box and the corresponding subwoofer and the preset test signal to obtain spread spectrum hidden signals corresponding to the target main sound box and the corresponding subwoofer respectively; sequentially emitting the corresponding spread spectrum hidden signals by the target main sound box and the corresponding subwoofer to calculate the phase difference between the target main sound box and the corresponding subwoofer; and determining whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the phase difference.

[0122] Optionally, before determining whether the current position where the target terminal device is located and the last collected position belong to different phase compensation areas for each collected current position, the method further comprises: performing phase difference calculation on a plurality of measurement positions in the sound field formed by the target main sound box and the corresponding subwoofer to obtain sound field phase difference data; and clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same class of sound field phase difference data in the phase compensation matrix forms the same phase compensation area.

[0123] Optionally, the step of performing spread spectrum hidden mixing on the audio being played by the target main sound box and the corresponding subwoofer and the preset test signal to obtain spread spectrum hidden signals corresponding to the target main sound box and the corresponding subwoofer respectively comprises: performing spread spectrum on the preset test signal by using a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is a longest sequence code; sequentially reducing the amplitude of the spread spectrum signal to a value less than the amplitude of each playing audio by a certain value to obtain amplitude-reduced signals corresponding to the target main sound box and the corresponding subwoofer respectively; wherein each playing audio is at least the audio being played by the target main sound box and the corresponding subwoofer; and mixing the audio being played by the target main sound box and the corresponding subwoofer with the corresponding amplitude-reduced signals to output, which is the spread spectrum hidden signals corresponding to the target main sound box and the corresponding subwoofer respectively.

[0124] Optionally, the step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting corresponding spread spectrum hidden signals through the target main sound box and the corresponding subwoofer comprises: sequentially emitting corresponding spread spectrum hidden signals through the target main sound box and the corresponding subwoofer, receiving the spread spectrum hidden signals through the target terminal device; despreading the spread spectrum hidden signals through the preset pseudo-random code, extracting a test signal from the despread signal, and obtaining the extracted test signal; and performing cross-correlation on the preset test signal and the extracted test signal, and calculating the phase difference between the target main sound box and the corresponding subwoofer.

[0125] Optionally, the step of determining whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the phase difference comprises: if the phase difference between any target main sound box and any corresponding subwoofer is greater than the preset phase difference threshold, determining whether the playing delay between the corresponding target main sound box and the corresponding subwoofer meets the preset correction condition.

[0126] Optionally, the step of performing delay compensation and synchronous playing on the subwoofer corresponding to the target main sound box according to the target delay parameter comprises: calculating a first delay compensation amount between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer according to the phase difference between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer; wherein the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer refer to the target main sound box and the corresponding subwoofer whose phase difference is greater than the preset phase difference threshold; calculating a second delay compensation amount between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer according to the network transmission rate in the target delay parameter; and performing delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount.

[0127] Optionally, the step of performing delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount comprises: calculating a target delay duration of the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount; and performing an atomic delay operation on the target delay duration through a digital signal processing chip in the to-be-corrected subwoofer to perform delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box.

[0128] The embodiment also provides a computer readable storage medium, which stores computer executable instructions. When the computer executable instructions are called and executed by a processor, the computer executable instructions cause the processor to implement the audio playing method described above, for example:

[0129] In the process of audio playing of any target master speaker, the current position of the target terminal device is collected according to a specified frequency; wherein the target master speaker is any master speaker; for each collected current position, it is judged whether the playing delay between the target master speaker and the corresponding subwoofer meets the preset correction condition; if the preset correction condition is met, a target delay parameter is obtained, the target delay parameter including a parameter causing a time difference in receiving audio signals from the target master speaker and the corresponding subwoofer at the current position; and according to the target delay parameter, the corresponding subwoofer of the target master speaker is compensated for delay and played synchronously.

[0130] In this way, when the system plays audio, the position of the terminal device is collected periodically, and it is preliminarily judged whether to trigger delay compensation for the subwoofer according to the collected position. If the trigger condition is met, the delay compensation amount is accurately calculated and synchronous playing is performed according to the delay parameter, so that the best listening position of the system can dynamically change with the movement of the device, the flexibility is improved, and the user's listening experience is better.

[0131] Optionally, for each collected current position, the step of judging whether the playing delay between the target master speaker and the corresponding subwoofer meets the preset correction condition includes: for each collected current position, it is judged whether the current position of the target terminal device and the position collected last time belong to different phase compensation areas; wherein the phase compensation area is a specified area in the preset phase compensation matrix, and the phase compensation matrix is determined based on the sound field formed by the target master speaker and the corresponding subwoofer; if they belong to different phase compensation areas, the audio being played by the target master speaker and the corresponding subwoofer is spread spectrum hidden mixed with the preset test signal to obtain the spread spectrum hidden signals corresponding to the target master speaker and the corresponding subwoofer respectively; the corresponding spread spectrum hidden signals are emitted by the target master speaker and the corresponding subwoofer in turn to calculate the phase difference between the target master speaker and the corresponding subwoofer; and according to the phase difference, it is judged whether the playing delay between the target master speaker and the corresponding subwoofer meets the preset correction condition.

[0132] Optionally, before judging whether the current position of the target terminal device and the position collected last time belong to different phase compensation areas for each collected current position, the method further includes: in the sound field formed by the target master speaker and the corresponding subwoofer, phase difference calculation is performed on a plurality of measurement positions to obtain sound field phase difference data; and the sound field phase difference data is clustered to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same class of sound field phase difference data in the phase compensation matrix forms the same phase compensation area.

[0133] Optionally, the step of mixing the audio played by the target main sound box and the corresponding subwoofer with the preset test signal to obtain the spread spectrum hidden signal corresponding to the target main sound box and the corresponding subwoofer respectively, comprises: spreading the preset test signal by a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is a longest sequence code; sequentially reducing the amplitude of the spread spectrum signal to a certain value smaller than the amplitude of each audio being played to obtain a reduced amplitude signal corresponding to the target main sound box and the corresponding subwoofer respectively; wherein each audio being played is at least the audio being played by the target main sound box and the corresponding subwoofer; mixing the audio played by the target main sound box and the corresponding subwoofer with the corresponding reduced amplitude signal to output, and the output is the spread spectrum hidden signal corresponding to the target main sound box and the corresponding subwoofer respectively.

[0134] Optionally, the step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum hidden signal by the target main sound box and the corresponding subwoofer, comprises: sequentially emitting the corresponding spread spectrum hidden signal by the target main sound box and the corresponding subwoofer, receiving the spread spectrum hidden signal by the target terminal device; despreading the spread spectrum hidden signal by a preset pseudo-random code, extracting the test signal from the despread signal to obtain the extracted test signal; cross-correlating the preset test signal and the extracted test signal to calculate the phase difference between the target main sound box and the corresponding subwoofer.

[0135] Optionally, the step of determining whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the phase difference, comprises: if the phase difference between any target main sound box and any corresponding subwoofer is greater than a preset phase difference threshold, determining whether the playing delay between the corresponding target main sound box and the corresponding subwoofer meets the preset correction condition.

[0136] Optionally, the step of performing delay compensation and synchronous playing on the subwoofer corresponding to the target main sound box according to the target delay parameter, comprises: calculating a first delay compensation amount between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer according to the phase difference between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer; wherein the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer refer to the target main sound box and the corresponding subwoofer whose phase difference is greater than a preset phase difference threshold; calculating a second delay compensation amount between the to-be-corrected main sound box and the corresponding to-be-corrected subwoofer according to the network transmission rate in the target delay parameter; performing delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount.

[0137] Optionally, the step of performing delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount comprises: calculating a target delay duration of the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box according to the first delay compensation amount and the second delay compensation amount; and performing an atomic delay operation on the target delay duration by using a digital signal processing chip in the to-be-corrected subwoofer, so as to perform delay compensation and synchronous playing on the to-be-corrected subwoofer corresponding to the to-be-corrected main sound box.

[0138] The method, device, system and computer program product of the present disclosure can be used to perform the method described in the foregoing method embodiments, and the specific implementation can be referred to the method embodiments, which will not be described here.

[0139] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0140] In addition, in the description of the embodiments of the present disclosure, unless otherwise explicitly specified and limited, the terms "mounting", "connection", "connecting" should be understood in a broad sense, for example, can be fixed connection, can also be detachable connection, or integral connection; can be mechanical connection, can also be electrical connection; can be direct connection, can also be indirect connection through an intermediate medium, can be the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present disclosure can be understood according to the specific circumstances.

[0141] The functions described above can be implemented in the form of software function units and sold or used as independent products when the functions are implemented in the form of software function units and sold or used as independent products. Based on such understanding, the technical solutions of the present disclosure can be embodied in the form of software products, and the computer software product is stored in a storage medium, including a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present disclosure. The foregoing storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and various media that can store program codes.

[0142] In the description of the present disclosure, it should be explained that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present disclosure. In addition, the terms "first", "second", "third" are only for the purpose of description, and cannot be understood as indicating or implying relative importance.

[0143] Finally, it should be noted that the above embodiments are only specific embodiments of the present disclosure, used to illustrate the technical solutions of the present disclosure, and are not limiting, and the protection scope of the present disclosure is not limited thereto. Although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can make modifications or easily think of changes to the technical solutions recorded in the foregoing embodiments within the technical range disclosed by the present disclosure, or make equivalent replacements to some technical features; and these modifications, changes or replacements do not cause the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A playing method of audio, applied to an audio playing system, the audio playing system comprising at least one main sound box and at least one subwoofer corresponding to each main sound box, characterized in that, The method comprises: During the audio playing process of any target master sound box, collecting the current position of the target terminal device according to a specified frequency; wherein the target master sound box is any master sound box; For each collected current position, judging whether the playing delay between the target master sound box and the corresponding subwoofer meets the preset correction condition; If the preset correction condition is met, obtaining a target delay parameter, the target delay parameter comprising a parameter causing the current position to receive audio signals from the target master sound box and the corresponding subwoofer to produce a time difference; According to the target delay parameter, performing delay compensation and synchronous playing on the subwoofer corresponding to the target master sound box.

2. The method of claim 1, wherein, The step of judging whether the playing delay between the target master sound box and the corresponding subwoofer meets the preset correction condition for each collected current position comprises: For each collected current position, judging whether the current position of the target terminal device and the position collected last time belong to different phase compensation areas; wherein the phase compensation area is a specified area in a preset phase compensation matrix, and the phase compensation matrix is determined based on the sound field formed by the target master sound box and the corresponding subwoofer; If they belong to different phase compensation areas, performing spread spectrum hidden mixing on the audio being played by the target master sound box and the corresponding subwoofer and a preset test signal to obtain spread spectrum hidden signals corresponding to the target master sound box and the corresponding subwoofer respectively; By sequentially emitting the corresponding spread spectrum hidden signals by the target master sound box and the corresponding subwoofer, calculating the phase difference between the target master sound box and the corresponding subwoofer; According to the phase difference, judging whether the playing delay between the target master sound box and the corresponding subwoofer meets the preset correction condition.

3. The method of claim 2, wherein, Before judging whether the current position of the target terminal device and the position collected last time belong to different phase compensation areas for each collected current position, the method further comprises: In the sound field formed by the target master sound box and the corresponding subwoofer, performing phase difference calculation on a plurality of measurement positions to obtain sound field phase difference data; Clustering the sound field phase difference data to obtain a phase compensation matrix; wherein at least one measurement position corresponding to the same class of sound field phase difference data in the phase compensation matrix forms the same phase compensation area.

4. The method of claim 2, wherein, The step of performing spread spectrum hidden mixing on the audio being played by the target master sound box and the corresponding subwoofer and a preset test signal to obtain spread spectrum hidden signals corresponding to the target master sound box and the corresponding subwoofer respectively comprises: Spreading the preset test signal by a preset pseudo-random code to obtain a spread spectrum signal; wherein the test signal is a longest sequence code; Sequentially reducing the amplitude of the spread spectrum signal to a certain value less than the amplitude of each playing audio to obtain amplitude-reduced signals corresponding to the target master sound box and the corresponding subwoofer respectively; wherein each playing audio is at least the audio being played by the target master sound box and the corresponding subwoofer. Mix the audio played by the target main sound box and the corresponding subwoofer with the corresponding amplitude reduction signal respectively, and output the mixed audio as the corresponding spread spectrum concealment signal of the target main sound box and the corresponding subwoofer.

5. The method of claim 2, wherein, The step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum concealment signal through the target main sound box and the corresponding subwoofer comprises: The step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum concealment signal through the target main sound box and the corresponding subwoofer comprises: The step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum concealment signal through the target main sound box and the corresponding subwoofer comprises: The step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum concealment signal through the target main sound box and the corresponding subwoofer comprises:

6. The method of claim 2, wherein, The step of calculating the phase difference between the target main sound box and the corresponding subwoofer by sequentially emitting the corresponding spread spectrum concealment signal through the target main sound box and the corresponding subwoofer comprises: The step of determining whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition according to the phase difference comprises:

7. The method of claim 1, wherein, If the phase difference between any target main sound box and any corresponding subwoofer is greater than the preset phase difference threshold, it is determined whether the playing delay between the corresponding target main sound box and the corresponding subwoofer meets the preset correction condition. The step of synchronously playing after delay compensation of the target main sound box and the corresponding subwoofer according to the target delay parameter comprises: According to the phase difference between the target main sound box and the corresponding subwoofer, a first delay compensation amount between the target main sound box and the corresponding subwoofer is calculated; wherein the target main sound box and the corresponding subwoofer refer to the target main sound box and the corresponding subwoofer whose phase difference is greater than the preset phase difference threshold. According to the network transmission rate in the target delay parameter, a second delay compensation amount between the target main sound box and the corresponding subwoofer is calculated.

8. The method of claim 7, wherein, Synchronously playing after delay compensation of the target main sound box and the corresponding subwoofer according to the first delay compensation amount and the second delay compensation amount. The step of synchronously playing after delay compensation of the target main sound box and the corresponding subwoofer according to the first delay compensation amount and the second delay compensation amount comprises: According to the first delay compensation amount and the second delay compensation amount, a target delay duration of the target main sound box and the corresponding subwoofer is calculated.

9. An audio playing device applied to an audio playing system, the audio playing system comprising at least one main sound box and at least one subwoofer corresponding to each main sound box, characterized in that, The digital signal processing chip in the target subwoofer performs atomic delay operation on the target delay duration to synchronously play after delay compensation of the target main sound box and the corresponding subwoofer. The device comprises: The acquisition module is configured to acquire a current position of a target terminal device at a specified frequency during audio playing of any target main sound box; wherein the target main sound box refers to any main sound box; The judgment module is configured to determine whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition for each acquired current position; and The judgment module is configured to determine whether the playing delay between the target main sound box and the corresponding subwoofer meets the preset correction condition for each acquired current position; and An acquisition module is configured to acquire a target delay parameter if a preset correction condition is met, the target delay parameter including a parameter causing the current position to receive audio signals from the target main sound box and corresponding subwoofer to have a time difference; A compensation module is configured to perform delay compensation and synchronized playing on the subwoofer corresponding to the target main sound box according to the target delay parameter.

10. A system for playing audio, characterized by An audio playing device includes at least one main sound box, at least one subwoofer corresponding to each main sound box, a processor and a memory, the memory storing machine executable instructions executable by the processor, and the processor executes the machine executable instructions to implement the audio playing method of any one of claims 1-8.

11. A computer readable storage medium characterized by, The computer readable storage medium stores computer executable instructions, and the computer executable instructions, when invoked and executed by a processor, cause the processor to implement the audio playing method of any one of claims 1-8.

Images