Audio data processing method and device, and sound box system

Abstract

The present application provides an audio data processing method and apparatus, as well as a sound box system, which relate to the field of audio technology and improve the sound quality of an audio playback device. The sound box system includes a full-frequency sound box and a low-frequency sound box. The full-frequency sound box is physically connected to the low-frequency sound box using a first fastening portion of the full-frequency sound box and a second fastening portion of the low-frequency sound box. The full-frequency sound box communicates with the low-frequency sound box using a first communication portion of the first fastening portion and a second communication portion of the second fastening portion. The first and second fastening portions are a pair of connecting portions, and the first and second communication portions are a pair of communication portions. The low-frequency sound box has a better low-frequency reproduction effect than the full-frequency sound box, and the full-frequency sound box has a wider frequency band range than the low-frequency sound box.

Description

[Technical field]

[0001] TECHNICAL FIELD Embodiments of the present application relate to the field of audio technology, and in particular to an audio data processing method and apparatus, and a sound box system. [Background technology]

[0002] With the development of audio software and hardware technology, audio playback devices (such as full-frequency sound boxes) are rapidly increasing. An important performance indicator of an audio playback device is the sound quality of the audio playback device.

[0003] For various existing full-frequency sound box products, it is currently difficult to achieve a desirable trade-off between the portability of the full-frequency sound box and the sound quality of the full-frequency sound box. For example, in the case of a full-frequency sound box with small size, small weight and high portability, the size of the sound cavity of the full-frequency sound box is reduced, so that the bass quality is affected. As a result, the sound quality is poor. As another example, in the case of a full-frequency sound box with high sound quality, many audio units are built into the full-frequency sound box (including mid- and high-frequency speakers / full-frequency speakers and low-frequency speakers), so that the full-frequency sound box has a large size, a large weight, high power consumption and poor portability.

[0004] Based on this, the research and development of a portable full-frequency sound box product with excellent sound quality is a difficult problem to be solved. Summary of the Invention

[0005] The embodiments of the present application provide an audio data processing method and apparatus, and a sound box system, for improving the sound quality of an audio playback device.

[0006] In order to achieve the above objectives, the following technical solutions are used in the embodiments of this application.

[0007] According to a first aspect, an embodiment of the present application provides an all-frequency sound box, including an all-frequency sound box body and a first fastening part. The all-frequency sound box body includes M speakers, the M speakers are planarly distributed in the all-frequency sound box body, and the M speakers form K pairs of acoustic dipoles, where M is a positive integer greater than 2, and K is a positive integer equal to or greater than 2. The first fastening part is disposed in a pre-set fastening area of ​​the all-frequency sound box body, the first fastening part is configured to physically connect to or separate from the low-frequency sound box, the first fastening part includes a first communication part, the first communication part is configured to enable the all-frequency sound box to communicate with the low-frequency sound box, and the first communication part supports multi-channel audio data transmission. The low-frequency sound box has a better low-frequency sound reproduction effect than the all-frequency sound box.

[0008] According to the full-frequency sound box provided in this embodiment of the present application, the M speakers included in the full-frequency sound box constitute multiple pairs of acoustic dipoles, so that the audio data obtained through the sound field expansion process (i.e., the target audio data) can be reproduced by using the full-frequency sound box to achieve a good sound field expansion effect and improve the sound quality. Furthermore, after the first fastening part of the full-frequency sound box is connected to the low-frequency sound box, the full-frequency sound box and the low-frequency sound box are used in a combined form to reproduce the audio data. This can greatly improve the reproduction effect of the audio data. Furthermore, the user can flexibly choose to reproduce the audio data by using the full-frequency sound box, or to reproduce the audio data by using the full-frequency sound box and the low-frequency sound box. This can satisfy various requirements of users.

[0009] In a possible implementation, the directions in which the K pairs of acoustic dipoles are arranged include at least two of the following: horizontal, vertical, or diagonally upward.

[0010] Specifically, the K pairs of acoustic dipoles include at least two of the following types of acoustic dipoles: acoustic dipoles in the horizontal direction, acoustic dipoles in the vertical direction, or acoustic dipoles in the diagonal upward direction. The horizontal direction is a direction parallel to the vertical projection of the full-frequency sound box body, and the vertical direction is a direction perpendicular to the vertical projection of the full-frequency sound box body. The diagonal upward direction may include a number of different preset directions, and the included angles between the different preset directions and the horizontal direction are different. The preset directions here may be understood as directions pointing to the sky at different angles (sky directions for short).

[0011] In a possible implementation, each pair of acoustic dipoles corresponds to a pair of speakers, and at least two pairs of acoustic dipoles among the K pairs of acoustic dipoles are as follows: d i ≠d j The condition is satisfied, and then, d i is the distance between the two loudspeakers that make up the i-th pair of acoustic dipoles, and d j are the two speakers that make up the jth pair of acoustic dipoles. Moth where i and j are each one of 1, 2, . . . , K, where i ≠ j, and K is a positive integer equal to or greater than 2. The two speakers constituting the i-th pair of acoustic dipoles are configured to reproduce a first frequency band of the target audio data, and the two speakers constituting the j-th pair of acoustic dipoles are configured to reproduce a first frequency band of the target audio data. Ka is and reproducing a second frequency band of the target audio data, the first frequency band and the second frequency band being different frequency bands.

[0012] In possible implementations, d i >d jIn this case, the center frequency of the audio data that can be reproduced by the two speakers that make up the i-th pair of acoustic dipoles is smaller than the center frequency of the audio data that can be reproduced by the two speakers that make up the j-th pair of acoustic dipoles.

[0013] In this embodiment of the present application, the frequency band of the audio data reproduced by the speaker pair constituting the acoustic dipole pair is related to the distance between the two speakers included in the speaker pair. Specifically, the center frequency of the audio data reproduced by the two speakers constituting the acoustic dipole pair becomes smaller as the distance between the speakers increases. A speaker pair with a small distance has a good reproduction effect for high-band audio data.

[0014] The speaker layout of the full-frequency acoustic box is adjusted so that the spacing between two speakers in the speaker pairs that constitute multiple pairs of acoustic dipoles is the same or different. Audio data of different frequency bands can be reproduced by using the speaker pairs with different spacing, so that sound field effects of different frequency bands can be generated.

[0015] In a possible implementation, one speaker may be shared by one or more pairs of acoustic dipoles.

[0016] In a possible implementation, a passive film is placed on at least one of the M speakers, and the passive film is configured to widen the low-frequency response of the speaker. Each of the at least one speaker corresponds to one passive film, and the passive film is attached to the back of the cavity of the speaker. The passive film is placed on the back of the cavity of the speaker, and the passive film and the cavity in the box body form an air spring whose resonant frequency is lower than the resonant frequency of the speaker. The speaker pushes the air spring to resonate at the resonant frequency. This can widen the low-frequency response of the speaker (e.g., increase the range, energy, and amplitude of the low-frequency response) and improve the bass quality of the full-frequency sound box. Alternatively, each of the at least one speaker corresponds to two passive films, and the two passive films are located on both sides of the cavity of the speaker, respectively. The passive films are disposed on both sides of the speaker cavity so as to further expand the effective resonance area of ​​the passive film and further greatly improve the bass quality of the full frequency sound box.

[0017] In a possible implementation, the all-frequency sound box provided in this embodiment of the present application further includes N speakers, where N is a positive integer and N is less than or equal to M. The N speakers are respectively arranged back-to-back with N speakers of the M speakers to form N back-to-back speaker pairs. The M speakers face a first plane and the N speakers face a second plane, the first plane and the second plane being two planes perpendicular to the vertical projection of the all-frequency sound box, and the first plane is parallel to the second plane. Alternatively, the N speakers are respectively arranged facing N speakers of the M speakers to form N facing speaker pairs. The cavities of the M loudspeakers face a first plane, and the cavities of the N loudspeakers face a second plane, the first plane and the second plane being two planes perpendicular to the vertical projection of the full frequency sound box, and the first plane is parallel to the second plane.

[0018] In a possible implementation, the two speakers of each pair of the N back-to-back speaker pairs share one cavity. A passive film is disposed in the cavity of at least one speaker pair of the N back-to-back speaker pairs. One speaker pair of the at least one speaker pair corresponds to two passive films. The two passive films are back-to-back and are attached to two sides adjacent to the speaker pair within the cavity, respectively.

[0019] In a possible implementation, the shape of the full frequency soundbox body is one of the following: ring, circle, tree, W-shape.

[0020] In a possible implementation, the first fastening portion is further configured to support the full frequency soundbox body.

[0021] For example, when the full frequency soundbox body is ring-shaped, the first fastening portion may be used as a base to support the ring-shaped soundbox body, so that the ring-shaped soundbox body can be safely placed on a tabletop.

[0022] In a possible implementation, the first fastening portion is a first sheet-like portion connected to the full frequency sound box body, the first sheet-like portion being configured to physically connect to or separate from a second sheet-like portion of the low frequency sound box body.

[0023] In a possible implementation, the first fastening portion is a recess located in a pre-set fastening area of ​​the full frequency sound box body, the recess being configured to physically connect to or separate from the protrusion of the low frequency sound box body.

[0024] In a possible implementation, the full-frequency sound box provided in this embodiment of the present application includes a processor and a transceiver connected to the processor. The processor is configured to perform multi-band filtering on the audio data to be reproduced and perform sound field widening processing on the filtered audio data to be reproduced to obtain target audio data, and the mid-frequency and / or high-frequency components of the target audio data are reproduced by the full-frequency sound box. The transceiver is configured to send low-frequency components of the target audio data to the low-frequency sound box by using the first communication unit, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box.

[0025] It should be noted that in this embodiment of the present application, the target audio data is audio data obtained through a sound field widening process. For ease of description, the audio data that has not undergone the sound field widening process is called raw audio data, and the audio data obtained through the sound field widening process is called target audio data, i.e., the target audio data is obtained by performing a sound field widening process on the raw audio data. It should be understood that both the raw audio data and the target audio data are audio data to be reproduced.

[0026] In this embodiment of the present application, the transceiver of the full frequency sound box is further configured to receive the audio to be reproduced. The audio data to be reproduced may be raw audio data or a component of the raw audio data in a different frequency band (e.g., a mid-frequency component or a high-frequency component). The audio data to be reproduced may alternatively be target audio data or a component of the target audio data in a different frequency band (e.g., a mid-frequency component or a high-frequency component).

[0027] According to a second aspect, an embodiment of the present application provides a low-frequency sound box, including a low-frequency sound box body and a second fastening part. The low-frequency sound box body includes one or more low-frequency speakers, and the second fastening part is disposed in a pre-set fastening area of ​​the low-frequency sound box body. The second fastening part is configured to physically connect to or separate from the full-frequency sound box, and the second fastening part includes a second communication part, and the second communication part is configured to enable the low-frequency sound box to communicate with the full-frequency sound box, and the second communication part supports multi-channel audio data transmission. The low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, and the frequency band range of the full-frequency sound box is wider than the frequency band range of the low-frequency sound box.

[0028] According to the low frequency sound box provided in this embodiment of the present application, one or more speakers of the low frequency sound box reproduce low frequency components of audio data. This can improve the bass quality of the audio data. Furthermore, the low frequency sound box may be connected to the full frequency sound box by using the second communication unit, and used together with the full frequency sound box in a combined form. The low frequency sound box sends the mid frequency components and / or high frequency components of the audio data obtained through the sound field expansion processing to the full frequency sound box, and the full frequency sound box reproduces the audio data. The full frequency sound box and the low frequency sound box are used in cooperation. This can improve the audio reproduction effect. Furthermore, the user may choose to reproduce the audio data by using the full frequency sound box, or to reproduce the audio data by using the full frequency sound box and the low frequency sound box. This can satisfy various requirements of the user.

[0029] In possible implementations, the shape of the low frequency sound box body may be a flat cylinder, a long cylinder, a cube, a rectangular parallelepiped, or other shapes, which is not limited in this embodiment of the present application.

[0030] In a possible implementation, the second fastening portion is a second sheet-like portion connected to the low frequency sound box body, the second sheet-like portion being configured to physically connect to or separate from the first sheet-like portion of the full frequency sound box body.

[0031] In a possible implementation, the second fastening portion is a protrusion located in a pre-set fastening area of ​​the low frequency sound box body, the protrusion being configured to physically connect to or separate from the recess of the full frequency sound box body.

[0032] In a possible implementation, the low frequency sound box further includes a charging port configured to connect to an external power source to provide power to the low frequency sound box or to charge the full frequency sound box by using the low frequency sound box when the low frequency sound box is connected to the full frequency sound box.

[0033] In a possible implementation, the low frequency sound box further comprises a camera and a microphone: the camera is configured to capture an image of a user (listener) in order to determine the user's position based on the image of the user, and likewise the microphone is configured to capture the user's acoustic signals in order to determine the user's position based on the user's acoustic signals.

[0034] In a possible implementation, the low-frequency sound box provided in this embodiment of the present application includes a processor and a transceiver connected to the processor. The processor is configured to perform multi-band filtering on the audio data to be played and perform sound field widening processing on the filtered audio data to be played to obtain target audio data, and the mid-frequency and / or high-frequency components of the target audio data are played by the full-frequency sound box. The transceiver is configured to transmit the mid-frequency and / or high-frequency components of the target audio data to the full-frequency sound box by using the second communication unit, and the low-frequency components of the target audio data are played by the low-frequency sound box.

[0035] In this embodiment of the present application, the transceiver of the low frequency sound box is further configured to receive the audio data to be played back, which may be the raw audio data and the low frequency components of the raw audio data, or the audio data to be played back may be the low frequency components of the target audio data.

[0036] According to a third aspect, an embodiment of the present application provides a sound box system including an all-frequency sound box according to the first aspect and any one of the possible implementations of the first aspect, and a low-frequency sound box according to the second aspect and any one of the possible implementations of the second aspect. The all-frequency sound box is physically connected to the low-frequency sound box by using a first fastening part and a second fastening part, and the all-frequency sound box communicates with the low-frequency sound box by using a first communication part and a second communication part. The first fastening part and the second fastening part are a group of paired connections, and the first communication part and the second communication part are a group of paired communication parts.

[0037] According to the sound box system provided in this embodiment of the present application, the full-frequency sound box of the sound box system can work independently, or the full-frequency sound box and the low-frequency sound box work together. Therefore, users can flexibly choose to play audio data by using the full-frequency sound box, or play audio data by using the full-frequency sound box and the low-frequency sound box. This can satisfy different demands of users.

[0038] In a possible implementation, the full frequency sound box is arranged to reproduce the target audio data or to reproduce high and / or mid frequency components of the target audio data, and the low frequency sound box is arranged to reproduce low frequency components of the target audio data.

[0039] When the full-frequency sound box works independently, reproducing the mid-frequency or high-frequency components of the target audio data by using the full-frequency sound box can improve the sound quality because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. When the full-frequency sound box and the low-frequency sound box work together, reproducing the low-frequency components of the target audio data by using the low-frequency sound box can improve the bass quality of the audio data because the low-frequency reproducing effect of the low-frequency sound box is better than that of the full-frequency sound box. Furthermore, reproducing the mid-frequency and / or high-frequency components of the target audio data by using the full-frequency sound box can improve the reproducing effect of the mid-frequency and / or high-frequency components of the target audio data because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. In this way, the reproducing effect of the audio data can be improved in the full frequency band of the audio data.

[0040] In a possible implementation, the full frequency sound box is connected to the low frequency sound box in a stacked or attached mode by using a first fastening part and a second fastening part.

[0041] In a possible implementation, the full frequency sound box is connected to the low frequency sound box in a stacked mode when the first fastening portion is a first sheet-like portion and the second fastening portion is a second sheet-like portion, and the first sheet-like portion is in contact with and coupled to the second sheet-like portion. The first sheet-like portion includes a first communication portion, the first communication portion being located within a vertical projection of the full frequency sound box body. The second sheet-like portion is located on the low frequency sound box body, and the second sheet-like portion includes a second communication portion. The second communication portion is located on the second sheet-like portion.

[0042] In a possible implementation, the all-frequency sound box is connected to the low-frequency sound box in the attachment mode when the first fastening portion is a first sheet-like portion extending outwardly along one side of the all-frequency sound box body and the second fastening portion is a second sheet-like portion extending outwardly along one side of the low-frequency sound box body, and the first sheet-like portion is in contact with and coupled to the second sheet-like portion. The first sheet-like portion includes a first communication portion, the first communication portion being located outside the vertical projection of the all-frequency sound box body, and the second sheet-like portion includes a second communication portion, the second communication portion being located outside the vertical projection of the low-frequency sound box body.

[0043] In a possible implementation, the first fastening part is connected to the second fastening part in a buckle coupling or magnetic coupling mode.

[0044] In a possible implementation, the first fastening portion is a recess arranged in a preset fastening area of ​​the full frequency sound box body, and the second fastening portion is a protrusion arranged in a preset fastening area of ​​the low frequency sound box body, and when the recess contacts and engages with the protrusion, the full frequency sound box is connected to the low frequency sound box in a stacked mode.

[0045] In a possible implementation, the first fastening part is connected to the second fastening part in a buckle or screw connection mode.

[0046] In summary, the first communication part is a magnetically attracted female connector of a magnetically attracted interface, and the second communication part is a magnetically attracted male connector of a magnetically attracted interface. Alternatively, the first communication part is a plug of a USB interface, and the second communication part is a socket of a USB interface. Alternatively, the first communication part and the second communication part may be other communication parts having a matching relationship and a removable mechanism. This is not limited in this embodiment of the present application.

[0047] In this embodiment of the present application, the full-frequency sound box is small in size, light in weight, and easy to carry.Compared with the full-frequency sound box, the low-frequency sound box has a slightly larger size and heavier weight, but has stronger data processing ability.

[0048] In a possible implementation, the sound box system further includes at least one full-frequency sound box, and at least two full-frequency sound boxes included in the sound box system can work together.

[0049] In a possible implementation, the sound box system further includes at least one full-frequency sound box and at least one low-frequency sound box. In the sound box system, one full-frequency sound box includes one No.In this case, at least two of the low-frequency sound boxes in the sound box system are included. Sound Box The subsystems may work together.

[0050] For the description of the relevant contents and technical effects of the full-frequency sound box and the low-frequency sound box in the sound box system in the third aspect, please refer to the relevant description in the first aspect. Details will not be described again here.

[0051] According to a fourth aspect, an embodiment of the present application provides an audio data processing method. The method includes: a terminal detects whether a first communication unit of a full-frequency sound box according to the first aspect and any one of the possible implementations of the first aspect is connected to a second communication unit of a low-frequency sound box according to the second aspect and any one of the possible implementations of the second aspect. If the terminal finds through the detection that the first communication unit is not connected to the second communication unit, the terminal sends the audio data to be played to the full-frequency sound box; if the terminal finds through the detection that the first communication unit is connected to the second communication unit, the terminal sends the first audio data to the full-frequency sound box and sends the second audio data to the low-frequency sound box, the first audio data being a mid-frequency component and / or a high-frequency component of the audio data to be played, and the second audio data being a low-frequency component of the audio data to be played; or the terminal sends the audio data to be played to the full-frequency sound box; or the terminal sends the audio data to be played to the low-frequency sound box.

[0052] According to the audio data processing method provided in this embodiment of the present application, the terminal determines to send audio data to the full-frequency sound box and / or the low-frequency sound box by detecting whether the first communication unit of the full-frequency sound box of the terminal is connected to the second communication unit of the low-frequency sound box, so that the full-frequency sound box processes the audio data and / or the low-frequency sound box processes the audio data, which achieves a good sound field expansion effect and improves the sound quality.

[0053] In a possible implementation, the terminal may detect whether the first communication unit is connected to the second communication unit through interaction with the full-frequency sound box. For example, the terminal obtains from the full-frequency sound box status information of a first port of the full-frequency sound box corresponding to the first communication unit, and determines whether the first communication unit is connected to the second communication unit based on the status information of the first port. The status information of the first port is "0" if the first communication unit is not connected to the second communication unit. In this case, after obtaining the status "0", the terminal determines that the first communication unit is not connected to the second communication unit. If the first communication unit is connected to the second communication unit, the status information of the first port is "1". In this case, after obtaining the status "1", the terminal determines that the first communication unit is connected to the second communication unit.

[0054] Alternatively, the terminal may detect whether the first communication unit is connected to the second communication unit by using other possible methods, which are not limited in this embodiment of the present application.

[0055] In a possible implementation, the terminal sends the audio data to be played to the full-frequency sound box specifically includes the terminal sends raw audio data to the full-frequency sound box. It should be understood that when the terminal sends raw audio data to the full-frequency sound box, the full-frequency sound box performs frequency division on the original data, and performs sound field expansion processing on the components of different frequency bands to obtain target audio data, and then plays the target audio data.

[0056] In a possible implementation, the terminal sends the audio data to be played to the full-frequency sound box specifically includes the terminal sends the target audio data to the full-frequency sound box. When the terminal sends the target audio data to the full-frequency sound box, the target audio data may be obtained by performing frequency division and sound field expansion processing on the raw audio data by another device, and then sent to the full-frequency sound box. Then, the full-frequency sound box plays the target audio data. The other device may be a terminal, a low-frequency sound box, or a device other than these two devices. This is not limited in this embodiment of the present application.

[0057] In a possible implementation, the terminal sends the first audio data to the full-frequency sound box and the second audio data to the low-frequency sound box specifically includes the terminal sends the mid-frequency and / or high-frequency components of the raw audio data to the full-frequency sound box and sends the low-frequency components of the raw audio data to the low-frequency sound box. Specifically, the terminal performs frequency division on the raw audio data to obtain the mid-frequency and / or high-frequency components and the low-frequency components of the raw audio data, and then the terminal sends the mid-frequency and / or high-frequency components of the raw audio data to the full-frequency sound box, and the full-frequency sound box performs sound field expansion processing on the mid-frequency and / or high-frequency components of the original data to obtain the mid-frequency and / or high-frequency components of the target audio data. Furthermore, the terminal sends the low-frequency components of the raw audio data to the low-frequency sound box, and the low-frequency sound box performs sound field expansion processing on the low-frequency components of the raw audio data to obtain the low-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0058] In a possible implementation, the terminal sends the first audio data to the full-frequency sound box and the second audio data to the low-frequency sound box specifically includes the terminal sending the mid-frequency and / or high-frequency components of the target audio data to the full-frequency sound box and the low-frequency components of the target audio data to the low-frequency sound box. Specifically, the terminal or other device performs frequency division on the raw audio data, performs sound field expansion processing on the mid-frequency and / or high-frequency components and low-frequency components obtained through frequency division, sends the mid-frequency and / or high-frequency components of the target audio data to the full-frequency sound box, and sends the low-frequency components of the target audio data to the low-frequency sound box. Then, the full-frequency sound box plays the mid-frequency and / or high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0059] In a possible implementation, the terminal sends the audio data to be played to the low-frequency sound box specifically includes the terminal sends raw audio data to the low-frequency sound box. It should be understood that when the terminal sends raw audio data to the low-frequency sound box, the low-frequency sound box performs frequency division on the original data and performs sound field expansion processing on the components of different frequency bands to obtain target audio data. Then, the low-frequency sound box plays the low-frequency components of the target audio data, and sends the mid-frequency components and / or high-frequency components of the target audio data to the full-frequency sound box, and the full-frequency sound box plays the mid-frequency components and / or high-frequency components.

[0060] In a possible implementation, the terminal sending the audio data to be played to the low-frequency sound box specifically includes the terminal sending the target audio data to the low-frequency sound box. It should be understood that when the terminal sends the target audio data to the low-frequency sound box, the target audio data may be obtained by performing frequency division and sound field expansion processing on the raw audio data by another device, and then sent to the low-frequency sound box. Then, the low-frequency sound box plays the low-frequency components of the target audio data, and the low-frequency sound box sends the mid-frequency components and / or high-frequency components of the target audio data to the full-frequency sound box, and the full-frequency sound box plays the mid-frequency components and / or high-frequency components. do .

[0061] According to a fifth aspect, an embodiment of the present application provides an audio data processing method, the method being applied to a full-frequency sound box according to the first aspect and any one of the possible implementations of the first aspect, comprising: obtaining audio data to be played back; performing multi-band filtering on the audio data to be played back to obtain mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back; performing sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back to obtain target audio data; and sending the low-frequency components of the target audio data to a low-frequency sound box, wherein the mid-frequency components and / or high-frequency components of the target audio data are played back by the full-frequency sound box, and the low-frequency components of the target audio data are played back by the low-frequency sound box.

[0062] According to the audio data processing method provided in this embodiment of the present application, after the full-frequency sound box completes the sound field expansion process on the audio data, in one aspect, the full-frequency sound box reproduces the high-frequency components and / or mid-frequency components of the audio data obtained through the sound field expansion process. Because the full-frequency sound box has a good reproduction effect on mid-frequency and high frequencies, the sound quality of the mid-frequency components and / or high-frequency components can be improved. In another aspect, the full-frequency sound box sends the low-frequency components of the audio data obtained through the sound field expansion process to the low-frequency sound box, and the low-frequency sound box reproduces the low-frequency components. Because the low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, the bass quality of the audio data can be improved.

[0063] In a possible implementation, the multi-band filtering may include high-frequency filtering, band-pass filtering, and low-frequency filtering, and / or the multi-band filtering includes high-frequency filtering and low-frequency filtering, It should be understood that the high-frequency filtering is performed on the audio data to obtain high-frequency components of the audio data, the band-pass filtering is performed on the audio data to obtain mid-frequency components of the audio data, and the low-frequency filtering is performed on the audio data to obtain low-frequency components of the audio data.

[0064] When multi-band filtering is performed on the audio data, the setting of the filtering frequency bands is related to the distance between the two speakers of a speaker pair that constitutes a dipole in the full frequency sound box. The filtering frequency bands determine the frequency bands that correspond to the filtered high, mid and low frequency components.

[0065] In a possible implementation, the sound field widening processing includes a full frequency soundbox performing high band dipole processing on the high frequency components of the filtered audio data and / or performing mid band dipole processing on the mid frequency components of the filtered audio data.

[0066] It can be understood that there is a sweet point area in the sound field of the speaker of the full-frequency sound box. The sweet point area is the area where good sound effect can be achieved. Generally, the sweet point area is the area that is off the middle of the full-frequency sound box by a preset angle. The user (or listener) has a desirable listening experience when the user is located in the sweet point area. When the user is away from the sweet point area (for example, the included angle between the user and the center of the full-frequency sound box is larger than the preset angle), binaural crosstalk will occur. As a result, the user's listening experience will be poor.

[0067] In this embodiment of the present application, a pair of acoustic dipoles corresponds to a pair of speakers, and signals with the same amplitude but different phases are reproduced by using a pair of speakers. The horizontal direction is used as an example. The right channel corresponds to one acoustic dipole, and the left channel corresponds to one acoustic dipole. For example, when the right channel signal has a large energy when it arrives at the user's left ear, crosstalk occurs between the left and right ears, that is, the right channel signal interferes with the left ear. As a result, the sound field is narrowed. The crosstalk between the left and right ears is small when the energy of the right channel signal is small when it arrives at the user's left ear.

[0068] In this embodiment of the present application, the sound field widening process is performed on the high frequency components of the audio data according to a high band dipole algorithm, and the sound field widening process is performed on the mid frequency components of the audio data according to a mid band dipole algorithm. For the right channel signal, it is ensured that the energy of the right channel signal is not reduced when it arrives at the right ear, while the energy of the right channel signal can be reduced when it arrives at the left ear, while it is ensured that the energy of the left channel signal is not reduced when it arrives at the left ear, while the energy of the left channel signal can be reduced when it arrives at the right ear. In this way, the binaural crosstalk is cancelled. In this embodiment of the present application, if the energy of the right channel signal is smaller when it arrives at the left ear of the user, the energy of the right channel signal is larger when it arrives at the right ear of the user. In this case, a better binaural crosstalk cancellation effect is achieved. Similarly, if the energy of the left channel signal is smaller when it arrives at the right ear, the energy of the left channel signal is larger when it arrives at the left ear. In this case, a better binaural crosstalk cancellation effect is achieved.

[0069] In a possible implementation, the sound field widening process includes processing the low frequency components of the filtered audio data according to a bass enhancement algorithm. In this way, the energy of the low frequency signal (i.e., the low frequency components) is dynamically increased without damaging the speaker (without exceeding the maximum displacement of the diaphragm), so that the bass quality of the audio data is greatly improved. It should be understood that the parameters of the speaker (TS parameters) are obtained in advance according to the bass enhancement algorithm, and modeling is performed based on the parameters of the speaker to obtain a processing model.

[0070] In a possible implementation, one frequency band corresponds to one or more pairs of acoustic dipoles. For example, the high frequency band corresponds to multiple pairs of acoustic dipoles. In this way, after being processed according to the high band dipole algorithm, the high frequency components obtained through high frequency filtering are reproduced by using speakers corresponding to multiple pairs of dipoles.

[0071] In a possible implementation, in this embodiment of the present application, the audio data is multi-channel audio data. For example, the multi-channel is a dual channel including a left channel (L) and a right channel (R). As another example, the multi-channel includes a left channel (L), a left surround channel (Ls), a left rear channel (Lb), a left upper channel (Lh), a right channel (R), a right surround channel (Rs), a right rear channel (Rb), a right upper channel (Rh), and a center channel (C).

[0072] According to a sixth aspect, an embodiment of the present application provides an audio data processing method, the method being applied to a low frequency sound box according to the second aspect and any one of the possible implementations of the second aspect, comprising: obtaining audio data to be reproduced; performing multi-band filtering on the audio data to be reproduced to obtain mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be reproduced; performing sound field expansion processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be reproduced to obtain target audio data; and sending the mid-frequency components and / or high-frequency components of the target audio data to a full frequency sound box, wherein the mid-frequency components and / or high-frequency components of the target audio data are reproduced by the full frequency sound box and the low-frequency components of the target audio data are reproduced by the low frequency sound box.

[0073] In this embodiment of the present application, after the low-frequency sound box completes the sound field expansion process for the audio data, in one aspect, the low-frequency components obtained through the bass enhancement process are reproduced by using the woofer of the low-frequency sound box. Because the low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, the bass quality of the audio data can be improved. In another aspect, the low-frequency sound box sends the high-frequency components and / or mid-frequency components of the audio data obtained by the sound field expansion process to the full-frequency sound box, and then the full-frequency sound box reproduces the high-frequency components and / or mid-frequency components. Because the full-frequency sound box has a good reproduction effect for the mid-frequency and high-frequency, the sound quality of the mid-frequency components and / or high-frequency components can be improved.

[0074] In a possible implementation, the audio data processing method provided in this embodiment of the present application further includes capturing image information of a listener by using a camera of the low-frequency sound box or capturing an acoustic signal of the listener by using a microphone, and the image information of the listener or the acoustic signal of the listener is used to perform sound field widening processing on the filtered audio data to be reproduced. Specifically, the low-frequency sound box analyzes the image information or the acoustic signal of the listener to determine the position information of the listener. The user's position information includes the included angle between the user and the central axis of the sound box system. Furthermore, the difference between the phases of reproducing signals by the two speakers constituting a pair of acoustic dipoles is adjusted based on the position information of the listener. The phase difference is a setting parameter for high-band dipole processing and / or mid-band dipole processing.

[0075] In this embodiment of the present application, in order to improve the user's listening experience, a setting parameter in the high-band dipole algorithm or the mid-band dipole algorithm (i.e., the setting parameter is the difference between the phases of reproducing signals by two speakers constituting a pair of acoustic dipoles) may be adjusted in the process of performing sound field expansion on the audio data. In this way, the binaural crosstalk cancellation effect is improved, so that the user achieves a good listening experience at the current position. Specifically, since the phase difference is related to the user's current position, the phase difference is adjusted by performing the above steps A to C. In this way, the sound field expansion process is performed on the audio data by using the adjusted phase difference to remove the binaural crosstalk. In this way, the sound field expansion is performed at the user's current position, and the user's listening experience is improved in real time.

[0076] According to a seventh aspect, an embodiment of the present application provides an audio data processing method, the method being applied to a scenario in which a terminal establishes a communication connection with a sound box system according to any one of the third aspect and possible implementations of the third aspect, and includes: when the terminal receives a first operation of a user, the terminal controls the full-frequency sound box to operate independently in response to the first operation, or when the terminal receives a second operation of a user, the terminal controls the full-frequency sound box and the low-frequency sound box to work together in response to the second operation.

[0077] According to the audio data processing method provided in this embodiment of the present application, the user performs corresponding operation on the terminal. In this case, in response to the user's operation, the terminal controls the full-frequency sound box of the sound box system to work independently, or controls the full-frequency sound box and the low-frequency sound box to work together. This can improve the user's experience and achieve a good sound field expansion effect.

[0078] When the full-frequency sound box works independently, reproducing the mid-frequency or high-frequency components of the target audio data by using the full-frequency sound box can improve the sound quality because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. When the full-frequency sound box and the low-frequency sound box work together, reproducing the low-frequency components of the target audio data by using the low-frequency sound box can improve the bass quality of the audio data because the low-frequency reproducing effect of the low-frequency sound box is better than that of the full-frequency sound box. Furthermore, reproducing the mid-frequency and / or high-frequency components of the target audio data by using the full-frequency sound box can improve the reproducing effect of the mid-frequency and / or high-frequency components of the target audio data because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. In this way, the reproducing effect of the audio data can be improved in the full frequency band of the audio data.

[0079] In a possible implementation, specifically, the terminal controls the full-frequency sound box to operate independently in response to the first operation, the terminal sends a first command to the sound box system in response to the first operation. The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operates independently means that the full-frequency sound box plays the target audio data.

[0080] In a possible implementation, the terminal sending the first command to the sound box system specifically includes: the terminal sending the first command to the low-frequency sound box.

[0081] Specifically, when the full-frequency sound box of the sound box system is connected to the low-frequency sound box (the first fastening part is connected to the second fastening part, and the first communication part is connected to the second communication part), the low-frequency sound box controls and manages the entire sound box system, that is, when the terminal sends a first command to the sound box system, it means sending the first command to the low-frequency sound box of the sound box system.

[0082] In a possible implementation, specifically, the terminal controls the full-frequency sound box and the low-frequency sound box to work together in response to the second operation includes the terminal sends a second command to the sound box system in response to the second operation. The second command is used to control the full-frequency sound box and the full-frequency sound box to work. The full-frequency sound box and the low-frequency sound box work together means that the full-frequency sound box plays the mid-frequency components and / or high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0083] In a possible implementation, the terminal sending the second command to the sound box system specifically includes: the terminal sending the second command to the low-frequency sound box.

[0084] In a possible implementation, the first operation is a selection operation by the user on a first option in a first interface of the terminal, the first option corresponding to the full-frequency sound box operating independently, and the second operation is a selection operation by the user on a second option in the first interface of the terminal, the second option corresponding to the full-frequency sound box and the low-frequency sound box working together.

[0085] In a possible implementation, when the full-frequency sound box operates independently, the audio data processing method provided in this embodiment of the present application further includes: when the terminal determines that the audio data to be currently played is deep low-frequency audio data, the terminal displays first prompt information, and the first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to work together.

[0086] In a possible implementation, the audio data processing method provided in this embodiment of the present application further includes: the terminal receiving a third operation; and the terminal controlling and activating a camera or microphone of the low-frequency sound box in response to the third operation.

[0087] In a possible implementation, the sound box system includes a plurality of full-frequency sound boxes. The audio data processing method provided in this embodiment of the present application further includes: the terminal determines the correspondence between the channels of the audio data and the plurality of full-frequency sound boxes according to the position information of the plurality of full-frequency sound boxes, and displays information about the correspondence between the channels of the audio data and the plurality of full-frequency sound boxes.

[0088] According to an eighth aspect, the embodiment of the present application provides an audio data processing method. The method is applied to a scenario in which a terminal establishes a communication connection with a sound box system according to any one of the third aspect and the possible implementations of the third aspect, and includes: the terminal determines a type of target audio data, and the type of target audio data has deep low frequency or non-deep low frequency; when the type of target audio data is non-deep low frequency, the terminal controls the full-frequency sound box to operate independently, or when the type of target audio data is deep low frequency, the terminal controls the full-frequency sound box and the low-frequency sound box to work together.

[0089] According to the audio data processing method provided in this embodiment of the present application, the terminal controls the full-frequency sound box of the sound box system to work independently according to the type of target audio data, or controls the full-frequency sound box and the low-frequency sound box to work together, which can achieve excellent sound field expansion effect.

[0090] When the full-frequency sound box works independently, reproducing the mid-frequency or high-frequency components of the target audio data by using the full-frequency sound box can improve the sound quality because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. When the full-frequency sound box and the low-frequency sound box work together, reproducing the low-frequency components of the target audio data by using the low-frequency sound box can improve the bass quality of the audio data because the low-frequency reproducing effect of the low-frequency sound box is better than that of the full-frequency sound box. Furthermore, reproducing the mid-frequency and / or high-frequency components of the target audio data by using the full-frequency sound box can improve the reproducing effect of the mid-frequency and / or high-frequency components of the target audio data because the full-frequency sound box has a good reproducing effect on mid-frequency and high frequencies. In this way, the reproducing effect of the audio data can be improved in the full frequency band of the audio data.

[0091] In a possible implementation, specifically, the terminal controls the full-frequency sound box to operate independently, the terminal sends a first command to the sound box system. The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operates independently means that the full-frequency sound box plays the target audio data.

[0092] In a possible implementation, the terminal sending the first command to the sound box system specifically includes: the terminal sending the first command to the low-frequency sound box.

[0093] In a possible implementation, specifically, the terminal controls the full-frequency sound box and the low-frequency sound box to cooperate with each other, the terminal sends a second command to the sound box system, and the second command is used to control the full-frequency sound box and the low-frequency sound box to operate. The full-frequency sound box and the low-frequency sound box cooperate with each other, which means that the full-frequency sound box plays the mid-frequency components and / or high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0094] In a possible implementation, the terminal sending the second command to the sound box system specifically includes: the terminal sending the second command to the low-frequency sound box.

[0095] According to a ninth aspect, an embodiment of the present application provides a terminal including a detection module and a transmission module. The detection module is configured to detect whether a first communication unit of the all-frequency sound box according to the first aspect and any one of the possible implementations of the first aspect is connected to a second communication unit of the low-frequency sound box according to the second aspect and any one of the possible implementations of the second aspect. The transmission module is configured to send audio data to be played to the all-frequency sound box if the detection module finds, by detection, that the first communication unit is not connected to the second communication unit. Alternatively, the transmission module is configured to send the first audio data to the all-frequency sound box and the second audio data to the low-frequency sound box if the detection module finds, by detection, that the first communication unit is connected to the second communication unit, the first audio data being a mid-frequency component and / or a high-frequency component of the audio data to be played, and the second audio data being a low-frequency component of the audio data to be played. Alternatively, the transmission module is configured to send the audio data to be played to the all-frequency sound box. Alternatively, the transmission module is configured to send the audio data to be played to a low frequency sound box.

[0096] According to a tenth aspect, an embodiment of the present application provides a full-frequency sound box, including an acquisition module, a filtering module, a processing module, and a transmission module. The acquisition module is configured to acquire audio data to be played. The filtering module is configured to perform multi-band filtering on the audio data to be played to acquire mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played. The processing module is configured to perform sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played to acquire target audio data. The transmission module is configured to send the low-frequency components of the target audio data to the low-frequency sound box, and the mid-frequency components and / or high-frequency components of the target audio data are played by the full-frequency sound box, and the low-frequency components of the target audio data are played by the low-frequency sound box.

[0097] According to an eleventh aspect, an embodiment of the present application provides a low-frequency sound box, including an acquisition module, a filtering module, a processing module, and a transmission module. The acquisition module is configured to acquire audio data to be played. The filtering module is configured to perform multi-band filtering on the audio data to be played to acquire mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played. The processing module is configured to perform sound field expansion processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played to acquire target audio data. The transmission module is configured to send the mid-frequency components and / or high-frequency components of the target audio data to the full-frequency sound box, where the mid-frequency components and / or high-frequency components of the target audio data are played by the full-frequency sound box, and the low-frequency components of the target audio data are played by the low-frequency sound box.

[0098] In a possible implementation, the low frequency sound box provided in this embodiment of the present application further includes an image capture module or an audio capture module, the image capture module being configured to capture image information of a listener, or the audio capture module being configured to capture an acoustic signal of a listener, and the image information of the listener or the acoustic signal of the listener is used to perform sound field widening processing of the filtered audio data to be reproduced.

[0099] According to a twelfth aspect, the embodiment of the present application provides a terminal. The terminal is used in a scenario in which the sound box system according to the third aspect and any one of the possible implementations of the third aspect establishes a communication connection, and includes a receiving module and a control module. The control module is configured to control the full-frequency sound box to operate independently in response to the first operation when the receiving module receives a first operation of a user, or the control module is configured to control the full-frequency sound box and the low-frequency sound box to work together in response to the second operation when the receiving module receives a second operation of a user.

[0100] In a possible implementation, the terminal provided in this embodiment of the present application further includes a transmitting module. The control module is specifically configured to control the transmitting module to send a first command to the sound box system in response to a first operation. The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operating independently means that the full-frequency sound box plays the target audio data.

[0101] In a possible implementation, the sending module is specifically configured to send the first command to the low frequency sound box.

[0102] In a possible implementation, the control module is specifically configured to control the sending module to send a second command to the sound box system in response to the second operation. The second command is used to control the full frequency sound box and the low frequency sound box to operate. The full frequency sound box and the low frequency sound box working together means that the full frequency sound box reproduces the mid frequency and / or high frequency components of the target audio data, and the low frequency sound box reproduces the low frequency components of the target audio data.

[0103] In a possible implementation, the sending module is specifically configured to send the second command to the low frequency sound box.

[0104] In a possible implementation, the first operation is a selection operation by the user on a first option in a first interface of the terminal, the first option corresponding to the full-frequency sound box operating independently, and the second operation is a selection operation by the user on a second option in the first interface of the terminal, the second option corresponding to the full-frequency sound box and the low-frequency sound box working together.

[0105] In a possible implementation, the terminal provided in this embodiment of the present application further includes a display module, which is configured to display first prompt information when the full-frequency sound box works independently and the terminal determines that the audio data to be currently played is deep low-frequency audio data, and the first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to work together.

[0106] In a possible implementation, the receiving module is further configured to receive a third operation. The control module is further configured to control and activate a camera or a microphone of the low frequency sound box in response to the third operation.

[0107] In a possible implementation, the terminal provided in this embodiment of the present application further includes a determining module. When the sound box system includes multiple full-frequency sound boxes, the determining module is configured to determine the correspondence between the channels of the audio data and the multiple full-frequency sound boxes based on the position information of the multiple full-frequency sound boxes. The display module is further configured to display information about the correspondence between the channels of the audio data and the multiple full-frequency sound boxes.

[0108] According to a thirteenth aspect, the embodiment of the present application provides a terminal. The terminal is used in a scenario in which the sound box system according to the third aspect and any one of the possible implementations of the third aspect establishes a communication connection, and includes a determination module and a control module. The determination module is configured to determine a type of target audio data, and the type of the target audio data includes deep low frequency or non-deep low frequency. The control module is configured to control the full-frequency sound box to operate independently when the type of the target audio data is non-deep low frequency, or the control module is configured to control the full-frequency sound box and the low-frequency sound box to work together when the type of the target audio data is deep low frequency.

[0109] In a possible implementation, the terminal provided in this embodiment of the present application further includes a sending module. The control module is specifically configured to control the sending module to send a first command to the sound box system. The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operating independently means that the full-frequency sound box plays the target audio data.

[0110] In a possible implementation, the sending module is specifically configured to send the first command to the low frequency sound box.

[0111] In a possible implementation, the terminal provided in this embodiment of the present application further includes a sending module. The control module is specifically configured to control the sending module to send a second command to the sound box system. The second command is used to control the full-frequency sound box and the low-frequency sound box to operate. The full-frequency sound box and the low-frequency sound box cooperate means that the full-frequency sound box reproduces the mid-frequency and / or high-frequency components of the target audio data, and the low-frequency sound box reproduces the low-frequency components of the target audio data.

[0112] In a possible implementation, the sending module is specifically configured to send the second command to the low frequency sound box.

[0113] According to a fourteenth aspect, an embodiment of the present application provides an all frequency sound box including a memory and at least one processor connected to the memory, the memory configured to store instructions, and the method according to the fifth aspect is executed after the instructions are read by the at least one processor.

[0114] According to a fifteenth aspect, an embodiment of the present application provides a computer-readable storage medium comprising a computer program, the method according to the fifth aspect being performed when the computer program is run on a computer.

[0115] According to a sixteenth aspect, an embodiment of the present application provides a computer program product comprising instructions, the computer program product being capable of, when executed on a computer, performing a method according to the fifth aspect.

[0116] According to a seventeenth aspect, an embodiment of the present application provides a chip including a memory and a processor, the memory being configured to store computer instructions, the processor being configured to retrieve and execute the computer instructions from the memory so as to perform a method according to the fifth aspect.

[0117] According to an eighteenth aspect, an embodiment of the present application provides a low frequency sound box including a memory and at least one processor connected to the memory, the memory being configured to store instructions, and the method according to the sixth aspect being executed after the instructions are read by the at least one processor.

[0118] According to a nineteenth aspect, an embodiment of the present application provides a computer-readable storage medium comprising a computer program, the method according to the sixth aspect being performed when the computer program is run on a computer.

[0119] According to a twentieth aspect, an embodiment of the present application provides a computer program product comprising instructions, the computer program product being capable of causing the computer to perform a method according to the sixth aspect when executed on a computer.

[0120] According to a twenty-first aspect, an embodiment of the present application provides a chip including a memory and a processor, the memory being configured to store computer instructions, the processor being configured to retrieve and execute the computer instructions from the memory so as to perform a method according to the sixth aspect.

[0121] According to a twenty-second aspect, an embodiment of the present application provides a terminal including a memory and at least one processor connected to the memory, the memory being configured to store instructions, and a method according to one of the fourth aspect, the seventh aspect, the eighth aspect and possible implementations of the fourth aspect, the seventh aspect and the eighth aspect being executed after the instructions are read by the at least one processor.

[0122] According to a twenty-third aspect, an embodiment of the present application provides a computer-readable storage medium comprising a computer program, the method according to the fourth aspect, the seventh aspect, the eighth aspect and one of the possible implementations of the fourth aspect, the seventh aspect and the eighth aspect being performed when the computer program is run on a computer.

[0123] According to a twenty-fourth aspect, an embodiment of the present application provides a computer program product comprising instructions, which when executed on a computer, can cause the computer to perform a method according to one of the fourth aspect, the seventh aspect, the eighth aspect and possible implementations of the fourth aspect, the seventh aspect and the eighth aspect.

[0124] According to a twenty-fifth aspect, an embodiment of the present application provides a chip including a memory and a processor, the memory being configured to store computer instructions, the processor being configured to retrieve and execute the computer instructions in the memory to perform a method according to one of the fourth aspect, the seventh aspect, the eighth aspect, and possible implementations of the fourth aspect, the seventh aspect, and the eighth aspect.

[0125] It should be understood that for the advantageous effects achieved by the technical solutions in the ninth to twelfth aspects of the embodiment of the present application and corresponding possible implementations, please refer to the technical effects of the first to eighth aspects and corresponding possible implementations of the first to eighth aspects, and the details will not be described again here. [Brief description of the drawings]

[0126] [Figure 1] FIG. 1 is a schematic diagram of the structure of a full-frequency sound box according to an embodiment of the present application. [Diagram 2] FIG. 2 is a schematic diagram of the shape of the full frequency sound box body according to an embodiment of the present application. [Diagram 3] FIG. 2 is a schematic diagram of the structure of the full-frequency sound box according to an embodiment of the present application. [Figure 4] FIG. 2 is a schematic diagram of a dipole in an all frequency soundbox according to an embodiment of the present application. [Diagram 5] FIG. 2 is a schematic layout diagram of a speaker for a ring-shaped full-frequency sound box according to an embodiment of the present application. [Figure 6]FIG. 2 is a schematic diagram of the position of a passive film in a full frequency sound box according to an embodiment of the present application. [Figure 7] 1A-1C are schematic diagrams of a facing speaker pair and a back-to-back speaker pair according to an embodiment of the present application. [Figure 8] FIG. 2 is a schematic diagram of the structure of a low-frequency sound box according to an embodiment of the present application. [Figure 9] FIG. 1 is a schematic diagram of the structure of a sound box system according to an embodiment of the present application. [Figure 10] FIG. 1 is a schematic diagram of connecting a full-frequency sound box to a low-frequency sound box in a stacking mode according to an embodiment of the present application. [Figure 11] FIG. 2 is a schematic diagram of connecting the full-frequency sound box to the low-frequency sound box in an attachment mode according to an embodiment of the present application. [Figure 12] FIG. 2 is a schematic top view of an all-frequency sound box according to an embodiment of the present application. [Figure 13] FIG. 2 is a schematic diagram of connecting a full-frequency sound box to a low-frequency sound box in a stacking mode according to an embodiment of the present application. [Figure 14] FIG. 2 is a schematic diagram of the hardware structure of a full-frequency sound box according to an embodiment of the present application; [Figure 15] FIG. 1 is a schematic diagram of a low-frequency sound box according to an embodiment of the present application. [Figure 16] 1 is a schematic diagram of an audio data processing method according to an embodiment of the present application; [Figure 17] FIG. 2 is a schematic diagram of an audio data processing method according to an embodiment of the present application; [Figure 18] FIG. 11 is a diagram of the directivity of a dipole corresponding to a right channel in the audio data processing method according to an embodiment of the present application. [Figure 19] FIG. 3 is a schematic diagram of an audio data processing method according to an embodiment of the present application; [Figure 20] 1 is a schematic flowchart 1 of dual channel audio data processing according to an embodiment of the present application. [Figure 21]1 is a schematic flowchart 1 of multi-channel audio data processing according to an embodiment of the present application. [Figure 22] 2 is a schematic flowchart 2 of dual channel audio data processing according to an embodiment of the present application. [Diagram 23] 2 is a schematic flowchart 2 of multi-channel audio data processing according to an embodiment of the present application. [Figure 24] FIG. 4 is a schematic diagram of an audio data processing method according to an embodiment of the present application. [Figure 25(a)] FIG. 1 is a schematic diagram of a display effect in an audio data processing method according to an embodiment of the present application; [Figure 25(b)] FIG. 1 is a schematic diagram of a display effect in an audio data processing method according to an embodiment of the present application; [Figure 26(a)] FIG. 2 is a schematic diagram illustrating a display effect in the audio data processing method according to an embodiment of the present application; [Figure 26(b)] FIG. 2 is a schematic diagram illustrating a display effect in the audio data processing method according to an embodiment of the present application; [Figure 27] FIG. 5 is a schematic diagram of an audio data processing method according to an embodiment of the present application. [Figure 28] 3 is a schematic diagram 3 of a display effect in the audio data processing method according to an embodiment of the present application; [Figure 29] FIG. 4 is a schematic diagram of the display effect in the audio data processing method according to the embodiment of the present application; [Diagram 30] FIG. 2 is a schematic diagram of the networking of the sound box system according to an embodiment of the present application. [Diagram 31] FIG. 3 is a schematic diagram 3 of the structure of the full-frequency sound box according to an embodiment of the present application. [Diagram 32] FIG. 1 is a schematic diagram of a low-frequency sound box according to an embodiment of the present application; [Diagram 33] FIG. 2 is a schematic diagram of the structure of a terminal according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0127] The term "and / or" in this specification only describes an association relationship that describes related objects and indicates that three relationships may exist. For example, A and / or B may indicate three cases: only A exists, both A and B exist, and only B exists.

[0128] In the description and claims of the embodiments of the present application, terms such as "first", "second", etc. are intended to distinguish between different objects, rather than to describe a particular order of the objects. For example, a first fastening portion and a second fastening portion are used to distinguish between different parts, rather than to describe a particular order of the parts. A first audio data and a second audio data are used to distinguish between different audio data, rather than to describe a particular order of the audio data.

[0129] Furthermore, in the embodiments of the present application, terms such as "for example" or "example" are used to denote providing an example, illustration, or description. Any embodiment or design scheme described in the embodiments of the present application as "for example" or "for example" should not be described as preferred or having more advantages over other embodiments or design schemes. Indeed, the use of terms such as "for example" or "example" is intended to concretely present the relevant concept.

[0130] In describing the embodiments of the present application, unless otherwise stated, "plurality" means two or more. For example, a plurality of processing units is two or more processing units, and a plurality of systems is two or more systems.

[0131] As shown in Fig. 1, an embodiment of the present application provides an all-frequency sound box. The all-frequency sound box includes an all-frequency sound box body 101 and a first fastening part 102. The all-frequency sound box body has M speakers 1011, the M speakers 1011 are distributed in a plane in the all-frequency sound box body, and the M speakers 1101 form K pairs of acoustic dipoles, where M is a positive integer greater than 2, and K is a positive integer equal to or greater than 2. The first fastening part 102 is disposed in a pre-set fastening area of ​​the all-frequency sound box body 101, the first fastening part 102 is configured to physically connect to or separate from the low-frequency sound box, the first fastening part 102 has a first communication part 1021, the first communication part 1021 is configured to enable the all-frequency sound box to communicate with the low-frequency sound box, and the first communication part supports multi-channel audio data transmission. The low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box.

[0132] Please note that FIG. 1 is merely a schematic diagram of the position of the first fastening portion 102 and the first communication portion 1021, and does not limit other features such as the shape of the first fastening portion 102 and the first communication portion 1021.

[0133] In this embodiment of the present application, the full frequency sound box is configured to reproduce the target audio data, or alternatively, the full frequency sound box is configured to reproduce the high and / or mid frequency components of the target audio data and the low frequency sound box is configured to reproduce the low frequency components of the target audio data.

[0134] It should be noted that in this embodiment of the present application, the target audio data reproduced by using the speaker of the full-frequency sound box is the audio data obtained through the sound field widening process. For ease of description, the audio data that has not undergone the sound field widening process is called raw audio data, and the audio data obtained through the sound field widening process is called target audio data, that is, the target audio data is obtained by performing the sound field widening process on the raw audio data. It should be understood that both the raw audio data and the target audio data are audio data to be reproduced. That is, the audio data to be reproduced obtained by the full-frequency sound box or the low-frequency sound box may be the raw audio data (or components of different frequency bands of the raw audio data, for example, the mid-frequency components, the high-frequency components, or the low-frequency components), or may be the target audio data obtained by performing the sound field widening process on the raw audio data.

[0135] In this embodiment of the present application, when the audio data to be reproduced obtained by the full-frequency sound box is raw audio data (or the mid-frequency components and / or high-frequency components of the raw audio data), the full-frequency sound box performs sound field widening processing on the raw audio data (or the mid-frequency components and / or high-frequency components of the raw audio data). When the audio data to be reproduced obtained by the full-frequency sound box is target audio data (or the mid-frequency components and / or high-frequency components of the target audio data), the target audio data (or the mid-frequency components and / or high-frequency components of the target audio data) is obtained by performing frequency division (specifically, by using multi-band filtering technology) on the raw audio data and performing sound field widening processing on the components of different frequency bands of the raw audio data by other devices.

[0136] Similarly, when the audio data to be played obtained by the low-frequency sound box is raw audio data (or the low-frequency components of the raw audio data), the low-frequency sound box performs sound field widening processing on the raw audio data (or the low-frequency components of the raw audio data). When the audio data to be played obtained by the low-frequency sound box is the low-frequency components of the target audio data, the low-frequency components of the target audio data are obtained by another device performing frequency division (specifically, by using multi-band filtering technology) on the raw audio data and performing sound field widening processing on the components of different frequency bands of the raw audio data.

[0137] Optionally, the shape of the full-frequency sound box body is one of the following: ring, circle, tree, W-shape. The ring shape of the full-frequency sound box body shown in Fig. 1 is used as an example, not a limitation of the shape of the full-frequency sound box body. Indeed, when the M speakers constitute multiple pairs of acoustic dipoles, the shape of the full-frequency sound box body may alternatively be designed to be other shapes than ring, circle, tree, or W-shape. This is not limited in this embodiment of the present application.

[0138] Figure 2 is a schematic front view of the all-frequency sound box body in several shapes. Figure 2(a) is a ring-shaped all-frequency sound box (i.e., sound ring), and M speakers are arranged in a ring; Figure 2(b) is a circular all-frequency sound box, and M speakers are arranged on a circular surface; Figure 2(c) is a tree-shaped all-frequency sound box; and Figure 2(d) is a W-shaped all-frequency sound box. In this embodiment of the present application, M speakers are arranged on one plane of the all-frequency sound box body, that is, M speakers are on the same plane and face the same surface of the all-frequency speaker.

[0139] In this embodiment of the present application, the first fastening part is further configured to support the full-frequency soundbox body. For example, as shown in Fig. 3, when the full-frequency soundbox body is ring-shaped, the first fastening part can be used as a base to support the ring-shaped soundbox body, so that the ring-shaped soundbox body can be safely placed on a tabletop.

[0140] In this embodiment of the present application, the M speakers of the full-frequency sound box form K pairs of acoustic dipoles, and a pair of acoustic dipoles corresponds to a pair of acoustic speakers. For example, the ring-shaped full-frequency sound box shown in Fig. 2(a) includes eight speakers. Speaker 1 and Speaker 5 form a pair of acoustic dipoles, Speaker 2 and Speaker 4 form a pair of acoustic dipoles, Speaker 6 and Speaker 8 form a pair of acoustic dipoles, and Speaker 3 and Speaker 7 form a pair of acoustic dipoles.

[0141] It should be understood that the arrangement direction of the K pairs of acoustic dipoles formed by the speakers in the all-frequency sound box includes at least two of the following: horizontal, vertical, or diagonal upward. Specifically, the K pairs of acoustic dipoles include at least two of the following types of acoustic dipoles: acoustic dipoles in the horizontal direction, acoustic dipoles in the vertical direction, or acoustic dipoles in the diagonal upward direction. With reference to FIG. 3, the horizontal direction is a direction parallel to the vertical projection of the all-frequency sound box body, and the vertical direction is a direction perpendicular to the vertical projection of the all-frequency sound box body. For example, the all-frequency sound box is a ring-shaped all-frequency sound box shown in FIG. 2(a). In the ring-shaped all-frequency sound box, the speaker 1 and the speaker 5 form a pair of acoustic dipoles in the horizontal direction, and the speaker 3 and the speaker 7 form a pair of acoustic dipoles in the vertical direction.

[0142] In this embodiment of the present application, the included angles of the above preset directions, and the preset directions herein, may be understood as directions pointing to the sky at different angles (short for skyward direction). For example, the direction shown in FIG. 4(a) is an included angle between that direction and the first direction that is less than 180 degrees, and is a skyward direction. For example, in the ring-shaped full-frequency sound box shown in FIG. 4(b), The diagonal upward direction may include a number of different preset directions, and the included angle between the different preset directions and the horizontal direction is different. In this preset direction, the two speakers in the dashed box constitute an acoustic dipole in the sky direction. For ease of description, in this embodiment of the present application, the acoustic dipoles in the other preset directions are collectively referred to as an acoustic dipole in the sky direction.

[0143] In this embodiment of the present application, the target audio data reproduced by the full-frequency sound box is audio data obtained by performing sound field widening processing on the raw audio data. It should be noted that the audio data obtained through the sound field widening processing corresponds to the dipoles in different directions of the full-frequency sound box. For example, the speaker pair constituting the acoustic dipole in the horizontal direction is configured to reproduce the audio data obtained through the sound field widening processing in the horizontal direction, the speaker pair constituting the acoustic dipole in the vertical direction is configured to reproduce the audio data obtained through the sound field widening processing in the vertical direction, and the speaker pair constituting the acoustic dipole in the sky direction is configured to reproduce the audio data obtained through the sound field widening processing in the sky direction. Performing the sound field widening in the vertical direction and the sound field widening in other preset directions can improve the 3D effect of the audio data reproduction. In this embodiment of the present application, the sound field widening includes performing high-band dipole processing on the high-frequency components of the audio data, performing mid-band dipole processing on the mid-frequency components of the audio data, and performing bass enhancement processing on the low-frequency components of the audio data. Details will be described in detail in the following method embodiment.

[0144] Optionally, the number M of speakers included in the full-frequency sound box is not limited in this embodiment of the present application, and is specifically set according to practical requirements.For example, in some implementations, the full-frequency sound box provided in this embodiment of the present application includes 6 speakers or 8 speakers.

[0145] The full-frequency sound box provided in this embodiment of the present application has excellent reproduction effect for the mid-frequency and high-frequency components of audio data. One or more of the M speakers are full-frequency speakers, or one or more of the M speakers are mid- and high-frequency speakers. This is not limited in this embodiment of the present application. For example, the full-frequency sound box includes eight speakers, and all eight speakers may be full-frequency speakers, or four of the eight speakers are full-frequency speakers, and four speakers are mid- and high-frequency speakers.

[0146] In one implementation, the M speakers of the full frequency sound box provided in this embodiment of the present application configure K pairs of acoustic dipoles, where a pair of acoustic dipoles corresponds to a pair of speakers, and at least two pairs of acoustic dipoles among the K pairs of acoustic dipoles are as follows: d i ≠d j The condition is satisfied, and then, d i is the distance between the two loudspeakers that make up the i-th pair of acoustic dipoles, and d j is the distance between the two speaker pairs constituting the jth pair of acoustic dipoles, where i and j are each one of 1, 2, ..., K, where i ≠ j and K is a positive integer equal to or greater than 2. Furthermore, the two speakers constituting the ith pair of acoustic dipoles are configured to reproduce a first frequency band of the target audio data, and the two speaker pairs constituting the jth pair of acoustic dipoles are configured to reproduce a second frequency band of the target audio data, where the first frequency band and the second frequency band are different frequency bands.

[0147] The frequency band of audio data reproduced by a pair of speakers that constitute an acoustic dipole pair is related to the distance between the two speakers included in the pair. Specifically, the center frequency of audio data reproduced by the two speakers that constitute an acoustic dipole pair decreases as the distance between the speakers increases. i >d j In this case, the center frequency of the audio data that can be reproduced by the two speakers that make up the i-th pair of acoustic dipoles is smaller than the center frequency of the audio data that can be reproduced by the two speakers that make up the j-th pair of acoustic dipoles.

[0148] For example, the frequency band of audio data reproduced by the speaker pair constituting the i-th pair of acoustic dipoles may be from 600 Hz to 2600 Hz, and the frequency band of audio data reproduced by the speaker pair constituting the j-th pair of acoustic dipoles may be from 2600 Hz to 12 kHz. A speaker pair with a small distance has a good reproduction effect for high-band audio data.

[0149] In this embodiment of the present application, the speaker layout of the full-frequency sound box is adjusted so that the spacing between two speakers in the speaker pairs constituting multiple pairs of acoustic dipoles is the same or different. Audio data of different frequency bands can be reproduced by using the speaker pairs with different spacing, so that sound field effects of different frequency bands can be generated.

[0150] For example, Figure 5 shows two different layouts of speakers in a ring-shaped all-frequency sound box. As shown in Figure 5(a), the ring-shaped all-frequency sound box includes four pairs of acoustic dipoles in the horizontal direction with different intervals. Speaker 1 and Speaker 4 constitute the first pair of acoustic dipoles in the horizontal direction, Speaker 8 and Speaker 5 constitute the second pair of acoustic dipoles in the horizontal direction, Speaker 2 and Speaker 3 constitute the third pair of acoustic dipoles in the horizontal direction, and Speaker 7 and Speaker 6 constitute the fourth pair of acoustic dipoles in the horizontal direction. The ring-shaped all-frequency sound box shown in Figure 5(b) includes two pairs of acoustic dipoles in the horizontal direction and two pairs of acoustic dipoles in the vertical direction. Speakers 1 and 3 form a pair of acoustic dipoles in the horizontal direction that are far from each other, speakers 5 and 4 form a pair of acoustic dipoles in the horizontal direction that are close to each other, speakers 5 and 2 form a pair of sound field extensions in the vertical direction that are far from each other, and speakers 5 and 6 form a pair of acoustic dipoles in the vertical direction that are close to each other.

[0151] Based on the description of the above embodiment, as the distance between the two speakers included in a speaker pair increases, the center frequency of the audio data reproduced by the speaker pair decreases; therefore, referring to FIG. 5(a), the center frequencies of the audio data reproduced by the four speaker pairs constituting the four pairs of acoustic dipoles in the horizontal direction increase sequentially, that is, the center frequency of the audio data corresponding to the first pair of acoustic dipoles in the horizontal direction is the lowest, the center frequency of the audio data corresponding to the second pair of acoustic dipoles in the horizontal direction is higher than the center frequency of the audio data corresponding to the first pair of acoustic dipoles in the horizontal direction, the center frequency of the audio data corresponding to the third pair of acoustic dipoles in the horizontal direction is higher than the center frequency of the audio data corresponding to the second pair of acoustic dipoles in the horizontal direction, and the center frequency of the audio data corresponding to the fourth pair of acoustic dipoles in the horizontal direction is high.

[0152] Optionally, in this embodiment of the present application, one speaker may be shared by one or more pairs of acoustic dipoles. For example, referring to FIG. 4(b), speaker 5 and speaker 4 form a pair of acoustic dipoles in the horizontal direction, speaker 5 and speaker 2 form a pair of acoustic dipoles in the vertical direction, and speaker 5 and speaker 6 form another pair of acoustic dipoles in the vertical direction. It can be seen that speaker 5 is shared by multiple pairs of acoustic dipoles.

[0153] Optionally, in this embodiment of the present application, a passive film is placed on at least one speaker of the M speakers of the full-frequency sound box, and the passive film is configured to widen the low-frequency response of the speaker. In an implementation, each of the at least one speaker corresponds to one passive film. As shown in FIG. 6(a), the passive film is attached to the back of the cavity of the speaker, and 601 in the figure represents the passive film. The passive film is placed on the back of the cavity of the speaker, and the passive film and the cavity in the box body form an air spring whose resonant frequency is lower than the resonant frequency of the speaker. The speaker pushes the air spring to resonate at the resonant frequency. This can widen the low-frequency response of the speaker (e.g., increase the range, energy, and amplitude of the low-frequency response) and improve the bass quality of the full-frequency sound box. In another implementation, each of the at least one speaker corresponds to two passive films. As shown in Fig. 6(b), two passive films are respectively located on both sides of the speaker cavity, and 602 and 603 in the figure represent the two passive films. The passive films are arranged on both sides of the speaker cavity so as to further expand the effective resonance area of ​​the passive film, and further greatly improve the bass quality of the full-frequency sound box. Please note that Fig. 6 is only a schematic diagram of the position of the passive films.

[0154] Optionally, the all-frequency sound box provided in this embodiment of the present application further comprises N speakers (N is a positive integer and N is less than or equal to M), the N speakers are respectively arranged back-to-back with N speakers of the M speakers to form N back-to-back speaker pairs. The M speakers face a first plane and the N speakers face a second plane, the first plane and the second plane are two planes perpendicular to the vertical projection of the all-frequency sound box, and the first plane is parallel to the second plane. Alternatively, the N speakers are respectively arranged facing N speakers of the M speakers to form N facing speaker pairs. The cavities of the M speakers face a first plane and the cavities of the N speakers face a second plane, the first plane and the second plane are two planes perpendicular to the vertical projection of the all-frequency sound box, and the first plane is parallel to the second plane. Correspondingly, the N speakers are also on the same plane. For example, one speaker pair is used as an example. Figure 7(a) is a schematic diagram of two facing speakers, and Figure 7(b) is a schematic diagram of two back-to-back speakers.

[0155] In this embodiment of the present application, the two speakers of each pair of N back-to-back speaker pairs share one cavity. In implementation, a passive film is placed in the cavity of at least one speaker pair of the N back-to-back speaker pairs. One speaker pair of the at least one speaker pair corresponds to two passive films. It is used as one speaker. The two passive films corresponding to a speaker pair are back-to-back and are attached to the two sides adjacent to the speaker pair in the cavity, respectively. For example, 701 and 702 in FIG. 7(b) represent two passive films.

[0156] Optionally, the first fastening portion may be a first sheet-like portion connected to the full-frequency soundbox body, the first sheet-like portion configured to physically connect to or separate from the second sheet-like portion of the low-frequency soundbox body. Alternatively, the first fastening portion is a recess located in a preset fastening area of ​​the full-frequency soundbox, the recess configured to physically connect to or separate from the protrusion of the low-frequency soundbox body.

[0157] According to the full-frequency sound box provided in this embodiment of the present application, the M speakers included in the full-frequency sound box constitute multiple pairs of acoustic dipoles, so that the audio data obtained through the sound field expansion process (i.e., the target audio data) can be reproduced by using the full-frequency sound box to achieve a good sound field expansion effect and improve the sound quality. Furthermore, after the first fastening part of the full-frequency sound box is connected to the low-frequency sound box, the full-frequency sound box and the low-frequency sound box are used in a combined form to reproduce the audio data. This can greatly improve the reproduction effect of the audio data. Furthermore, the user can flexibly choose to reproduce the audio data by using the full-frequency sound box, or to reproduce the audio data by using the full-frequency sound box and the low-frequency sound box. This can satisfy various requirements of users.

[0158] An embodiment of the present application provides a low-frequency sound box. As shown in FIG. 8, the low-frequency sound box includes a low-frequency sound box body 801 and a second fastening part 802. The low-frequency sound box body includes one or more low-frequency speakers 8011. The second fastening part 802 is located in a preset fastening area of ​​the low-frequency sound box body, and the second fastening part 802 is configured to physically connect to or separate from the full-frequency sound box, and the second fastening part 802 includes a second communication part 8021. The second communication part 8021 is configured to enable the low-frequency sound box to communicate with the full-frequency sound box, and the second communication part supports multi-channel audio data transmission. The low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, and the frequency band range of the full-frequency sound box is wider than the frequency band range of the low-frequency sound box.

[0159] Please note that FIG. 8 is merely a schematic diagram of the position of the second fastening portion 802 and the second communication portion 8021, and does not limit other features such as the shape of the second fastening portion 802 and the second communication portion 8021.

[0160] The low frequency sound box is configured to reproduce low frequency components of the target audio data, the full frequency sound box is configured to reproduce the target audio data or high and / or mid frequency components of the target audio data, similarly the target audio data is audio data obtained through a sound field widening process.

[0161] Optionally, the shape of the low-frequency sound box body may be a flat cylinder, a long cylinder, a cube, a rectangular parallelepiped, or other shapes. This is not limited in this embodiment of the present application. Please note that Figure 8 is merely a schematic diagram in which a flat cylinder is used as the low-frequency sound box, rather than limiting the specific shapes and other features of the low-frequency sound box and the first communication unit.

[0162] Optionally, the second fastening portion is a second sheet-like portion connected to the low frequency sound box body, the second sheet-like portion is configured to physically connect to or separate from the first sheet-like portion of the full frequency sound box body. Alternatively, the second fastening portion is a protrusion disposed in a preset fastening area of ​​the low frequency sound box body, the protrusion is configured to physically connect to or separate from the recess of the full frequency sound box body.

[0163] Optionally, the low-frequency sound box further includes a charging port, which is configured to connect to an external power source to supply power to the low-frequency sound box, or to charge the full-frequency sound box by using the low-frequency sound box when the low-frequency sound box is connected to the full-frequency sound box. Specifically, the first communication unit is connected to the second communication unit after the first fastening unit is connected to the second fastening unit, so that the low-frequency sound box charges the full-frequency sound box.

[0164] Optionally, the low frequency sound box provided in this embodiment of the present application further includes a camera and a microphone. The camera is configured to capture an image of a user (listener) so as to determine the user's position based on the image of the user. Similarly, the microphone is configured to capture a user's acoustic signal so as to determine the user's position based on the user's acoustic signal.

[0165] According to the low frequency sound box provided in this embodiment of the present application, one or more speakers of the low frequency sound box reproduce low frequency components of audio data. This can improve the bass quality of the audio data. Furthermore, the low frequency sound box may be connected to the full frequency sound box by using the second communication unit, and used together with the full frequency sound box in a combined form. The low frequency sound box sends the mid frequency components and / or high frequency components of the audio data obtained through the sound field expansion processing to the full frequency sound box, and the full frequency sound box reproduces the audio data. The full frequency sound box and the low frequency sound box are used in cooperation. This can improve the audio reproduction effect. Furthermore, the user may choose to reproduce the audio data by using the full frequency sound box, or to reproduce the audio data by using the full frequency sound box and the low frequency sound box. This can satisfy various requirements of the user.

[0166] The embodiment of the present application provides a sound box system. As shown in Fig. 9, the sound box system includes a full-frequency sound box 901 and a low-frequency sound box 902. The full-frequency sound box 901 is the full-frequency sound box described in the above embodiment. The low-frequency sound box 902 is the low-frequency sound box described in the above embodiment. For the structure description of the full-frequency sound box 901 and the low-frequency sound box 902, please refer to the above embodiment. Details will not be described again here.

[0167] It can be understood that the full-frequency sound box 901 is physically connected to the low-frequency sound box 902 by using a first fastening part and a second fastening part, and the first fastening part and the second fastening part are a group of paired connections. From the above embodiment, it can be seen that the first fastening part includes a first communication part, the second fastening part includes a second communication part, and the first communication part is connected to the second communication part after the first fastening part is physically connected to the second fastening part. In this way, the full-frequency sound box 901 can communicate with the low-frequency sound box 902, and the first communication part and the second communication part are a group of paired communication parts (for example, transmitting audio data or control signaling), or the low-frequency sound box charges the full-frequency sound box (it should be noted that when the low-frequency sound box charges the full-frequency sound box, the low-frequency sound box is connected to a power source).

[0168] Please note that Fig. 8 is only a schematic diagram of a possible configuration of the sound box system. In Fig. 8, the full-frequency sound box is ring-shaped, the low-frequency sound box is flat cylindrical, and the full-frequency sound box is connected to the low-frequency sound box in a stacking mode. In Fig. 8, the first fastening part, the second fastening part, the first communication part, and the second communication part cannot be seen because the full-frequency sound box and the low-frequency sound box are in a connected state. Optionally, the full-frequency sound box and the low-frequency sound box may each take other shapes. The mode of connection between the full-frequency sound box and the low-frequency sound box may alternatively be in other connection modes. This is not limited in this embodiment of the present application.

[0169] The full-frequency sound box 901 is configured to play the target audio data or play the high-frequency and / or mid-frequency components of the target audio data. The low-frequency sound box 902 is configured to play the low-frequency components of the target audio data, and the low-frequency playing effect of the low-frequency sound box is better than that of the full-frequency sound box, and the frequency band range of the full-frequency sound box is wider than that of the low-frequency sound box.

[0170] Optionally, the full frequency sound box is connected to the low frequency sound box in a stacked or attached mode by using a first fastener and a second fastener.

[0171] In practice, as shown in FIG. 10(a), when the first fastening portion is a first sheet-like portion 1001 connected to the full-frequency sound box body, and the second fastening portion is a second sheet-like portion 1002 connected to the low-frequency sound box body, and the first sheet-like portion is in contact with and coupled to the second sheet-like portion, the full-frequency sound box is connected to the low-frequency sound box in stacking mode. Specifically, the first sheet-like portion 1001 includes a first communication portion 1001a, and the first communication portion 1001a is located in the vertical projection of the full-frequency sound box body. The second sheet-like portion 1002 is located on the low-frequency sound box body, and the second sheet-like portion 1002 includes a second communication portion 1002a. The second communication portion 1002a is disposed on the second sheet-like portion 1002, whereby the full-frequency sound box is connected to the low-frequency sound box in stacking mode. FIG. 10(b) is a schematic diagram of the effect of connecting a full frequency sound box to a low frequency sound box in a stacked mode.

[0172] Optionally, a first sheet-like portion 1001 The second sheet-like portion is connected to the second sheet-like portion in a buckle connection or magnetic connection mode. 1002 Indeed, the first sheet-like portion 1001Alternatively, the second sheet-like portion may be formed in another operable manner. 1002 This is not a limitation in this embodiment of the present application.

[0173] In another implementation, as shown in Fig. 11(a), the first fastening portion is a first sheet-like portion 1101 extending outward along one side of the full-frequency sound box body, and the second fastening portion is a second sheet-like portion 1002 extending outward along one side of the low-frequency sound box body, and when the first sheet-like portion 1101 is in contact with and coupled to the second sheet-like portion 1102, the full-frequency sound box is connected to the low-frequency sound box in the attachment mode. Specifically, the first sheet-like portion 1101 includes a first communication portion 1101a, which is located outside the vertical projection of the full-frequency sound box body, and the second sheet-like portion 1102 includes a second communication portion 1102a, which is located outside the vertical projection of the low-frequency sound box body. Fig. 11(b) is a schematic diagram of the effect of connecting the full-frequency sound box to the low-frequency sound box in the attachment mode.

[0174] Referring to the above two modes of connecting the full-frequency sound box to the low-frequency sound box, the first fastening part is connected to the full-frequency sound box body, and the first fastening part includes a first communication part. When the first communication part is located within the vertical projection of the full-frequency sound box body, for example, Fig. 12(a) to Fig. 12(c), and the second fastening part is located on the low-frequency sound box body, the full-frequency sound box is connected to the low-frequency sound box in the stacking mode. When the first communication part is located outside the vertical projection of the full-frequency sound box body, for example, Fig. 12(d), and the second fastening part is located outside the vertical projection of the low-frequency sound box body, the full-frequency sound box is connected to the low-frequency sound box in the mounting mode.

[0175] In yet another embodiment, as shown in Fig. 13(a), the first fastening portion is a recess 1301 arranged on a preset fastening area of ​​the full frequency sound box body, and the second fastening portion is a protrusion 1302 arranged on a preset fastening area of ​​the low frequency sound box body, and when the recess 1301 contacts and couples with the protrusion 1302, the full frequency sound box is connected to the low frequency sound box in stacking mode. Fig. 13(b) is a schematic diagram of the effect of connecting the full frequency sound box to the low frequency sound box in stacking mode.

[0176] Optionally, the recess 1301 may be connected to the protrusion 1302 in a buckle-connecting mode, a screw-connecting mode, or other feasible manner, which is not limited in this embodiment of the present application.

[0177] In summary, optionally, the first communication part is a magnetically attracted female connector of a magnetically attracted interface, and the second communication part is a magnetically attracted male connector of a magnetically attracted interface. Alternatively, the first communication part is a plug of a USB interface, and the second communication part is a socket of a USB interface. Alternatively, the first communication part and the second communication part may be other communication parts having a matching relationship and a removable mechanism. This is not limited in this embodiment of the present application.

[0178] Optionally, the sound box system provided in this embodiment of the present application further includes at least one full-frequency sound box, and the structure of the at least one full-frequency sound box is the same as the structure of the full-frequency sound box in the above embodiment.The at least one full-frequency sound box and the one full-frequency sound box in the sound box system constitute at least two full-frequency sound boxes in the sound box system, and the at least two full-frequency sound boxes included in the sound box system can cooperate with each other.The manner in which the at least two full-frequency sound boxes cooperate with each other will be described in detail in the following embodiment.

[0179] Optionally, the sound box system provided in this embodiment of the present application further includes at least one full-frequency sound box and at least one low-frequency sound box. In the sound box system, one full-frequency sound box includes: No. In this case, the sound box system includes at least two Sound Box Contains at least two subsystems Sound Box Subsystems may cooperate. At least two No. The manner in which the roundbox subsystems work together is described in detail in the following embodiments.

[0180] In this embodiment of the present application, the full-frequency sound box is small in size, light in weight, and easy to carry. For example, the ring-shaped full-frequency sound box has a diameter of about 25 centimeters (cm), a thickness of about 3 centimeters, and a weight of less than 500 grams. Compared with the full-frequency sound box, the low-frequency sound box has a slightly larger size and a larger weight. For example, the flat cylindrical low-frequency sound box has a bottom diameter of about 30 cm, a height of about 10 cm, and a weight of more than 2000 grams.

[0181] According to the sound box system provided in this embodiment of the present application, the full-frequency sound box of the sound box system can work independently, or the full-frequency sound box and the low-frequency sound box work together. Therefore, users can flexibly choose to play audio data by using the full-frequency sound box, or play audio data by using the full-frequency sound box and the low-frequency sound box. This can satisfy different demands of users.

[0182] Furthermore, when the full-frequency sound box works independently, reproducing the mid-frequency or high-frequency components of the target audio data by using the full-frequency sound box can improve the sound quality because the full-frequency sound box has a good reproducing effect on mid-frequency and high-frequency. When the full-frequency sound box and the low-frequency sound box work together, reproducing the low-frequency components of the target audio data by using the low-frequency sound box can improve the bass quality of the audio data because the low-frequency reproducing effect of the low-frequency sound box is better than that of the full-frequency sound box. Furthermore, reproducing the mid-frequency and / or high-frequency components of the target audio data by using the full-frequency sound box can improve the reproducing effect of the mid-frequency and / or high-frequency components of the target audio data because the full-frequency sound box has a good reproducing effect on mid-frequency and high-frequency. In this way, the reproducing effect of the audio data can be improved in the full frequency band of the audio data.

[0183] The following describes separately the hardware structures of the full-frequency sound box and the low-frequency sound box included in the sound box system provided in the embodiment of the present application.

[0184] 14 is a schematic diagram of the hardware structure of a full-frequency sound box according to an embodiment of the present application. As shown in FIG. 14, the full-frequency sound box includes a processor 1401, one or more speakers 1402, one or more digital-to-analog conversion modules 1403, one or more power amplifiers 1404, a communication module 1405, a power supply 1406, and a connection module 1407, where the digital-to-analog conversion module 1403 and the power amplifier 1404 correspond to the speaker 1402.

[0185] The processor 1401 is the core control and processing unit of the full frequency sound box, and has functions such as signal flow control and processing, etc. For example, the processor 1401 processes audio data.

[0186] The one or more speakers 1402 are full-frequency soundbox playback devices and are configured to play audio data processed by the processor 1401. Optionally, the one or more speakers 1402 may be full-frequency speakers, and the one or more speakers 1402 Some of them may be mid- and high-frequency speakers, which is not particularly limited in this embodiment of the present application.

[0187] One or more digital-to-analog conversion modules 1403 are configured to convert the audio data processed by the processor 1401 from a digital signal format to an analog signal format.

[0188] The one or more power amplifiers 1404 are configured to amplify the power of the audio signal in analog signal form, and then the one or more speakers 1402 reproduce the audio data.

[0189] The communication module 1405 is configured to assist the full-frequency sound box to communicate with other devices. For example, the communication module 1405 may be a Bluetooth module. The Bluetooth module is used to establish communication between the full-frequency sound box and a mobile phone to transmit audio data. The communication module 1405 may be a transceiver.

[0190] The power supply 1406 is configured to provide power to the full frequency sound box, and the power supply 1406 may be a battery.

[0191] The connection module 1407 is configured to detachably connect the full-frequency sound box to the low-frequency sound box. A contactable connection between the full-frequency sound box and the low-frequency sound box is implemented by using the connection module 1407 to implement communication between the full-frequency sound box and the low-frequency sound box or to charge the full-frequency sound box. The connection module 1407 includes a communication unit, which may be a USB interface or a magnetic attraction interface. The transceiver of the full-frequency sound box may send audio data to the low-frequency sound box by using the communication unit.

[0192] Optionally, the full frequency sound box provided in this embodiment of the present application may further include an analog audio interface 1408. The analog audio interface 1408 is configured to receive or transmit analog audio signals.

[0193] 15 is a schematic diagram of the hardware structure of a low-frequency sound box according to an embodiment of the present application. As shown in FIG. 15, the low-frequency sound box includes a processor 1501, one or more low-frequency speakers 1502, one or more digital-to-analog conversion modules 1503, one or more power amplifiers 1504, a communication module 1505, a power supply 1506, and a connection module 1507, where the digital-to-analog conversion module 1503 and the power amplifier 1504 correspond to the low-frequency speaker 1502.

[0194] The processor 1501 is the core control and processing unit of the entire full-frequency sound box (including the full-frequency sound box and the low-frequency sound box), and has functions such as signal flow control and processing. In addition, compared with the processor 1401 of the full-frequency sound box, the processor 1501 of the low-frequency sound box has stronger calculation and storage capabilities and calculation resources.

[0195] The one or more speakers 1502 are bass reproduction devices and are configured to reproduce low frequency components of the audio data processed by the processor 1501 .

[0196] One or more digital-to-analog conversion modules 1503 are configured to convert the audio data processed by the processor 1501 from a digital signal format to an analog signal format.

[0197] The one or more power amplifiers 1504 are configured to amplify the power of the audio signal in analog signal form, and then the one or more speakers 1502 reproduce the audio data.

[0198] The communication module 1505 is low The frequency sound box is configured to assist in communicating with other devices. For example, the communication module 1505 may include: low Used to establish a connection between the frequency sound box and the mobile phone to transmit audio data. Communication module 1505 may be a transceiver. Optionally, the communication module 1505 may be a Bluetooth module or a Wi-Fi module, which is not limited in this embodiment of the present application.

[0199] Power supply 1506 is a wired power supply that provides power to the low frequency sound box and the full frequency sound box.

[0200] The connection module 1507 is configured to detachably connect the low frequency sound box to the full frequency sound box. The contactable connection between the full frequency sound box and the low frequency sound box is implemented by using the connection module 1507 to implement communication between the full frequency sound box and the low frequency sound box or to charge the full frequency sound box. The connection module 1507 includes a communication unit, which may be a USB interface or a magnetic attraction interface. The transceiver of the low frequency sound box may send audio data to the full frequency sound box by using the communication unit.

[0201] Optionally, the low-frequency sound box provided in this embodiment of the present application may further include other expandable units, for example, the low-frequency sound box further includes a camera or a microphone array.

[0202] Based on the full-frequency sound box and the low-frequency sound box in the sound box system in the above embodiment, an embodiment of the present application provides an audio data processing method. As shown in Figure 16, the method includes steps 1601 to 1603.

[0203] Step 1601: The terminal detects whether the first communication unit of the full-frequency sound box is connected to the second communication unit of the low-frequency sound box.

[0204] Based on the description of the above embodiment, the full-frequency sound box includes a first fastening part, and the first communication part is disposed on the first fastening part. The low-frequency sound box includes a second fastening part, and the second communication part is disposed on the second fastening part. The full-frequency sound box is physically connected to or separated from the low-frequency sound box by using the first fastening part and the second fastening part. The full-frequency sound box can communicate with the low-frequency sound box when the first communication part is connected to the second communication part. Furthermore, the first communication part and the second communication part support multi-channel audio data transmission, the low-frequency sound box's low-frequency reproduction effect is better than that of the full-frequency sound box, and the frequency band range of the full-frequency sound box is wider than that of the low-frequency sound box.

[0205] For relevant descriptions of the structures of the full-frequency sound box and the low-frequency sound box, please refer to the relevant contents in the above embodiments.

[0206] Optionally, the terminal may detect whether the first communication unit is connected to the second communication unit through interaction with the full-frequency sound box. For example, the terminal obtains from the full-frequency sound box status information of a first port of the full-frequency sound box corresponding to the first communication unit, and determines whether the first communication unit is connected to the second communication unit based on the status information of the first port. The status information of the first port is "0" if the first communication unit is not connected to the second communication unit. In this case, after obtaining the status "0", the terminal determines that the first communication unit is not connected to the second communication unit. If the first communication unit is connected to the second communication unit, the status information of the first port is "1". In this case, after obtaining the status "1", the terminal determines that the first communication unit is connected to the second communication unit.

[0207] It should be noted that the terminal may alternatively detect whether the first communication unit is connected to the second communication unit by using other possible methods, which are not limited in this embodiment of the present application.

[0208] Step 1602: If the terminal finds through detection that the first communication unit is not connected to the second communication unit, the terminal sends the audio data to be played to the full-frequency sound box.

[0209] With reference to the description of the audio data to be played in the above embodiment, it can be seen that the audio data to be played can be raw audio data or target audio data. In this way, the terminal sending the audio data to be played to the full frequency sound box may include the following two cases:

[0210] Case 1: The device sends raw audio data to the full frequency sound box.

[0211] It should be understood that when the terminal sends raw audio data to the full-frequency sound box, the full-frequency sound box performs frequency division on the original data and performs sound field expansion processing on the components of different frequency bands to obtain target audio data, and plays the target audio data.

[0212] Case 2: The terminal sends the target audio data to the full-frequency sound box.

[0213] When the terminal sends target audio data to the full-frequency sound box, the full-frequency sound box may be obtained by performing frequency division and sound field expansion processing on the raw audio data by another device, and then sent to the full-frequency sound box. Then the full-frequency sound box plays the target audio data. The other device may be the terminal, the low-frequency sound box, or other devices other than those two devices. This is not limited in this embodiment of the present application.

[0214] Step 1603: If the terminal finds through detection that the first communication unit is connected to the second communication unit, the terminal transmits audio data in one of the following ways in steps 1603a to 1603c.

[0215] Step 1603a: The terminal sends the first audio data to the full-frequency sound box, and sends the second audio data to the low-frequency sound box.

[0216] The first audio data is the mid-frequency and / or high-frequency components of the audio data to be reproduced, and the second audio data is the low-frequency components of the audio data to be reproduced.

[0217] Similarly, the terminal may send audio data to the full-frequency sound box and the low-frequency sound box in several cases, including the following:

[0218] Case 1: The terminal sends the mid-frequency and / or high-frequency components of the raw audio data to the full-frequency sound box, and sends the low-frequency components of the raw audio data to the low-frequency sound box.

[0219] Optionally, the terminal performs frequency division on the raw audio data to obtain the mid-frequency components and / or high-frequency components and the low-frequency components of the raw audio data, and then the terminal sends the mid-frequency components and / or high-frequency components of the raw audio data to the full-frequency sound box, and the full-frequency sound box performs sound field expansion processing on the mid-frequency components and / or high-frequency components of the original data to obtain the mid-frequency components and / or high-frequency components of the target audio data.Furthermore, the terminal sends the low-frequency components of the raw audio data to the low-frequency sound box, and the low-frequency sound box performs sound field expansion processing on the low-frequency components of the raw audio data to obtain the low-frequency components of the target audio data, and the low-frequency sound box reproduces the low-frequency components of the target audio data.

[0220] Case 2: The terminal sends the mid-frequency components and / or high-frequency components of the target audio data to the full-frequency sound box, and sends the low-frequency components of the target audio data to the low-frequency sound box.

[0221] Optionally, the terminal or other device performs frequency division of the raw audio data, performs sound field widening processing on the mid-frequency and / or high-frequency components and low-frequency components obtained through frequency division, sends the mid-frequency and / or high-frequency components of the target audio data to the full-frequency sound box, and sends the low-frequency components of the target audio data to the low-frequency sound box. Then, the full-frequency sound box reproduces the mid-frequency and / or high-frequency components of the target audio data, and the low-frequency sound box reproduces the low-frequency components of the target audio data.

[0222] Step 1603b: The terminal sends the audio data to be played to the full frequency sound box.

[0223] There are also two cases when the terminal sends audio data to be played to the full frequency sound box. For details, please refer to step 1602 above. The details will not be described again here.

[0224] It should be noted that when the audio data to be played sent by the terminal to the full-frequency sound box is raw audio data, the full-frequency sound box performs frequency division on the raw audio data, and also performs sound field expansion processing to obtain the target audio data.

[0225] Optionally, after the full-frequency sound box obtains the target audio data, the way of playing the target audio data includes the following two ways:

[0226] Method 1: Full frequency sound box plays the target audio data.

[0227] Method 2: The full frequency sound box plays the mid-frequency and / or high-frequency components of the target audio data, and the full frequency sound box sends the low-frequency components of the target audio data to the low-frequency sound box, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0228] Step 1603c: The terminal sends the audio data to be played to the low frequency sound box.

[0229] The terminal sending audio data to be played to the low frequency sound box may include the following two cases:

[0230] Case 1: The device sends raw audio data to the low frequency sound box.

[0231] It should be understood that when the terminal sends raw audio data to the low-frequency sound box, the low-frequency sound box performs frequency division on the original data and performs sound field expansion processing on the components of different frequency bands to obtain target audio data. Then, the low-frequency sound box plays the low-frequency components of the target audio data, and sends the mid-frequency and / or high-frequency components of the target audio data to the full-frequency sound box, and the full-frequency sound box plays the mid-frequency and / or high-frequency components.

[0232] Case 2: The terminal sends the target audio data to the low-frequency sound box.

[0233] It should be understood that when the terminal sends the target audio data to the low-frequency sound box, the target audio data may be obtained by performing frequency division and sound field expansion processing on the raw audio data by other devices, and then sent to the low-frequency sound box. Then, the low-frequency sound box plays the low-frequency components of the target audio data, and the low-frequency sound box sends the mid-frequency components and / or high-frequency components of the target audio data to the full-frequency sound box, and the full-frequency sound box plays the mid-frequency components and / or high-frequency components. do .

[0234] According to the audio data processing method provided in this embodiment of the present application, the terminal determines to send audio data to the full-frequency sound box and / or the low-frequency sound box by detecting whether the first communication unit of the full-frequency sound box of the terminal is connected to the second communication unit of the low-frequency sound box, so that the full-frequency sound box processes the audio data and / or the low-frequency sound box processes the audio data, which achieves a good sound field widening effect and improves the sound quality.

[0235] As shown in Figure 17, an embodiment of the present application provides an audio data processing method. The method is applied to the above full frequency sound box, and includes steps 1701 to 1704.

[0236] Step 1701: The full frequency sound box obtains the audio data to be played.

[0237] It should be understood that the audio data to be played is raw audio data. Optionally, the audio data to be played may be audio data received by the full-frequency sound box from a terminal, or audio data obtained by the full-frequency sound box from other devices. This is not limited in this embodiment of the present application.

[0238] Step 1702: The full frequency sound box performs multi-band filtering on the acquired to-be-played audio data to obtain mid-frequency components and / or high-frequency components and low-frequency components of the to-be-played audio data.

[0239] Optionally, in this embodiment of the present application, the multi-band filtering may include high-frequency filtering, band-pass filtering, and low-frequency filtering, and / or the multi-band filtering includes high-frequency filtering and low-frequency filtering, it should be understood that the high-frequency filtering is performed on the audio data to obtain high-frequency components of the audio data, the band-pass filtering is performed on the audio data to obtain mid-frequency components of the audio data, and the low-frequency filtering is performed on the audio data to obtain low-frequency components of the audio data.

[0240] It should be noted that in this embodiment of the present application, when multi-band filtering is performed on the audio data, the setting of the filtering frequency band is related to the distance between the two speakers of the speaker pair that constitutes a dipole in the full frequency sound box. The filtering frequency band determines the frequency bands that correspond to the filtered high, mid and low frequency components.

[0241] Step 1703: The full frequency sound box performs sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back to obtain target audio data.

[0242] Step 1703 includes step 1703a and step 1703b.

[0243] Step 1703a: The full frequency soundbox performs high-band dipole processing on the high frequency components of the filtered audio data, and / or performs mid-band dipole processing on the mid frequency components of the filtered audio data.

[0244] It can be understood that there is a sweet point area in the sound field of the speaker of the full-frequency sound box. The sweet point area is the area where good sound effect can be achieved. Generally, the sweet point area is the area that is off the middle of the full-frequency sound box by a preset angle. The user (or listener) has a desirable listening experience when the user is located in the sweet point area. When the user is away from the sweet point area (for example, the included angle between the user and the center of the full-frequency sound box is larger than the preset angle), binaural crosstalk will occur. As a result, the user's listening experience will be poor.

[0245] In this embodiment of the present application, a pair of acoustic dipoles corresponds to a pair of speakers, and signals with the same amplitude but different phases are reproduced by using a pair of speakers. The horizontal direction is used as an example. The right channel corresponds to one acoustic dipole, and the left channel corresponds to one acoustic dipole. For example, when the right channel signal has a large energy when it arrives at the user's left ear, crosstalk occurs between the left and right ears, that is, the right channel signal interferes with the left ear. As a result, the sound field is narrowed. The crosstalk between the left and right ears is small when the energy of the right channel signal is small when it arrives at the user's left ear.

[0246] In this embodiment of the present application, the sound field widening process is performed on the high frequency components of the audio data according to a high band dipole algorithm, and the sound field widening process is performed on the mid frequency components of the audio data according to a mid band dipole algorithm. For the right channel signal, it is ensured that the energy of the right channel signal is not reduced when it arrives at the right ear, while the energy of the right channel signal can be reduced when it arrives at the left ear, while it is ensured that the energy of the left channel signal is not reduced when it arrives at the left ear, while the energy of the left channel signal can be reduced when it arrives at the right ear. In this way, the binaural crosstalk is cancelled. In this embodiment of the present application, if the energy of the right channel signal is smaller when it arrives at the left ear of the user, the energy of the right channel signal is larger when it arrives at the right ear of the user. In this case, a better binaural crosstalk cancellation effect is achieved. Similarly, if the energy of the left channel signal is smaller when it arrives at the right ear, the energy of the left channel signal is larger when it arrives at the left ear. In this case, a better binaural crosstalk cancellation effect is achieved.

[0247] The directivity of the dipole changes after processing is performed according to the dipole algorithm. Figure 18 is a directivity diagram of a dipole corresponding to the right channel. The crosstalk cancellation effect can be further displayed by using the directivity diagram of the dipole. The directivity diagram of the acoustic dipole corresponding to the right channel can be expressed according to the following formula:

number

[0248] FIG. 18(a) is used as an example. Note that the angle on the circumference is φ (0 degrees to 360 degrees), and different circumferences correspond to different energies (e.g., 0.5, 1, 1.5, and 2). FIG. 18(a) is a directional diagram of a diode corresponding to the case where θ is 0 degrees. Referring to the directional diagram, it can be seen that the energy of the right channel signal when arriving at the left ear is small, and the energy of the right channel signal when arriving at the right ear is large. Specifically, in FIG. 18(a), the user is located in front of the full-frequency sound box (in the 270-degree direction). When the included angle between the user's left ear and the center of the full-frequency sound box is 30 degrees, the 240-degree direction in the diagram is the direction in which the user's left ear is located. In this case, the corresponding θ is 0 degrees. The energy of the right channel signal when arriving at the left ear is small at about 240 degrees, and the energy of the right channel signal when arriving at the right ear is about 300 It can be seen that it is larger in degrees.

[0249] Figure 18(b) is a diagram of the diode's directivity when θ is 30 degrees, and Figure 18(c) is a diagram of the diode's directivity when θ is -30 degrees. Similarly, in this case, the right channel signal has less energy when it arrives at the left ear, and more energy when it arrives at the right ear.

[0250] Optionally, one frequency band corresponds to one or more pairs of acoustic dipoles. For example, the high frequency band corresponds to multiple pairs of acoustic dipoles. In this way, after being processed according to the high band dipole algorithm, the high frequency components obtained through high frequency filtering are reproduced by using speakers corresponding to multiple pairs of dipoles.

[0251] Step 1703b: Perform bass enhancement processing on the low frequency components of the filtered audio data.

[0252] In this embodiment of the present application, the low frequency components of the filtered audio data are processed according to a bass enhancement algorithm. In this way, the energy of the low frequency signal (i.e., the low frequency components) is dynamically increased without damaging the speaker (without exceeding the maximum displacement of the diaphragm), so that the bass quality of the audio data is greatly improved.

[0253] It should be understood that according to the bass enhancement algorithm, the parameters of the speaker (TS parameters) are obtained in advance, and modeling is performed based on the parameters of the speaker to obtain a processing model. For details, please refer to existing methods. The details will not be described in this embodiment of the present application.

[0254] Optionally, after processing the raw audio data, the full-frequency sound box obtains target audio data (specifically including mid-frequency components and / or high-frequency components and low-frequency components of the target audio data), and the mid-frequency components and / or high-frequency components of the target audio data are reproduced by the full-frequency sound box.

[0255] Step 1704: The full frequency sound box sends the low frequency components of the target audio data to the low frequency sound box.

[0256] In this way, the low-frequency components of the target audio data are reproduced by the low-frequency sound box, and the low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box.

[0257] In implementation, the full frequency sound box may play the target audio data (including mid and / or high frequency components as well as low frequency components) rather than sending the low frequency components of the target audio data to the low frequency sound box.

[0258] According to the audio data processing method provided in this embodiment of the present application, after the full-frequency sound box completes the sound field expansion process on the audio data, in one aspect, the full-frequency sound box reproduces the high-frequency components and / or mid-frequency components of the audio data obtained through the sound field expansion process. Because the full-frequency sound box has a good reproduction effect on mid-frequency and high frequencies, the sound quality of the mid-frequency components and / or high-frequency components can be improved. In another aspect, the full-frequency sound box sends the low-frequency components of the audio data obtained through the sound field expansion process to the low-frequency sound box, and the low-frequency sound box reproduces the low-frequency components. Because the low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, the bass quality of the audio data can be improved.

[0259] As shown in Figure 19, an embodiment of the present application provides an audio data processing method. The method is applied to a low frequency sound box, and includes steps 1901 to 1904.

[0260] Step 1901: The low frequency sound box obtains the audio data to be played.

[0261] It should be understood that the audio data to be played is raw audio data. Optionally, the audio data to be played may be audio data received by the low-frequency sound box from a terminal, or audio data obtained by the low-frequency sound box from other devices. This is not limited in this embodiment of the present application.

[0262] Step 1902: The low frequency sound box performs multi-band filtering on the acquired to-be-played audio data to acquire mid-frequency components and / or high-frequency components and low-frequency components of the to-be-played audio data.

[0263] Step 1903: The low frequency sound box performs sound field widening processing on the mid frequency components and / or high frequency components and low frequency components of the audio data to be played back to obtain target audio data.

[0264] It should be noted that the method of performing multi-band filtering and sound field widening processing by the low-frequency sound box on the audio data to be played is the same as the method of performing multi-band filtering and sound field widening processing by the full-frequency sound box on the audio data to be played.For details, please refer to the description in the above embodiment.The details will not be described again here.

[0265] Step 1904: The low frequency sound box sends the mid frequency components and / or high frequency components of the target audio data to the full frequency sound box.

[0266] In this embodiment of the present application, after the low-frequency sound box completes the sound field widening process on the audio data, in one aspect, the low-frequency components obtained through the bass enhancement process are reproduced by using the woofer of the low-frequency sound box. Since the low-frequency components of the audio data are reproduced by a dedicated low-frequency speaker in the low-frequency sound box, the bass quality of the audio data can be improved. In another aspect, the low-frequency sound box sends the high-frequency components and / or mid-frequency components of the audio data obtained by the sound field widening process to the full-frequency sound box, and then the full-frequency sound box reproduces the high-frequency components and / or mid-frequency components. Since the full-frequency sound box has a good reproduction effect on the mid-frequency and high-frequency, the sound quality of the mid-frequency components and / or high-frequency components can be improved.

[0267] According to the audio data processing method provided in this embodiment of the present application, the layout of the full-frequency soundbox speakers in the soundbox system and the above sound field widening algorithms (including high-band dipole algorithm, mid-band dipole algorithm, and bass enhancement algorithm) coordinate with each other to achieve a wider sound field effect.

[0268] Optionally, in this embodiment of the present application, the audio data is multi-channel audio data. For example, the multi-channel is a dual channel including a left channel (L) and a right channel (R). As another example, the multi-channel includes a left channel (L), a left surround channel (Ls), a left rear channel (Lb), a left upper channel (Lh), a right channel (R), a right surround channel (Rs), a right rear channel (Rb), a right upper channel (Rh), and a center channel (C).

[0269] For example, the full-frequency sound box of the sound box system is a ring-shaped full-frequency sound box that includes eight speakers. For the layout of the eight speakers of the ring-shaped full-frequency sound box, please refer to FIG. 2(a). The following describes how the speaker and the sound field widening algorithm cooperate with each other by using an example in which the audio data is dual-channel audio data and multi-channel audio data.

[0270] When the first communication unit of the full-frequency sound box in the sound box system is connected to the second communication unit of the low-frequency sound box, after the low-frequency sound box obtains the dual-channel audio data (including a left channel signal and a right channel signal) to be played, referring to FIG. 20, the processing procedure of the dual-channel audio data includes:

[0271] Step 2001: The low frequency sound box performs high frequency filtering, medium frequency filtering, and low frequency filtering on the left channel (L) signal to obtain a high frequency component of the left channel signal, a medium frequency component of the left channel signal, and a low frequency component of the left channel signal.

[0272] Step 2002: The low frequency sound box performs high frequency filtering, medium frequency filtering, and low frequency filtering on the right channel (R) audio signal to obtain a high frequency component of the right channel signal, a medium frequency component of the right channel signal, and a low frequency component of the right channel signal.

[0273] For ease of description, in this embodiment of the present application, the left channel signal is D L and the high frequency components of the left channel signal are expressed as D L_h and the mid-frequency component of the left channel signal is D L_c and the low frequency components of the left channel signal are expressed as D L_l The right channel signal is expressed as D R and the high frequency components of the right channel signal are expressed as DR_h and the intermediate frequency component of the right channel signal is D R_c and the low frequency components of the right channel signal are expressed as D R_l This is expressed as:

[0274] Step 2003: The low frequency sound box extracts the high frequency components D of the left channel signal. L_h and the high frequency component D of the right channel signal R_h to obtain the processed high frequency component D' of the left channel signal. L_h and the processed high frequency component D' of the right channel signal R_h Get the.

[0275] Step 2004: The low frequency sound box outputs the mid-frequency component D of the left channel signal. L_c and the intermediate frequency component D of the right channel signal R_c to obtain the processed mid-frequency component D' of the left channel signal. L_c and the processed intermediate frequency component D' of the right channel signal. R_c Get the.

[0276] Step 2005: The low frequency sound box outputs the low frequency components D of the left channel signal. L_l and the low frequency component D of the right channel signal R_l Perform audio mixing on the low-frequency component D l and then the low frequency component D l , and the low frequency components D' of the processed audio data are l The low frequency sound box obtains the low frequency components D' of the processed audio data. l Play.

[0277] In this embodiment of the present application, the mixed low frequency components obtained through the audio mixing process are D l =D L_l +D R_l Satisfy.

[0278] Step 2006: The low-frequency sound box receives the high-frequency component D' of the left channel signal obtained through the sound field expansion process. L_h and the intermediate frequency component D' L_c and the high frequency component D' of the right channel signal obtained through the sound field expansion process. R_h and the intermediate frequency component D' R_c and send it to the full frequency sound box.

[0279] It should be understood that the high and mid frequency components are reproduced by corresponding speakers of the full frequency sound box.

[0280] In this embodiment of the present application, the corresponding speakers of the full-frequency sound box reproduce audio data, which means that the speaker pairs constituting an acoustic dipole in the horizontal direction reproduce the audio data (including high-frequency components and mid-frequency components) obtained through the horizontal sound field expansion. Specifically, the closer speaker pair reproduces the high-frequency components, and the farther speaker pair reproduces the mid-frequency components.

[0281] For example, referring to FIG. 2(a), in this embodiment of the present application, Speaker 2 and Speaker 4 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through the horizontal sound field expansion. Speaker 6 and Speaker 8 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through the horizontal sound field expansion. Speaker 1 and Speaker 5 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce mid frequency components obtained through the horizontal sound field expansion.

[0282] Optionally, a frequency band corresponds to one or more speaker pairs, for example the high frequency band (i.e. the high frequency components mentioned above) corresponds to two speaker pairs.

[0283] Accordingly, Table 1 is an example of the correspondence between each component of the audio data and the speakers of the full frequency sound box. [Table 1]

[0284] It should be noted that " / " in Table 1 indicates that there is no data, that is, Speaker 3 and Speaker 7 do not play audio data.

[0285] In summary, it can be seen that performing sound field widening processing on dual channel audio data is performing sound field widening processing on the audio data in the horizontal direction.

[0286] When the first communication unit of the full-frequency sound box in the sound box system is connected to the second communication unit of the low-frequency sound box, after the low-frequency sound box obtains multi-channel (including left channel, left surround channel, left rear channel, upper left channel, right channel, right surround channel, right rear channel, upper right channel, and center channel) audio data to be played, referring to FIG. 21, the processing procedure of the multi-channel audio data includes the following steps:

[0287] Step 2101: The low frequency sound box mixes the audio data of the left channel (L), the left surround channel (Ls), and the left rear channel (Lb) to obtain a horizontal left channel signal.

[0288] In this embodiment of the present application, the left channel signal is D L and the audio data for the left surround channel is represented as D Ls and the audio data for the left rear channel is represented as D Lb In this case, the horizontal left channel signal is expressed as D LH =D L +D Ls +D Lb It is.

[0289] Step 2102: The low frequency sound box receives the horizontal left channel signal DLH , and perform high-frequency filtering, intermediate-frequency filtering, and low-frequency filtering on the high-frequency component D LH_h , the intermediate frequency component of the horizontal left channel signal D LH_c , and the low frequency component D of the horizontal left channel signal LH_l Get the.

[0290] Step 2103: The low frequency sound box mixes the audio data of the right channel (R), the right surround channel (Rs), and the right rear channel (Rb) to obtain a horizontal right channel signal.

[0291] In this embodiment of the present application, the right channel signal is D R and the audio data for the right surround channel is represented as D Rs and the audio data for the right rear channel is represented as D Rb In this case, the horizontal right channel signal is expressed as D RH =D R +D Rs +D Rb It is.

[0292] Step 2104: The low frequency sound box receives the horizontal right channel signal D RH , and perform high-frequency filtering, intermediate-frequency filtering, and low-frequency filtering on the high-frequency component D RH_h , the intermediate frequency component D of the horizontal right channel signal RH_c , and the low frequency component D of the horizontal right channel signal RH_l Get the.

[0293] Step 2105: The low frequency sound box receives the audio data D of the upper left channel (Lh). Lh , and perform high-frequency filtering, intermediate-frequency filtering, and low-frequency filtering on the high-frequency component D LV_h , the intermediate frequency component of the vertical left channel signal D LV_c , and the low frequency component D of the vertical left channel signal LV_lGet the.

[0294] It should be understood that the top left channel audio data is the vertical left channel signal, hereinafter referred to as the vertical left channel signal for short.

[0295] Step 2106: The low frequency sound box receives the audio data D in the top right channel (Rh). Rh , and perform high-frequency filtering, intermediate-frequency filtering, and low-frequency filtering on the vertical right channel signal D RV_h , the intermediate frequency component of the vertical right channel signal D RV_c , and the low frequency component D of the vertical right channel signal RV_l Get the.

[0296] It should be understood that the audio data in the top right channel is the vertical right channel signal, hereinafter referred to as the vertical right channel signal for short.

[0297] Step 2107: The low frequency sound box outputs the center channel (C) audio data D C , and perform high-frequency filtering and low-frequency filtering on the high-frequency component D C_h and the low frequency component D of the center channel audio data C_l Get the.

[0298] Step 2108: The low frequency sound box horizontally extracts the high frequency component D of the horizontal left channel signal. LH_h and the high frequency component D of the horizontal right channel signal RH_h , and performing high-band dipole processing on the horizontal left channel signal to obtain the processed high-frequency component D' LH_h and the processed high frequency component D' of the horizontal right channel signal. RH_h Get the.

[0299] Step 2109: The low frequency sound box horizontally converts the mid-frequency component DLH_c and the intermediate frequency component D of the horizontal right channel signal RH_c , and performing mid-band dipole processing on the horizontal left channel signal to obtain the processed mid-frequency component D' LH_c and the processed intermediate frequency component D' of the horizontal right channel signal. RH_c Get the.

[0300] Step 2110: The low frequency sound box vertically converts the high frequency component D LV_h and the high frequency component D of the vertical right channel signal RV_h , and perform high-band dipole processing on the vertical left channel signal to obtain the processed high-frequency component D' LV_h and the processed high frequency component D' of the vertical right channel signal. Rv_h Get the.

[0301] Step 2111: The low frequency sound box vertically converts the intermediate frequency component D LV_c and the intermediate frequency component D of the vertical right channel signal RV_c , and perform mid-band dipole processing on the vertical left channel signal to obtain the processed mid-frequency component D' LV_c and the processed intermediate frequency component D' of the vertical right channel signal. RV_c Get the.

[0302] Step 2112: The low frequency sound box outputs the low frequency component D of the horizontal left channel signal. LH_l , the low frequency component of the horizontal right channel signal D RH_l , the low frequency component of the vertical left channel signal D LV_l , the low frequency component of the vertical right channel signal D RV_l , and the low frequency components of the center channel audio data D C_l Perform audio mixing on the low-frequency component D l and then the low frequency component D l , and the low frequency components D' of the processed audio data are l Get the.

[0303] It should be understood that the low frequency components of the processed audio data are reproduced by a low frequency sound box.

[0304] In this embodiment of the present application, the mixed low frequency components obtained through the audio mixing process are D l =D LH_l +D RH_l +D LV_l +D RV_l +D C_l Satisfy.

[0305] Step 2113: The low-frequency sound box performs an audio mixing process on the high-frequency components and mid-frequency components of the audio data obtained through the sound field widening process, and sends the audio data obtained through the audio mixing process to the full-frequency sound box.

[0306] Step 2114: The full-frequency sound box receives the audio data obtained through the audio mixing process and sent by the low-frequency sound box.

[0307] It should be understood that the audio data obtained through the audio mixing process is played back by the corresponding speakers of the full frequency sound box.

[0308] In this embodiment of the present application, the corresponding speakers of the full-frequency sound box reproduce audio data, which means that the speaker pairs constituting the acoustic dipole in the horizontal direction reproduce audio data (including high-frequency components and mid-frequency components) obtained through the horizontal sound field expansion. Specifically, the closer speaker pair reproduces the high-frequency components, and the farther speaker pair reproduces the mid-frequency components. Furthermore, the speaker pairs constituting the acoustic dipole in the vertical direction reproduce audio data (including high-frequency components and mid-frequency components) obtained through the vertical sound field expansion. Specifically, the closer speaker pair reproduces the high-frequency components, and the farther speaker pair reproduces the mid-frequency components.

[0309] For example, referring to FIG. 2(a), in this embodiment of the present application, speaker 4 and speaker 6 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce high frequency components obtained through sound field expansion in the vertical direction. Speaker 2 and speaker 8 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce high frequency components obtained through sound field expansion in the vertical direction. Speaker 3 and speaker 7 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce mid frequency components obtained through sound field expansion in the vertical direction. Furthermore, speaker 2 and speaker 4 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through sound field expansion in the horizontal direction. Speaker 6 and speaker 8 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through sound field expansion in the horizontal direction. Speaker 1 and speaker 5 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce mid frequency components obtained through sound field expansion in the horizontal direction.

[0310] Similarly, one frequency band corresponds to one or more speaker pairs.

[0311] Accordingly, Table 2 is an example of the correspondence between each component of the audio data and the speakers of the full frequency sound box. [Table 2]

[0312] Up to now, the above audio mixing process specifically involves dividing the high frequency component D' of the horizontal left channel signal into LH_h , the high frequency component D' of the vertical right channel signal RV_h , and the high frequency component D of the center channel C_h The high frequency component D' of the horizontal right channel signal is mixed. RH_h , the high frequency component D' of the vertical right channel signal RV_h , and the high frequency component D of the center channel C_h The high frequency component D' of the horizontal right channel signal is mixed. RH_h , the high frequency component D' of the vertical left channel signal LV_h , and the high frequency component D of the center channel C_h The high frequency component D' of the horizontal left channel signal is mixed. LH_h , the high frequency component D' of the vertical left channel signal LV_h , and the high frequency component D of the center channel C_h It can be understood that the mixing of the above is a process of mixing the above.

[0313] In summary, it can be seen that performing sound field widening processing on multi-channel audio data is performing sound field widening processing on the audio data in the horizontal direction and in the vertical direction, in this way a three-dimensional sound field effect can be generated.

[0314] Similarly, in the sound box system, the first communication unit of the full-frequency sound box is not connected to the second communication unit of the low-frequency sound box, or the first communication unit of the full-frequency sound box is connected to the second communication unit of the low-frequency sound box, but the full-frequency sound box processes audio data independently. When the low-frequency sound box does not participate in audio data processing, how the speaker and the sound field widening algorithm cooperate with each other is described by using dual-channel audio data and multi-channel audio data as examples.

[0315] When the audio data is dual channel audio data (including a left channel signal and a right channel signal), the full frequency sound box performs a sound field expansion process on the dual channel audio data and reproduces the audio data obtained through the sound field expansion process. With reference to FIG. 2(a) and FIG. 22, the speaker 2 and the speaker 4 form a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through the sound field expansion in the horizontal direction. The speaker 6 and the speaker 8 form a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through the sound field expansion in the horizontal direction. The speaker 1 and the speaker 5 form a pair of acoustic dipoles in the horizontal direction and are configured to reproduce mid frequency components obtained through the sound field expansion in the horizontal direction.

[0316] Please note that, unlike in Fig. 20, the low frequency components of the audio data that have been subjected to the bass enhancement process are mixed with other high frequency components or mid frequency components and played by the speaker of the full frequency sound box. Accordingly, referring to Fig. 22, Table 3 is an example of the correspondence between each component of the audio data and the speaker of the full frequency sound box. [Table 3]

[0317] The audio data is multi-channel audio data (including a left channel, a left surround channel, a left rear channel, an upper left channel, a right channel, a right surround channel, a right rear channel, an upper right channel, and a center channel), and the full-frequency sound box performs a sound field expansion process on the multi-channel audio data and reproduces the audio data obtained through the sound field expansion process. With reference to (a) of FIG. 2 and FIG. 23, the speaker 4 and the speaker 6 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce high-frequency components obtained through the sound field expansion in the vertical direction. The speaker 2 and the speaker 8 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce high-frequency components obtained through the sound field expansion in the vertical direction. The speaker 3 and the speaker 7 constitute a pair of acoustic dipoles in the vertical direction and are configured to reproduce intermediate frequency components obtained through the sound field expansion in the vertical direction. Furthermore, the speaker 2 and the speaker 4 constitute a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high-frequency components obtained through the sound field expansion in the horizontal direction. The speakers 6 and 8 form a pair of acoustic dipoles in the horizontal direction and are configured to reproduce high frequency components obtained through the horizontal sound field expansion. The speakers 1 and 5 form a pair of acoustic dipoles in the horizontal direction and are configured to reproduce mid frequency components obtained through the horizontal sound field expansion.

[0318] Please note that unlike that in FIG. 21, the low frequency components of the audio data that have been through the bass enhancement process are mixed with other high frequency or mid frequency components and played back by the speakers of the full frequency sound box.

[0319] Accordingly, referring to FIG. 23, Table 4 is an example of the correspondence between each component of the audio data and the speaker of the full frequency sound box. [Table 4]

[0320] In another implementation, the embodiment of the present application provides an audio data processing method. The method is applied to a scenario in which a terminal establishes a communication connection with the above-mentioned sound box system. The sound box system includes a full-frequency sound box and a low-frequency sound box. A first communication unit of the full-frequency sound box is connected to a second communication unit of the low-frequency sound box. The full-frequency sound box includes a first fastening part, and the first communication unit is disposed on the first fastening part, and the low-frequency sound box includes a second fastening part, and the second communication unit is disposed on the second fastening part, and the full-frequency sound box is physically connected to or separated from the low-frequency sound box by using the first fastening part and the second fastening part. The full-frequency sound box and the low-frequency sound box can communicate with each other by using the first communication unit and the second communication unit. The first communication unit and the second communication unit support multi-channel audio transmission. As shown in FIG. 24, the method includes steps 2401 to 2404.

[0321] Step 2401: The terminal receives a first operation from the user.

[0322] Step 2402: The terminal controls the full-frequency sound box to operate independently in response to a first operation.

[0323] The first operation is a selection operation performed by a user on a first option in a first interface of the terminal, and the first option corresponds to the full-frequency sound box operating independently. The full-frequency sound box operating independently means that the full-frequency sound box plays the target audio data.

[0324] Optionally, the first operation may be a touch screen operation, a button press operation, etc., which is not particularly limited in this embodiment of the present invention. For example, the touch screen operation is a press operation, a long press operation, a slide operation, a tap operation, a floating operation (an operation performed by a user near the touch screen), etc., performed by a user on a touch screen of a terminal. The button press operation corresponds to an operation performed by a user on a button of the terminal, such as a power button, a volume button, or a home button, such as a click operation, a double click operation, a long press operation, or a combination button press operation.

[0325] In the application scenario of this embodiment of the present application, a full-frequency sound box application is installed on a terminal.After a user launches the full-frequency sound box application and establishes a communication connection with a sound box system, the terminal displays a first interface, and the user can perform corresponding operations in the first interface to control the sound box system to work in different working modes.Here, the working modes of the sound box system include: the full-frequency sound box works independently, and the full-frequency sound box and the low-frequency sound box work together.

[0326] For example, the first interface is the interface 2501 shown in FIG. 25(a). The first interface 2501 includes a first option 2501a and a second option 2501b. The first option 2501a corresponds to the full-frequency sound box working independently. The second option 2501b corresponds to the full-frequency sound box and the low-frequency sound box working together. The user may select a corresponding option in the interface 2501 based on the actual requirements. For example, the user taps the first option 2501a, in which case the full-frequency sound box can be controlled to work independently.

[0327] As another example, the first interface is the interface 2502 shown in Fig. 25(b). The first interface 2502 includes a full frequency sound box icon 2502a and a low frequency sound box icon 2502b. For example, a user taps the full frequency sound box icon 2501a, in which case the full frequency sound box can be controlled to operate independently.

[0328] Step 2402 may specifically include step 2402a.

[0329] Step 2402a: The terminal sends a first command to the sound box system in response to the first operation, and the first command is used to control the full-frequency sound box to operate independently.

[0330] Specifically, when the full-frequency sound box of the sound box system is connected to the low-frequency sound box (the first fastening part is connected to the second fastening part, and the first communication part is connected to the second communication part), the low-frequency sound box controls and manages the entire sound box system, that is, when the terminal sends a first command to the sound box system, it means sending the first command to the low-frequency sound box of the sound box system.

[0331] Optionally, in another implementation, the terminal may also send the first command to the all-frequency sound box to control the all-frequency sound box to operate independently.

[0332] It should be noted that when the terminal sends a first command to the low-frequency sound box, the low-frequency sound box and the full-frequency sound box of the sound box system execute step A1 to step A4.

[0333] Step A1: The low-frequency sound box sends a control command to the full-frequency sound box, and the control command is used to instruct the full-frequency sound box to play the target audio data.

[0334] Step A2: The full frequency sound box receives a control command and obtains the audio data to be played.

[0335] The control instructions are further used to instruct the full frequency soundbox to perform multi-band filtering on the audio data to be reproduced, and to perform sound field widening processing on the filtered audio data to be reproduced.

[0336] Optionally, the full-frequency sound box may establish a communication connection with the terminal after the full-frequency sound box receives a control command from the low-frequency sound box, so that the full-frequency sound box obtains the audio data (which is raw audio data) to be played from the terminal. Alternatively, the low-frequency sound box obtains the audio data to be played from the terminal and sends the audio data to be played to the full-frequency sound box. Alternatively, the full-frequency sound box may obtain the audio data to be played from other devices. This is not limited in this embodiment of the present application.

[0337] Step A3: The full frequency sound box performs multi-band filtering on the acquired to-be-played audio data to obtain mid-frequency components and / or high-frequency components and low-frequency components of the to-be-played audio data.

[0338] Step A4: The full frequency sound box performs sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back to obtain target audio data.

[0339] For detailed description of the contents of processing the audio data to be played in step A2 to step A4 by the full frequency sound box, please refer to the relevant description in the above embodiment, and the details will not be described again here.

[0340] Optionally, after processing the raw audio data, the full-frequency sound box obtains target audio data (specifically including mid-frequency components and / or high-frequency components and low-frequency components of the target audio data). The target audio data can be played by the full-frequency sound box. In this case, it should be noted that the low-frequency sound box of the sound box system does not participate in the processing and playing of audio data.

[0341] Step 2403: The terminal receives a second operation.

[0342] Step 2404: The terminal controls the full-frequency sound box and the low-frequency sound box to work together in response to the second operation.

[0343] The second operation is a selection operation performed by the user on a second option in the first interface of the terminal, and the second option corresponds to the full-frequency sound box and the low-frequency sound box working together. The full-frequency sound box and the low-frequency sound box working together means that the full-frequency sound box plays the mid-frequency components and / or high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

[0344] Optionally, the second operation may be a touch screen operation, a button press operation, etc., which is not particularly limited in this embodiment of the present invention. For example, the touch screen operation is a press operation, a long press operation, a slide operation, a tap operation, a floating operation (an operation performed by a user near the touch screen), etc., performed by a user on a touch screen of the terminal. The button press operation corresponds to an operation performed by a user on a button of the terminal, such as a power button, a volume button, or a home button, such as a click operation, a double click operation, a long press operation, or a combination button press operation.

[0345] 25(a), as shown in FIG. 26(a), the second option 2501b corresponds to the full frequency sound box and the low frequency sound box working together, and the user may select the corresponding option in the interface 2501 based on the actual requirements. For example, the user taps the second option 2501b, in this case, the full frequency sound box and the low frequency sound box may work together.

[0346] With reference to Fig. 25(b), as shown in Fig. 26(b), the user may drag the low frequency sound box icon 2502b below the full frequency sound box icon 2501a, so that the full frequency sound box and the low frequency sound box achieve a stack effect. In this way, the full frequency sound box and the low frequency sound box can be controlled to work together.

[0347] Step 2404 may specifically include step 2404a.

[0348] Step 2404a: The terminal sends a second command to the sound box system in response to the second operation, and the second command is used to control the full-frequency sound box and the full-frequency sound box to operate.

[0349] Specifically, the terminal sends a second command to the low-frequency sound box.

[0350] It should be noted that when the terminal sends a second command to the low-frequency sound box, the low-frequency sound box executes steps B1 to B3.

[0351] Step B1: The low frequency sound box performs multi-band filtering on the acquired to-be-played audio data to acquire mid-frequency components and / or high-frequency components and low-frequency components of the to-be-played audio data.

[0352] Optionally, after the low-frequency sound box receives the second command, the low-frequency sound box may obtain the audio data (which is raw audio data) to be played from the terminal, or the low-frequency sound box may obtain the audio data to be played from other devices, which is not limited in this embodiment of the present application.

[0353] Step B2: The low frequency sound box performs sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back to obtain target audio data.

[0354] Step B3: The low frequency sound box sends the mid frequency components and / or high frequency components of the target audio data to the full frequency sound box.

[0355] In this case, it should be understood that the mid-frequency and / or high-frequency components of the target audio data are reproduced by the full-frequency sound box, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box.

[0356] For detailed description of the contents of processing the audio data to be played by the low frequency sound box in step B1 to step B3, please refer to the relevant description in the above embodiment, and the details will not be described again here.

[0357] It should be noted that in the above steps 2401 to 2404, the terminal selects to perform step 2402 and step 2403 or step 2404 based on the specific operation of the user.

[0358] Optionally, when the full-frequency sound box and the low-frequency sound box of the sound box system work together, the audio data processing method provided in this embodiment of the present application further includes the following steps C1 to C4.

[0359] Step C1: The terminal receives a third operation of the user, and controls and activates the camera or microphone of the low-frequency sound box in response to the third operation.

[0360] Specifically, the terminal may send a third command to the low-frequency sound box in response to the third operation, the third command being used to instruct the low-frequency sound box to activate a camera or a microphone.

[0361] Step C2: The low frequency sound box activates the camera or microphone.

[0362] Step C3: The low frequency sound box captures the image information of the listener by using a camera, or captures the acoustic signal of the listener by using a microphone.

[0363] The image information of the listener or the acoustic signal of the listener is used to perform sound field widening processing on the filtered audio data to be reproduced.

[0364] Step C4: The low frequency sound box performs sound field widening processing on the filtered audio data to be played back according to the image information or acoustic signal of the listener.

[0365] Specifically, the low-frequency sound box analyzes the image information or the acoustic signal of the listener to determine the position information of the listener. The user's position information includes the included angle between the user and the central axis of the sound box system. Furthermore, the difference between the phases of the signals reproduced by the two speakers constituting a pair of acoustic dipoles (i.e., the above-mentioned phase difference θ) is adjusted based on the listener's position information. The phase difference is a setting parameter for the high-band dipole processing and / or the mid-band dipole processing.

[0366] In this embodiment of the present application, in order to improve the user's listening experience, a setting parameter in the high-band dipole algorithm or the mid-band dipole algorithm (i.e., the setting parameter is the difference between the phases of reproducing signals by two speakers constituting a pair of acoustic dipoles) may be adjusted in the process of performing sound field expansion on the audio data. In this way, the binaural crosstalk cancellation effect is improved, so that the user achieves a good listening experience at the current position. Specifically, since the phase difference is related to the user's current position, the phase difference is adjusted by performing the above steps A to C. In this way, the sound field expansion process is performed on the audio data by using the adjusted phase difference to remove the binaural crosstalk. In this way, the sound field expansion is performed at the user's current position, and the user's listening experience is improved in real time.

[0367] Optionally, when the sound box system includes multiple full-frequency sound boxes, the multiple full-frequency sound boxes are separately connected to the low-frequency sound box, and the multiple full-frequency sound boxes can work together.

[0368] In the collaborative mode, after the low-frequency sound box performs a sound field expansion process on the audio data to be played back to obtain target audio data, the low-frequency sound box sends the high-frequency components and mid-frequency components of the target audio data to each of the multiple full-frequency sound boxes, and plays the high-frequency components and mid-frequency components of the target audio data by using corresponding speakers of the multiple full-frequency sound boxes.

[0369] Optionally, there are multiple modes that multiple full-frequency sound boxes cooperate with each other. For example, the correspondence between each full-frequency sound box and the corresponding frequency band of audio data is as shown in Table 1. Alternatively, some of the speakers of the full-frequency sound box play high frequency components, and other part of the speakers play mid-frequency components. Specifically, the cooperation mode can be set based on actual user requirements. This is not limited in this embodiment of the present application.

[0370] In other cooperation modes, the multiple full-frequency sound boxes separately obtain the audio data to be played, perform sound field widening processing on the audio data to be played to obtain target audio data, and then the multiple full-frequency sound boxes separately play the target audio data. Similarly, there may be multiple modes in which the multiple full-frequency sound boxes cooperate with each other. For example, different full-frequency sound boxes process audio data of different channels. Specifically, the cooperation mode may be set based on actual user requirements. This is not limited in this embodiment of the present application.

[0371] Optionally, when the sound box system includes multiple sound box subsystems (for the description of the speaker subsystems, please refer to the above embodiment), Multiple Soundbox Subsystemscan cooperate with each other. For example, the low-frequency sound box of each sound box subsystem performs sound field widening processing on the audio data to be played to obtain target audio data, plays the low-frequency components of the target audio data, and sends the mid-frequency components and / or high-frequency components of the target audio data to the corresponding full-frequency sound box separately. The full-frequency sound box plays the mid-frequency components and / or high-frequency components. There may be multiple modes in which multiple sound box subsystems cooperate with each other. For example, different sound box subsystems process audio data of different channels. Specifically, the cooperation mode may be set based on actual user requirements. This is not limited in this embodiment of the present application.

[0372] According to the audio data processing method provided in this embodiment of the present application, the user performs corresponding operations on the terminal. In this case, in response to the user's operations, the terminal controls the full-frequency sound box of the sound box system to work independently, or controls the full-frequency sound box and the low-frequency sound box to work together, which can improve the user experience.

[0373] In yet another implementation, the embodiment of the present application provides an audio data processing method. The method is applied to a scenario in which a terminal establishes a communication connection with a sound box system. The sound box system includes a full-frequency sound box and a low-frequency sound box. A first communication unit of the full-frequency sound box is connected to a second communication unit of the low-frequency sound box. The full-frequency sound box includes a first fastening part, and the first communication unit is disposed on the first fastening part, and the low-frequency sound box includes a second fastening part, and the second communication unit is disposed on the second fastening part, and the full-frequency sound box is physically connected to or separated from the low-frequency sound box by using the first fastening part and the second fastening part. The full-frequency sound box and the low-frequency sound box can communicate with each other by using the first communication unit and the second communication unit. The first communication unit and the second communication unit support multi-channel audio transmission. As shown in FIG. 27, the method includes steps 2701 to 2703.

[0374] Step 2701: The terminal determines the type of the target audio data.

[0375] The types of target audio data include deep bass or non-deep bass. Deep bass is a frequency below 200Hz. For example, musical instruments such as bass, cello, low violin, and bass drum, or low notes, respectively, belong to deep bass.

[0376] Step 2702: When the type of the target audio data is non-deep low frequency, the terminal controls the full frequency sound box to operate independently.

[0377] The full-frequency sound box works independently, which means that the full-frequency sound box plays the target audio data.

[0378] Similarly, the terminal sends a first command to the sound box system (specifically, the low frequency sound box) to control the full frequency sound box to operate independently. The first command is used to control the full frequency sound box to operate independently. The low frequency sound box and the full frequency sound box of the sound box system execute the above steps A1 to A4 when the terminal sends the first command to the low frequency sound box. For details, please refer to the description in the above embodiment. The details are not described again here.

[0379] Step 2703: When the type of the target audio data is deep low frequency, the terminal controls the full-frequency sound box and the low-frequency sound box to work together.

[0380] The full frequency sound box and the low frequency sound box working together means that the full frequency sound box reproduces the mid frequency and / or high frequency components of the target audio data, and the low frequency sound box reproduces the low frequency components of the target audio data.

[0381] Similarly, the terminal sends a second command to the sound box system (specifically, the low frequency sound box) to control the full frequency sound box and the low frequency sound box to work together. The second command is used to control the full frequency sound box and the low frequency sound box to work. The low frequency sound box of the sound box system executes the above steps B1 to B3 when the terminal sends the second command to the low frequency sound box. For details, please refer to the description in the above embodiment. The details are not described again here.

[0382] In this embodiment of the present application, when the full-frequency sound box operates independently, if the terminal determines that the audio data to be currently played is deep low-frequency audio data, the audio data processing method provided in this embodiment of the present application includes the terminal displaying first prompt information. The first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to cooperate. For example, if the terminal determines that the audio data to be currently played is deep low-frequency audio data, the terminal displays the first prompt information. In this case, the user performs a corresponding operation on the terminal according to the first prompt information to switch the operation mode of the sound box system to a mode in which the full-frequency sound box and the low-frequency sound box cooperate. For example, FIG. 28 (a) is a schematic diagram of the display effect of the first prompt information. Alternatively, when the terminal determines that the audio data to be played is deep low-frequency audio data, the terminal automatically switches the operation mode of the sound box system, and then displays the first prompt information on the display of the terminal to inform the user that the operation mode of the sound box system is switched to the mode in which the full-frequency sound box and the low-frequency sound box work together.For example, Fig. 28(b) is a schematic diagram of the display effect of the first prompt information.

[0383] It should be noted that when the full-frequency sound box is not connected to the low-frequency sound box, the terminal determines that the audio data to be currently played is deep low-frequency audio data. In this case, the terminal may display the second prompt information on the display of the terminal. The second prompt information is used to prompt the user to add the low-frequency sound box to the full-frequency sound box, that is, to prompt the user to physically connect the full-frequency sound box to the low-frequency sound box, so that the full-frequency sound box and the low-frequency sound box work together. That is, the low-frequency sound box processes the audio data, the low-frequency sound box plays the low-frequency components of the processed audio data, and the full-frequency sound box plays the mid-frequency components and / or high-frequency components of the processed audio data. For example, FIG. 29 is a schematic diagram of the display effect of the second prompt information.

[0384] Optionally, the terminal may present the first prompt information or the second prompt information in a fixed bar, a floating window, or a bubble manner, which is not limited in this embodiment of the present application.

[0385] Optionally, the terminal may further display at least one type of the following information: the quality of the channel of the audio data currently being played by the sound box system, the rendering mode of the audio data, or information regarding the correspondence between the channel of the audio data and the speaker of the full-frequency sound box.

[0386] In this embodiment of the present application, the rendering mode of the audio data includes 2D mode or 3D mode. The terminal displays the above information in the process of the terminal establishing a communication connection with the full-frequency sound box, and the terminal interacts with the full-frequency sound box to play the audio data. In this way, the user can know some detailed status of the currently played audio data, so as to improve the user's subjective experience.

[0387] Optionally, when the sound box system includes multiple full-frequency sound boxes, the audio data processing method provided in this embodiment of the present application further includes: the terminal determines the correspondence between the channels of the audio data and the multiple full-frequency sound boxes based on the position information of the multiple full-frequency sound boxes, and displays information about the correspondence between the channels of the audio data and the multiple full-frequency sound boxes.

[0388] For example, when sound box system includes five full-frequency sound boxes, the channels of audio data corresponding to the five full-frequency sound boxes are allocated according to the positions of the five full-frequency sound boxes. For example, as shown in Fig. 30, the channels corresponding to full-frequency sound box 1 to full-frequency sound box 5 are left channel, center channel, right channel, right surround channel and left surround channel. Optionally, the correspondence between the channels of audio data and the multiple full-frequency sound boxes can be set according to actual requirements, which is not limited in this embodiment of the present application.

[0389] According to the sound box system provided in this embodiment of the present application, an audio data processing method is provided. The terminal controls the full-frequency sound box to operate independently, or controls the full-frequency sound box and the low-frequency sound box to cooperate to achieve a good sound field expansion effect. Furthermore, when the full-frequency sound box operates independently, reproducing the mid-frequency components and / or high-frequency components of the target audio data by using the full-frequency sound box can improve the sound quality because the full-frequency sound box has a good reproduction effect for the mid-frequency and high frequencies. When the full-frequency sound box and the low-frequency sound box operate, reproducing the low-frequency components of the target audio data by using the low-frequency sound box can improve the bass quality of the audio data because the low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box. Furthermore, reproducing the mid-frequency components and / or high-frequency components by using the full-frequency sound box can improve the reproduction effect of the mid-frequency components and / or high-frequency components of the target audio data because the full-frequency sound box has a good reproduction effect for the mid-frequency and high frequencies. In this way, the playback effect of the audio data can be improved in the whole frequency band of the audio data.

[0390] Accordingly, the embodiment of the present application provides a full-frequency sound box. As shown in Fig. 31, the full-frequency sound box includes an acquisition module 3101, a filtering module 3102, and a processing module 3103. The acquisition module 3101 is configured to acquire audio data to be played. For example, the acquisition module 3101 is configured to perform step 1701 of the above method embodiment. The filtering module 3102 is configured to perform multi-band filtering on the audio data to be played acquired by the acquisition module 3101 to acquire mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played. For example, the filtering module 3102 is configured to perform step 1702 of the above method embodiment. The processing module 3103 is configured to perform sound field widening processing on the mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played to acquire target audio data. For example, the processing module 3103 is configured to perform step 1703 (including steps 1703a and 1703b) of the above method embodiment.

[0391] Optionally, the full-frequency sound box further includes a sending module 3104. The sending module 3104 is configured to send low-frequency components of the target audio data to the low-frequency sound box. For example, the sending module 3104 is configured to perform step 1704 of the above method embodiment.

[0392] Each of the above modules may further perform other related operations in the above method embodiments. For details, please refer to the descriptions in the above method embodiments. The details will not be described again here.

[0393] Similarly, the device embodiment described in FIG. 31 is merely an example. For example, the division into units (or modules) is merely a logical functional division, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into other systems, or some features may be ignored or not implemented. The functional units in the embodiments of the present application may be integrated into one module, and each of the modules may exist physically independently, or two or more units may be integrated into one module. The above modules in FIG. 31 may be implemented in the form of hardware, or may be implemented in the form of software functional units. For example, when implemented by using software, the filtering module 3102 and the processing module 3103 may be implemented by software functional modules generated after the processor of the full frequency sound box reads the program code stored in the memory. The above modules may alternatively be implemented by different hardware of the full frequency sound box. For example, the filtering module 3102 is implemented by a part of the processing resources in the processor of the full frequency sound box (e.g., one or two cores in a multi-core processor), while the processing module 3103 is implemented by using the remaining part of the processing resources in the processor of the full frequency sound box (e.g., other cores in a multi-core processor), or by using a programmable device such as a field-programmable gate array (FPGA) or a co-processor. The transmission module 3104 is implemented by the network interface of the full frequency sound box, etc. It is clear that the above functional modules may alternatively be implemented by a combination of software and hardware. For example, the filtering module 3102 is implemented by a hardware programmable device, and the processing module 3103 is a software functional module generated after the CPU reads a program code stored in a memory.

[0394] For further details about implementing the above functions by the acquisition module 3101, the filtering module 3102, the processing module 3103, and the sending module 3104, please refer to the description in the above method embodiment. The details will not be repeated here.

[0395] All embodiments herein are described in an inventive manner, and for the same or similar parts in the embodiments, please refer to these embodiments, with each embodiment focusing on the differences from other embodiments.

[0396] The embodiment of the present application provides a low-frequency sound box. As shown in Fig. 32, the low-frequency sound box includes an acquisition module 3201, a filtering module 3202, a processing module 3203, and a sending module 3204. The acquisition module 3201 is configured to acquire audio data to be played. For example, the acquisition module 3201 is configured to perform step 1901 of the above method embodiment. The filtering module 3202 is configured to receive the audio data from the acquisition module 3201. 3201 The filtering module 3202 is configured to perform multi-band filtering on the to-be-played audio data obtained by the filtering module 3202 to obtain mid-frequency components and / or high-frequency components and low-frequency components of the to-be-played audio data. For example, the filtering module 3202 is configured to perform step 1902 of the above method embodiment. The processing module 3203 is configured to perform sound field widening processing on the to-be-played audio data and / or high-frequency components and low-frequency components to obtain target audio data. For example, the processing module 3203 is configured to perform step 1903 of the above method embodiment. The sending module 3204 is configured to send the mid-frequency components and / or high-frequency components of the target audio data to a full-frequency sound box. For example, the sending module 3204 is configured to perform step 1904 of the above method embodiment.

[0397] Optionally, the low frequency sound box may further include other modules, such as an image capture module or an audio capture module. The image capture module is configured to capture image information of the listener. The audio capture module is configured to capture an acoustic signal of the listener.

[0398] Each of the above modules may further perform other related operations in the above method embodiments. For details, please refer to the descriptions in the above method embodiments. The details will not be described again here.

[0399] Similarly, the device embodiment described in FIG. 32 is merely an example. For example, the division into units (or modules) is merely a logical functional division, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into other systems, or some features may be ignored or not implemented. The functional units in the embodiments of the present application may be integrated into one module, and each of the modules may exist physically independently, or two or more units may be integrated into one module. The above modules in FIG. 32 may be implemented in the form of hardware, or may be implemented in the form of software functional units. For example, when implemented by using software, the filtering module 3202 and the processing module 3203 may be implemented by software functional modules generated after the processor of the low frequency sound box reads the program code stored in the memory. The above modules may alternatively be implemented by different hardware of the low frequency sound box. For example, the filtering module 3202 is implemented by a part of the processing resources in the processor of the low frequency sound box (e.g., one or two cores in a multi-core processor), while the processing module 3203 is implemented by using the remaining part of the processing resources in the processor of the low frequency sound box (e.g., other cores in a multi-core processor), or by using a programmable device such as a field-programmable gate array (FPGA) or a co-processor. The transmission module 3204 is implemented by the network interface of the low frequency sound box, etc. It is clear that the above functional modules may alternatively be implemented by a combination of software and hardware. For example, the filtering module 3202 is implemented by a hardware programmable device, and the processing module 3203 is a software functional module generated after the CPU reads a program code stored in a memory.

[0400] For further details about implementing the above functions by the acquisition module 3201, the filtering module 3202, the processing module 3203, and the sending module 3204, please refer to the description in the above method embodiment. The details will not be repeated here.

[0401] All embodiments herein are described in an inventive manner, and for the same or similar parts in the embodiments, please refer to these embodiments, with each embodiment focusing on the differences from other embodiments.

[0402] The embodiment of the present application further provides a terminal. As shown in Fig. 33, the terminal includes a detection module 3301 and a transmission module 3302. The detection module 3301 is configured to detect whether the first communication unit of the full-frequency sound box is connected to the second communication unit of the low-frequency sound box. For example, the detection module 3301 is configured to perform step 1601 of the above method embodiment. The transmission module 3302 is configured to send audio data to be played to the full-frequency sound box when it is found through detection that the first communication unit is not connected to the second communication unit. For example, the transmission module 3302 is configured to perform step 1602 of the above method embodiment. When the detection finds that the first communication unit is connected to the second communication unit, the sending module 3302 is further configured to send the first audio data to the full frequency sound box and send the second audio data to the low frequency sound box, for example, the sending module 3302 is configured to perform step 1603a of the above method embodiment, where the first audio data is the mid-frequency component and / or the high-frequency component of the audio data to be played, and the second audio data is the low-frequency component of the audio data to be played; or the sending module 3302 is further configured to send the audio data to be played to the full frequency sound box, for example, the sending module 3302 is configured to perform step 1603b of the above method embodiment; or the sending module 3302 is further configured to send the audio data to be played to the low frequency sound box, for example, the sending module 3302 is configured to perform step 1603c of the above method embodiment.

[0403] The terminal provided in this embodiment of the present application further includes a receiving module 3303 and a control module 3304. The receiving module is configured to receive a first operation or a second operation of a user. For example, the receiving module 3303 is configured to perform step 2401 and step 2403 of the above method embodiment. The control module 3304 is further configured to control the full-frequency sound box to operate independently, or control the full-frequency sound box and the low-frequency sound box to work together, in response to the first operation. For example, the control module 3304 is configured to perform step 2402 and step 2404 of the above method embodiment.

[0404] Specifically, the control module 3304 is specifically configured to control the transmitting module 3302 to send a first command to the sound box, for example, to control the transmitting module 3302 to perform step 2402a or step 2404a of the above method embodiment.

[0405] Optionally, the terminal provided in this embodiment of the present application further includes a display module 3305. The display module 3305 is configured to display first prompt information. The first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to cooperate. The display module 3305 may further display other content. For details, please refer to the related content in the above method embodiment. It should be understood that the display module 3305 may display related content under the control of the control module 3304.

[0406] The terminal provided in this embodiment of the present application further includes a determining module 3306. The determining module 3306 is configured to determine a type of target audio data. The type of target audio data includes deep low frequency or non-deep low frequency. For example, the determining module 3306 is configured to execute step 2701 of the above method embodiment. The control module 3304 is further configured to control the full-frequency sound box to operate independently when the type of target audio data is non-deep low frequency, or control the full-frequency sound box and the low-frequency sound box to work together when the type of target audio data is non-deep low frequency. For example, the control module 3304 is configured to execute step 2702 or step 2403 of the above method embodiment.

[0407] Each of the above modules may further perform other related operations in the above method embodiments. For details, please refer to the descriptions in the above method embodiments. The details will not be described again here.

[0408] Similarly, the device embodiment described in FIG. 33 is merely an example. For example, the division into units (or modules) is merely a logical functional division, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into other systems, or some features may be ignored or not implemented. The functional units in the embodiments of the present application may be integrated into one module, and each of the modules may exist physically independently, or two or more units may be integrated into one module. The above modules in FIG. 33 may be implemented in the form of hardware, or may be implemented in the form of software functional units. For example, when implemented by using software, the detection module 3301 and the determination module 3306 may be implemented by software functional modules generated after the processor of the terminal reads the program code stored in the memory. The above modules may alternatively be implemented by different hardware of the terminal. For example, the detection module 3301 is implemented by a part of the processing resources in the processor of the terminal (e.g., one or two cores in a multi-core processor), while the determination module 3306 is implemented by using the remaining part of the processing resources in the processor of the terminal (e.g., other cores in a multi-core processor), or by using a programmable device such as a field-programmable gate array (FPGA) or a co-processor. The transmission module 3302 and the reception module 3303 are implemented by a network interface of the terminal, etc. The display module 3305 is implemented by a display of the terminal. It is clear that the above functional modules may alternatively be implemented by a combination of software and hardware. For example, the determination module 3306 is implemented by a hardware programmable device, and the detection module 3301 is a software function module generated after the CPU reads the program code stored in the memory.

[0409] For further details regarding the implementation of the above functions by the detection module 3301, the transmission module 3302, the reception module 3303, the control module 3304, the display module 3305, and the decision module 3306, please refer to the description in the above method embodiment. The details will not be repeated here.

[0410] All embodiments herein are described in an inventive manner, and for the same or similar parts in the embodiments, please refer to these embodiments, with each embodiment focusing on the differences from other embodiments.

[0411] All or part of the above embodiments may be implemented by software, hardware, firmware, or any combination thereof. When a software program is used to implement the embodiments, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded into a computer and executed, all or part of the procedures or functions of the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center in a wired (e.g., coaxial cable, optical fiber, or digital subscriber line (DSL)) or wireless (e.g., infrared, radio wave, or microwave) manner. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device such as a server or data center incorporating one or more available media. The usable media may be magnetic media (e.g., floppy disks, magnetic disks, or magnetic tapes), optical media (e.g., digital video discs (DVDs)), semiconductor media (e.g., solid state drives (SSDs)), and the like.

[0412] The above description of implementation allows those skilled in the art to understand that for convenience and concise description, the above division into functional modules is taken as an illustrative example. In actual application, the above functions can be assigned to different modules and implemented according to requirements. That is, the internal structure of the device is divided into different functional modules to implement all or part of the above functions. For detailed operation processes of the above systems, devices and units, please refer to the corresponding processes in the above method embodiments. Details will not be described again here.

[0413] In some embodiments provided in the present application, it should be understood that the disclosed system, device, and method may be implemented in other manners. For example, the device embodiment described is merely an example. For example, the division into modules or units is merely a logical division of functions, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into other systems, or some features may be ignored or not implemented. Furthermore, the shown or discussed mutual couplings or direct couplings or communication connections may be implemented through some interface. Indirect couplings or communication connections between devices or units may be implemented in an electrical, mechanical, or other form.

[0414] The units described as separate parts may or may not be physically separated, and the parts shown as units may or may not be physical units, and may be located in one place or distributed among multiple network units. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.

[0415] Furthermore, the functional units in the embodiments of the present application may be integrated into one processing unit, each of the units may exist physically independent, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0416] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be essentially implemented in the form of a software product, or the part contributing to the prior art, or all or part of the technical solution. The computer software product is stored in a storage medium and includes some instructions for instructing a computer device (which may be a personal computer, a server, a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present application. The above storage medium includes any medium that can store program code, such as a flash memory, a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disk.

[0417] The above description is merely a specific implementation of the present application, and is not intended to limit the scope of protection of the present application. Any modifications or replacements within the technical scope disclosed in the present application should fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be subject to the scope of protection of the claims.

[0418] This application claims priority to Chinese Patent Application No. 202010880205.9, filed with the State Intellectual Property Office of the People's Republic of China on August 27, 2020, for the invention titled "AUDIO DATA PROCESSING METHOD AND APPRATUS, AND SOUND BOX SYSTEM." The earlier Chinese patent application is hereby incorporated by reference in its entirety.

Claims

1. A full-frequency sound box having a full-frequency sound box body and a first fastening part, The full-frequency sound box body has M speakers, the M speakers are distributed in a plane on the full-frequency sound box body, and the M speakers form K pairs of acoustic dipoles, where M is a positive integer greater than 2, and K is a positive integer equal to or greater than 2; The first fastening part is arranged in a preset fastening area of ​​the full-frequency sound box body, and the first fastening part is configured to be connectable to a second fastening part that is arranged on the body of the low-frequency sound box so that the full-frequency sound box is physically connected to or separated from the low-frequency sound box, the first fastening part has a first communication part, and the first communication part is configured to enable the full-frequency sound box to communicate with the low-frequency sound box, and the first communication part supports multi-channel audio data transmission; The low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box; A pair of acoustic dipoles corresponds to a pair of speakers, At least two pairs of acoustic dipoles among the K pairs of acoustic dipoles satisfy the following condition: d i ≠ d j , where d i is the distance between two speakers constituting the i-th pair of acoustic dipoles, d j is the distance between two speakers constituting the j-th pair of acoustic dipoles, each of i and j is one of 1, 2, ..., K, i ≠ j, and K is a positive integer equal to or greater than 2; the two speakers constituting the i-th pair of acoustic dipoles are configured to reproduce a first frequency band of target audio data, and the two speakers constituting the j-th pair of acoustic dipoles are configured to reproduce a second frequency band of the target audio data, the first frequency band and the second frequency band being different frequency bands. Full frequency sound box.

2. The arrangement directions of the K pairs of acoustic dipoles include at least two of the following: horizontal, vertical, or diagonal upward directions.

2. The full frequency sound box of claim 1.

3. d ｉ >d ｊ In this case, the center frequency of the audio data that can be reproduced by the two speakers that constitute the i-th pair of acoustic dipoles is smaller than the center frequency of the audio data that can be reproduced by the two speakers that constitute the j-th pair of acoustic dipoles.

3. The full frequency sound box according to claim 1 or 2.

4. a passive film disposed on at least one of the M speakers, the passive film configured to extend a low frequency response of the speaker; Each of the at least one speaker corresponds to one passive film, and the passive film is attached to the back of the cavity of the speaker, or each of the at least one speaker corresponds to two passive films, and the two passive films are located on both sides of the cavity of the speaker, respectively.

4. An all frequency soundbox according to any one of claims 1 to 3.

5. The full frequency sound box further comprises N speakers, where N is a positive integer and N is less than or equal to M; the N speakers are respectively arranged back-to-back with N speakers of the M speakers to form N back-to-back speaker pairs, the M speakers facing a first plane and the N speakers facing a second plane, the first plane and the second plane being two planes perpendicular to a vertical projection of the full frequency sound box, the first plane being parallel to the second plane, or The N speakers are arranged facing N speakers of the M speakers respectively to form N facing speaker pairs, the cavities of the M speakers facing a first plane, the cavities of the N speakers facing a second plane, the first plane and the second plane being two planes perpendicular to a vertical projection of the full frequency sound box, and the first plane is parallel to the second plane.

5. An all frequency soundbox according to any one of claims 1 to 4.

6. the two speakers of each pair of the N back-to-back speaker pairs share a cavity; A passive film is disposed in a cavity of at least one speaker pair of the N back-to-back speaker pairs, and one speaker pair of the at least one speaker pair corresponds to two passive films, the two passive films being back-to-back and respectively attached to two sides in the cavity adjacent to the speaker pair.

6. The full frequency sound box of claim 5.

7. The full frequency sound box body has one of the following shapes: ring, circle, tree, W-shape.

7. An all frequency soundbox according to any one of claims 1 to 6.

8. The first fastening portion is further configured to support the full frequency sound box body.

8. An all frequency soundbox according to any one of claims 1 to 7.

9. The first fastening part is a first sheet-like part connected to the full-frequency sound box body; or The first fastening portion is a recess disposed in a preset fastening area of ​​the full frequency sound box body; 9. An all frequency soundbox according to any one of claims 1 to 8.

10. the full frequency sound box having a processor and a transceiver coupled to the processor; The processor is configured to perform multi-band filtering on the audio data to be reproduced, and perform sound field widening processing on the filtered audio data to be reproduced to obtain target audio data, and mid-frequency components and / or high-frequency components of the target audio data are reproduced by the full-frequency sound box; the transceiver is configured to send low-frequency components of the target audio data to the low-frequency sound box by using the first communication unit, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box; 10. An all frequency soundbox according to any one of claims 1 to 9.

11. A low-frequency sound box having a low-frequency sound box body and a second fastening part, The low-frequency sound box body has one or more low-frequency speakers, the second fastening part is arranged in a preset fastening area of ​​the low-frequency sound box body, the second fastening part is arranged on the body of the full-frequency sound box so that the low-frequency sound box is physically connected to or separated from the full-frequency sound box, the second fastening part is configured to be connectable to a first fastening part that is paired with the second fastening part, the second fastening part has a second communication part, the second communication part is configured to enable the low-frequency sound box to communicate with the full-frequency sound box, and the second communication part supports multi-channel audio data transmission; The low-frequency reproduction effect of the low-frequency sound box is better than that of the full-frequency sound box, and the frequency band range of the full-frequency sound box is wider than that of the low-frequency sound box; The low-frequency sound box further comprises a camera or a microphone, and the low-frequency sound box is configured to capture image information of a listener by using the camera or capture an acoustic signal of a listener by using the microphone, and the image information of the listener or the acoustic signal of the listener is used to perform a sound field widening process of the filtered audio data to be reproduced. Low frequency sound box.

12. The second fastening portion is a second sheet-like portion connected to the low-frequency sound box body; or The second fastening portion is a protrusion disposed in a preset fastening area of ​​the low frequency sound box body; 12. The low frequency sound box according to claim 11.

13. The low frequency sound box further comprises a charging port, the charging port being configured to be connected to an external power source to supply power to the low frequency sound box, or to charge the full frequency sound box by using the low frequency sound box when the low frequency sound box is connected to the full frequency sound box.

13. A low frequency sound box according to claim 11 or 12.

14. the low frequency sound box having a processor and a transceiver coupled to the processor; The processor is configured to perform multi-band filtering on the audio data to be reproduced to obtain the filtered audio data to be reproduced, and perform sound field widening processing on the filtered audio data to be reproduced to obtain target audio data, and mid-frequency components and / or high-frequency components of the target audio data are reproduced by the full-frequency sound box; the transceiver is configured to transmit the mid-frequency components and / or the high-frequency components of the target audio data to the full-frequency sound box by using the second communication unit, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box; A low frequency sound box according to any one of claims 11 to 13.

15. A device comprising an all-frequency sound box according to any one of claims 1 to 10 and a low-frequency sound box according to any one of claims 11 to 14, The full-frequency sound box is physically connected to the low-frequency sound box by using the first fastening part and the second fastening part, and the full-frequency sound box communicates with the low-frequency sound box by using the first communication part and the second communication part, the first fastening part and the second fastening part are a group of paired connection parts, and the first communication part and the second communication part are a group of paired communication parts. Sound box system.

16. the full frequency sound box is adapted to reproduce target audio data or to reproduce high and / or mid frequency components of the target audio data; the low frequency sound box is configured to reproduce low frequency components of the target audio data; 16. The sound box system of claim 15.

17. The full frequency sound box is connected to the low frequency sound box in a stacking or mounting mode by using the first fastening part and the second fastening part.

17. A sound box system according to claim 15 or 16.

18. When the first fastening portion is a first sheet-like portion and the second fastening portion is a second sheet-like portion, and the first sheet-like portion is in contact with and bonded to the second sheet-like portion, the full frequency sound box is connected to the low frequency sound box in a stacking mode.

18. A sound box system according to claim 17.

19. The first fastening portion is a first sheet-like portion extending outward along one side of the full-frequency sound box body, and the second fastening portion is a second sheet-like portion extending outward along one side of the low-frequency sound box body, and when the first sheet-like portion is in contact with and coupled to the second sheet-like portion, the full-frequency sound box is connected to the low-frequency sound box in an attachment mode.

18. A sound box system according to claim 17.

20. The first fastening portion is connected to the second fastening portion in a buckle coupling or magnetic coupling mode.

20. A sound box system according to claim 18 or 19.

21. The first fastening part is a recess arranged on a preset fastening area of ​​the full-frequency sound box body, and the second fastening part is a protrusion arranged on a preset fastening area of ​​the low-frequency sound box body, and when the recess is contacted and coupled with the protrusion, the full-frequency sound box is connected to the low-frequency sound box in a stacking mode.

18. A sound box system according to claim 17.

22. The first fastening part is connected to the second fastening part in a buckle or screw fastening mode.

22. The sound box system of claim 21.

23. The sound box system further includes at least one full-frequency sound box, and at least two full-frequency sound boxes included in the sound box system can cooperate with each other. A sound box system according to any one of claims 15 to 22.

24. The sound box system further comprises at least one full-frequency sound box and at least one low-frequency sound box; In the sound box system, one full-frequency sound box corresponds to one low-frequency sound box to constitute one sound box subsystem, and at least two sound box subsystems included in the sound box system can cooperate with each other; A sound box system according to any one of claims 15 to 22.

25. Detecting by a terminal whether the first communication unit of the full frequency sound box according to any one of claims 1 to 10 is connected to the second communication unit of the low frequency sound box according to any one of claims 11 to 14; sending, by the terminal, audio data to be played to the full frequency sound box when the terminal finds through detection that the first communication unit is not connected to the second communication unit; sending, by the terminal, first audio data to the full-frequency sound box and second audio data to the low-frequency sound box when the terminal finds through detection that the first communication unit is connected to the second communication unit, the first audio data being mid-frequency components and / or high-frequency components of the audio data to be played, and the second audio data being low-frequency components of the audio data to be played; sending, by said terminal, audio data to be played to said full frequency sound box; or sending, by said terminal, audio data to be played to said low frequency sound box; 13. An audio data processing method comprising:

26. A method for processing audio data applied to a full frequency soundbox according to any one of claims 1 to 10, comprising the steps of: Obtaining audio data to be played; performing multi-band filtering on the audio data to be played to obtain mid-frequency and / or high-frequency components and low-frequency components of the audio data to be played; performing a sound field widening process on the mid-frequency components and / or the high-frequency components and the low-frequency components of the audio data to be played back to obtain target audio data; sending the low frequency components of the target audio data to the low frequency sound box; having the mid-frequency components and / or the high-frequency components of the target audio data are reproduced by the full-frequency sound box, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box. method.

27. A method for processing audio data applied to a low frequency sound box according to any one of claims 11 to 14, comprising the steps of: Obtaining audio data to be played; performing multi-band filtering on the audio data to be played to obtain mid-frequency and / or high-frequency components and low-frequency components of the audio data to be played; performing a sound field widening process on the mid-frequency components and / or the high-frequency components and the low-frequency components of the audio data to be played back to obtain target audio data; sending the mid-frequency components and / or the high-frequency components of the target audio data to the full-frequency soundbox; having the mid-frequency components and / or the high-frequency components of the target audio data are reproduced by the full-frequency sound box, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box. method.

28. A method for processing audio data applied in a scenario in which a terminal establishes a communication connection with a soundbox system according to any one of claims 15 to 24, comprising the steps of: When the terminal receives a first operation of a user, controlling the full-frequency sound box to operate independently in response to the first operation by the terminal; or When the terminal receives a second operation of the user, controlling the full-frequency sound box and the low-frequency sound box to cooperate with each other in response to the second operation by the terminal. The method according to claim 1,

29. controlling an all-frequency sound box to operate independently in response to the first operation by the terminal; sending, by the terminal, a first command to the sound box system in response to the first operation; The first command is used to control the full frequency sound box to operate independently; The full-frequency sound box operates independently, which means that the full-frequency sound box plays the target audio data; 29. The method of claim 28.

30. sending a first command to the sound box system; sending said first command to said low frequency sound box.

30. The method of claim 29.

31. controlling the full frequency sound box and the low frequency sound box to cooperate in response to the second operation by the terminal; sending a second command to the sound box system in response to the second operation by the terminal; the second instructions are used to control the full frequency sound box and the low frequency sound box to operate; The full-frequency sound box and the low-frequency sound box cooperate with each other means that the full-frequency sound box reproduces the mid-frequency and / or high-frequency components of the target audio data, and the low-frequency sound box reproduces the low-frequency components of the target audio data.

31. The method of any one of claims 28 to 30.

32. sending a second command to the sound box system; sending said second command to said low frequency sound box.

32. The method of claim 31 .

33. The first operation is a selection operation performed by the user on a first option in a first interface of the terminal, the first option corresponding to the full frequency sound box operating independently; The second operation is a selection operation performed by the user on a second option in the first interface of the terminal, the second option corresponding to the full frequency sound box and the low frequency sound box working together.

33. A method according to any one of claims 28 to 32.

34. When the full frequency sound box operates independently, the method includes: The method further includes displaying first prompt information by the terminal when the terminal determines that the audio data to be currently played is deep low-frequency audio data; The first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to cooperate with each other.

34. A method according to any one of claims 28 to 33.

35. The method comprises: receiving a third operation by the terminal; and Controlling and activating a camera or a microphone of the low-frequency sound box in response to the third operation by the terminal; Further comprising 35. A method according to any one of claims 28 to 34.

36. The sound box system includes a plurality of full-frequency sound boxes, the method comprising: determining, by the terminal, a correspondence between the channels of the audio data and the plurality of full-frequency sound boxes based on position information of the plurality of full-frequency sound boxes; and displaying information about the correspondence between the channels of the audio data and the plurality of full-frequency sound boxes.

36. A method according to any one of claims 28 to 35.

37. A method for processing audio data applied in a scenario in which a terminal establishes a communication connection with a soundbox system according to any one of claims 15 to 24, comprising the steps of: determining, by the terminal, a type of target audio data, the type of the target audio data having deep low frequency or non-deep low frequency; When the type of the target audio data is the non-deep low frequency, controlling a full frequency sound box by the terminal to operate independently; or When the type of the target audio data is the deep low frequency, controlling, by the terminal, the full frequency sound box and the low frequency sound box to cooperate with each other; The method according to claim 1,

38. Controlling the full frequency sound box to operate independently by the terminal; sending a first command by said terminal to said sound box system; The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operating independently means that the full-frequency sound box plays the target audio data.

38. The method of claim 37.

39. sending a first command to the sound box system; sending said first command to said low frequency sound box.

39. The method of claim 38.

40. Controlling, by the terminal, the full-frequency sound box and the low-frequency sound box to cooperate with each other, sending a second command by the terminal to the sound box system; The second instruction is used to control the full-frequency sound box and the low-frequency sound box to operate, and the full-frequency sound box and the low-frequency sound box working together means that the full-frequency sound box plays the mid-frequency components and / or the high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data.

40. A method according to any one of claims 37 to 39.

41. sending a second command to the sound box system; sending said second command to said low frequency sound box.

41. The method of claim 40.

42. A detection module and a transmission module, said detection module is configured to detect whether said first communication part of a full frequency sound box according to any one of claims 1 to 10 is connected to said second communication part of a low frequency sound box according to any one of claims 11 to 14; The sending module is configured to send audio data to be played to the full frequency sound box when the detection module finds through detection that the first communication unit is not connected to the second communication unit; or The sending module is configured to send first audio data to the full frequency sound box and send second audio data to the low frequency sound box when the detection module finds through detection that the first communication unit is connected to the second communication unit, the first audio data being mid-frequency components and / or high-frequency components of the audio data to be played, and the second audio data being low-frequency components of the audio data to be played, or the transmitting module is configured to send audio data to be played to the full frequency sound box; or the transmitting module is configured to send audio data to be played to the low-frequency sound box; Terminal.

43. A full frequency sound box, The present invention includes an acquisition module, a filtering module, a processing module, and a sending module, the acquisition module is configured to acquire audio data to be played; the filtering module is configured to perform multi-band filtering on the audio data to be played back to obtain mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back; the processing module is configured to perform a sound field widening process on the mid-frequency components and / or the high-frequency components and the low-frequency components of the audio data to be reproduced to obtain target audio data; The sending module is configured to send the low frequency components of the target audio data to a low frequency sound box through a first communication unit included in a first fastening unit, the first fastening unit is arranged in a preset fastening area on the body of the full frequency sound box, the first fastening unit is configured to be connectable to a second fastening unit paired with the first fastening unit, the second fastening unit is arranged on the body of the low frequency sound box so that the full frequency sound box is physically connected to or separated from the low frequency sound box, the first communication unit is configured to enable the full frequency sound box to communicate with the low frequency sound box, and the first communication unit supports multi-channel audio data transmission; the mid-frequency components and / or the high-frequency components of the target audio data are reproduced by the full-frequency sound box, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box; The body of the full frequency sound box has M speakers distributed in a plane on the body, the M speakers forming K pairs of acoustic dipoles, M being a positive integer greater than 2, and K being a positive integer equal to or greater than 2; A pair of acoustic dipoles corresponds to a pair of speakers, At least two pairs of acoustic dipoles among the K pairs of acoustic dipoles satisfy the following condition: d i ≠ d j , where d i is the distance between two speakers constituting the i-th pair of acoustic dipoles, d j is the distance between two speakers constituting the j-th pair of acoustic dipoles, each of i and j is one of 1, 2, ..., K, i ≠ j, and K is a positive integer equal to or greater than 2; the two speakers constituting the i-th pair of acoustic dipoles are configured to reproduce a first frequency band of target audio data, and the two speakers constituting the j-th pair of acoustic dipoles are configured to reproduce a second frequency band of the target audio data, the first frequency band and the second frequency band being different frequency bands. Full frequency sound box.

44. A low frequency sound box, The present invention includes an acquisition module, a filtering module, a processing module, and a sending module, the acquisition module is configured to acquire audio data to be played; the filtering module is configured to perform multi-band filtering on the audio data to be played back to obtain mid-frequency components and / or high-frequency components and low-frequency components of the audio data to be played back; the processing module is configured to perform a sound field widening process on the mid-frequency components and / or the high-frequency components and the low-frequency components of the audio data to be reproduced to obtain target audio data; The transmitting module is configured to send the mid-frequency components and / or the high-frequency components of the target audio data to the full-frequency sound box through a second communication unit included in a second fastening unit, the second fastening unit is arranged in a preset fastening area on the body of the low-frequency sound box, the second fastening unit is configured to be connectable to a first fastening unit paired with the second fastening unit, the first fastening unit being arranged on the body of the full-frequency sound box so that the low-frequency sound box is physically connected to or separated from the full-frequency sound box, the second communication unit is configured to enable the low-frequency sound box to communicate with the full-frequency sound box, and the second communication unit supports multi-channel audio data transmission; the mid-frequency components and / or the high-frequency components of the target audio data are reproduced by the full-frequency sound box, and the low-frequency components of the target audio data are reproduced by the low-frequency sound box; The low frequency sound box further comprises an image capture module or an audio capture module; the image capture module is configured to capture image information of a listener; or the audio capture module is configured to capture an acoustic signal of a listener; the image information of the listener or the acoustic signal of the listener is used to perform a sound field widening process of the filtered audio data to be reproduced, Low frequency sound box.

45. A terminal for use in a scenario for establishing a communication connection with a sound box system according to any one of claims 15 to 24, comprising: A receiving module and a control module, The control module is configured to control the full frequency sound box to operate independently in response to a first operation of a user when the receiving module receives the first operation of the user; or The control module is configured to control the full-frequency sound box and the low-frequency sound box to cooperate with each other in response to a second operation of the user when the receiving module receives the second operation of the user. Terminal.

46. The terminal further comprises a transmitting module; the control module is specifically configured to control the transmission module to send a first command to the sound box system in response to the first operation; The first command is used to control the full frequency sound box to operate independently; The full-frequency sound box operates independently, which means that the full-frequency sound box plays the target audio data; 46. ​​The terminal of claim 45.

47. the transmitting module is specifically configured to send the first command to the low frequency sound box; 47. The terminal of claim 46.

48. The terminal further comprises a transmitting module; the control module is specifically configured to control the transmission module to send a second command to the sound box system in response to the second operation; the second instructions are used to control the full frequency sound box and the low frequency sound box to operate; The full-frequency sound box and the low-frequency sound box cooperate with each other means that the full-frequency sound box reproduces the mid-frequency and / or high-frequency components of the target audio data, and the low-frequency sound box reproduces the low-frequency components of the target audio data. A terminal according to any one of claims 45 to 47.

49. the transmitting module is specifically configured to send the second command to the low frequency sound box; 49. The terminal of claim 48.

50. The first operation is a selection operation performed by the user on a first option in a first interface of the terminal, the first option corresponding to the full frequency sound box operating independently; The second operation is a selection operation performed by the user on a second option in the first interface of the terminal, the second option corresponding to the full frequency sound box and the low frequency sound box working together. A terminal according to any one of claims 45 to 49.

51. The terminal further comprises a display module; The display module is configured to display first prompt information when the full-frequency sound box operates independently and the terminal determines that the audio data to be currently played is deep low-frequency audio data; The first prompt information is used to prompt the full-frequency sound box and the low-frequency sound box to cooperate with each other. A terminal according to any one of claims 45 to 50.

52. The receiving module is further configured to receive a third operation; The control module is further configured to control and activate a camera or a microphone of the low-frequency sound box in response to the third operation. A terminal according to any one of claims 45 to 51.

53. The terminal further comprises a determination module and a display module, and the sound box system comprises a plurality of full-frequency sound boxes; The determination module is configured to determine a correspondence between a channel of audio data and the plurality of full-frequency sound boxes based on position information of the plurality of full-frequency sound boxes; the display module is configured to display information regarding the correspondence between the channels of the audio data and the plurality of full-frequency sound boxes; A terminal according to any one of claims 45 to 52.

54. A terminal for use in a scenario for establishing a communication connection with a sound box system according to any one of claims 15 to 24, comprising: A decision module and a control module, the determination module is configured to determine a type of target audio data, the type of the target audio data comprising deep low frequency or non-deep low frequency; the control module is configured to control a full frequency sound box to operate independently when the type of the target audio data is the non-deep low frequency; or the control module is configured to control the full frequency sound box and the low frequency sound box to cooperate when the type of the target audio data is the deep low frequency; Terminal.

55. The terminal further comprises a transmitting module; the control module is specifically configured to control the transmission module to send a first command to the sound box system; The first command is used to control the full-frequency sound box to operate independently, and the full-frequency sound box operating independently means that the full-frequency sound box plays the target audio data.

55. The terminal of claim 54.

56. the transmitting module is specifically configured to send the first command to the low frequency sound box; 56. The terminal of claim 55.

57. The terminal further comprises a transmitting module; the control module is specifically configured to control the transmission module to send a second command to the sound box system; The second instruction is used to control the full-frequency sound box and the low-frequency sound box to operate, and the full-frequency sound box and the low-frequency sound box working together means that the full-frequency sound box plays the mid-frequency components and / or the high-frequency components of the target audio data, and the low-frequency sound box plays the low-frequency components of the target audio data. A terminal according to any one of claims 54 to 56.

58. the transmitting module is specifically configured to send the second command to the low frequency sound box; 58. The terminal of claim 57.

59. a memory and at least one processor coupled to the memory; The memory is configured to store instructions; 27. The method of claim 26, wherein the instructions are executed after being read by the at least one processor. Full frequency sound box.

60. A computer program comprising: The method of claim 26 is carried out when the computer program is run on a computer, A computer-readable storage medium.

61. a memory and at least one processor coupled to the memory; The memory is configured to store instructions; 28. The method of claim 27, wherein the instructions are executed after being read by the at least one processor. Low frequency sound box.

62. A computer program comprising: The method of claim 27 is carried out when the computer program is run on a computer, A computer-readable storage medium.

63. a memory and at least one processor coupled to the memory; The memory is configured to store instructions; The method of claim 25, any one of claims 28 to 36 or any one of claims 37 to 41 is executed after the instructions have been read by the at least one processor. Terminal.

64. A computer program comprising: The method according to claim 25, any one of claims 28 to 36 or any one of claims 37 to 41 is carried out when the computer program is run on a computer, A computer-readable storage medium.

Images