Audio mixing and data transmission method, device and system based on charging bin

Abstract

The invention discloses an audio mixing and data transmission method, device and system based on a charging bin, and the method comprises the steps: receiving accompaniment audio data transmitted by a mobile terminal in a standard protocol mode in a first time period when a receiving time slot arrives; in the first time period, human voice audio data collected by a microphone are obtained; performing sound mixing processing on the accompaniment audio data and the voice audio data to obtain mixed karaoke audio data; and in the second time period, broadcasting the karaoke audio data to the plurality of audio playing devices in a broadcast form, so that the plurality of audio playing devices play the karaoke audio data, and when the number of the plurality of audio playing devices is more than one, the plurality of audio playing devices can receive and play the karaoke audio data at the same time. When the number of the audio playing devices is more than one, the karaoke audio data can be received and played at the same time, so that the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless audio data communication processing, and in particular to a method, device and system for audio mixing and data transmission based on a charging compartment. Background Art

[0002] With the development of smart device technology, its application functions are becoming more and more abundant. For example, users can use TWS headphones or Bluetooth speakers to realize KTV functions. Users need a combination of mobile phones, Bluetooth speakers and TWS headphones. By connecting TWS headphones to mobile phones or Bluetooth speakers with mobile phones, TWS headphones capture the user's voice, and the mobile phone provides music accompaniment. The voice and accompaniment are mixed on the mobile phone or Bluetooth speaker and then broadcast through the Bluetooth speaker.

[0003] Taking the charging box with karaoke as an example, in the environment of a DIY small KTV, the charging box collects the human voice through the sound pickup module, and obtains the accompaniment music of the mobile phone through Bluetooth connection. The human voice and accompaniment music are then mixed and transmitted to the TWS headphones or Bluetooth speakers, thereby realizing karaoke based on the charging box.

[0004] However, the karaoke method based on the charging case in the prior art can only transmit the same audio signal to a pair of headphones or a pair of speakers, and cannot transmit audio signals to multiple different headphones and / or speakers at the same time, that is, it cannot achieve the purpose of sharing audio data simultaneously.

[0005] In addition, during the transmission of karaoke audio data, lag is likely to occur.

[0006] Therefore, how to achieve the simultaneous sharing of karaoke audio data by multiple different headphones and / or speakers has become a technical problem that needs to be solved urgently;

[0007] On this basis, how to reduce the lag phenomenon during the playback of karaoke audio data has become another technical problem that needs to be solved urgently. Summary of the invention

[0008] Based on the above situation, the main purpose of the present invention is to provide an audio mixing and data transmission method, device and system based on a charging case, so as to enable multiple different headphones and / or speakers to share karaoke audio data at the same time.

[0009] To achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0010] In the first aspect, an embodiment of the present invention discloses an audio mixing transmission method based on a charging compartment, which is applied to the charging compartment. The charging compartment, a mobile terminal and an audio playback device constitute a karaoke system for data interaction. The number of audio playback devices is several. The method includes:

[0011] Step S100, in a first time period, receiving the accompaniment audio data sent by the mobile terminal when a receiving time slot arrives in a standard protocol manner, and sending ACK / NACK response information to the mobile terminal when a response time slot arrives;

[0012] Step S200, obtaining human voice audio data collected by a microphone in a first time period, wherein the microphone is built into the charging compartment;

[0013] Step S300, mixing the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data;

[0014] Step S400, in the second time period, broadcast the karaoke audio data to several audio playback devices in the form of broadcasting, so that the several audio playback devices play the karaoke audio data, and when the number of the several audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time; wherein the first time period and the second time period constitute a karaoke audio data receiving and sending cycle.

[0015] Optionally, in step S100, the accompaniment audio data is received in a mode of alternating sending and receiving time slots in a first time period;

[0016] In step S400, the second time period is operated in the sending mode for the entire time period, so that the second time period is entirely used for broadcasting karaoke audio data.

[0017] Optionally, in step S400, the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that a plurality of audio playback devices can use at least 2 Bluetooth standard communication time slots to scan and receive karaoke audio data.

[0018] Optionally, the second time period is shorter than the first time period;

[0019] In step S100, the received accompaniment audio data is composed of a plurality of encoded data packets;

[0020] Between step S300 and step S400, the method further includes:

[0021] Step S310, re-encode the karaoke audio data consisting of the accompaniment audio data and the vocal audio data into a data packet, so that one data packet is broadcast when the karaoke audio data is broadcast.

[0022] Optionally, the working mode in the first time period is an EDR mode, in which data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset;

[0023] The working mode of the second time period is ADV mode. In ADV mode, the charging bin works in broadcast mode to broadcast and transmit data externally.

[0024] The method also includes:

[0025] In response to the mode switching instruction, the EDR mode and the ADV mode are exited, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset.

[0026] In a second aspect, an embodiment of the present invention discloses a data transmission method based on a charging bin, which is applied to a charging bin, a mobile terminal and an audio playback device to form a karaoke system, and the method includes:

[0027] The charging compartment executes the method of the first aspect above;

[0028] During the execution of step S400 by the charging compartment, the mobile terminal sends the lyrics corresponding to the accompaniment audio data to the lyrics board;

[0029] The lyrics board synchronously displays the lyrics while the charging compartment executes step S400.

[0030] In a third aspect, an embodiment of the present invention discloses an audio mixing transmission device based on a charging compartment, which is applied to the charging compartment. The charging compartment, the mobile terminal and the audio playback device constitute a karaoke system for data interaction. The number of audio playback devices is several, and the device includes:

[0031] The accompaniment receiving module is used to receive the accompaniment audio data sent by the mobile terminal in a first time period in a standard protocol manner when a receiving time slot arrives, and send ACK / NACK response information to the mobile terminal when a response time slot arrives;

[0032] A human voice acquisition module, used to acquire human voice audio data collected by a microphone in a first time period, wherein the microphone is built into the charging compartment;

[0033] A mixing processing module is used to mix the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data;

[0034] The mixing broadcast module is used to broadcast karaoke audio data to several audio playback devices in the form of broadcast in the second time period, so that the several audio playback devices play the karaoke audio data, and when the number of the several audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time; wherein the first time period and the second time period constitute a karaoke audio data receiving and sending cycle.

[0035] Optionally, in the accompaniment receiving module, the accompaniment audio data is received by operating in a mode of alternating sending and receiving time slots in a first time period;

[0036] In the audio mixing broadcast module, the second time period is operated in the sending mode throughout the entire time period, so that the second time period is entirely used for broadcasting karaoke audio data.

[0037] Optionally, in the audio mixing and broadcasting module, the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that a plurality of audio playback devices can utilize at least 2 Bluetooth standard communication time slots to scan and receive karaoke audio data.

[0038] Optionally, the second time period is shorter than the first time period;

[0039] In the accompaniment receiving module, the received accompaniment audio data is composed of a plurality of coded data packets;

[0040] The device also includes:

[0041] The encoding module is used to re-encode the karaoke audio data composed of the accompaniment audio data and the vocal audio data into a data packet, so that one data packet is broadcast when the karaoke audio data is broadcast.

[0042] Optionally, the working mode in the first time period is an EDR mode, in which data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset;

[0043] The working mode of the second time period is ADV mode. In ADV mode, the charging bin works in broadcast mode to broadcast and transmit data externally.

[0044] The device also includes:

[0045] The mode switching module is used to exit the EDR mode and the ADV mode in response to the mode switching instruction, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset.

[0046] In a fourth aspect, an embodiment of the present invention discloses a Bluetooth headset charging compartment, comprising:

[0047] The method of the first aspect is used to perform audio mixing and transmission, or the device includes the third aspect.

[0048] Optionally, the Bluetooth headset charging case also cooperates with a mobile terminal and an audio playback device to implement the method of the second aspect above.

[0049] In a fifth aspect, an embodiment of the present invention discloses a computer-readable storage medium having a computer program stored thereon, wherein the computer program stored in the storage medium is used to be executed by a processor to implement the method of the first aspect above.

[0050] In a sixth aspect, an embodiment of the present invention discloses a chip for a Bluetooth communication charging case, which has an integrated circuit thereon, and the integrated circuit is designed to implement the method of the first aspect above.

[0051] In a seventh aspect, an embodiment of the present invention discloses an audio mixing and transmission system based on a charging compartment, comprising:

[0052] A Bluetooth charging case adopts the method of the first aspect to perform audio mixing and transmission, or includes the device of the third aspect.

[0053] In an eighth aspect, an embodiment of the present invention discloses a data transmission system based on a charging bin, comprising:

[0054] A Bluetooth charging compartment, which uses the method of the first aspect to perform audio mixing and transmission, or includes the device of the third aspect;

[0055] The mobile terminal, during the execution of step S400 by the charging compartment, sends the lyrics corresponding to the accompaniment audio data to the lyrics board;

[0056] The lyrics board synchronously displays the lyrics while the charging compartment executes step S400.

[0057] Beneficial effects:

[0058] According to an audio mixing and data transmission method, device and system based on a charging bin disclosed in an embodiment of the present invention, a first time period and a second time period are used to form a karaoke audio data receiving and sending cycle, and a plurality of different headphones and / or speakers are simultaneously shared with karaoke audio data by organically combining sending and receiving accompaniment audio data according to a Bluetooth connection in the first time period and broadcasting karaoke audio data in the second time period. Specifically, in the first time period, the accompaniment audio data sent by the mobile terminal is received in a standard protocol manner when the receiving time slot arrives, and the human voice audio data collected by the microphone is obtained, thereby mixing to obtain the karaoke audio data; then, in the second time period, the karaoke audio data is broadcast to several audio playback devices in the form of a broadcast. Since it is in the form of a broadcast, each audio playback device can simultaneously scan and receive the broadcast karaoke audio data during the broadcast, that is, when the number of audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time, thereby improving the user experience.

[0059] In addition, compared with the one-receive-one-send-and-response method, the concentrated broadcasting of karaoke audio data in the second time period can reduce the jamming phenomenon during the playback of karaoke audio data because the broadcasting can omit the data retransmission link.

[0060] Other beneficial effects of the present invention will be explained in the specific implementation manner through the introduction of specific technical features and technical solutions. Through the introduction of these technical features and technical solutions, those skilled in the art should be able to understand the beneficial technical effects brought about by the technical features and technical solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The embodiments of the present invention will be described below with reference to the accompanying drawings.

[0062] Figure 1 This is a schematic diagram of an example of a karaoke system disclosed in this embodiment;

[0063] Figure 2 This is a flow chart of an audio mixing and transmission method based on a charging compartment disclosed in this embodiment;

[0064] Figure 3 This is a schematic diagram of the structure of a charging compartment module disclosed in this embodiment;

[0065] Figure 4 A schematic diagram of a timing sequence for sending, receiving and mixing audio data disclosed in this embodiment;

[0066] Figure 5 This is a schematic diagram of another example of a karaoke system disclosed in this embodiment;

[0067] Figure 6 A schematic diagram of a three-terminal system structure consisting of a mobile terminal, a Bluetooth headset and a charging compartment thereof disclosed in this embodiment;

[0068] Figure 7 This is a schematic diagram of the structure of an audio mixing and transmission device based on a charging compartment disclosed in this embodiment. DETAILED DESCRIPTION

[0069] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the following detailed description of the present invention, some specific details are described in detail. In order to avoid confusing the essence of the present invention, known methods, processes, procedures, and components are not described in detail.

[0070] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.

[0071] Unless the context clearly requires otherwise, throughout the specification and claims, the words "include", "comprising" and similar words should be interpreted in an inclusive sense rather than an exclusive or exhaustive sense; that is, in the sense of "including but not limited to".

[0072] In the description of the present invention, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0073] In order to realize that multiple different headphones and / or speakers share karaoke audio data at the same time, this embodiment discloses an audio mixing transmission method based on a charging warehouse, which is applied to the charging warehouse. The charging warehouse, the mobile terminal and the audio playback device constitute a karaoke system for data interaction. The number of audio playback devices is several, please refer to Figure 1 , Figure 1 This is a schematic diagram of an example of a karaoke system disclosed in this embodiment. The karaoke system includes: a charging compartment 1, an audio player 2, and a mobile terminal 3. The charging compartment 1 is provided with a microphone 11 for collecting external sounds; the audio player 2 includes a Bluetooth headset 21 and / or a Bluetooth speaker 22. In this embodiment, the specific number of audio players 2 is not limited; the mobile terminal 3 can be a mobile phone, a tablet, or other device with an audio processing function. In this embodiment, the charging compartment 1 is used to collect human voices, and after mixing with the accompaniment audio provided by the mobile terminal 3, it is transmitted to the audio player 2 for playback, thereby realizing karaoke.

[0074] Please refer to Figure 2 , Figure 2 The flowchart of the audio mixing transmission method based on the charging bin disclosed in this embodiment includes: step S100, step S200, step S300 and step S400, wherein:

[0075] Step S100, in the first time period, receiving the accompaniment audio data sent by the mobile terminal when the receiving time slot arrives in a standard protocol manner. Figure 1 and Figure 3 , Figure 3 This is a schematic diagram of the charging bin module structure disclosed in this embodiment. In this embodiment, the charging bin 1 establishes a Bluetooth communication connection with the mobile terminal 3 through the Bluetooth module 11, and interacts with the mobile terminal 3 in the sending and receiving time slots according to the standard protocol. Specifically, when the receiving time slot arrives, the data packets sent by the mobile terminal 3 are received, each of which is loaded with accompaniment audio data, and ACK / NACK response information is sent to the mobile terminal when the response time slot arrives.

[0076] Step S200, in the first time period, obtain the human voice audio data collected by the microphone. Figure 3 The microphone 12 is built in the charging compartment 1, and the charging compartment 1 collects the user's voice to obtain voice audio data through the microphone 12. It should be noted that this embodiment does not limit the execution order between step S100 and step S200.

[0077] Step S300, mixing the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data. Specifically, after obtaining the accompaniment audio data and the vocal audio data, the accompaniment audio data and the vocal audio data can be processed with sound effects and mixed to obtain mixed karaoke audio data, wherein the karaoke audio data includes mixed vocals and accompaniment. Figure 3 The mixing process can be implemented by the mixing module. The Bluetooth module obtains the music accompaniment audio data of the mobile phone, and the microphone obtains the user's vocal data. Under the control of the processor module, the mixing module mixes the accompaniment audio data and the vocal data to form mixed audio data. The mixing module may include an ADC and a DAC unit, which can convert the analog signal of the accompaniment audio and the vocal audio into a digital signal. This part is the prior art in this technical field and will not be described in detail.

[0078] Step S400, in the second time period, broadcast the karaoke audio data to a plurality of audio playback devices in the form of a broadcast. Figure 1 and Figure 3 In the specific implementation process, the karaoke audio data can be broadcasted through the Bluetooth module 11 so that several audio playback devices can play the karaoke audio data. Figure 1 The audio playback device 2 referred to in this embodiment can be a Bluetooth headset 21, a Bluetooth speaker 22, or a combination of a Bluetooth headset 21 and a Bluetooth speaker 22; the number of audio playback devices 2 can be one or more. In the specific implementation process, in the second time period, each audio playback device is always in a scanning state, so that they can each receive the karaoke audio data broadcast by the charging compartment 1. In this way, when the number of audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time.

[0079] In the specific implementation process, the first time period and the second time period constitute a karaoke audio data receiving and transmitting cycle T, that is, each karaoke audio data receiving and transmitting cycle T includes a first time period and a second time period, and different and adjacent receiving and transmitting cycles T, the first time period and the second time period are alternated.

[0080] In order to reduce data jamming and improve data transmission efficiency, in an optional embodiment, in step S100, the system works in a mode of alternating sending and receiving time slots in the first time period to receive the accompaniment audio data; in step S400, the system works in a sending mode during the entire second time period, so that the second time period is used entirely for broadcasting karaoke audio data. Figure 4 , Figure 41 is a timing diagram of audio data receiving and sending mixing disclosed in the present embodiment. Specifically, in a first time period, the mobile terminal 3 sends accompaniment audio data to the charging compartment 1 according to the standard protocol in the receiving and sending time slot, such as accompaniment audio data packets acc 1, acc 2...acc n; in the first time period, the Bluetooth module of the charging compartment 1 operates in a standard mode, and receives accompaniment audio data in an alternating mode of receiving and sending time slots, such as accompaniment audio data packets acc 1, acc 2...acc n, and replies ACK response information to the mobile terminal 3 after receiving the accompaniment audio data packet; in the first time period, the microphone of the charging compartment 1 is also continuously collecting human voice audio data, such as human voice audio data packets voc 1, voc 2...voc n; in the present embodiment, after receiving the accompaniment audio data packet and the human voice audio data packet, the charging compartment 1 will decode these audio data packets, extract the accompaniment audio data and the human voice audio data in each data packet, and then perform sound effect processing and mixing processing on these accompaniment audio data and the human voice audio data to obtain karaoke audio data, such as karaoke audio data packets mac 1, mac 2...mac n; In the second time period, the Bluetooth module of the charging case 1 works in the sending mode all the time, so as to broadcast the karaoke audio data to several audio playback devices all the time. That is, the Bluetooth module of the charging case 1 centrally broadcasts all the karaoke audio data (mac-all) received and mixed in the first time period in the second time period, thereby improving the data transmission efficiency. Moreover, since the Bluetooth module of the charging case 1 works in the sending mode all the time, that is, the state switching between receiving and sending will not be performed, on the one hand, the time slot waste and bandwidth occupation caused by the state switching is avoided, and on the other hand, there is no need to resend a single data packet, thereby reducing the bandwidth occupation, thereby reducing the data jam phenomenon.

[0081] In order to have enough time to broadcast the karaoke audio data, in an optional embodiment, in step S400, the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that several audio playback devices can use at least 2 Bluetooth standard communication time slots to scan and receive the karaoke audio data. In this embodiment, in the second time period, no time slot division is performed, but the whole time period works in the sending state. In the specific implementation process, the Bluetooth module of the charging compartment 1 broadcasts the karaoke audio data for a duration of at least 2 Bluetooth standard communication time slots in the second time period. During this period, several audio playback devices all work in the scanning mode in the second time period, that is, in the at least 2 Bluetooth standard communication time slots, several audio playback devices are scanning and receiving karaoke audio data.

[0082] In order to further improve the data transmission efficiency, in an optional embodiment, the duration of the second time period is shorter than the duration of the first time period. Specifically, the second time period can be much shorter than the duration of the first time period, thereby reducing the data incoherence caused by the long interval between receiving the accompaniment audio data and the vocal audio data.

[0083] In step S100, the received accompaniment audio data is composed of a plurality of coded data packets; between step S300 and step S400, it also includes: step S310, re-encoding the karaoke audio data composed of the accompaniment audio data and the human voice audio data into a data packet, so that a data packet is broadcast when the karaoke audio data is broadcast. Specifically, the data received in the first time period is carried by a plurality of encoded accompaniment audio data packets, and each encoded data packet contains information such as a frame header and a frame tail. In this embodiment, by re-encoding the karaoke audio data composed of the accompaniment audio data and the human voice audio data into a data packet, the frame header, the frame tail and other data can be reduced, and then the data transmission amount of the karaoke audio data broadcast in the second time period is reduced, thereby improving the data transmission efficiency. In some embodiments, the broadcast data packet can also be compressed so that the duration occupied by the broadcast data is shorter than the duration of the EDR mode to send and receive data, thereby improving the coherence of the data.

[0084] It should be emphasized that in this embodiment, by combining the two technical means of reducing the length of the second time period and coordinating data re-encoding, at least three technical effects are achieved: avoiding the problem of data incoherence, ensuring the integrity of data transmission, and improving data transmission efficiency.

[0085] To facilitate technical personnel in the field to understand the working process, please refer to Figure 3 and Figure 4 , in each receiving and transmitting time slot, the vocal audio data (voc 1, voc 2...) acquired by the microphone is sent to the mixing module, and the accompaniment audio data (acc 1, acc 2...) acquired by the Bluetooth module is also sent to the mixing module, and the mixing module mixes the vocal audio data and the accompaniment audio data to form mixed audio data (mac 1, mac 2...). After several time slots in the first time period, the charging warehouse switches from the EDR time period to the ADV time period (that is, the second time period). In the second time period, the mixing module sends all the mixed audio data (mac-all) to the Bluetooth module, and the Bluetooth module broadcasts externally in the ADV time period. At this time, the Bluetooth headset and the Bluetooth speaker can obtain the broadcast audio data in the ADV time period and play it in their respective audio playback units. In this embodiment, the ADV time period is not further decomposed into time slots, but the ADV time period includes at least 2 time slots and more.

[0086] In the specific implementation process, the number of time slots in the first time period depends on the data processing capacity and timeliness of the charging warehouse. If the packet loss rate has a low impact, the number of time slots in the first time period can be appropriately increased. In this way, even if a data packet is lost, it will not cause serious auditory impact.

[0087] In order to realize the application of multiple scenarios of the charging warehouse, such as the conventional headphone mode and the karaoke mode of the present application, and to be able to switch back and forth between these scenarios, in an optional embodiment, different working modes are configured for the charging warehouse to realize the communication configuration in different scenarios. For details, please refer to Figure 4 , the working mode of the first time period is EDR mode, in which data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset; the working mode of the second time period is ADV mode, in which the charging compartment works in broadcast mode to broadcast data to the outside; the method disclosed in this embodiment also includes: exiting the EDR mode and ADV mode in response to the mode switching instruction, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset. In this embodiment, by configuring different working modes for the charging compartment, it is realized that the charging compartment can be used to switch its own working mode, conveniently switch back and forth between the karaoke scene and the headset scene; it can also switch the mode of the Bluetooth headset, and conveniently switch back and forth between the karaoke scene and the headset scene. It should be noted that, based on the fact that the Bluetooth headset and the charging compartment are usually from the same manufacturer, the manufacturer can customize the control instructions to modify the protocols of the Bluetooth headset and the charging compartment to realize the control of the communication mode and communication object of the Bluetooth headset and the charging compartment. It can be seen that in this embodiment, the user only needs one action to realize the switching control of multiple subjects in different scenes, which simplifies the user operation and improves the user experience.

[0088] In order to visually present lyrics to users and improve user experience, this embodiment also discloses a data transmission method based on a charging bin, which is applied to a karaoke system composed of a charging bin, a mobile terminal and an audio playback device. Please refer to Figure 1 The karaoke system further includes a lyrics board 4, and data is exchanged between the lyrics board 4 and the mobile terminal 3. The data transmission method includes:

[0089] The charging compartment executes the method disclosed in the above embodiment; while the charging compartment executes step S400 to broadcast the karaoke audio data to several audio playback devices in the form of a broadcast, the mobile terminal sends the lyrics corresponding to the accompaniment audio data to the lyrics board 4; the lyrics board 4 synchronously displays the lyrics during the charging compartment executes step S400, thereby achieving that while the audio playback device plays the karaoke data, the lyrics board 4 synchronously presents the lyrics of the corresponding song to the user.

[0090] To facilitate understanding by those skilled in the art, the specific application scenarios of the audio mixing transmission method and the data transmission method based on the charging bin disclosed in this embodiment are described below:

[0091] Please refer to Figure 1 , Figure 1 In order to make the charging compartment work in karaoke mode, the charging compartment 1 is provided with a microphone 11, which is used to obtain the user's voice. The display module of the charging compartment 1 is provided with two modes that can be selected by touch, including TWS mode and ADV mode. Figure 1 What is shown is the ADV mode (broadcast audio mode, also known as the karaoke mode). Its specific working principle is as follows: the charging compartment 1 obtains the song accompaniment audio from the mobile terminal 3, the charging compartment 1 obtains the user's voice through the microphone 11, performs mixing processing at the charging compartment 1, and then performs Bluetooth broadcasting through the charging compartment 1. After the Bluetooth headset 21, Bluetooth speaker 22 and / or other audio playback device 2 obtain the Bluetooth broadcast, audio playback is performed; at the same time, the mobile terminal 3 will send the corresponding lyrics of the song to the lyrics board 4 via Bluetooth connection. Thus, a creative DIY small KTV system architecture is formed. In this scenario, users can share karaoke audio data with various audio playback devices, such as Bluetooth headsets 21 and Bluetooth speakers 22, to achieve sharing of karaoke works with different users.

[0092] In some scenarios, users use the charging case and Bluetooth headphones to sing karaoke alone. In this scenario, the lyrics board 4 and the Bluetooth speaker 22 may not be used. Figure 5 , Figure 5 This is another example schematic diagram of a karaoke system disclosed in this embodiment. In this system, a mobile phone, an earphone charging compartment and a TWS earphone are included. At this time, the lyrics board 4 and the Bluetooth speaker 22 are no longer necessary components (such as Figure 5 The charging compartment 1 is provided with a microphone 11, which is used to obtain the user's voice. The display module of the charging compartment 1 is provided with two modes that can be selected by touch, including TWS mode and ADV mode. Figure 5 What is shown is the ADV mode (broadcast audio mode, that is, karaoke mode). Its specific working principle is: the charging compartment 1 obtains the song accompaniment audio from the mobile terminal 3, the charging compartment 1 obtains the user's voice through the microphone 11, performs reverberation processing at the charging compartment 1, and then performs Bluetooth broadcasting through the charging compartment 1. After the Bluetooth headset 21 obtains the Bluetooth broadcast, the audio is played. Thus, the simplest personal DIY small KTV system architecture is formed. In this scenario, users can practice karaoke by themselves without affecting other users.

[0093] In some scenarios, when the user wants to use the headset mode of the Bluetooth headset, the system can be constructed to include a mobile terminal 3, a charging compartment 1 and a Bluetooth headset 21, please refer to Figure 6 , Figure 6 Schematic diagram of a three-terminal system structure consisting of a mobile terminal, a Bluetooth headset and a charging compartment disclosed in this embodiment. In this system, the lyrics board 4 and the Bluetooth speaker 22 are no longer necessary components (such as Figure 5 The display module of the charging compartment 1 is provided with two modes that can be selected by touch, including TWS mode and ADV mode. Figure 6 What is shown is the TWS mode (headphone mode). Its specific working principle is: the master earphone in the Bluetooth headset 21 obtains the audio from the mobile terminal 3 (through the BLE link), and the slave earphone in the Bluetooth headset 21 monitors the audio communication between the mobile terminal 3 and the master earphone in the Bluetooth headset 21. The charging compartment 1 can also perform BLE link data interaction with the Bluetooth headset 21 in the existing manner. As a result, the normal earphone mode of the Bluetooth headset 21 is switched back.

[0094] This embodiment also discloses an audio mixing transmission device based on a charging compartment, which is applied to the charging compartment. The charging compartment, the mobile terminal and the audio playback device constitute a karaoke system for data interaction. The number of audio playback devices is several. Figure 7 , Figure 7 The structure diagram of an audio mixing transmission device based on a charging compartment disclosed in this embodiment includes: an accompaniment receiving module 100, a human voice acquisition module 200, a mixing processing module 300 and a mixing broadcasting module 400, wherein:

[0095] The accompaniment receiving module 100 is used to receive the accompaniment audio data sent by the mobile terminal in a first time period in a standard protocol manner when a receiving time slot arrives, and send ACK / NACK response information to the mobile terminal when a response time slot arrives;

[0096] The human voice acquisition module 200 is used to acquire human voice audio data collected by a microphone in a first time period, wherein the microphone is built in the charging compartment;

[0097] The mixing processing module 300 is used to mix the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data;

[0098] The mixing broadcast module 400 is used to broadcast karaoke audio data to several audio playback devices in the form of broadcast in the second time period, so that several audio playback devices play the karaoke audio data, and when the number of several audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time; wherein, the first time period and the second time period constitute a karaoke audio data receiving and sending cycle.

[0099] In an optional embodiment, in the accompaniment receiving module 100, the accompaniment audio data is received by operating in a mode of alternating sending and receiving time slots in a first time period;

[0100] In the audio mixing broadcast module 400, the second time period operates in the sending mode throughout the entire time period, so that the second time period is entirely used for broadcasting karaoke audio data.

[0101] In an optional embodiment, in the audio mixing and broadcasting module 400, the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that several audio playback devices can use at least 2 Bluetooth standard communication time slots to scan and receive karaoke audio data.

[0102] In an optional embodiment, the duration of the second time period is shorter than the duration of the first time period;

[0103] In the accompaniment receiving module 100, the received accompaniment audio data is composed of a plurality of encoded data packets;

[0104] The device also includes:

[0105] The encoding module is used to re-encode the karaoke audio data composed of the accompaniment audio data and the vocal audio data into a data packet, so that one data packet is broadcast when the karaoke audio data is broadcast.

[0106] In an optional embodiment, the working mode in the first time period is an EDR mode, and the EDR mode is that data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset;

[0107] The working mode of the second time period is ADV mode. In ADV mode, the charging bin works in broadcast mode to broadcast and transmit data externally.

[0108] The device also includes:

[0109] The mode switching module is used to exit the EDR mode and the ADV mode in response to the mode switching instruction, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset.

[0110] This embodiment also discloses a Bluetooth headset charging compartment, including:

[0111] The method disclosed in the above embodiment is used to perform audio mixing and transmission, or the device disclosed in the above embodiment is included.

[0112] In an optional embodiment, the Bluetooth headset charging case also cooperates with a mobile terminal and an audio playback device to implement the data transmission method disclosed in the above embodiment.

[0113] This embodiment also discloses a chip for a Bluetooth communication charging case, which has an integrated circuit thereon, and the integrated circuit is designed to implement the method disclosed in the above embodiment.

[0114] This embodiment also discloses an audio mixing transmission system based on a charging compartment, including:

[0115] The method disclosed in the above embodiment is used to perform audio mixing and transmission, or the device disclosed in the above embodiment is included.

[0116] This embodiment also discloses a data transmission system based on a charging compartment, including:

[0117] A Bluetooth charging compartment, which uses the method disclosed in the above embodiment to perform audio mixing and transmission, or includes the device disclosed in the above embodiment;

[0118] The mobile terminal, during the execution of step S400 by the charging compartment, sends the lyrics corresponding to the accompaniment audio data to the lyrics board;

[0119] The lyrics board synchronously displays the lyrics while the charging compartment executes step S400.

[0120] According to an audio mixing and data transmission method, device and system based on a charging bin disclosed in an embodiment of the present invention, a first time period and a second time period are used to form a karaoke audio data receiving and sending cycle, and a plurality of different headphones and / or speakers are simultaneously shared with karaoke audio data by organically combining sending and receiving accompaniment audio data according to a Bluetooth connection in the first time period and broadcasting karaoke audio data in the second time period. Specifically, in the first time period, the accompaniment audio data sent by the mobile terminal is received in a standard protocol manner when the receiving time slot arrives, and the human voice audio data collected by the microphone is obtained, thereby mixing to obtain the karaoke audio data; then, in the second time period, the karaoke audio data is broadcast to several audio playback devices in the form of a broadcast. Since it is in the form of a broadcast, each audio playback device can simultaneously scan and receive the broadcast karaoke audio data during the broadcast, that is, when the number of audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time, thereby improving the user experience.

[0121] In addition, compared with the one-receive-one-send-and-response method, the concentrated broadcasting of karaoke audio data in the second time period can reduce the jamming phenomenon during the playback of karaoke audio data because the broadcasting can omit the data retransmission link.

[0122] In addition, the present invention also provides a computer-readable storage medium, such as a chip, a CD, etc., on which an execution program is stored, and when the execution program is executed, any of the methods described above is implemented.

[0123] It should be noted that the computer-readable storage medium described in the embodiments of the present disclosure is not limited to the above-mentioned embodiments, and may also be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device.

[0124] It will be appreciated by those skilled in the art that, under the premise of no conflict, the above-mentioned preferred solutions can be freely combined and superimposed. Among them, the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings, for example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. The numbering of each step in this article is only for the convenience of description and reference, and is not used to limit the order of execution. The specific execution order is determined by the technology itself, and those skilled in the art can determine various allowable and reasonable orders based on the technology itself.

[0125] It should be noted that the use of step numbers (letters or numbers) to refer to certain specific method steps in the present invention is only for the purpose of convenience and brevity of description, and is by no means intended to limit the order of these method steps by letters or numbers. Those skilled in the art will understand that the order of the relevant method steps should be determined by the technology itself and should not be inappropriately limited by the existence of step numbers. Those skilled in the art can determine various permissible and reasonable step orders based on the technology itself.

[0126] Those skilled in the art will appreciate that, without conflict, the above-mentioned preferred solutions can be freely combined and superimposed.

[0127] It should be understood that the above-mentioned embodiments are merely illustrative and not restrictive. Without departing from the basic principles of the present invention, various obvious or equivalent modifications or substitutions that can be made by those skilled in the art to the above-mentioned details will all be included in the scope of the claims of the present invention.

Claims

1. An audio mixing transmission method based on a charging compartment is applied to the charging compartment, wherein the charging compartment, a mobile terminal and an audio playback device constitute a karaoke system for data interaction, characterized in that: The number of the audio playback devices is several, and the method comprises: Step S100, in a first time period, receiving the accompaniment audio data sent by the mobile terminal when a receiving time slot arrives in a standard protocol manner, and sending ACK / NACK response information to the mobile terminal when a response time slot arrives; Step S200, obtaining human voice audio data collected by a microphone during the first time period, wherein the microphone is built into the charging compartment; Step S300, mixing the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data; Step S400, in the second time period, broadcast the karaoke audio data to several audio playback devices in the form of broadcast, so that the several audio playback devices play the karaoke audio data, and when the number of the several audio playback devices is more than one, they can all receive and play the karaoke audio data at the same time; wherein the first time period and the second time period constitute a karaoke audio data receiving and sending cycle.

2. The audio mixing transmission method based on the charging compartment as claimed in claim 1, characterized in that: In the step S100, the accompaniment audio data is received in a mode of alternating sending and receiving time slots during the first time period; In the step S400, the second time period is operated in the sending mode throughout the entire time period, so that the second time period is entirely used for broadcasting the karaoke audio data.

3. The audio mixing transmission method based on the charging compartment as claimed in claim 2 is characterized in that: In the step S400, the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that the plurality of audio playback devices can use at least 2 Bluetooth standard communication time slots to scan and receive the karaoke audio data.

4. The audio mixing transmission method based on the charging compartment as described in any one of claims 1 to 3, characterized in that: The duration of the second time period is shorter than the duration of the first time period; In the step S100, the received accompaniment audio data is composed of a plurality of encoded data packets; Between step S300 and step S400, the method further includes: Step S310, re-encode the karaoke audio data consisting of the accompaniment audio data and the vocal audio data into a data packet, so that one data packet is broadcast when the karaoke audio data is broadcast.

5. The audio mixing transmission method based on the charging compartment as described in any one of claims 1 to 3, characterized in that: The working mode of the first time period is an EDR mode, in which data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset; The working mode of the second time period is the ADV mode, and the ADV mode is that the charging bin works in the broadcast mode to broadcast and transmit data externally; The method further comprises: The EDR mode and the ADV mode are exited in response to the mode switching instruction, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset.

6. A data transmission method based on a charging bin, which is applied to a karaoke system composed of a charging bin, a mobile terminal and an audio player, and is characterized in that: The method comprises: The charging compartment performs the method according to any one of claims 1 to 5; During the execution of step S400 by the charging compartment, the mobile terminal sends the lyrics corresponding to the accompaniment audio data to the lyrics board; The lyrics board synchronously displays the lyrics while the charging compartment executes step S400.

7. An audio mixing transmission device based on a charging compartment, applied to the charging compartment, wherein the charging compartment, a mobile terminal and an audio playback device constitute a karaoke system for data interaction, characterized in that: The number of the audio playback devices is several, and the apparatus comprises: An accompaniment receiving module (100) is used to receive the accompaniment audio data sent by the mobile terminal in a first time period in a standard protocol manner when a receiving time slot arrives, and to send ACK / NACK response information to the mobile terminal when a response time slot arrives; A human voice acquisition module (200), used to acquire human voice audio data collected by a microphone during the first time period, wherein the microphone is built into the charging compartment; A mixing processing module (300) is used to mix the accompaniment audio data and the vocal audio data to obtain mixed karaoke audio data; The mixing broadcast module (400) is used to broadcast the karaoke audio data to a plurality of audio playback devices in the form of a broadcast in a second time period, so that the plurality of audio playback devices play the karaoke audio data, and when the number of the plurality of audio playback devices is more than one, all of them can simultaneously receive and play the karaoke audio data; wherein the first time period and the second time period constitute a karaoke audio data receiving and sending cycle.

8. The audio mixing and transmission device based on the charging compartment as claimed in claim 7, characterized in that: In the accompaniment receiving module (100), in the first time period, the module operates in a mode of alternating sending and receiving time slots to receive the accompaniment audio data; In the audio mixing broadcast module (400), the second time period operates in a sending mode throughout the second time period, so that the second time period is entirely used to broadcast the karaoke audio data.

9. The audio mixing and transmission device based on the charging compartment as claimed in claim 8, characterized in that: In the audio mixing and broadcasting module (400), the duration of the second time period is at least 2 Bluetooth standard communication time slots, so that the plurality of audio playback devices can use at least 2 Bluetooth standard communication time slots to scan and receive the karaoke audio data.

10. The audio mixing and transmission device based on the charging compartment as described in any one of claims 7 to 9, characterized in that: The duration of the second time period is shorter than the duration of the first time period; In the accompaniment receiving module (100), the received accompaniment audio data is composed of a plurality of encoded data packets; The device also includes: The encoding module is used to re-encode the karaoke audio data composed of the accompaniment audio data and the vocal audio data into a data packet, so that one data packet is broadcast when the karaoke audio data is broadcast.

11. The audio mixing and transmission device based on the charging compartment according to any one of claims 7 to 9, characterized in that: The working mode of the first time period is an EDR mode, in which data is exchanged between the charging compartment and the mobile terminal and the mobile terminal disconnects the Bluetooth connection with the Bluetooth headset; The working mode of the second time period is the ADV mode, and the ADV mode is that the charging bin works in the broadcast mode to broadcast and transmit data externally; The device also includes: The mode switching module is used to exit the EDR mode and the ADV mode in response to a mode switching instruction, so that the mobile terminal establishes a Bluetooth connection with the Bluetooth headset.

12. A Bluetooth headset charging compartment, characterized in that: include: The method according to any one of claims 1 to 5 is used to perform audio mixing and transmission, or the device according to any one of claims 7 to 11 is included.

13. The Bluetooth headset charging compartment according to claim 12, characterized in that: The Bluetooth headset charging compartment also cooperates with a mobile terminal and an audio playback device to implement the method as claimed in claim 6.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: The computer program stored in the storage medium is used to be executed by a processor to implement the method according to any one of claims 1 to 5.

15. A chip for a Bluetooth communication charging compartment, having an integrated circuit thereon, characterized in that: The integrated circuit is designed to implement the method according to any one of claims 1-5.

16. An audio mixing transmission system based on a charging compartment, comprising: A Bluetooth charging case, which performs audio mixing and transmission using the method described in any one of claims 1-5, or includes a device described in any one of claims 7-11.

17. A data transmission system based on a charging compartment, characterized in that: include: A Bluetooth charging compartment, using the method described in any one of claims 1 to 5 to perform audio mixing and transmission, or comprising the device described in any one of claims 7 to 11; The mobile terminal sends the lyrics corresponding to the accompaniment audio data to the lyrics board during the execution of step S400 by the charging compartment; The lyrics board synchronously displays the lyrics while the charging compartment executes step S400.

Images