Voice data transmission control method, device and system and readable storage medium

[0044] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Several embodiments of the invention are shown in the drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thorough and comprehensive.

[0045] When the user is playing a game and using a Bluetooth headset, if a real-time call is started with a teammate, the android system will automatically switch to mono HFP for voice data transmission. The real-time call sound and game background music are transmitted through the HFP protocol, and the two are mixed. At the same time, it greatly reduces the sound quality and affects the user experience.

[0046] In order to solve this technical problem, the present invention proposes an audio data transmission control method, please refer to figure 1 For the audio data transmission control method proposed in the first embodiment of the present invention, it is used for audio data transmission between the mobile terminal and the Bluetooth headset, which includes the following steps:

[0047] S101: Monitor the current mode of the mobile terminal in real time, and determine whether the current mode is a game mode and whether a real-time call in the game mode is enabled.

[0048] In the present invention, the mobile terminal can be a mobile phone, a tablet computer, or any other movable networked electronic device. In this step, the system in the mobile terminal monitors the current mode and determines whether the current mode is a preset mode.

[0049] In this embodiment, the preset mode is a game mode and needs to satisfy that the game real-time call is enabled. Specifically, the actual determination method is: first determine whether the current mode of the mobile terminal is a game mode, if so, continue to determine that the real-time call in the game mode is enabled, and if it is determined that the mobile terminal has started the real-time call, then determine the above The current mode satisfies the preset mode condition, thereby triggering the response operation in step S102.

[0050] S102: If it is determined that the current mode is the game mode and the real-time call in the game mode is enabled, the mobile terminal controls the connected Bluetooth headset to compress the current voice data collected through a preset compression protocol and compress the compressed The current voice data is transmitted back to the mobile terminal, and the audio data is transmitted to the connected Bluetooth headset through a two-channel transmission protocol, where the current voice data is the voice of the user during a game call.

[0051] As described above, after it is determined that the mobile terminal is in the aforementioned game mode and the real-time call function in the game mode is enabled, the mobile terminal transmits audio data to the Bluetooth headset through the A2DP protocol. It should be pointed out here that the transmitted audio data includes background music data, game sound data (such as game gunshots) and teammate sound data. In addition, when it is determined that the current mode of the mobile terminal is the game mode, and after the real-time call in the game mode is opened, the HFP channel corresponding to the control Bluetooth headset is closed.

[0052] Since A2DP is a two-channel transmission, in this embodiment, one channel transmits game sound effect data and background music data, and the other channel transmits teammate sound data. Different from the traditional HFP mono transmission, it can effectively distinguish the game background sound from the teammate's voice, improve the overall sound quality, and enhance the user experience.

[0053] In addition, the Bluetooth headset terminal collects the user's voice data in the real-time call, compressed and encoded by SBC, and then transmitted to the mobile phone through the GATT protocol, so as to realize the transmission of the current user's real-time call voice data to the teammate terminal, realizing a higher quality game Real-time call.

[0054] In the audio data transmission control method proposed by the present invention, when it is monitored that the current mode of the mobile terminal is the game mode, and the real-time call is started in the game mode, the two-channel transmission protocol is used for audio between the mobile terminal and the Bluetooth headset. For data transmission, in the present invention, the A2DP transmission protocol is used for data transmission, that is, background music data, game sound effect data or teammate sound data are transmitted to the Bluetooth headset terminal; at the same time, the Bluetooth headset terminal collects the user's real-time call voice data After compression and encoding, it is sent to the mobile terminal via the second preset protocol GATT to realize real-time calls with other teammates. For the current game user, the voices of other teammates in the game are also transmitted through the A2DP protocol, because the A2DP protocol is Dual-channel, thus avoiding the problem that the background sound of the game and the real-time voice of teammates are mixed, which causes the sound quality to deteriorate and affects the user experience.

[0055] See figure 2 versus image 3 For the audio data transmission control method proposed in the second embodiment of the present invention, the method includes the following steps:

[0056] S201: Monitor the current mode of the mobile phone in real time.

[0057] In this embodiment, the mobile phone system is an android system. In the mobile phone application, the system monitors the current mode of the mobile phone in real time.

[0058] S202: Determine whether the current mode is a game mode.

[0059] In this step, the game in the game mode generally refers to a multi-user interconnected competitive game. For example, currently popular games such as "Glory of the King" and "Exciting Battlefield".

[0060] S203: Judge whether to start a real-time call.

[0061] The main difference between the present invention and the prior art lies in the difference in audio data transmission channels when the mobile phone is in a game and is conducting a real-time voice call. Therefore, in this step, when it is determined that the current mode of the mobile phone is the game mode, it is also necessary to continue to determine whether the mobile phone has started a real-time call. It should be pointed out here that the "real-time call" here is different from the traditional dial-up call, but a specific real-time call in the game mode.

[0062] S204: The mobile phone transmits the audio data to the Bluetooth headset through the A2DP protocol.

[0063] If it is determined that the mobile phone A is in the game mode and the real-time call has been turned on, the mobile phone A transmits audio data to the Bluetooth headset through the A2DP protocol. Specifically, during audio data transmission, one channel transmits game sound effect data and background music data, and the other channel transmits teammate sound data. Because A2DP is a two-channel transmission, it can distinguish game sound effects (such as game gun sounds and game background sounds) from teammates' sounds. Game users can distinguish the direction of game gun sounds well without affecting the normal progress of the game.

[0064] S205: The Bluetooth headset collects the user's voice, encodes and compresses it and sends it to the mobile phone through the GATT protocol.

[0065] For Bluetooth headsets, when making a real-time call, the user's voice data is collected, compressed and encoded by SBC, and then transmitted to mobile phone A via the GATT protocol. The android system on the mobile phone uses Bluetooth low energy data as a standard voice input and sends it to the android audio input system to realize two-way voice calls.

[0066] For mobile phone A, mobile phone B, and mobile phone C, they represent the mobile terminals of different game users. They can transmit data to each other through wireless data networks to realize the normal progress of the game. Specifically, the current voice data collected by the Bluetooth headset terminals connected to mobile phone B and mobile phone C is the current voice data of user B and user C, compressed and encoded by SBC and transmitted to mobile phone A via GATT protocol, which is equivalent to User A’s teammate voice data. Then mobile phone A transmits the teammate's voice data and game background sound to the Bluetooth headset terminal connected to mobile phone A through the two-channel transmission protocol, thereby improving the sound quality.

[0067] In the actual game process, due to the influence of various factors, the real-time call quality may be reduced, and the game user cannot receive the voice of teammates in time, thereby affecting the progress of the game. To solve this technical problem, please refer to Figure 4 For the audio data transmission control method proposed in the third embodiment of the present invention, the method includes the following steps:

[0068] S301: Receive user voice data.

[0069] The received user voice data is the real-time call voice collected by the Bluetooth headset, and the user's real-time call voice during the game is compressed and encoded by SBC to obtain the above-mentioned user voice data.

[0070] S302: Perform text recognition and convert it into text data.

[0071] After receiving the current voice data transmitted back from the Bluetooth headset to the mobile terminal, the mobile phone system performs voice semantic recognition on the received current voice data, thereby converting it into text data.

[0072] S303: Transmit the current application corresponding to the preset game mode in the mobile phone for text display.

[0073] After the text recognition conversion is performed, the converted text is displayed on the screen of the current game in real-time as a barrage, so that the current game user can view the voice information of teammates in text.

[0074] What needs to be added here is that when performing voice recognition, the mobile phone system will automatically recognize the user’s game ID and account number, and add the user’s game account before the converted text. When it is displayed on the game interface of the mobile phone screen, it is displayed in the format of "user game ID account + voice conversion text". For example, when a user is playing a game of PlayerUnknown’s Battlegrounds, “su8mys: I have a third-level helmet” pops up on the game interface of the phone screen, where su8mys is the user’s game ID account, and “I have three levels. "Helmet A" is the user's current voice data, that is, the text data obtained after voice semantic recognition of the voice of the conversation with teammates. It is understandable that this setting is beneficial for the user to view and distinguish the voice information of the game user.

[0075] In practical applications, there may be problems that affect the real-time call in the game due to poor network environment. To solve this technical problem, please refer to Figure 5 For the audio data transmission control method proposed in the fourth embodiment of the present invention, the method includes the following steps:

[0076] S401: Monitor the current audio transmission rate.

[0077] S402: Determine whether the current audio transmission rate reaches the rated audio transmission rate.

[0078] It is understandable that the rated audio transmission rate can meet the normal real-time call network speed requirements. In this step, it is determined whether the current audio transmission rate reaches the rated audio transmission rate. It is understandable that if the current audio transmission rate cannot reach the rated audio transmission rate, the real-time voice call may freeze. It should be supplemented here that the rated audio transmission rate here can be set according to actual audio transmission conditions, and the audio transmission rate value set by the user is not fixed and depends on actual application requirements.

[0079] S403: Switch to the HFP channel for audio transmission.

[0080] If it is determined that the current audio transmission rate has not reached the rated audio transmission rate, in order to reduce the flow requirement during audio transmission, in this embodiment, the mobile phone system controls the voice transmission channel to be switched to the HFP channel for audio transmission. It is understandable that this situation is only for the problem that the real-time call in the game is stuck due to poor network environment. If the two-channel A2DP transmission protocol is still used, it is undoubtedly easy to cause transmission jams. Therefore, in the actual setting, an alternative solution is set. In the case of a poor network environment, the second best option is to change the transmission channel. Switch to the HFP channel, sacrificing a certain transmission quality to ensure basic audio transmission.

[0081] See Image 6 , The fifth embodiment of the present invention also provides an audio data transmission device, wherein the device includes a mode monitoring module 11 and a transmission control module 12 connected to each other;

[0082] The above-mentioned mode monitoring module 11 is specifically used for:

[0083] Used to monitor the current mode of the mobile terminal in real time, determine whether the current mode is a game mode and whether the real-time call in the game mode is enabled;

[0084] The aforementioned transmission control module 12 is specifically used for:

[0085] If it is determined that the current mode is the game mode and the real-time call in the game mode is turned on, the mobile terminal controls the connected Bluetooth headset to compress the current voice data collected through a preset compression protocol and compress the compressed The current voice data is transmitted back to the mobile terminal, and the audio data is transmitted to the connected Bluetooth headset through a two-channel transmission protocol, where the current voice data is the voice of the user during a game call;

[0086] The transmission control module 12 is also used for:

[0087] Controlling the HFP channel of the Bluetooth headset to close; and

[0088] After collecting the current voice data, compressing and encoding according to the SBC algorithm, the current voice data is transmitted back to the mobile terminal through the GATT protocol.

[0089] The present invention also provides an audio data transmission system, including a mobile terminal and at least one Bluetooth headset that performs audio data transmission with the mobile terminal, wherein the mobile terminal includes a mode monitoring module and a transmission control module connected to each other:

[0090] The mode monitoring module is specifically used for:

[0091] Monitor the current mode of the mobile terminal in real time, determine whether the current mode is a game mode and whether the real-time call in the game mode is enabled;

[0092] The transmission control module is specifically used for:

[0093] If it is determined that the current mode is the game mode and the real-time call in the game mode is enabled, the mobile terminal controls the connected Bluetooth headset to compress the collected current voice data through a preset compression protocol and compress the compressed current voice Data is transmitted back to the mobile terminal, and audio data is transmitted to the connected Bluetooth headset through a two-channel transmission protocol, wherein the current voice data is the voice of the user during a game call;

[0094] The transmission control module is also used for:

[0095] Controlling the HFP channel of the Bluetooth headset to close; and

[0096] After collecting the current voice data, compressing and encoding according to the SBC algorithm, the current voice data is transmitted back to the mobile terminal through the GATT protocol.

[0097] The present invention also provides a readable storage medium. The logic and/or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for implementing logic functions, Can be embodied in any readable storage medium for instruction execution systems, devices or equipment (such as computer-based systems, systems including processors or other systems that can fetch instructions from instruction execution systems, devices or equipment and execute instructions) ) Use, or use in combination with these instructions to execute systems, devices or equipment. For the purposes of this specification, a "readable storage medium" can be any device that can contain, store, communicate, propagate, or transmit a program for use by an instruction execution system, device, or device or in combination with these instruction execution systems, devices, or devices.

[0098] More specific examples (non-exhaustive list) of readable storage media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the readable storage medium may even be paper or other suitable media on which the program can be printed, because it can be, for example, optically scanned paper or other media, followed by editing, interpretation or other suitable media if necessary. The program is processed in a manner to obtain the program electronically and then stored in the computer memory.

[0099] It should be understood that each part of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the foregoing embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: a logic gate circuit for implementing logic functions on data signals Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate array (PGA), field programmable gate array (FPGA), etc.

[0100] In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structure, materials or features are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner.

[0101] The above-mentioned embodiments only express several implementation modes of the present invention, and their description is more specific and detailed, but they should not be understood as a limitation to the patent scope of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can be made, and these all fall within the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be subject to the appended claims.