Audio sharing method and related device

Abstract

The application provides an audio sharing method and related equipment, and relates to the technical field of communication. The audio sharing method comprises the following steps: copying audio data to be played to obtain first audio data corresponding to a first wireless earphone and second audio data corresponding to a second wireless earphone; using a first protocol stack processing module to encode the first audio data based on an audio coding format of the first wireless earphone and send the first audio data to the first wireless earphone; and using a second protocol stack processing module to encode the second audio data based on an audio coding format of the second wireless earphone and send the second audio data to the second wireless earphone. By using the above method, the audio data to be played is divided into multiple parts, each part corresponding to a wireless earphone, and the virtualized multiple protocol stack processing modules can perform differentiated processing on each part of the audio data. Each part of the audio data can be independently encoded and adjusted in volume and sound quality, so that multiple wireless earphones can play audio with different coding formats, different volumes and different sound qualities.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of communication, and in particular, to an audio sharing method and related devices. BACKGROUND

[0002] The development of wireless earphones enables people to enjoy audio more conveniently. Since wireless earphones are small in size and comfortable to wear, people can wear them for a long time in daily life so as to enjoy audio at any time through wireless earphones. However, the same audio can only be listened to by one person through earphones at present. Taking a mobile phone as an audio output device for example, if the audio is to be shared, the audio file can only be shared between mobile phones or one earphone can only be shared in general.

[0003] In order to realize the connection of one audio output device and multiple earphones, one existing solution is to share audio between wireless earphones, and one wireless earphone shares the received audio with another wireless earphone. This solution does not support independent volume adjustment of each wireless earphone, and the audio data needs to be encoded in an encoding mode supported by all earphones. For earphones with different sound quality playback performance, it is impossible to meet the difference in sound quality audio listening, and the audio sharing experience is poor. SUMMARY

[0004] In view of the above, it is necessary to provide an audio sharing method and related devices, which can solve the problem that the audio data received by multiple earphones participating in audio sharing cannot be independently encoded.

[0005] In a first aspect, the present application provides an audio sharing method applied to a smart terminal, the audio sharing method comprising: copying audio data to be played to obtain first audio data corresponding to a first wireless earphone and second audio data corresponding to a second wireless earphone, the smart terminal virtually having a first protocol stack processing module corresponding to the first audio data and a second protocol stack processing module corresponding to the second audio data; encoding the first audio data based on an audio encoding format of the first wireless earphone by using the first protocol stack processing module to obtain encoded first audio data, and encoding the second audio data based on an audio encoding format of the second wireless earphone by using the second protocol stack processing module to obtain encoded second audio data; sending the encoded first audio data to the first wireless earphone, and sending the encoded second audio data to the second wireless earphone.

[0006] According to the technical scheme, the audio data is copied into multiple copies, and multiple wireless earphones connected to the smart terminal are processed by virtualizing multiple protocol stack processing modules (such as a Bluetooth protocol stack processing module, a Wi-Fi protocol stack processing module, etc.) in the smart terminal to carry multiple audio data. The multiple protocol stack processing modules can process the multiple audio data differently. Each copy of the audio data can be processed by different volume gain processing and different audio coding formats. For example, the volume gain of the corresponding audio data can be adjusted according to the volume adjustment request of the connected wireless earphone, or the sampling frequency and bit width of the corresponding audio data can be adjusted according to the sampling mode support capability of the connected wireless earphone, so that each wireless earphone can independently adjust the volume and use different audio coding formats to play audio with different sound quality.

[0007] In a possible implementation, the smart terminal communicates with the first wireless earphone and the second wireless earphone through Bluetooth, and the copied audio data to be played includes: converting the audio data to be played into pulse code modulation (PCM) format audio data, and mixing the PCM format audio data; the PCM format audio data after mixing is transmitted to the Bluetooth protocol stack through the audio hardware abstraction layer and the Bluetooth hardware abstraction layer; and the PCM format audio data after mixing is copied by the Bluetooth protocol stack.

[0008] According to the technical scheme, the PCM format audio data after mixing is copied by the Bluetooth protocol stack, and multiple copies of the audio data corresponding to multiple wireless earphones connected to the smart terminal are obtained, which facilitates subsequent volume gain adjustment, sampling frequency and bit width adjustment, and coding by using different audio coding formats in the Bluetooth protocol stack. Compared with copying the audio data in other nodes, the multiple copies of the audio data are not transmitted to the Bluetooth protocol stack, so that more data transmission resources are not occupied.

[0009] In a possible implementation, the first protocol stack processing module is a first Bluetooth protocol stack processing module, and the second protocol stack processing module is a second Bluetooth protocol stack processing module. The first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module are created in the Bluetooth protocol stack, and each of the first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module includes a Bluetooth interface layer (BTIF), a Bluetooth application layer (BTA), and a Bluetooth stack layer (BTstack). The first audio data is encoded by the first protocol stack processing module based on an audio encoding format of the first wireless earphone to obtain encoded first audio data, and the second audio data is encoded by the second protocol stack processing module based on an audio encoding format of the second wireless earphone to obtain encoded second audio data. The first audio data is transmitted from the BTIF to the BTA in the first Bluetooth protocol stack processing module, and then transmitted from the BTA to the BTstack in the first Bluetooth protocol stack processing module. The BTstack in the first Bluetooth protocol stack processing module encodes the first audio data based on the audio encoding format of the first wireless earphone. The second audio data is transmitted from the BTIF to the BTA in the second Bluetooth protocol stack processing module, and then transmitted from the BTA to the BTstack in the second Bluetooth protocol stack processing module. The BTstack in the second Bluetooth protocol stack processing module encodes the second audio data based on the audio encoding format of the second wireless earphone.

[0010] According to the technical solution, a plurality of Bluetooth protocol stack processing modules are created in the Bluetooth protocol stack, corresponding to a plurality of wireless earphones connected to the smart terminal. Each Bluetooth protocol stack processing module includes a BTIF, a BTA, and a BTstack, so that each piece of audio data can be processed by the corresponding Bluetooth protocol stack processing module, for example, encoded by using different audio encoding formats, independently adjusted in volume gain, and independently adjusted in sampling frequency and bit width.

[0011] In a possible implementation, the BTstack in the first Bluetooth protocol stack processing module calls an audio encoder corresponding to the audio encoding format of the first wireless earphone to encode the first audio data, and the BTstack in the second Bluetooth protocol stack processing module calls an audio encoder corresponding to the audio encoding format of the second wireless earphone to encode the second audio data.

[0012] According to the technical scheme, when the audio coding processing is performed, the BT stack in the Bluetooth protocol stack processing module can call the audio encoder corresponding to the audio coding format of the wireless earphone to code the audio data, for example, the BT stack in the first Bluetooth protocol stack processing module can call the SBC audio encoder to code the audio data, and the BT stack in another Bluetooth protocol stack processing module can call the AAC audio encoder to code the audio data, so that independent coding of multiple pieces of audio data is implemented.

[0013] In a possible implementation, before the first audio data is coded based on the audio coding format of the first wireless earphone by the first protocol stack processing module to obtain the coded first audio data and the second audio data is coded based on the audio coding format of the second wireless earphone by the second protocol stack processing module to obtain the coded second audio data, the method further includes: performing volume gain adjustment and / or tone adjustment on the first audio data, and the tone adjustment includes adjusting the sampling frequency and the sampling bit width of the audio data; and performing volume gain adjustment and / or tone adjustment on the second audio data.

[0014] According to the technical scheme, before the audio data coding is performed, the Bluetooth protocol stack can also perform volume gain adjustment on the corresponding audio data, or adjust the sampling frequency and the bit width of the corresponding audio data, so that each wireless earphone can independently perform volume adjustment and can play audio of different tones.

[0015] In a possible implementation, the volume gain adjustment and / or tone adjustment on the first audio data includes that the BT stack in the first Bluetooth protocol stack processing module performs the volume gain adjustment and / or the tone adjustment on the first audio data, and the volume gain adjustment and / or the tone adjustment on the second audio data includes that the BT stack in the second Bluetooth protocol stack processing module performs the volume gain adjustment and / or the tone adjustment on the second audio data.

[0016] According to the technical scheme, before the BT stack codes the audio data, the corresponding audio data can be subjected to volume gain adjustment, or the corresponding audio data can be subjected to adjustment of the sampling frequency and the bit width, so that each wireless earphone can independently perform volume adjustment and can play audio of different tones.

[0017] In a possible implementation, the smart terminal comprises a first wireless connection network chip and a second wireless connection network chip, and the audio sharing method further comprises: copying the audio data to be played to obtain third audio data corresponding to the third wireless earphone, and the smart terminal further virtually has a third protocol stack processing module corresponding to the third audio data; encoding the third audio data based on an audio coding format of the third wireless earphone by using the third protocol stack processing module to obtain encoded third audio data; sending the encoded third audio data to the third wireless earphone through the second wireless connection network chip; and sending the encoded first audio data to the first wireless earphone and sending the encoded second audio data to the second wireless earphone, comprising: sending the encoded first audio data to the first wireless earphone through the first wireless connection network chip and sending the encoded second audio data to the second wireless earphone through the first wireless connection network chip.

[0018] By adopting the technical solution, the audio data is copied into multiple copies, corresponding to multiple wireless earphones connected to the smart terminal, multiple protocol stack processing modules are virtually set up in the smart terminal to carry multiple audio data, each copy of audio data can be processed in different forms by the multiple protocol stack processing modules, and different audio coding formats can be used. The wireless connection network chip generally supports the transmission of one or two audio data. In the case of multiple wireless connection network chips in the smart terminal, for two audio data, only one wireless connection network chip can be used for audio data transmission, and the remaining wireless connection network chips are in a dormant state, which can save the power of the smart terminal. In the case of connecting a third wireless earphone to the smart terminal, another wireless connection network chip can be enabled for audio data transmission, so that each audio data can be transmitted to the corresponding wireless earphone.

[0019] In a possible implementation, the first wireless earphone, the second wireless earphone, and the third wireless earphone are wireless earphones supporting an advanced audio distribution profile (A2DP) protocol and / or a low-energy Bluetooth audio standard (LE Audio) protocol of a new generation Bluetooth technology standard.

[0020] By adopting the technical solution, the multiple wireless earphones for audio sharing can be wireless earphones supporting the A2DP protocol and / or the LE Audio protocol, for example, multiple wireless earphones supporting the A2DP protocol, multiple wireless earphones supporting the LE Audio (LE Audio unicast / LE Audio broadcast) protocol, or one or more wireless earphones supporting the A2DP protocol and one or more wireless earphones supporting the LE Audio protocol.

[0021] In a possible implementation, the smart terminal comprises a first wireless connection network chip and a second wireless connection network chip, the first wireless connection network chip has a stronger chip capability than the second wireless connection network chip, the first encoded audio data has a larger data volume than the second encoded audio data, and the sending of the first encoded audio data to the first wireless earphone and the sending of the second encoded audio data to the second wireless earphone comprise: sending the first encoded audio data to the first wireless earphone through the first wireless connection network chip and sending the second encoded audio data to the second wireless earphone through the second wireless connection network chip.

[0022] By using the technical solution, for two-channel audio data in different audio encoding formats, if the first encoded audio data has a larger data volume than the second encoded audio data, packet loss or delay may occur in the transmission of the two-channel audio data through one wireless connection network chip, and the transmission delay of the audio can be reduced and the audio playback delay can be avoided by using two wireless connection network chips to transmit the two-channel audio data.

[0023] In a second aspect, the present application provides a smart terminal, which comprises a memory and a processor; the memory and the processor are coupled; the memory is configured to store program instructions; and the processor is configured to read the program instructions stored in the memory to implement the audio sharing method of the first aspect.

[0024] In a third aspect, the present application provides a computer readable storage medium, which stores computer readable instructions, and the computer readable instructions are executed by a processor to implement the audio sharing method of the first aspect.

[0025] In a fourth aspect, the present application provides a chip, which is coupled with a memory in a smart terminal and is configured to control the smart terminal to implement the audio sharing method of the first aspect.

[0026] In addition, the technical effects brought by the second aspect to the fourth aspect can be referred to the descriptions of the methods of the respective designs in the method part, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 A schematic diagram of a processing flow of Bluetooth audio data on a mobile phone side according to an embodiment of the present application;

[0028] Figure 2 A schematic diagram of a system architecture to which a method of audio synchronization according to an embodiment of the present application is applicable;

[0029] Figure 3A flowchart of audio data stream delivery of the smart terminal to two wireless earphones according to an embodiment of the present application;

[0030] Figure 4a An architecture diagram of the smart terminal implementing Bluetooth communication with multiple wireless earphones according to an embodiment of the present application;

[0031] Figure 4b A data processing flowchart of the audio processing module of the smart terminal in Figure 4a

[0032] Figure 5a An architecture diagram of the smart terminal adjusting volume after being connected with the wireless earphones according to an embodiment of the present application;

[0033] Figure 5b An architecture diagram of the smart terminal adjusting volume after being connected with the wireless earphones according to another embodiment of the present application;

[0034] Figures 6a-6b An architecture diagram of the Bluetooth protocol stack of the smart terminal virtualizing a corresponding number of Bluetooth protocol stack processing modules based on the number of connected wireless earphones according to an embodiment of the present application;

[0035] Figure 7 An architecture diagram of the Bluetooth protocol stack of the smart terminal adjusting volume, sound quality and wireless connection network control according to an embodiment of the present application;

[0036] Figure 8 A flowchart of the audio sharing method according to an embodiment of the present application;

[0037] Figure 9 A hardware architecture diagram of a smart terminal according to an embodiment of the present application;

[0038] Figure 10 A hardware architecture diagram of a wireless earphone according to an embodiment of the present application. DETAILED DESCRIPTION

[0039] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0040] ​The terms "first", "second", etc. are used only for the purpose of description and do not indicate or imply relative importance or a specific order. Thus, features with "first", "second" can include one or more of the features explicitly or implicitly. In the description of the embodiments of the present application, the words "exemplary", "or", "for example", etc. are used to mean an example, an instance, or an illustration. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or having any advantage over other embodiments or design solutions. Rather, the use of "exemplary", "or", "for example" is intended to present concepts in a particular manner.

[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. It is to be understood that the use of "or" herein includes "and" unless otherwise stated. For example, a phrase such as "A or B" can include A, B, or A and B. An "and / or" as used herein is to be taken as a descriptive purpose only and not as limiting. For example, A and / or B can mean A, B, or A and B. "At least one" means one or more. "Multiple" means two or more. For example, at least one of a, b, or c can mean a, b, c, a and b, a and c, b and c, or a, b, and c. It should be understood that the order of the steps in the flowcharts shown herein can be changed, and some can be omitted.

[0042] The module referred to in the embodiments of the present application can refer to a series of computer program instruction segments capable of completing a specific function, or a functional module formed by computer program instruction segments and hardware. The division of the module is a logical functional division, and there can be another division manner in actual implementation, which is not limited by the present application.

[0043] Generally, the same audio can only be played through one pair of earphones. Taking a mobile phone as an example of an audio output device, the mobile phone can generally only connect one pair of wireless earphones. As shown in Figure 1 The flow of audio data processed by the mobile phone and transmitted to the Bluetooth earphone in the related art can include:

[0044] (1) processing the audio data of the application program by using an audio processing algorithm.

[0045] The processing of the audio data can include converting the audio data into PCM format audio data, and performing noise reduction, sound mixing, etc. on the PCM format audio data. The sound mixing can include bass processing, surround sound processing, equalizer processing, reverb processing, etc.

[0046] (2) The volume of the mixed audio data is processed.

[0047] The volume processing can be achieved by adjusting the volume gain of the PCM format audio data. For example, the PCM format audio data is adjusted by 100% volume gain.

[0048] (3) The audio data after the volume processing is transmitted to the Bluetooth hardware abstraction layer (BT HAL) through the audio hardware abstraction layer (Audio HAL).

[0049] (4) The audio data after the volume processing is transmitted to the Bluetooth interface layer (BTIF) of the Bluetooth protocol stack through the BT HAL, and then transmitted to the Bluetooth stack layer (BT stack) of the Bluetooth protocol stack by the Bluetooth application layer (BTA).

[0050] (5) The BT stack encodes and streams the audio data, and sends the audio data to the left earphone and the right earphone of the Bluetooth earphone for playing.

[0051] For example, the BT stack can include an encoding module, a streaming module, and a sending module. The encoding module is used to encode the audio data, for example, using the sub-band codec (SBC) method to encode the audio data after the volume processing. The streaming module is used to stream the encoded audio data into first stream data and second stream data, the first stream data corresponding to the left earphone of the Bluetooth earphone, and the second stream data corresponding to the right earphone of the Bluetooth earphone. The sending module is used to send the first stream data to the left earphone of the Bluetooth earphone to make the left earphone of the Bluetooth earphone play the first stream data, and send the second stream data to the right earphone of the Bluetooth earphone to make the right earphone of the Bluetooth earphone play the second stream data.

[0052] The above process can only realize the audio data transmission of one earphone, and cannot meet the demand of audio sharing while wearing earphones. In order to solve this problem, mobile phone manufacturers have developed audio sharing solutions, and the related audio sharing solutions have the following defects: some mobile phone manufacturers develop audio sharing solutions that only support their own wireless earphones, and the number of earphones is limited to two, and the two earphones output audio of the same sound quality, and another part of the mobile phone manufacturers develop audio sharing solutions that support third-party wireless earphones, but the third-party wireless earphones cannot independently adjust the volume, and the number of earphones is also limited to two, and the two earphones output audio of the same sound quality.

[0053] Therefore, the audio sharing method provided by the embodiments of the present application can copy the PCM format audio data into multiple copies through the Bluetooth protocol stack, correspond to multiple wireless earphones connected by the smart terminal, and virtually correspond to the Bluetooth protocol stack processing module in the Bluetooth protocol stack. Each Bluetooth protocol stack processing module can process each copy of audio data differently, so that each wireless earphone can independently adjust the volume, use different audio coding formats, and play different sound quality audio.

[0054] As shown in Figure 2 , it is a system architecture schematic diagram suitable for the method for synchronizing audio provided by the embodiments of the present application. The system architecture can include a smart terminal 100 and two or more wireless earphones 200.

[0055] The smart terminal 100 can be a smart terminal of various types. For example, it can be a smart phone as shown in Figure 2 , it can also be a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a personal digital assistant (PDA), a smart television, a smart watch, a vehicle-mounted device, an industrial device, etc. The specific type of the smart terminal is not limited by the present application. The wireless earphone 200 is an earphone supporting a Bluetooth communication protocol. The Bluetooth communication protocol can be a classic Bluetooth (BT) protocol, a Bluetooth low energy (BLE) protocol (such as a low energy Bluetooth audio standard (LEAudio) including a new generation of Bluetooth technical standard BT5.2). With the evolution of the Bluetooth protocol, it can also be other Bluetooth protocols to be released in the future.

[0056] In some embodiments, the smart terminal 100 can establish a connection with each wireless headset 200 via wireless communication technology. This wireless communication technology can be, for example, Bluetooth technology (including classic Bluetooth or Bluetooth Low Energy (BLE)). Optionally, the smart terminal 100 and the wireless headset 200 can also communicate via wireless local area networks (WLANs) (such as Wireless Fidelity (Wi-Fi) networks), Zigbee, frequency modulation (FM), near field communication (NFC), infrared (IR), or general 2.4GHz / 5GHz frequency band wireless communication technologies. The wireless connection is a connection established using this wireless communication technology. For ease of description, the following embodiments of this application use the establishment of a Bluetooth connection between the smart terminal 100 and the wireless headset 200 via Bluetooth technology as an example.

[0057] Audio services can exist between the smart terminal 100 and each wireless headset 200 connected to it via Bluetooth. These audio services can include various types. For example, the audio services can include media services and call services. Media services can include playing music, recordings, audio from video files, background music in games, and call alerts for the user. Call services can include playing the other party's voice data or collecting the user's voice data and sending it to the other party in scenarios such as telephone calls, WeChat voice messages, audio calls, video calls, games, and voice assistants.

[0058] In some embodiments, the wireless earphone 200 can be of various types, such as in-ear, over-ear, over-ear, or ear-hook wireless earphones. The wireless earphone may include a left earbud worn on the user's left ear and a right earbud worn on the user's right ear, which can be connected by a connecting cable, such as a neckband wireless earphone; or it may be two independent parts, such as true wireless stereo (TWS) earphones. This application does not limit the specific type of earphone in its embodiments.

[0059] like Figure 3 The diagram shows the process of transmitting audio data stream from the smart terminal 100 to the wireless earphone 200 according to an embodiment of this application.

[0060] exist Figure 3In the embodiment, the intelligent terminal 100 is a mobile phone, and the wireless earphone 200 includes a first wireless earphone and a second wireless earphone. The mobile phone is installed with one or more application programs (APPs). It is assumed that the mobile phone is installed with a music application program. The mobile phone can start the music application program and play music in response to a user operation. During the music playing, the process of transmitting the audio data stream from the intelligent terminal 100 to the first wireless earphone and the second wireless earphone can include the following steps:

[0061] (1) The music application program writes the audio data to an audio track.

[0062] An application program located at the application program layer can construct an Audio track instance at the application program framework layer, that is, one application program can correspond to one Audio track. After constructing the Audio track, the music application program can write the audio data to the corresponding Audio track, and realize the audio playing control through the Audio track.

[0063] (2) The Audio track outputs the decoded audio data to an audio system engine (Audio Flinger).

[0064] The decoded audio data can be PCM format audio data. The Audio Flinger is responsible for managing the input audio stream device, the output audio stream device, and the switching of the audio mode, the loading of the audio parameter, the processing and transmission of the audio data, and the like. When an audio stream is output by a certain application program, the audio data included in the audio stream can be identified as a certain stream type, and the decoded audio data is output to the Audio Flinger through the Audio track corresponding to the application program. The Audio Flinger can load the volume corresponding to the audio stream type according to the audio stream type. The Audio Flinger can also perform the mixing processing on the audio data, and output the mixed audio data to the Audio HAL.

[0065] (3) The Audio Flinger outputs the mixed audio data to the Audio HAL.

[0066] The Audio HAL can receive the mixed audio data, and select the output audio hardware device. For example, the audio hardware device can be the loudspeaker, the receiver of the mobile phone, and other audio playing devices (for example, earphone, sound box, and the like) connected to the mobile phone. In the embodiment, Figure 2 In the embodiment, since the mobile phone establishes the Bluetooth connection with the first wireless earphone and the second wireless earphone, the Audio HAL selects the first wireless earphone and the second wireless earphone as the output audio hardware device.

[0067] (4) The Audio HAL passes the mixed audio data to the BT HAL.

[0068] After the Audio HAL determines that the audio hardware device is the first wireless earphone and the second wireless earphone, the Audio HAL can pass the mixed audio data to the BT HAL, so as to facilitate subsequent transmission of the audio data to the first wireless earphone and the second wireless earphone through the Bluetooth chip in the mobile phone for playing. The Bluetooth chip can convert the audio data into a data packet conforming to the Bluetooth protocol and send it to the wireless earphone. In actual application, the Bluetooth chip can be packaged with a Wi-Fi module, an FM module, and a global position system (GPS) module into the same chip, which can be referred to as a wireless connectivity network (WCN) chip, and the embodiments of the present application do not limit this.

[0069] (5) The BT HAL passes the mixed audio data to the Bluetooth protocol stack.

[0070] (6) The Bluetooth protocol stack performs copy processing on the mixed audio data to obtain first audio data corresponding to the first wireless earphone and second audio data corresponding to the second wireless earphone.

[0071] In some embodiments, the mixed audio data can be copied and processed by the Bluetooth protocol stack to obtain two copies of the mixed audio data (for ease of distinction, referred to as first audio data and second audio data in this embodiment), the first audio data corresponding to the first wireless earphone and the second audio data corresponding to the second wireless earphone.

[0072] The Bluetooth protocol stack can perform volume gain adjustment and sound quality adjustment (adjusting the sampling frequency and sampling bit width of the audio data) on the first audio data and the second audio data, respectively, so that the first wireless earphone and the second wireless earphone can independently adjust the volume and play different sound quality audio. For example, the Bluetooth protocol stack can perform sound quality adjustment on the audio data (the first audio data and the second audio data) based on the sampling mode support capability of the wireless earphone (the first wireless earphone and the second wireless earphone), and perform volume gain adjustment on the audio data (the first audio data and the second audio data) based on the volume adjustment instruction sent by the wireless earphone (the first wireless earphone and the second wireless earphone).

[0073] (7) The Bluetooth protocol stack encodes the first audio data to obtain first compressed data packets, and encodes the second audio data to obtain second compressed data packets.

[0074] For example, the Bluetooth protocol stack can encode the first audio data and the second audio data according to a specified Bluetooth codec to obtain a first compressed data packet and a second compressed data packet. The Bluetooth codec corresponding to the audio data can be determined based on the sampling frequency and the sampling bit width of the audio data, or can be specified by an upper-layer application (for example, the Bluetooth protocol stack receives an encoding specification instruction of an application layer application, and selects a corresponding Bluetooth codec). If the first audio data and the second audio data have different sampling frequencies and sampling bit widths, the Bluetooth protocol stack can encode the first audio data and the second audio data according to different Bluetooth codecs.

[0075] The Bluetooth codec can include SBC, advanced audio coding (AAC), lossless transmission technology coding (APTX), and the like.

[0076] (8) The Bluetooth protocol stack encapsulates the first compressed data packet and the second compressed data packet obtained by encoding.

[0077] The Bluetooth protocol stack can encapsulate the first compressed data packet and the second compressed data packet obtained by encoding through an advanced audio distribution profile (A2DP) or LE Audio. For a wireless earphone that only supports A2DP, the compressed data packet is encapsulated based on A2DP, and for a wireless earphone that supports A2DP and LE Audio, the compressed data packet can be encapsulated based on A2DP or LE Audio.

[0078] (9) The Bluetooth protocol stack transmits the encapsulated first compressed data packet and the second compressed data packet to the first Bluetooth chip (located on the side of the mobile phone).

[0079] (10) The first Bluetooth chip converts the encapsulated first compressed data packet into first digital audio data through Bluetooth radio frequency (RF) and sends it to the second Bluetooth chip (located on the side of the first wireless earphone), and converts the encapsulated second compressed data packet into second digital audio data through Bluetooth RF and sends it to the third Bluetooth chip (located on the side of the second wireless earphone).

[0080] (11) The second Bluetooth chip receives the first digital audio data sent by the first Bluetooth chip, and the third Bluetooth chip receives the second digital audio data sent by the first Bluetooth chip.

[0081] (12) The Bluetooth host protocol stack (may also be referred to as BT Host) of the first wireless earphone converts the first digital audio data into a first Bluetooth data packet, and unpacks the first Bluetooth data packet to obtain a first compressed data packet; the BT Host of the second wireless earphone converts the second digital audio data into a second Bluetooth data packet, and unpacks the second Bluetooth data packet to obtain a second compressed data packet.

[0082] On the side of the mobile phone, if the first compressed data packet is packaged based on A2DP, the first wireless earphone can unpack the first Bluetooth data packet based on A2DP, and if the second compressed data packet is packaged based on LE Audio, the second wireless earphone can unpack the second Bluetooth data packet based on LE Audio.

[0083] (13) The audio processing module (may also be referred to as Audio processing module) of the first wireless earphone decodes the first compressed data packet to obtain first audio data, and the audio processing module of the second wireless earphone decodes the second compressed data packet to obtain second audio data.

[0084] (14) The audio codec (may also be referred to as Audio codec) of the first wireless earphone converts the first audio data into a first analog audio signal, and the audio codec of the second wireless earphone converts the second audio data into a second analog audio signal.

[0085] The first audio data and the second audio data are digital audio signals, for example, the first audio data and the second audio data are PCM format audio data, which are converted into analog audio signals through the audio codec, and then the audio playback component is driven to play sound.

[0086] (15) The audio playback component of the first wireless earphone converts the first analog audio signal into a sound signal for playing, and the audio playback component of the second wireless earphone converts the second analog audio signal into a sound signal for playing.

[0087] The audio playback component can be a speaker component in the wireless earphone, which converts the analog audio signal into a sound signal and plays it through the speaker component.

[0088] A commonly used WCN chip generally supports at most two-way transmission and processing of encoded audio signals, if the smart terminal 100 is equipped with a WCN chip supporting more than two-way transmission and processing of encoded audio signals, or is equipped with two or more WCN chips, the smart terminal 100 can also establish a Bluetooth connection with more than two wireless earphones 200.

[0089] After the smart terminal 100 establishes the Bluetooth connection with the plurality of wireless earphones 200, on the smart terminal side, the audio data flowing through the BTHAL can be copied by the Bluetooth protocol stack into multiple copies, each copy of the audio data corresponding to a different wireless earphone, and different processing can be performed on each copy of the audio data for wireless earphones with different capabilities, for example, different Bluetooth encoding methods are used, or different adjustments are made to the sampling frequency, sampling bit width, and volume gain of the audio data.

[0090] The plurality of wireless earphones 200 can be a plurality of wireless earphones supporting the A2DP protocol, a plurality of wireless earphones supporting the LE Audio (LE Audio Unicast / LE Audio Broadcast) protocol, or one or more wireless earphones supporting the A2DP protocol and one or more wireless earphones supporting the LE Audio protocol. LE Audio Unicast can refer to a point-to-point connection based on the LE Audio protocol, and LE Audio Broadcast can refer to a point-to-multiple connection based on the LE Audio protocol.

[0091] As shown in Figure 4a , the smart terminal provided by the embodiment of the present application implements an architecture schematic diagram for Bluetooth communication with a plurality of wireless earphones.

[0092] In Figure 4a , the smart terminal establishes a Bluetooth connection with four wireless earphones, the smart terminal includes two WCN chips, each WCN chip is used to transmit two-way Bluetooth audio data, that is, each WCN chip respectively communicates with two wireless earphones through Bluetooth. Taking the smart terminal installed with a music application program and the four wireless earphones simultaneously playing music of the music application program as an example for description. It is assumed that the audio encoding formats corresponding to the four wireless earphones are SBC format, AAC format, Low Complexity Communications Codec (LC3) format and LC3 plus format, respectively, wherein the SBC format and the AAC format belong to the encoding format of the A2DP, the LC3 format belongs to the encoding format of the LE Audio Unicast, and the LC3 plus format belongs to the encoding format of the LE Audio Broadcast. The process of the smart terminal implementing Bluetooth communication with the plurality of wireless earphones can include:

[0093] (i) In response to a user operation, the music application program is started and a song is selected for playing.

[0094] (ii) The audio processing module (also referred to as the Audio processing module) processes the third audio data written by the music application program to obtain fourth audio data.

[0095] In the operating system of smart terminals, the introduction of audio focus can prevent sound playback chaos caused by multiple applications playing audio data simultaneously. That is, only one application can hold audio focus at a time; when an application needs to output audio, it must first request audio focus. For example, a music application can request audio focus before playing a song, such as... Figure 4b As shown, the audio processing module of a smart terminal can first determine the application that obtains audio focus, and then process the audio data written by the application that obtains audio focus. The audio processing module's processing of the third audio data written by the music application may include setting audio routing, decoding the third audio data into PCM format audio data, and mixing the PCM format audio data to obtain fourth audio data. By setting audio routing, the third audio data written by the music application can be transmitted to a designated audio hardware device for playback.

[0096] In some embodiments, the audio processing module may include a media player, an audio track, and an audio Flinger. If the third audio data written by the music application is not in PCM format, the media player can create an audio decoder corresponding to the third audio data. The audio decoder decodes the third audio data into PCM format audio data, which is then passed from the audio track to the audio Flinger for mixing. If the third audio data written by the music application is in PCM format, it can be directly passed from the audio track to the audio Flinger for mixing.

[0097] (iii) The audio processing module passes the fourth audio data to Audio HAL.

[0098] (iv) Audio HAL passes the fourth audio data to BT HAL.

[0099] (v)BT HAL passes the fourth audio data to the Bluetooth protocol stack.

[0100] (vi) The Bluetooth protocol stack copies the fourth audio data to obtain four copies of the fourth audio data corresponding to the four wireless earphones, and processes the four copies of the fourth audio data respectively.

[0101] In some embodiments, the Bluetooth protocol stack can have different audio playback capabilities for the four wireless earphones, and different audio quality processing can be performed on each piece of audio data, for example, by adjusting the sampling frequency and sampling bit width of the audio data to adjust the audio quality. The Bluetooth protocol stack can also perform volume gain adjustment on the corresponding fourth audio data according to the volume adjustment instructions of each wireless earphone.

[0102] In some embodiments, the existing Bluetooth protocol stack code can be improved, and four Bluetooth protocol stack processing modules can be virtually created in the Bluetooth protocol stack. As an example, each Bluetooth protocol stack processing module includes a BTIF, a BTA, and a BT stack, and each piece of fourth audio data can be transmitted to the corresponding BT stack through the corresponding BTIF and the corresponding BTA, and encoded by the encoding module of the BT stack. As shown in Figure 4a assuming that the audio encoding formats of the four wireless earphones are SBC format, AAC format, LC3 format, and LC3 plus format, respectively, and the corresponding encoding modules are SBC encoding module, AAC encoding module, LC3 encoding module, and LC3 plus encoding module, respectively, the SBC encoding module, the AAC encoding module, the LC3 encoding module, and the LC3 plus encoding module can perform audio data encoding in parallel by virtually creating four Bluetooth protocol stack processing modules in the Bluetooth protocol stack.

[0103] In some embodiments, for wireless earphones supporting absolute volume, different volumes currently set and adjusted by the user during use of the wireless earphones can be sent to the wireless earphone side for volume adjustment by the smart terminal through standard audio / video remote control protocol (AVRCP) instructions. For wireless earphones supporting non-absolute volume, the volume gain of the fourth audio data can be adjusted by the BT stack in the Bluetooth protocol stack, and after the volume gain adjustment is completed, the encoding module is used for encoding.

[0104] For wireless earphones with different audio quality playback requirements, the sampling frequency and sampling bit width of the fourth audio data can also be adjusted by the BT stack in the Bluetooth protocol stack, and after the adjustment is completed, the encoding module is used for encoding.

[0105] In some embodiments, the BIF in the Bluetooth protocol stack can also be configured to adjust the volume gain, sampling frequency, and sampling bit width of the audio data.

[0106] (vii) The four pieces of processed fourth audio data are transmitted to the four wireless earphones through the two WCN chips.

[0107] For example, the fourth audio data output by the SBC encoding module and the AAC encoding module can be transmitted to two wireless earphones via a WCN chip, and the fourth audio data output by the LC3 encoding module and the LC3 plus encoding module can be transmitted to another two wireless earphones via another WCN chip.

[0108] In some embodiments, if the intelligent terminal includes multiple WCN chips, the audio data transmitted by the WCN chips can be set according to the performance difference of the WCN chips. For the WCN chip with stronger performance, the WCN chip is preferentially used to transmit audio data with a larger amount of encoded data.

[0109] The following will be described in combination with Figure 5a and 5b The architecture diagram of the intelligent terminal connected with the wireless earphone for volume adjustment is introduced.

[0110] For the wireless earphone supporting absolute volume, that is, the wireless earphone supports synchronization with the volume of the intelligent terminal side. Taking the intelligent terminal as a mobile phone as an example, there is an option of "Bluetooth device volume synchronization with the mobile phone" in the Bluetooth earphone setting interface on the mobile phone side. When the "Bluetooth device volume synchronization with the mobile phone" option is in the on state, the user adjusts the volume (non-mute volume) on the mobile phone side, the mobile phone side does not adjust the volume, and the volume level of the audio data on the mobile phone side is fixed at 15 levels. The mobile phone side sends the volume adjustment instruction (the volume level is generally 1-15 level volume) to the wireless earphone, and the wireless earphone adjusts the volume based on the received volume adjustment instruction. When the user adjusts the volume to be mute volume (0 level volume) on the mobile phone side, the mobile phone side processes the audio data to be 0 level mute, and the wireless earphone receives the 0 level mute audio data.

[0111] As shown in Figure 5a On the mobile phone side, the audio file (for example, the audio format is moving picture experts group audio layer-3 (MP3), AAC, etc.) on the mobile phone side is decoded by the audio decoder into PCM format audio data, the PCM format audio data is processed according to the maximum volume gain (15 levels), and then is subjected to mixing processing. The mixed audio data is encoded by the encoding module (for example, the SBC encoding module is used to encode the audio data), and the encoded audio data is sent to the wireless earphone via the Bluetooth chip.

[0112] At the wireless earphone side, the Bluetooth chip receives the encoded audio data, the encoded audio data is decoded by the decoding module to obtain PCM format audio data, the PCM format audio data can be adjusted by different proportions of volume gain based on the volume adjustment instruction sent by the mobile phone side (for example, 1-15 level adjustment), and the audio data after the volume gain adjustment is subjected to sound mixing processing, and the mixed audio data is converted into an analog audio signal by the audio decoder to drive the audio playback component of the wireless earphone to play.

[0113] For the wireless earphone supporting absolute volume, but the "Bluetooth device volume synchronization with mobile phone" option of the mobile phone side is in the off state, when the user adjusts the volume through the mobile phone side, the mobile phone side adjusts the volume gain of the PCM format audio data, and the wireless earphone side is fixed at the volume level of 15.

[0114] As shown in Figure 5b At the mobile phone side, the audio file of the mobile phone side is decoded into PCM format audio data by the audio decoder, the PCM format audio data is adjusted by different proportions of volume gain based on the volume adjustment instruction, and then subjected to sound mixing processing, and the mixed audio data is encoded by the encoding module, and the encoded audio data is sent to the wireless earphone by the Bluetooth chip.

[0115] At the wireless earphone side, the Bluetooth chip receives the encoded audio data, the encoded audio data is decoded by the decoding module to obtain PCM format audio data, the PCM format audio data is processed according to the maximum volume gain (15 level), and the audio data after the volume gain processing is subjected to sound mixing processing, and the mixed audio data is converted into an analog audio signal by the audio decoder to drive the audio playback component of the wireless earphone to play.

[0116] For the wireless earphone supporting non-absolute volume, its volume adjustment process is the same as that of the wireless earphone supporting absolute volume, but the "Bluetooth device volume synchronization with mobile phone" option of the mobile phone side is in the off state. That is, when the user adjusts the volume through the mobile phone side, the mobile phone side adjusts the volume gain of the PCM format audio data, and the wireless earphone side is fixed at the volume level of 15.

[0117] Since the WCN chip generally supports at most two channels of encoded audio signal transmission processing, in the case that the intelligent terminal includes multiple WCN chips, if the intelligent terminal is connected with one or two wireless earphones, the intelligent terminal can use only one WCN chip to perform the encoded audio signal transmission processing, and the remaining WCN chips can be in a sleep state. With the increase in the number of wireless earphones connected or the increase in the data amount of the encoded audio signal to be transmitted and processed, the remaining one or more WCN chips are activated. Assuming that the intelligent terminal includes two WCNs, if the intelligent terminal is connected with one or two wireless earphones, the intelligent terminal can use only one WCN chip to perform the encoded audio signal transmission processing, and the other WCN chip is in a sleep state. When three or four wireless earphones are connected, two WCN chips are used to perform the encoded audio signal transmission processing.

[0118] As shown in Figure 6a With 6b It is illustrated that the Bluetooth protocol stack can virtually generate a corresponding number of Bluetooth protocol stack processing modules according to the number of wireless earphones connected with the intelligent terminal, and one or more WCN chips can be selectively activated to perform the audio data transmission processing. As shown in Figure 6a It is assumed that the intelligent terminal establishes a Bluetooth connection with a first wireless earphone and a second wireless earphone at a first time, the first wireless earphone plays SBC format audio data, and the second wireless earphone plays AAC format audio data. The audio data after flowing through the BT HAL is copied by the Bluetooth protocol stack into two copies, which are transmitted to a BT stack through a BTIF and a BTA for encoding. The BT stack of the first channel of audio data uses the SBC encoding module for encoding, the BT stack of the second channel of audio data uses the AAC encoding module for encoding, the encoded first channel of audio data is sent to the first wireless earphone through the first WCN chip, and the encoded second channel of audio data is sent to the second wireless earphone through the first WCN chip. As shown in Figure 6b At a second time after the first time, the intelligent terminal also establishes a Bluetooth connection with a third wireless earphone, the second wireless earphone plays AAC format audio data, and the audio data after flowing through the BT HAL is copied by the Bluetooth protocol stack into three copies, which are transmitted to a BT stack through a BTIF and a BTA for encoding. The BT stack of the first channel of audio data uses the SBC encoding module for encoding, the BT stack of the second channel of audio data uses the AAC encoding module for encoding, and the BT stack of the third channel of audio data uses the AAC encoding module for encoding. The encoded first channel of audio data is sent to the first wireless earphone through the first WCN chip, the encoded second channel of audio data is sent to the second wireless earphone through the first WCN chip, and the encoded third channel of audio data is sent to the second wireless earphone through the second WCN chip.

[0119] In some embodiments, due to the different data amounts of the data encoded by different Bluetooth encoding modes, in the case that the smart terminal includes multiple WCN chips, in order to realize the fast transmission of the audio data on the smart terminal side to the wireless earphone and avoid the occurrence of transmission packet loss, the smart terminal can also select and switch the WCN chips according to the Bluetooth encoding format of the wireless earphone connected thereto. For example, the smart terminal is connected with a pair of wireless earphones, if the data amount of the Bluetooth encoding format of the pair of wireless earphones is relatively small (for example, SBC format), the smart terminal can enable a WCN chip with relatively low performance (relatively low power consumption) among the multiple WCN chips to perform the transmission processing of the encoded audio signal, if the data amount of the Bluetooth encoding format of the pair of wireless earphones is relatively large (for example, APTX), the smart terminal can enable a WCN chip with relatively high performance among the multiple WCN chips to perform the transmission processing of the encoded audio signal.

[0120] For example, the smart terminal is connected with two pairs of wireless earphones, if the data amount of the Bluetooth encoding format of the two pairs of wireless earphones is relatively small, one WCN chip among the multiple WCN chips can be enabled to perform the transmission processing of the encoded audio signal, if the data amount of the Bluetooth encoding format of one pair of wireless earphones is relatively small and the data amount of the Bluetooth encoding format of the other pair of wireless earphones is relatively large, two WCN chips among the multiple WCN chips can be enabled to respectively perform the transmission processing of the encoded audio signal.

[0121] For example, the smart terminal is connected with three pairs of wireless earphones, if the data amount of the Bluetooth encoding format of two pairs of wireless earphones is relatively small and the data amount of the Bluetooth encoding format of the other pair of wireless earphones is relatively large, one WCN chip among the multiple WCN chips can be enabled to perform the transmission processing of the two pairs of wireless earphones with relatively small data amount, and another WCN chip can be enabled to perform the transmission processing of the pair of wireless earphones with relatively large data amount.

[0122] In some embodiments, the selection and switching logic of the WCN chips can be pre-configured in the Audio HAL or the Bluetooth protocol stack.

[0123] As Figure 7 For example, the selection and switching logic of the WCN chips can be pre-configured in the Bluetooth protocol stack, the Bluetooth protocol stack can select one or more WCN chips to perform the transmission processing of the audio signal according to the number of the currently connected wireless earphones. For example, when the number of the currently connected wireless earphones is less than or equal to two, one WCN chip is enabled to perform the transmission processing of the audio signal, and when the number of the currently connected wireless earphones is three, two WCN chips are enabled to perform the transmission processing of the audio signal.

[0124] The Bluetooth protocol stack receives the audio data transmitted by the BT HAL, and can copy the audio data according to the number of wireless earphones currently connected to the smart terminal, to obtain audio data corresponding to each wireless earphone, so as to facilitate subsequent differential processing of each audio data, so that each wireless earphone can independently adjust the volume and play different audio data of different sound quality.

[0125] For example, the Bluetooth protocol stack can perform volume gain processing on the audio data corresponding to a certain Bluetooth earphone according to the volume adjustment instruction sent by the Bluetooth earphone. The Bluetooth protocol stack can also use different encoding modules to encode the audio data or adjust the sampling frequency and sampling bit width of the audio data when the smart terminal establishes a Bluetooth connection with a certain Bluetooth earphone or during use of the Bluetooth earphone.

[0126] For example, when the smart terminal establishes a Bluetooth connection with multiple Bluetooth earphones, the Bluetooth protocol stack can select a corresponding encoding module to encode the audio data according to the default audio encoding format (such as SBC format, AAC format, LC3 format, etc.) of each wireless earphone, and adjust the sampling frequency and sampling bit width of the audio data according to the sampling mode support capability of each wireless earphone.

[0127] For example, during use of the Bluetooth earphone, if a certain Bluetooth earphone supports multiple audio playback formats, the user can adjust the audio encoding format of the audio data sent to the Bluetooth earphone on the Bluetooth earphone setting interface of the smart terminal, and the Bluetooth protocol stack can use different encoding modules to encode the audio data. The user can also adjust the sound quality of the audio data sent to the Bluetooth earphone on the Bluetooth earphone setting interface of the smart terminal, and the Bluetooth protocol stack can adjust the sampling frequency and sampling bit width of the audio data to achieve sound quality adjustment of the audio data.

[0128] It should be understood that the audio sharing method provided by the embodiments of the present application can be applied to the scenario of synchronizing audio between multiple earphones. For example, the following takes the smart terminal as the phone of user A to exemplarily introduce the application scenarios to which the audio sharing method provided by the embodiments of the present application can be applied.

[0129] Application scenario one: an audio sharing scenario in which the smart terminal connects multiple wireless earphones with different sound quality playback capabilities.

[0130] For example, user A and user B respectively wear respective wireless earphones (e.g., corresponding to the first wireless earphone and the second wireless earphone described above) to listen to audio. The first wireless earphone worn by user A is relatively low in price and only supports ordinary sound quality audio (e.g., SBC encoded sound quality). The second wireless earphone worn by user B is relatively high in price and supports high-definition sound quality audio (e.g., APTX encoded sound quality). During the process of listening to audio, if user A finds that a certain audio melody is very good and wants to share it with user B, user A can establish a wireless connection between the phone of user A and the second wireless earphone of user B (e.g., by discovering the second wireless earphone of user B in the Bluetooth connection interface of the phone and performing a connection operation with the second wireless earphone of user B), and the phone of user A can obtain the audio encoding format of the second wireless earphone. After determining that there are two wireless earphones connected, the phone of user A can obtain two copies of audio data through the Bluetooth protocol stack, one copy of the audio data is encoded by the SBC encoding module and sent to the first wireless earphone worn by user A, and the other copy of the audio data is encoded by the APTX encoding module and sent to the second wireless earphone worn by user B, so that the first wireless earphone worn by user A listens to SBC encoded sound quality, and the second wireless earphone worn by user B listens to APTX encoded sound quality.

[0131] In a possible implementation manner, when user A wants to share with user B during the process of listening to audio, user A can perform an audio sharing trigger operation with the second wireless earphone on the first wireless earphone worn by user A, or user B can perform an audio sharing trigger operation with the first wireless earphone on the second wireless earphone worn by user B (e.g., let the second wireless earphone touch the first wireless earphone), and the second wireless earphone can disconnect the device currently connected and establish a connection with the device connected by the first wireless earphone, i.e., establish a connection with the phone of user A.

[0132] In a possible implementation, if user A also wants to share with user C, the third wireless earphone worn by user C supports AAC encoded sound quality, user A can perform an audio sharing trigger operation with the third wireless earphone on the first wireless earphone worn by user A, or user C can perform an audio sharing trigger operation with the first wireless earphone on the third wireless earphone worn by user C (for example, let the third wireless earphone bump the first wireless earphone), the third wireless earphone can disconnect the device currently connected, and instead establish a connection with the device connected by the first wireless earphone (if the third wireless earphone does not establish a connection with any device, it can establish a connection with the device connected by the first wireless earphone directly after bumping), that is, establish a connection with the mobile phone of user A. In this case, after determining that there are three wireless earphones connected, the mobile phone of user A can obtain three copies of audio data through the Bluetooth protocol stack, one copy of the audio data is encoded by the SBC encoding module and sent to the first wireless earphone worn by user A, one copy of the audio data is encoded by the APTX encoding module and sent to the second wireless earphone worn by user B, and one copy of the audio data is encoded by the AAC encoding module and sent to the third wireless earphone worn by user C.

[0133] Application scenario two: volume and / or sound quality adjustment of multiple wireless earphones in an audio sharing scenario.

[0134] For example, user A and user B wear their respective wireless earphones (such as the first wireless earphone and the second wireless earphone described above) to listen to audio, and the first wireless earphone and the second wireless earphone can support the same or different audio encoding. During the process of listening to audio, if user A finds that a certain audio melody is very pleasant and wants to share it with user B, user A can establish a wireless connection between the mobile phone of user A and the second wireless earphone of user B, for example, user A discovers the second wireless earphone of user B through the Bluetooth connection interface of the mobile phone, and performs a connection operation with the second wireless earphone of user B, or user A can perform an audio sharing trigger operation with the second wireless earphone on the first wireless earphone worn by user A, to establish a connection between the mobile phone of user A and the second wireless earphone worn by user B, or user B can perform an audio sharing trigger operation with the first wireless earphone on the second wireless earphone worn by user B, to establish a connection between the mobile phone of user A and the second wireless earphone worn by user B.

[0135] After confirming the connection between two wireless earbuds, User A's phone can copy two audio data sets via the Bluetooth protocol stack. Based on the audio encoding capabilities supported by both earbuds, it performs corresponding encoding, ensuring that both User A's first wireless earbud and User B's second wireless earbud can hear the audio melody. If User B finds the current volume too low or too high, they can adjust the volume on their second wireless earbud. Upon receiving this volume adjustment command, User A's phone can adjust the volume gain of the corresponding audio data via the Bluetooth protocol stack, then encode the volume-gain-adjusted audio data and transmit it to User B's second wireless earbud.

[0136] If user B's second wireless earphone supports higher audio quality than user A's first wireless earphone, user A can also configure the audio data output to user B's second wireless earphone on their phone to have a higher sampling frequency and sampling bit width. For example, in the second wireless earphone's connection settings interface on the phone, user A can adjust the default audio quality to high. The Bluetooth protocol stack will then adjust the sampling frequency and sampling bit width of the audio data corresponding to the second wireless earphone, encode the adjusted audio data, and transmit it to user B's second wireless earphone.

[0137] Normally, each wireless earphone connected to a mobile phone displays the default sound quality in the connection settings interface. This means that the sampling frequency and sampling bit width of the audio data (PCM format audio data) of each wireless earphone are the same by default. Only different audio encoding formats may be used later, such as SBC encoding, AAC encoding, APTX encoding, etc.

[0138] See Figure 8 The image shows an audio sharing method provided in an embodiment of this application. This audio sharing method can be applied to smart terminals. The audio sharing method includes:

[0139] S801 establishes a wireless communication connection with the first wireless earphone and obtains the audio encoding format of the first wireless earphone.

[0140] S802 establishes a wireless communication connection with the second wireless earphone and obtains the audio encoding format of the second wireless earphone.

[0141] In some embodiments, the wireless communication connection may be a Bluetooth connection. The smart terminal may support establishing Bluetooth connections with multiple devices simultaneously. After the smart terminal establishes a Bluetooth connection with the first wireless earphone and the second wireless earphone, it may obtain the audio encoding format of the first wireless earphone and the audio encoding format of the second wireless earphone.

[0142] In some embodiments, step S801 can be performed simultaneously with step S802, or step S801 can be performed before or after step S802.

[0143] S803, copying the audio data to be played to obtain first audio data corresponding to the first wireless earphone and second audio data corresponding to the second wireless earphone.

[0144] For example, the audio data to be played can be audio data written by an application installed on the smart terminal, and the copying process of the audio data to be played includes: converting the audio data to be played into PCM format audio data, mixing the PCM format audio data, and delivering the mixed PCM format audio data to the Bluetooth protocol stack via the audio hardware abstraction layer and the Bluetooth hardware abstraction layer, and then copying the mixed PCM format audio data by the Bluetooth protocol stack to obtain first audio data corresponding to the first wireless earphone and second audio data corresponding to the second wireless earphone. The wireless protocol stack of the smart terminal is virtually divided into a first protocol stack processing module corresponding to the first audio data and a second protocol stack processing module corresponding to the second audio data, and the wireless protocol stack is virtually divided into multiple protocol stack processing modules to carry multiple audio data, so as to facilitate differential processing of each audio data.

[0145] In some embodiments, if the first wireless earphone and the second wireless earphone establish a connection with the smart terminal through Bluetooth, the first protocol stack processing module is a first Bluetooth protocol stack processing module, and the second protocol stack processing module is a second Bluetooth protocol stack processing module. The first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module can be created in the Bluetooth protocol stack, and both the first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module include BTIF, BTA, and BTstack. The first audio data can be transmitted to the BT stack in the first Bluetooth protocol stack processing module via the BTIF and the BTA in the first Bluetooth protocol stack processing module, and the BT stack in the first Bluetooth protocol stack processing module can encode the first audio data based on the audio encoding format of the first wireless earphone, for example, the BT stack in the first Bluetooth protocol stack processing module can call an audio encoder corresponding to the audio encoding format of the first wireless earphone to encode the first audio data. The second audio data is transmitted to the BT stack in the second Bluetooth protocol stack processing module via the BTIF and the BTA in the second Bluetooth protocol stack processing module, and the BT stack in the second Bluetooth protocol stack processing module encodes the second audio data based on the audio encoding format of the second wireless earphone, for example, the BT stack in the second Bluetooth protocol stack processing module calls an audio encoder corresponding to the audio encoding format of the second wireless earphone to encode the second audio data.

[0146] S804, encode the first audio data based on the audio encoding format of the first wireless earphone by using the first protocol stack processing module to obtain encoded first audio data, and encode the second audio data based on the audio encoding format of the second wireless earphone by using the second protocol stack processing module to obtain encoded second audio data.

[0147] In some embodiments, before encoding the first audio data, the Bluetooth protocol stack can also perform volume gain adjustment and / or tone adjustment on the first audio data, and the tone adjustment includes adjusting the sampling frequency and sampling bit width of the audio data. Before encoding the second audio data, the Bluetooth protocol stack can also perform volume gain adjustment and / or tone adjustment on the second audio data. For example, the first audio data is adjusted by the BT stack in the first Bluetooth protocol stack processing module, and the second audio data is adjusted by the BT stack in the second Bluetooth protocol stack processing module, so that multiple wireless earphones can independently adjust the volume and play different tone of audio.

[0148] S805, send the encoded first audio data to the first wireless earphone, and send the encoded second audio data to the second wireless earphone.

[0149] In some embodiments, the smart terminal includes a first wireless connection network chip and a second wireless connection network chip, and the encoded first audio data can be sent to the first wireless earphone through the first wireless connection network chip, and the encoded second audio data can be sent to the second wireless earphone through the first wireless connection network chip, and the second wireless connection network chip is in a dormant state, which can save the power consumption of the smart terminal.

[0150] In some embodiments, if the data amount of the encoded first audio data is greater than the data amount of the encoded second audio data, in order to reduce the audio playing delay, the smart terminal can send the encoded first audio data to the first wireless earphone through the first wireless connection network chip, and send the encoded second audio data to the second wireless earphone through the second wireless connection network chip.

[0151] In some embodiments, if the smart terminal establishes wireless communication connection with more than two wireless earphones, for example, also establishes wireless communication connection with a third wireless earphone, the smart terminal can also obtain the audio encoding format of the third wireless earphone, encode the copied third audio data based on the audio encoding format of the third wireless earphone to obtain encoded third audio data, and send the encoded third audio data to the third wireless earphone through the second wireless connection network chip.

[0152] In some embodiments, the first wireless earphone, the second wireless earphone, and the third wireless earphone can be wireless earphones supporting A2DP protocol and / or LE Audio protocol.

[0153] Referring to Figure 9 As shown in the figure, the following describes the smart terminal 100 related to the embodiments of the present application. The smart terminal in the embodiments of the present application can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, and the like, which includes a touch screen, and the embodiments of the present application do not specially limit the specific form of the smart terminal. Please refer to Figure 9 , Figure 9 FIG. 1 is a structural schematic diagram of the smart terminal 100 provided by the embodiments of the present application.

[0154] The smart terminal 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0155] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the smart terminal 100. In other embodiments of the present application, the smart terminal 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0156] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0157] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0158] The memory in the processor 110 can also be configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0159] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0160] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can contain multiple sets of I2C bus. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces respectively. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, and the touch function of the intelligent terminal 100 is realized.

[0161] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can contain multiple sets of I2S bus. The processor 110 can be coupled to the audio module 170 through the I2S bus, and communication between the processor 110 and the audio module 170 is realized. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, and the function of answering the phone through the Bluetooth earphone is realized.

[0162] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, and the function of answering the phone through the Bluetooth earphone is realized. The I2S interface and the PCM interface can both be used for audio communication.

[0163] The UART interface is a universal serial data bus, which is used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, and the Bluetooth function is realized. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, and the function of playing music through the Bluetooth earphone is realized.

[0164] The MIPI interface can be used to connect the processor 110 and the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the smart terminal 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the smart terminal 100.

[0165] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0166] The USB interface 130 is an interface that conforms to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 can be used to connect a charger to charge the smart terminal 100, and can also be used to transmit data between the smart terminal 100 and peripheral devices. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other smart terminals 100, such as AR devices and the like.

[0167] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the smart terminal 100. In other embodiments of the present application, the smart terminal 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0168] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the smart terminal 100. The charging management module 140 can charge the battery 142 while also supplying power to the smart terminal 100 through the power management module 141.

[0169] The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can be disposed in the same device.

[0170] The wireless communication function of the intelligent terminal 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, and the like.

[0171] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the intelligent terminal 100 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0172] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the intelligent terminal 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter, amplify, and the like the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor and radiate the signals as electromagnetic waves through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be disposed in the same device.

[0173] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110 and disposed in the same device as the mobile communication module 150 or other functional modules.

[0174] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, modulate it, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.

[0175] In some embodiments, the antennas 1 and the mobile communication module 150 are coupled, and the antennas 2 and the wireless communication module 160 are coupled, so that the smart terminal 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidu navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0176] The smart terminal 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0177] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oled, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the smart terminal 100 can include one or N display screens 194, where N is a positive integer greater than 1. In some embodiments, the display screen 194 can be a touch screen. That is, the display screen 194 can include a touch sensor 180K.

[0178] The smart terminal 100 can implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0179] The ISP is configured to process data fed back by the camera 193. For example, when taking a photo, a shutter is opened, light is transmitted to a light-sensing element of the camera through a lens, the light signal is converted into an electrical signal, and the light-sensing element of the camera transmits the electrical signal to the ISP for processing to convert the electrical signal into an image visible to the naked eye. The ISP can also optimize algorithms for noise, brightness, and skin color of the image. The ISP can also optimize parameters such as exposure and color temperature of a shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0180] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects the optical image onto a light-sensing element. The light-sensing element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light-sensing element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the smart terminal 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0181] The digital signal processor is used to process digital signals, which can process not only digital image signals but also other digital signals. For example, when the intelligent terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0182] The video codec is used to compress or decompress digital video. The intelligent terminal 100 can support one or more video codecs. In this way, the intelligent terminal 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0183] The NPU is a neural-network (NN) computing processor, which can quickly process input information by drawing on the structure of a biological neural network, such as the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the intelligent terminal 100 can realize intelligent cognitive applications, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0184] The internal memory 121 can include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs).

[0185] The random access memory can include a static random-access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM, such as the fifth generation DDR SDRAM commonly referred to as DDR5 SDRAM), etc.

[0186] The non-volatile memory can include a magnetic disk storage device, a flash memory.

[0187] According to the operation principle, the flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. According to the potential order of the storage unit, the flash memory can include single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. According to the storage specification, the flash memory can include universal flash storage (UFS), embedded multi media Card (eMMC), etc.

[0188] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of an operating system or other programs running, and can also be used to store data of users and application programs, etc.

[0189] The non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.

[0190] The external memory interface 120 can be used to connect an external non-volatile memory, so as to expand the storage capacity of the intelligent terminal 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120, so as to realize the data storage function. For example, music, video, etc. files are saved in the external non-volatile memory.

[0191] The intelligent terminal 100 can realize the audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, media data playing, recording, etc.

[0192] The audio module 170 is used to convert digital audio information into analog audio signals, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or part of the function modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals. The intelligent terminal 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0193] The receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the smart terminal 100 answers a phone call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0194] The microphone 170C, also called "microphone", "sounder", is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can make a sound by holding the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The smart terminal 100 can be provided with at least one microphone 170C. In some other embodiments, the smart terminal 100 can be provided with two microphones 170C, which can realize noise reduction function in addition to collecting sound signals. In some other embodiments, the smart terminal 100 can be provided with three, four or more microphones 170C, which can realize sound signal collection, noise reduction, sound source identification, directional recording and other functions.

[0195] The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0196] The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be arranged on the display screen 194. The pressure sensor 180A can be of various types, such as a resistance type pressure sensor, an inductance type pressure sensor, a capacitance type pressure sensor, etc. The capacitance type pressure sensor can include at least two parallel plates made of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The smart terminal 100 determines the intensity of the pressure according to the change of the capacitance. When a touch operation is applied to the display screen 194, the smart terminal 100 detects the intensity of the touch operation according to the pressure sensor 180A. The smart terminal 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, the touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction of viewing a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction of creating a new short message is executed.

[0197] The gyro sensor 180B can be used to determine the motion posture of the smart terminal 100. In some embodiments, the angular velocity of the smart terminal 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of shaking of the smart terminal 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the smart terminal 100 by reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and motion sensing game scenarios.

[0198] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the smart terminal 100 calculates the altitude, assists in positioning and navigation by using the air pressure value measured by the barometric pressure sensor 180C.

[0199] The magnetic sensor 180D includes a Hall sensor. The smart terminal 100 can use the magnetic sensor 180D to detect the opening and closing of a flip cover case. In some embodiments, when the smart terminal 100 is a flip phone, the smart terminal 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. In turn, according to the detected opening and closing state of the case or the opening and closing state of the flip cover, the smart terminal 100 can set features such as automatic unlocking of the flip cover.

[0200] The acceleration sensor 180E can detect the magnitude of acceleration of the smart terminal 100 in various directions (typically three axes). When the smart terminal 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the smart terminal 100 and applied to landscape / portrait switching, pedometers, and other applications.

[0201] The distance sensor 180F is used to measure distance. The smart terminal 100 can measure distance by infrared or laser. In some embodiments, in a shooting scenario, the smart terminal 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0202] The proximity light sensor 180G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode can be an infrared light-emitting diode. The smart terminal 100 emits infrared light outwardly through the light-emitting diode. The smart terminal 100 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the smart terminal 100. When insufficient reflected light is detected, the smart terminal 100 can determine that there is no object near the smart terminal 100. The smart terminal 100 can use the proximity light sensor 180G to detect that a user is holding the smart terminal 100 close to the ear for a call, so as to automatically turn off the screen to achieve the purpose of power saving. The proximity light sensor 180G can also be used for automatic unlocking and locking of the case mode and pocket mode.

[0203] Ambient light sensor 180L is configured to sense ambient light intensity. The smart terminal 100 can adaptively adjust the display screen 194 brightness according to the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust white balance when taking a photo. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the smart terminal 100 is in a pocket to prevent accidental touch.

[0204] Fingerprint sensor 180H is configured to collect a fingerprint. The smart terminal 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application lock, fingerprint photo, fingerprint answer incoming call, etc.

[0205] Temperature sensor 180J is configured to detect temperature. In some embodiments, the smart terminal 100 uses the temperature detected by the temperature sensor 180J to implement temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the smart terminal 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In another embodiment, when the temperature is lower than another threshold, the smart terminal 100 heats the battery 142 to avoid abnormal shutdown of the smart terminal 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, the smart terminal 100 performs voltage boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0206] Touch sensor 180K, also known as "touch device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as "touch screen". The touch sensor 180K is configured to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the smart terminal 100, which is different from the position of the display screen 194.

[0207] Bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of the human body sound part vibration bone block. The bone conduction sensor 180M can also contact the human body pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse voice signals based on the vibration signals of the sound part vibration bone block obtained by the bone conduction sensor 180M to realize voice function. The application processor can parse heart rate information based on the blood pressure pulsation signals obtained by the bone conduction sensor 180M to realize heart rate detection function.

[0208] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. The smart terminal 100 can receive button input and generate key signal inputs related to user settings and function control of the smart terminal 100.

[0209] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to different touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0210] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0211] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the smart terminal 100. The smart terminal 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The smart terminal 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the smart terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the smart terminal 100 and cannot be separated from the smart terminal 100.

[0212] The audio sharing methods described in the above embodiments can all be implemented in the smart terminal 100 with the above hardware structure.

[0213] like Figure 10 The diagram shown is a structural schematic of a wireless earphone 200 provided in an embodiment of this application. This wireless earphone 200 can correspond to... Figure 3The first wireless earphone is shown. The wireless earphone 200 can include at least one processor 201, at least one memory 202, a wireless communication module 203, an audio module 204, a power module 205, and an input / output interface 206, etc. The processor can include one or more interfaces for connecting with other components of the wireless earphone 200. The wireless earphone 200 can be stored in an earphone box.

[0214] The memory 202 can be used to store program codes, for example, for Bluetooth connection between the wireless earphone 200 and the smart terminal 100, or for charging the wireless earphone 200, etc. The memory 202 can also be used to store other information, such as the priority of the smart terminal 100, etc. In addition, the memory 202 can also store the communication information of other devices (such as the smart terminal 100), such as the communication address, the device identifier, etc. The memory 202 can also store the audio synchronization trigger operation corresponding to other audio playback devices (such as the second wireless earphone). The processor 201 can be used to execute the above-mentioned program codes, call related modules to realize the functions of the wireless earphone 200 in the embodiments of the present application. For example, to realize the Bluetooth pairing between the wireless earphone 200 and the smart terminal 100, and the audio playback function, etc.

[0215] In some embodiments, the processor 201 can include one or more processing units, and different processing units can be independent devices or integrated in one or more processors 201. The processor 201 can be an integrated control chip, or can be composed of a circuit including various active and / or passive components, and the circuit is configured to perform the functions described in the embodiments of the present application that belong to the processor 201. The wireless communication module 203 can be used to support the communication between the wireless earphone 100 and other electronic devices or earphone boxes, including BLE, WLAN (such as Wi-Fi), Zigbee, FM, NFC, IR, or general 2.4G / 5G wireless communication technology, etc. Wireless communication data exchange.

[0216] In some embodiments, the wireless communication module 203 can include a Bluetooth chip, which can support the wireless earphone 200 to establish Bluetooth connection with multiple electronic devices. For example, the first wireless earphone can pair with the smart terminal 100 and establish Bluetooth connection through the Bluetooth chip, so as to realize wireless communication and audio service processing between the wireless earphone 200 and the smart terminal 100 through the Bluetooth connection. The Bluetooth chip can also support the function of broadcasting audio in the LE audio core protocol specification, so that the wireless earphone 200 receives one or more audio streams broadcasted by the smart terminal. In addition, the wireless communication module 203 can also include an antenna. The wireless communication module 203 receives electromagnetic waves via the antenna, and performs frequency conversion and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 201. The wireless communication module 203 can also receive signals to be sent from the processor 201, perform frequency conversion and amplification, and convert the signals into electromagnetic wave radiation via the antenna. The wireless communication module 203 can obtain signals emitted by other devices (such as the smart terminal 100), such as probe request, scan signal, etc., and can send response signals, scan responses, etc., so that other devices (such as the smart terminal 100) can discover the wireless earphone 200 and establish a wireless communication connection with other devices (such as the smart terminal 100).

[0217] The wireless communication module 203 can also emit signals, such as broadcast BLE signals, so that other devices (such as the smart terminal 100) can discover the wireless earphone 200 and establish a wireless communication connection with other devices (such as the smart terminal 100) to communicate with other devices (such as the smart terminal 100) through Bluetooth. The audio module 204 can be used to manage audio data and realize input and output of audio signals of the wireless earphone 200. For example, the audio module 204 can obtain audio signals from the wireless communication module 203, or deliver audio signals to the wireless communication module 203, to realize functions such as making and receiving calls, playing music, starting / closing the voice assistant of the smart terminal connected to the earphone, receiving / sending voice data of the user, etc. The audio module 204 can include a speaker (or earpiece, receiver) component for outputting audio signals, a microphone (or microphone, microphone), a microphone receiving circuit cooperating with the microphone, etc. The speaker can be used to convert audio electrical signals into sound signals and play them. The microphone can be used to convert sound into audio electrical signals.

[0218] The power module 205 can be configured to provide system power for the wireless earphone 200, to supply power for each module of the wireless earphone 200, and to support the wireless earphone 200 to receive a charging input. The power module 205 can include a power management unit (PMU) and a battery. The power management unit can receive an external charging input, convert the charging input into an electrical signal, and supply the converted electrical signal to the battery for charging. The power management unit can also convert an electrical signal provided by the battery into an electrical signal suitable for other modules, such as the audio module 204 and the wireless communication module 203, to prevent overcharging, over-discharging, short circuit, overcurrent, and the like of the battery. In some embodiments, the power module 205 can further include a wireless charging coil for wireless charging of the wireless earphone 200. In addition, the power management unit can be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like.

[0219] The plurality of input / output interfaces 206 (i.e., communication interfaces) can be configured to provide wired connection for charging or communication between the wireless earphone 200 and the earphone case. In some embodiments, the input / output interface can be a USB interface. In other embodiments, the input / output interface 206 can be an earphone electrical connector. When the wireless earphone 200 is placed in the earphone case, the wireless earphone 200 can establish electrical connection with an electrical connector in the earphone case through the earphone electrical connector, thereby charging the battery in the wireless earphone 200. In other embodiments, after the electrical connection is established, the wireless earphone 200 can also communicate data with the earphone case, for example, can receive pairing instructions from the earphone case.

[0220] Additionally, the wireless earphone 200 may also include a sensor 207. For example, the sensor 207 may be a distance sensor or a proximity light sensor, used to determine whether the wireless earphone 200 is being worn by a user. For instance, the wireless earphone 200 may use the distance sensor to detect whether there is an object nearby, thereby determining whether the wireless earphone 200 is being worn by a user. When it is determined that the wireless earphone 200 is being worn, the wireless earphone 200 may turn on its speaker. As another example, the sensor 207 may also include a bone conduction sensor, combined with a bone conduction earphone. Using the bone conduction sensor, the wireless earphone 200 can acquire vibration signals from the bone fragments of the human vocal cords, analyze the speech signals, and realize voice functionality, thereby receiving the user's voice commands. The wireless earphone 200 can also perform voice authentication based on the user's voice signals acquired by the bone conduction earphone, for example, to authenticate the user's identity in business scenarios such as payment transactions. For example, the sensor 207 may also include: a touch sensor for detecting user touch operations; a fingerprint sensor for detecting user fingerprints and identifying user identity; and an ambient light sensor that can adaptively adjust parameters (such as volume) based on the perceived ambient light brightness. Furthermore, the sensor 207 can also detect audio synchronization trigger operations corresponding to different audio playback devices (such as a second wireless headset), such as single-click, double-click, multiple-click, long-press, heavy-press, and swipe touch operations; or it can detect collision operations between the wireless headset 200 and other devices. The sensor 207 can convert the audio synchronization trigger operations into electrical signals and transmit them to the processor 201, enabling the processor 201 to determine which audio playback device to establish a wireless connection with and share audio based on the audio synchronization trigger operations.

[0221] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the wireless earphone 200. It may have more than Figure 10 The shown components may be more or fewer, and two or more components may be combined, or different component configurations may be used. For example, the outer surface of the wireless headset 200 may also include components such as a button 208, indicator lights (which can indicate battery level, incoming / outgoing calls, pairing mode, etc.), a display screen (which can display relevant information to the user), and a dustproof mesh (which can be used with the earpiece). The button 208 may be a physical button or a virtual button (used in conjunction with a touch sensor), used to trigger operations such as power on / off, pause, play, record, initiate pairing, share audio, and reset.

[0222] This embodiment also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on the smart terminal 100, the smart terminal 100 performs the aforementioned related method steps to implement the audio sharing method in the above embodiment.

[0223] The embodiment also provides a computer program product, which, when running on a computer, causes the computer to perform the above related steps to realize the audio sharing method in the above embodiment.

[0224] In addition, the embodiment of the present application also provides a device, which can be a chip, a component or a module. The device can include a processor and a memory connected to each other. The memory is used to store computer execution instructions. When the device is running, the processor can execute the computer execution instructions stored in the memory to enable the chip to perform the audio sharing method in the above method embodiments.

[0225] Through the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional modules is taken as an example. In actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0226] In the several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented by other ways. For example, the device embodiments described above are only schematic, and the division of the modules or units is only a logical function division, and there can be another division way in actual implementation, for example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between each of the units can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0227] The units described as separate components can or can not be physically separate, and the components displayed as units can be one physical unit or multiple physical units, that is, they can be located in one place, or can be distributed in multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0228] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware, or in the form of software functional unit.

[0229] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or substantially or all or part of the technical solutions that make contributions to the prior art can be embodied in the form of a software product. The software product is stored in a storage medium, and includes a number of instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the various embodiments of the method of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0230] The above embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An audio sharing method applied to a smart terminal, characterized in that, The method comprises: copying audio data to be played to obtain first audio data corresponding to a first wireless earphone and second audio data corresponding to a second wireless earphone, the smart terminal virtually having a first protocol stack processing module corresponding to the first audio data and a second protocol stack processing module corresponding to the second audio data; encoding the first audio data based on an audio encoding format of the first wireless earphone by using the first protocol stack processing module to obtain encoded first audio data, and encoding the second audio data based on an audio encoding format of the second wireless earphone by using the second protocol stack processing module to obtain encoded second audio data; sending the encoded first audio data to the first wireless earphone and sending the encoded second audio data to the second wireless earphone.

2. The audio sharing method of claim 1, wherein, The smart terminal communicates with the first wireless earphone and the second wireless earphone through Bluetooth, and the copying of the audio data to be played comprises: converting the audio data to be played into pulse code modulation (PCM) format audio data, and mixing the PCM format audio data; delivering the mixed PCM format audio data to a Bluetooth protocol stack through an audio hardware abstraction layer and a Bluetooth hardware abstraction layer; copying the mixed PCM format audio data by using the Bluetooth protocol stack.

3. The audio sharing method of claim 2, wherein, The first protocol stack processing module is a first Bluetooth protocol stack processing module, and the second protocol stack processing module is a second Bluetooth protocol stack processing module, the first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module are created in the Bluetooth protocol stack, and the first Bluetooth protocol stack processing module and the second Bluetooth protocol stack processing module each comprise a Bluetooth protocol stack interface layer (BTIF), a Bluetooth protocol stack application layer (BTA), and a Bluetooth protocol stack layer (BT stack), the encoding of the first audio data based on an audio encoding format of the first wireless earphone by using the first protocol stack processing module to obtain encoded first audio data, and the encoding of the second audio data based on an audio encoding format of the second wireless earphone by using the second protocol stack processing module to obtain encoded second audio data, comprise: the first audio data is delivered to the BT stack in the first Bluetooth protocol stack processing module through the BTIF and the BTA in the first Bluetooth protocol stack processing module, and the BT stack in the first Bluetooth protocol stack processing module encodes the first audio data based on the audio encoding format of the first wireless earphone; the second audio data is delivered to the BT stack in the second Bluetooth protocol stack processing module through the BTIF and the BTA in the second Bluetooth protocol stack processing module, and the BT stack in the second Bluetooth protocol stack processing module encodes the second audio data based on the audio encoding format of the second wireless earphone.

4. The audio sharing method of claim 3, wherein: The BT stack in the first Bluetooth protocol stack processing module calls an audio encoder corresponding to an audio coding format of the first wireless earphone to encode the first audio data; The BT stack in the second Bluetooth protocol stack processing module calls an audio encoder corresponding to an audio coding format of the second wireless earphone to encode the second audio data.

5. The audio sharing method of claim 3, wherein, Before the first audio data is encoded based on the audio coding format of the first wireless earphone by the first protocol stack processing module to obtain encoded first audio data and the second audio data is encoded based on the audio coding format of the second wireless earphone by the second protocol stack processing module to obtain encoded second audio data, the method further comprises: The first audio data is subjected to volume gain adjustment and / or tone adjustment, and the tone adjustment comprises adjusting the sampling frequency and sampling bit width of the audio data; The second audio data is subjected to volume gain adjustment and / or tone adjustment.

6. The audio sharing method of claim 5, wherein, The first audio data is subjected to volume gain adjustment and / or tone adjustment, and the tone adjustment comprises adjusting the sampling frequency and sampling bit width of the audio data; The first audio data is subjected to volume gain adjustment and / or tone adjustment by the BT stack in the first Bluetooth protocol stack processing module; The second audio data is subjected to volume gain adjustment and / or tone adjustment by the BT stack in the second Bluetooth protocol stack processing module. The smart terminal comprises a first wireless connection network chip and a second wireless connection network chip, and the method further comprises:

7. The audio sharing method according to any one of claims 1 to 6, wherein, The audio data to be played is copied to obtain third audio data corresponding to a third wireless earphone, and the smart terminal is virtually provided with a third protocol stack processing module corresponding to the third audio data; The third audio data is encoded based on the audio coding format of the third wireless earphone by the third protocol stack processing module to obtain encoded third audio data; The encoded third audio data is sent to the third wireless earphone through the second wireless connection network chip; The encoded first audio data is sent to the first wireless earphone, and the encoded second audio data is sent to the second wireless earphone, which comprises: The encoded first audio data is sent to the first wireless earphone through the first wireless connection network chip, and the encoded second audio data is sent to the second wireless earphone through the first wireless connection network chip. The first wireless earphone, the second wireless earphone and the third wireless earphone are wireless earphones supporting the advanced audio distribution mode A2DP protocol and / or the new generation Bluetooth technology standard LE Audio protocol of the low-power Bluetooth audio standard.

8. The audio sharing method of claim 7, wherein, ​ 9. The audio sharing method of any one of claims 1 to 6, wherein, The smart terminal comprises a first wireless connection network chip and a second wireless connection network chip, the first wireless connection network chip has a stronger chip capability than the second wireless connection network chip, the data volume of the encoded first audio data is greater than that of the encoded second audio data, and the sending of the encoded first audio data to the first wireless earphone and the sending of the encoded second audio data to the second wireless earphone comprise: sending the encoded first audio data to the first wireless earphone through the first wireless connection network chip and sending the encoded second audio data to the second wireless earphone through the second wireless connection network chip.

10. A smart terminal, characterized by The smart terminal comprises a memory and a processor; The memory is configured to store program instructions. The processor is configured to read the program instructions stored in the memory to implement the audio sharing method according to any one of claims 1 to 9.

11. A computer readable storage medium, characterized in that, The computer readable storage medium stores computer readable instructions, and the computer readable instructions are executed by a processor to implement the audio sharing method according to any one of claims 1 to 9.

12. A chip coupled with a memory in a smart terminal, characterized in that, The chip is configured to control the smart terminal to implement the audio sharing method according to any one of claims 1 to 9.

Images