Audio playing method and system and electronic equipment
By establishing a Bluetooth connection terminal between Bluetooth headset and audio output device, the problem of missing smart home device audio when users use Bluetooth headsets is solved, and indirect communication between smart home devices and audio output devices is realized, improving user experience.
Patent Information
- Application Number
- CN202510140824.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-27
- Publication Date
- 2025-04-22
AI Technical Summary
When users use Bluetooth headsets to play phone audio, the audio from smart home devices at home may be overwritten, causing users to miss important information.
By establishing a Bluetooth connection to the terminal in which the Bluetooth headset is connected to the audio output device, establishing a wireless communication connection to communicate with a smart home device or mobile terminal without Bluetooth connection. After receiving the event message generated by the smart home device or the mobile terminal, the terminal forwards the corresponding audio to the audio output device for playback.
Smart home devices or mobile terminals that are not connected to audio output devices are realized indirectly communicated with audio output devices, avoiding users from missing important information and improving user experience.
Smart Images

Figure CN119865387A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202110587662.3, and the original application date is May 27, 2021. The entire contents of the original application are incorporated into this application by reference. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to an audio playback method, system and electronic device. Background Art
[0003] Currently, Bluetooth headsets have been widely used in users' daily lives. For example, after the Bluetooth headset establishes a Bluetooth connection with a terminal such as a mobile phone, the mobile phone can play the audio in the mobile phone to the user through the Bluetooth headset.
[0004] With the rapid development of smart home technology, one or more smart home devices may be installed in a user or family. For example, a user's home may be equipped with smart home devices such as a TV, a tablet computer, and a rice cooker. Then, when a user uses a Bluetooth headset to play audio from a mobile phone at home, the sound played in the Bluetooth headset may cover the sound played by the smart home devices at home. For example, when a rice cooker sounds a reminder tone after cooking soup, if the user is using a Bluetooth headset to play a song in the mobile phone, the user is likely to not be able to hear the reminder tone from the rice cooker, thereby missing the information conveyed by smart home devices such as the rice cooker, which reduces the user experience. Summary of the invention
[0005] The present application provides an audio playback method, system and electronic device, which can play audio of other electronic devices that are not connected to the Bluetooth headset through a Bluetooth headset, thereby improving the user experience.
[0006] In order to achieve the above objectives, this application adopts the following technical solutions:
[0007] In a first aspect, the present application provides an audio system, including a first terminal, a second terminal, and an audio output device, wherein the first terminal establishes a Bluetooth connection with the audio output device, the second terminal does not establish a Bluetooth connection with the audio output device, and a wireless communication connection is established between the first terminal and the second terminal; wherein,
[0008] The second terminal is used to: generate a first event. When the second terminal is a smart home device (such as a microwave oven, etc.), the first event is any event generated when the smart home device is working. When the second terminal is a mobile terminal (such as a tablet computer, etc.), the first event is an event in which the mobile terminal occupies functional resources of an audio output device; further, the above-mentioned wireless communication connection can be used to send a first message corresponding to the first event to the first terminal; the first terminal is used to: receive the first message sent by the second terminal; further, the above-mentioned Bluetooth connection can be used to send a first audio corresponding to the first message to the audio output device; the audio output device is used to: receive the first audio sent by the first terminal, and play the first audio.
[0009] That is to say, when a smart home device or mobile terminal that is not connected to an audio output device (such as a Bluetooth headset) via Bluetooth needs to play audio corresponding to a certain event, the event can be first reported to the first terminal that is connected to the audio output device via Bluetooth, and then the first terminal uses the audio output device to broadcast the corresponding audio to the user. In this way, a smart home device or mobile terminal that is not connected to an audio output device can also indirectly realize the communication function with the audio output device. This prevents users from missing events reported by other electronic devices that are not connected to the audio output device when wearing an audio output device, thereby improving the user experience.
[0010] At the same time, when a mobile terminal that is not connected to the audio output device needs to occupy the functional resources of the audio output device, the audio generated by the mobile terminal can also be sent to the first terminal connected to the audio output device, and then the first terminal uses the audio output device to play the audio, thereby realizing the function of a multi-mode audio output device (such as a multi-mode Bluetooth headset).
[0011] In a possible implementation, when the first event is any event generated when the smart home device is working, the first message includes: audio information and / or text information corresponding to the first event. For example, the first event may be a heating end event generated by a microwave oven, and the corresponding first message may include a prompt tone of the heating end event. For another example, the first event may be a ringing event generated by a smart door lock, and the corresponding first message may include a text message of "a guest is visiting", etc.
[0012] In one possible implementation, when the first message includes audio information, the first audio may include audio information, for example, the first audio may be the same as the audio information in the first message; and / or, when the first message includes text information, the first terminal may also be used to convert the text information in the first message into the first audio.
[0013] In one possible implementation, before sending the first audio corresponding to the first message to the audio output device, the first terminal is also used to: if the audio output device is not executing an audio playback service, indicating that the audio channel on the audio output device is idle at this time, the first audio can be sent directly to the audio output device; if the audio output device is executing a certain audio playback service, the first audio can be sent to the audio output device according to the type of the audio playback service.
[0014] Exemplarily, sending the first audio to the audio output device according to the type of the audio playback service includes: when the type of the audio playback service is a call service or a ringing service, since the call service and the ringing service have higher priorities, the first audio can be mixed with the audio of the audio playback service and sent to the audio output device; when the type of the audio playback service is a multimedia service, since the priority of the multimedia service is lower, the sending of the audio of the audio playback service to the audio output device can be suspended, and the first audio can be sent to the audio output device. After the first audio is sent to the audio output device, the first terminal can continue to send the audio in the above audio playback service to the audio output device.
[0015] In a possible implementation, the first event may be an event that a mobile terminal occupies a functional resource of an audio output device, that is, a mobile terminal also needs to use an audio output device to play audio. The functional resource may include an audio playback functional resource and / or a call functional resource, the call functional resource is used to complete a call function of a terminal, and the audio playback functional resource is used to implement a function of playing audio for a terminal.
[0016] In the above scenario, before the second terminal generates the first event, the second terminal is also used to: display a preset control, which is used to prompt the user to use the second terminal to occupy the functional resources of the audio output device; at this time, the second terminal generates the first event, including: in response to a preset operation (such as a click operation, etc.) input by the user to the control, the second terminal can generate the first event.
[0017] Exemplarily, the second terminal displays preset controls, including: when the second terminal obtains an audio playback operation input by the user (for example, when the user clicks the play button of the music), the second terminal can display the above controls; or, when the second terminal obtains a message that the audio output device is connected to the first terminal through Bluetooth, the second terminal can display the above controls.
[0018] In addition, in the above scenario, after the second terminal sends the above first message to the first terminal, the second terminal can send all the generated audio data to the first terminal; at this time, the first terminal is also used to receive the audio data sent by the second terminal, and the audio data is the first audio that the audio output device needs to play.
[0019] In a possible implementation, after the first terminal establishes a Bluetooth connection with the audio output device, the first terminal is further used to: send a broadcast message in the audio system, where the broadcast message is used to instruct the first terminal to establish a Bluetooth connection with the audio output device. In this way, a terminal (such as the second terminal) that receives the broadcast message in the audio system can send the corresponding first message to the first terminal connected to the audio output device when the first event occurs.
[0020] In a second aspect, the present application provides an audio playback method, including: a first terminal and a second terminal establish a wireless communication connection, for example, the first terminal and the second terminal can establish a wireless communication connection by accessing the same Wi-Fi network; after the first terminal establishes a Bluetooth connection with an audio output device, the first terminal can receive a first message sent by the second terminal through the above-mentioned wireless communication connection, and the first message is used to indicate that the second terminal generates a first event, and at this time, the second terminal and the audio output device have not established a Bluetooth connection; wherein, when the second terminal is a smart home device, the first event is any event generated when the smart home device is working, and when the second terminal is a mobile terminal, the first event is an event that the mobile terminal occupies functional resources of the audio output device; then, the first terminal can determine a first audio corresponding to the first message; and send the first audio to the audio output device via a Bluetooth connection, so that the audio output device plays the first audio.
[0021] In this way, a smart home device or mobile terminal that is not connected to the audio output device can indirectly realize the communication function with the audio output device, thereby preventing the user from missing events reported by other electronic devices that are not connected to the audio output device when wearing the audio output device, thereby improving the user experience.
[0022] In a possible implementation manner, the first message may include the first audio; or the first message may include text information corresponding to the first audio.
[0023] In one possible implementation, the first terminal sends the first audio to the audio output device, including: if the audio output device is not performing an audio playback service, the first terminal may send the first audio to the audio output device; if the audio output device is performing an audio playback service, the first terminal may send the first audio to the audio output device according to the type of the audio playback service.
[0024] Exemplarily, the first terminal sends the first audio to the audio output device according to the type of the audio playback service, including: when the type of the audio playback service is a call service or a ringing service, mixing the first audio with the audio of the audio playback service and sending them to the audio output device; when the type of the audio playback service is a multimedia service, pausing sending the audio of the audio playback service to the audio output device, and sending the first audio to the audio output device.
[0025] In one possible implementation, the above-mentioned functional resources specifically include audio playback functional resources and / or call function resources. The call function resources are used to complete the call function of a certain terminal, and the audio playback functional resources are used to implement the function of playing audio for a certain terminal; at this time, the first audio is the audio data sent by the second terminal after sending the first message.
[0026] In a possible implementation, after the first terminal receives the first message sent by the second terminal, the method further includes: the first terminal may send a connection success message to the second terminal, so that the second terminal sends subsequently generated audio data to the first terminal in response to the connection success message.
[0027] In a possible implementation, before the first terminal receives the first message sent by the second terminal, it also includes: the first terminal accesses the local area network where the second terminal is located, thereby establishing a wireless communication connection with the second terminal; when the first terminal establishes a Bluetooth connection with the audio output device, the first terminal sends a broadcast message in the local area network, and the broadcast message is used to instruct the first terminal to establish a Bluetooth connection with the audio output device.
[0028] In a third aspect, the present application provides an audio playback method, including: a first terminal and a second terminal establish a wireless communication connection; the second terminal receives a broadcast message sent by the first terminal, the broadcast message is used to instruct the first terminal to establish a Bluetooth connection with an audio output device, and the second terminal does not establish a Bluetooth connection with the audio output device; when the second terminal generates a first event, a first message corresponding to the first event can be sent to the first terminal, so that the first terminal uses the audio output device to play the corresponding audio. Wherein, when the second terminal is a smart home device, the first event is any event generated when the smart home device is working, and when the second terminal is a mobile terminal, the first event is an event that the mobile terminal occupies the functional resources of the audio output device.
[0029] In this way, a smart home device or mobile terminal that is not connected to the audio output device can indirectly realize the communication function with the audio output device, thereby preventing the user from missing events reported by other electronic devices that are not connected to the audio output device when wearing the audio output device, thereby improving the user experience.
[0030] In a possible implementation, the second terminal sends a first message corresponding to a first event to the first terminal, including: the second terminal obtains the communication address (such as an IP address, etc.) of the first terminal; the second terminal sends the first message corresponding to the first event to the first terminal according to the communication address.
[0031] In a possible implementation, after the second terminal receives the broadcast message sent by the first terminal, the method further includes: the second terminal displays a preset control, which is used to prompt the user to use the second terminal to occupy the functional resources of the audio output device. In this scenario, the second terminal can generate a first event of occupying the functional resources of the audio output device in response to the preset operation input by the user to the control.
[0032] In a fourth aspect, the present application provides a terminal (such as the first terminal or the second terminal described above), comprising: a communication module, a memory, and one or more processors; the memory, the communication module, and the processor are coupled. The memory is used to store computer program codes, and the computer program codes include computer instructions; when the terminal is running, the processor is used to execute one or more computer instructions stored in the memory, so that the terminal executes the audio playback method described in any one of the above items.
[0033] In a fifth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on a terminal (such as the first terminal or the second terminal mentioned above), the audio playback method described in any one of the above items is executed on the terminal (such as the first terminal or the second terminal mentioned above).
[0034] In a sixth aspect, the present application provides a computer program product, which, when executed on a terminal (eg, the first terminal or the second terminal), enables the terminal (eg, the first terminal or the second terminal) to execute any of the audio playback methods described above.
[0035] It can be understood that the above-provided terminal, computer storage medium and computer program product are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 A schematic diagram of the architecture of an audio system provided in an embodiment of the present application;
[0037] Figure 2 An example of an audio playback method provided in the present application is shown in FIG. Figure 1 ;
[0038] Figure 3A A schematic diagram of the structure of a Bluetooth headset provided in an embodiment of the present application Figure 1 ;
[0039] Figure 3B A schematic diagram of the structure of a Bluetooth headset provided in an embodiment of the present application Figure 2 ;
[0040] Figure 4A schematic diagram of the structure of a mobile phone provided in an embodiment of the present application;
[0041] Figure 5 An interactive schematic diagram of an audio playback method provided in an embodiment of the present application;
[0042] Figure 6 An example of an audio playback method provided in the present application is shown in FIG. Figure 2 ;
[0043] Figure 7 Schematic diagram 3 of an application scenario of an audio playback method provided in an embodiment of the present application;
[0044] Figure 8 An example of an audio playback method provided in the present application is shown in FIG. Figure 4 ;
[0045] Fig. 9 An example of an audio playback method provided in the present application is shown in FIG. Figure 5 ;
[0046] Fig.10 An example of an audio playback method provided in the present application is shown in FIG. Figure 6 ;
[0047] Fig.11 An example of an audio playback method provided in the present application is shown in FIG. Figure 7 ;
[0048] Fig.12 An example of an audio playback method provided in the present application is shown in FIG. Figure 8 ;
[0049] Fig.13 An example of an audio playback method provided in the present application is shown in FIG. Figure 9 ;
[0050] Fig.14 An example of an audio playback method provided in the present application is shown in FIG. Figure 10 ;
[0051] Fig.15 An example of an audio playback method provided in the present application is shown in FIG. Figure 10 one;
[0052] Fig.16 An example of an audio playback method provided in the present application is shown in FIG. Figure 10 two;
[0053] Fig.17 An example of an audio playback method provided in the present application is shown in FIG. Figure 10 three;
[0054] Fig.18 A schematic diagram of a terminal structure provided in an embodiment of the present application Figure 1 ;
[0055] Fig.19 A schematic diagram of a terminal structure provided in an embodiment of the present application Figure 2 . DETAILED DESCRIPTION
[0056] The implementation of this embodiment will be described in detail below with reference to the accompanying drawings.
[0057] refer to Figure 1 The audio playback method provided in the embodiment of the present application can be applied Figure 1 An audio system 100 is shown.
[0058] Exemplarily, the audio system 100 may include electronic devices with Bluetooth function (referred to as Bluetooth devices), such as a mobile phone 101, a tablet computer 102, etc. Optionally, the audio system 100 may also include electronic devices without Bluetooth function (referred to as non-Bluetooth devices), such as a microwave oven 103, an air conditioner 104, etc.
[0059] Of course, the audio system 100 may also include speakers, vehicle-mounted equipment (also referred to as a vehicle computer), laptop computers, ultra-mobile personal computers (UMPCs), handheld computers, netbooks, personal digital assistants (PDAs), wearable electronic devices, virtual reality devices, and other devices.
[0060] Among them, the devices in the audio system 100 can be divided into Bluetooth devices and non-Bluetooth devices according to whether they have Bluetooth functions. Alternatively, the devices in the audio system 100 can also be divided into smart home devices and mobile terminals. Among them, smart home devices can also be called IOT (internet of things) devices. For example, smart home devices may include microwave ovens 103, air conditioners 104, etc. Smart home devices are usually set up in the user's home and the user does not carry them with him. Mobile terminals may include mobile phones 101, tablet computers 102, etc. The size of mobile terminals is usually small, which is convenient for users to carry with them.
[0061] The electronic devices in the audio system 100 may be interconnected via a communication network. Exemplarily, the communication network may be a wired network or a wireless network. For example, the communication network may be a local area network (LAN) or a wide area network (WAN), such as the Internet. The above-mentioned communication network can be implemented using any known network communication protocol, and the above-mentioned network communication protocol can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), FIREWIRE, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, wireless fidelity (Wi-Fi), NFC, voice over Internet protocol (VoIP), communication protocols supporting network slicing architecture or any other suitable communication protocols.
[0062] That is to say, the various electronic devices in the audio system 100 can form a network (ie, networking) according to certain communication protocols and networking strategies, so that the various electronic devices in the audio system 100 can communicate with each other.
[0063] For example, each electronic device in the audio system 100 can access a Wi-Fi network provided by an access point (AP) such as a router, so that a Wi-Fi connection is established between each electronic device. For another example, each electronic device in the audio system 100 can log in to the same account (such as a Huawei account), and then interconnect through one or more servers.
[0064] In the embodiment of the present application, Figure 1As shown, any device with Bluetooth function in the audio system 100 can also establish a Bluetooth connection with the Bluetooth headset 200. Taking the establishment of a Bluetooth connection between the mobile phone 101 and the Bluetooth headset 200 as an example, after the mobile phone 101 and the Bluetooth headset 200 establish a Bluetooth connection, the user can use the Bluetooth headset 200 to listen to the audio played by the mobile phone 101. In this scenario, other devices in the audio system 100 may need to play a reminder sound of a certain event when working. For example, when the user uses the Bluetooth headset 200 to listen to the song played by the mobile phone 101, the microwave oven 103 is heating food. When the microwave oven 103 finishes heating, it is necessary to play a reminder sound of the heating end event. At this time, if the microwave oven 103 directly plays the reminder sound of the heating end event in the existing manner, the user who is using the Bluetooth headset 200 is likely to not hear the reminder sound, thereby missing the heating end event reported by the microwave oven 103.
[0065] In this regard, in the embodiment of the present application, still taking the above scenario as an example, after the mobile phone 101 establishes a Bluetooth connection with the Bluetooth headset 200, Figure 2 As shown, when the microwave oven 103 finishes heating, the microwave oven 103 can send the heating end event (or the prompt tone of the heating end event) to the mobile phone 101 in the networking. For example, the microwave oven 103 can send the above heating end event (or the prompt tone of the heating end event) to the mobile phone 101 through the currently connected Wi-Fi network. Furthermore, the mobile phone 101 sends the above heating end event (or the prompt tone of the heating end event) to the Bluetooth headset 200 through the Bluetooth connection between the Bluetooth headset 200, and the Bluetooth headset 200 plays the heating end event (or the prompt tone of the heating end event) in the form of voice. In this way, when the user uses the Bluetooth headset 200 connected to the mobile phone 101, the Bluetooth headset 200 can directly perceive the events reported by other devices (such as the microwave oven 103) that are not connected to the Bluetooth headset 200, so as to avoid missing the relevant messages reported to the user by each electronic device in the networking.
[0066] That is to say, when an electronic device in the audio system 100 that is not connected to the Bluetooth headset 200 (such as the above-mentioned microwave oven 103) needs to report an event to the user, the event can be first reported to an electronic device in the network that is connected to the Bluetooth headset 200 (such as the above-mentioned mobile phone 101), and then the electronic device broadcasts the corresponding event to the user through the Bluetooth headset 200.
[0067] In this way, non-Bluetooth devices without Bluetooth function can also indirectly realize the communication function with the Bluetooth headset 200. After the Bluetooth headset 200 is connected to a Bluetooth device in the audio system 100, it can receive events reported by various electronic devices in the audio system 100, avoiding the user from missing events reported by other electronic devices that are not connected to the Bluetooth headset 200 when wearing the Bluetooth headset 200, thereby improving the user experience.
[0068] It should be noted that the above embodiment is illustrated by the heating end event of the microwave oven 103. It is understandable that there may be many specific events reported to the user by different electronic devices in the audio system 100. For example, the program reminder event reported by the TV, the ringing event reported by the doorbell, the washing program completion event reported by the washing machine, etc., and the present application does not impose any limitation on this.
[0069] In addition, some Bluetooth headsets can support establishing point-to-point Bluetooth connections with multiple Bluetooth devices (i.e., multi-mode Bluetooth headsets). For example, for a dual-mode Bluetooth headset, the Bluetooth headset can simultaneously establish Bluetooth connections with Bluetooth device 1 and Bluetooth device 2. At this time, both Bluetooth device 1 and Bluetooth device 2 can send audio to the Bluetooth headset for playback.
[0070] However, due to the limitation of frequency resources and hardware configuration, some Bluetooth headsets only support establishing a point-to-point Bluetooth connection with one Bluetooth device (i.e., a single-mode Bluetooth headset). The cost of such Bluetooth headsets is usually lower than that of a multi-mode Bluetooth headset. In the embodiment of the present application, if a single-mode Bluetooth headset is used to connect to a Bluetooth device in the audio system 100 (e.g., the mobile phone 101), the single-mode Bluetooth headset can still receive and play the audio sent by other electronic devices in the audio system 100 according to the above method, thereby using a low-cost single-mode Bluetooth headset to achieve the functions of a high-cost multi-mode Bluetooth headset, which can also improve the user experience.
[0071] It should be noted that in the above embodiment, a Bluetooth headset (such as the Bluetooth headset 200) is used as an example of an audio output device of the Bluetooth device in the audio system 100. It can be understood that the above Bluetooth headset can also be an audio output device with Bluetooth function, such as a Bluetooth speaker and a Bluetooth TV, and the embodiment of the present application does not impose any restrictions on this.
[0072] For example, Figure 3A FIG. 2 shows a schematic diagram of the structure of a Bluetooth headset (such as the Bluetooth headset 200 described above). Figure 3A As shown, the Bluetooth headset may include: a left earplug 201-1, a right earplug 201-2 and an earplug box 201-3. The earplug box may be used to store the left and right earplugs of the Bluetooth headset. Figure 3A A schematic diagram of a product form of a Bluetooth headset is given by way of example only. The product form of the peripheral device provided in the embodiment of the present application is not limited to Figure 3A Bluetooth headset shown.
[0073] Please refer to Figure 3B , is a schematic diagram of the structure of an earplug (left earplug or right earplug) of a Bluetooth headset provided in an embodiment of the present application. Figure 3BAs shown, the earplug of the Bluetooth headset (such as the right earplug or the left earplug) may include: a processor 210, a memory 220, a sensor 230, a wireless communication module 240, a receiver 250, a microphone 260 and a power supply 270.
[0074] The memory 220 may be used to store application code, such as application code for establishing a wireless connection with another earplug (such as the right earplug 201-2) of the Bluetooth headset, and for pairing the earplug with the electronic device 100 (such as the mobile phone 200). The processor 210 may control the execution of the above application code to implement the functions of the Bluetooth headset in the embodiment of the present application.
[0075] The memory 220 may also store a Bluetooth address for uniquely identifying the earplug and a Bluetooth address of another earplug of the Bluetooth headset. In addition, the memory 220 may also store connection data of an electronic device that has been successfully paired with the earplug. The Bluetooth address may be a media access control (MAC) address.
[0076] The sensor 230 may be a distance sensor or a proximity light sensor. The earplug may determine whether it is worn by the user through the sensor 230. For example, the earplug may use a proximity light sensor to detect whether there is an object near the earplug, thereby determining whether the earplug is worn by the user. When it is determined that the earplug is worn, the earplug may turn on the receiver 250. In some embodiments, the earplug may also include a bone conduction sensor, combined into a bone conduction headset. Using the bone conduction sensor, the earplug may obtain the vibration signal of the vocal bone, parse the voice signal, and realize the voice function. In other embodiments, the earplug may also include a touch sensor for detecting the user's touch operation. In other embodiments, the earplug may also include a fingerprint sensor for detecting the user's fingerprint, identifying the user's identity, etc. In other embodiments, the earplug may also include an ambient light sensor, which may adaptively adjust some parameters, such as the volume, according to the brightness of the perceived ambient light.
[0077] The wireless communication module 240 is used to support short-distance data exchange between the earplug of the Bluetooth headset and various electronic devices, such as the above-mentioned electronic device 100. In some embodiments, the wireless communication module 240 can be a Bluetooth transceiver. The earplug of the Bluetooth headset can establish a wireless connection with the above-mentioned electronic device 100 through the Bluetooth transceiver to achieve short-distance data exchange between the two.
[0078] At least one receiver 250, also called a "receiver", can be used to convert the audio electrical signal into a sound signal and play it. For example, when the earplug of a Bluetooth headset is used as the audio output device of the electronic device 100, the receiver 250 can convert the received audio electrical signal into a sound signal and play it.
[0079] At least one microphone 260, which may also be referred to as a "microphone" or "microphone", is used to convert a sound signal into an audio electrical signal. For example, when the earplug of a Bluetooth headset is used as an audio input device of the electronic device 100, when the user is speaking (such as talking or sending a voice message), the microphone 260 can collect the user's voice signal and convert it into an audio electrical signal. The above audio electrical signal is the audio data in the embodiment of the present application.
[0080] The power supply 270 can be used to supply power to various components included in the earplug of the Bluetooth headset. In some embodiments, the power supply 270 can be a battery, such as a rechargeable battery.
[0081] Usually, a Bluetooth headset comes with an earbud box (e.g. Figure 3A 201-3 shown in FIG. 201-3). The earplug box can be used to store the left and right earplugs of the Bluetooth headset. Figure 3A As shown, the earplug box 201-3 can be used to store the left earplug 201-1 and the right earplug 201-2 of the Bluetooth headset. In addition, the earplug box can also charge the left and right earplugs of the Bluetooth headset. Accordingly, in some embodiments, the earplugs may also include: an input / output interface 280. The input / output interface 280 may be used to provide any connection between the earplugs of the Bluetooth headset and the earplug box (such as the earplug box 201-3).
[0082] In some embodiments, the input / output interface 280 may be an electrical connector. When the earplugs of the Bluetooth headset are placed in an earplug box, the earplugs of the Bluetooth headset may be electrically connected to the earplug box (such as the input / output interface of the earplug box) through the electrical connector. After the electrical connection is established, the earplug box may charge the power supply 270 of the earplugs of the Bluetooth headset. After the electrical connection is established, the earplugs of the Bluetooth headset may also perform data communication with the earplug box. For example, the earplugs of the Bluetooth headset may receive pairing instructions from the earplug box through the electrical connection. The pairing command is used to instruct the earplugs of the Bluetooth headset to turn on the wireless communication module 240, so that the earplugs of the Bluetooth headset may be paired and connected with the electronic device 100 using a corresponding wireless communication protocol (such as Bluetooth).
[0083] Of course, the earplug of the Bluetooth headset may not include the input / output interface 280. In this case, the earplug can realize the charging or data communication function based on the wireless connection established with the earplug box through the wireless communication module 240.
[0084] In addition, in some embodiments, the earplug box (such as the earplug box 301 described above) may also include a processor, a memory and other components. The memory may be used to store application code, and the processor of the earplug box controls the execution to realize the functions of the earplug box. For example, when the user opens the lid of the earplug box, the processor of the earplug box executes the application code stored in the memory, and can send a pairing command to the earplug of the Bluetooth headset in response to the user's operation of opening the lid.
[0085] It is understandable that the structure shown in the embodiment of the present application does not constitute a specific limitation on the earplug of the Bluetooth headset. Figure 3B More or fewer components shown in the figure may be combined with two or more components, or may have different component configurations. For example, the earplug may also include an indicator light (which may indicate the status of the earplug such as the battery level), a dust screen (which may be used in conjunction with a handset), and other components. Figure 3B The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application specific integrated circuits.
[0086] It should be noted that the structures of the left and right earplugs of the Bluetooth headset can be the same. For example, the left and right earplugs of the Bluetooth headset can both include Figure 3B Alternatively, the structures of the left and right earplugs of the Bluetooth headset may also be different. For example, one earplug of the Bluetooth headset (such as the right earplug) may include Figure 3B , and the other earbud (such as the left earbud) may include Figure 3B Other components except microphone 260.
[0087] For example, Figure 4 A schematic structural diagram of a mobile phone (such as the mobile phone 101 described above) is shown.
[0088] like Figure 4 As shown, the mobile phone may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (USB) interface 430, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, a camera 493, a display screen 494, etc.
[0089] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the mobile phone. In other embodiments of the present application, the mobile phone may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0090] The processor 410 may include one or more processing units, for example, the processor 410 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0091] The processor 410 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may store instructions or data that the processor 410 has just used or cyclically used. If the processor 410 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 410, and thus improves the efficiency of the system.
[0092] In some embodiments, the processor 410 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0093] The wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, mobile communication module 450, wireless communication module 460, modem processor and baseband processor.
[0094] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0095] The mobile communication module 450 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on mobile phones. The mobile communication module 450 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 450 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 450 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 450 can be set in the processor 410. In some embodiments, at least some of the functional modules of the mobile communication module 450 can be set in the same device as at least some of the modules of the processor 410.
[0096] The wireless communication module 460 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to mobile phones. The wireless communication module 460 can be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 410. The wireless communication module 460 can also receive the signal to be sent from the processor 410, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0097] In some embodiments, the antenna 1 of the mobile phone is coupled to the mobile communication module 450, and the antenna 2 is coupled to the wireless communication module 460, so that the mobile phone can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).
[0098] The mobile phone implements display functions through a GPU, a display screen 494, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 410 may include one or more GPUs that execute program instructions to generate or change display information.
[0099] The display screen 494 is used to display images, videos, etc. The display screen 494 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone may include 1 or N display screens 494, where N is a positive integer greater than 1.
[0100] The mobile phone can realize the shooting function through ISP, camera 493, video codec, GPU, display 494 and application processor.
[0101] ISP is used to process the data fed back by camera 493. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 493.
[0102] Camera 493 is used to capture static images or videos. In some embodiments, the mobile phone may include 1 or N cameras, where N is a positive integer greater than 1. Camera 493 may be a front camera or a rear camera.
[0103] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals. For example, when a mobile phone selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0104] Video codecs are used to compress or decompress digital videos. A mobile phone can support one or more video codecs. In this way, the mobile phone can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0105] The external memory interface 420 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone. The external memory card communicates with the processor 410 through the external memory interface 420 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0106] The internal memory 421 can be used to store computer executable program codes, which include instructions. The processor 410 executes various functional applications and data processing of the mobile phone by running the instructions stored in the internal memory 421. The internal memory 421 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the internal memory 421 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0107] The mobile phone can implement audio functions such as music playing and recording through the audio module 470, the speaker 470A, the receiver 470B, the microphone 470C, the earphone interface 470D, and the application processor.
[0108] The audio module 470 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 470 can also be used to encode and decode audio signals. In some embodiments, the audio module 470 can be arranged in the processor 410, or some functional modules of the audio module 470 can be arranged in the processor 410.
[0109] The speaker 470A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The mobile phone can listen to music or listen to hands-free calls through the speaker 470A.
[0110] The receiver 470B, also called a "handset", is used to convert audio electrical signals into sound signals. When the mobile phone receives a call or voice message, the voice can be received by placing the receiver 470B close to the human ear.
[0111] Microphone 470C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by putting their mouth close to microphone 470C to input the sound signal into microphone 470C. The mobile phone can be provided with at least one microphone 470C. In other embodiments, the mobile phone can be provided with two microphones 470C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the mobile phone can also be provided with three, four or more microphones 470C to realize the collection of sound signals, noise reduction, identification of sound sources, and realization of directional recording function, etc.
[0112] The earphone interface 470D is used to connect a wired earphone and can be a USB interface 430 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0113] The sensor module 480 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0114] Of course, the mobile phone may also include a charging management module, a power management module, a battery, buttons, indicators, and one or more SIM card interfaces, etc., and the embodiments of the present application do not impose any restrictions on this.
[0115] The following combination Figure 1 The audio system 100 shown introduces a specific embodiment of the present application. It is understandable that the application scenario of the audio playback method provided by the present application is not limited thereto. Figure 1 In the scenario shown, the Bluetooth headset 200 can be connected to the mobile phone 101 as an audio output device of the mobile phone 101 , while other electronic devices in the audio system 100 are not connected to the Bluetooth headset 200 .
[0116] Specifically, refer to Figure 5 The audio playback method provided in this embodiment may include the following steps:
[0117] S501. Mobile phone 101 accesses a first local area network, which includes N (N is an integer greater than 0) devices.
[0118] Exemplarily, the first local area network may be a local area network composed of various IOT devices (i.e., smart home devices) in the user's home and / or the user's mobile terminal. Among them, the IOT device may be a device such as a television, a refrigerator, a microwave oven, or an air conditioner, and the mobile terminal may be a tablet computer, a mobile phone, or other devices. In addition, the devices in the first local area network may have a Bluetooth function or may not have a Bluetooth function, and the embodiment of the present application does not impose any restrictions on this.
[0119] In some embodiments, the user can connect his / her mobile terminal and one or more IOT devices at home to the Wi-Fi network provided by the router to form a local area network. In this case, the Wi-Fi network at home is the first local area network.
[0120] Taking the first local area network as the Wi-Fi network in the user's home as an example, the various devices in the Wi-Fi network can communicate with each other. Figure 6 As shown, the mobile phone 101 can also access the Wi-Fi network, that is, access the first local area network. After the mobile phone 101 joins the first local area network, it can communicate with each device in the first local area network as a member of the first local area network. At this time, the mobile phone 101 establishes a wireless communication connection with each device in the first local area network through the first local area network.
[0121] In addition, in addition to using the Wi-Fi function to form a local area network with the user's mobile phone 101 and various IOT devices in the home, the user's mobile phone 101 and various IOT devices in the home can also be formed into a local area network using Bluetooth, ZigBee (Purple Bee Protocol) or Ultra Wide Band (UWB) and other methods. The embodiments of the present application do not impose any restrictions on this.
[0122] S502 : The mobile phone 101 establishes a Bluetooth connection with the Bluetooth headset 200 .
[0123] The mobile phone 101 is generally provided with a Bluetooth function. In step S502, when the user wishes to use the Bluetooth headset 200 to play the audio provided by the mobile phone 101, Figure 7 As shown, the mobile phone 101 can use its own Bluetooth function to establish a Bluetooth connection with the Bluetooth headset 200. Of course, if the mobile phone 101 is establishing a Bluetooth connection with the Bluetooth headset 200 for the first time, the mobile phone 101 can also perform pairing and other processes with the Bluetooth headset 200 before establishing a Bluetooth connection with the Bluetooth headset 200.
[0124] It should be noted that the present embodiment of the application does not limit the order between the above steps S501 and S502. That is, the mobile phone 101 can first access the first local area network (such as a Wi-Fi network) and then establish a Bluetooth connection with the Bluetooth headset 200; or, the mobile phone 101 can first establish a Bluetooth connection with the Bluetooth headset 200 and then access the first local area network; or, the mobile phone 101 can simultaneously establish a Bluetooth connection with the Bluetooth headset 200 and access the first local area network, and the present embodiment of the application does not impose any restrictions on this.
[0125] S503 . The mobile phone 101 sends a broadcast message in the first local area network. The broadcast message is used to instruct the mobile phone 101 to establish a Bluetooth connection with the Bluetooth headset 200 .
[0126] In some embodiments, after the mobile phone 101 accesses the first local area network, if the mobile phone 101 establishes a Bluetooth connection with the Bluetooth headset 200, the mobile phone 101 may be triggered to send a broadcast message in the first local area network. The broadcast message is used to indicate that the mobile phone 101 has established a Bluetooth connection with the Bluetooth headset 200, so that the devices in the first local area network know that the current audio output device of the Bluetooth headset 200 is the mobile phone 101.
[0127] Alternatively, if the mobile phone 101 has established a Bluetooth connection with the Bluetooth headset 200 when accessing the first local area network, then after accessing the first local area network, the mobile phone 101 can be triggered to send the above-mentioned broadcast message in the first local area network, so that the devices in the first local area network know that the current audio output device of the Bluetooth headset 200 is the mobile phone 101.
[0128] Still taking the first LAN as the Wi-Fi network in the user's home as an example, Figure 7 As shown, after the mobile phone 101 establishes a Bluetooth connection with the Bluetooth headset 200, the message 1 can be broadcast in the currently connected Wi-Fi network. At this time, other electronic devices in the Wi-Fi network except the mobile phone 101 can receive the message 1.
[0129] For example, the mobile phone 101 may carry the device identification of the mobile phone 101 in the preset field of the message 1. For example, the device identification of the mobile phone 101 may be the MAC (Media Access Control) address, name, etc. of the mobile phone 101. In this way, after the device receiving the message 1 in the Wi-Fi network parses the device identification of the mobile phone 101 from the preset field, it can be known that the device currently connected to the Bluetooth headset 200 is the mobile phone 101, that is, the audio output device of the current Bluetooth headset 200 is the mobile phone 101.
[0130] Exemplarily, when any device in the Wi-Fi network learns that the audio output device of the current Bluetooth headset 200 is a device in the Wi-Fi network (e.g., mobile phone 101), the device can record the audio output device of the Bluetooth headset 200. For example, a preset flag bit can be set in device 1, and when the variable in the flag bit is 1, it indicates that there is no device connected to the Bluetooth headset in the current Wi-Fi network; when the variable in the flag bit is 0, it indicates that there is a device connected to the Bluetooth headset in the current Wi-Fi network. Then, when device 1 learns that the audio output device of the current Bluetooth headset 200 is mobile phone 101, the variable in the above flag bit can be modified to 0, and the device identification of mobile phone 101 can be recorded.
[0131] Subsequently, when the IOT device 1 in the Wi-Fi network needs to report an event to the user, by querying the above-mentioned mark bit and device identification, it can be determined that there is a device connected to the Bluetooth headset in the current Wi-Fi network, and the device identification of the device connected to the Bluetooth headset (i.e., mobile phone 101) can be determined.
[0132] In other embodiments, for example, after the mobile phone 101 accesses the first local area network and establishes a Bluetooth connection with the Bluetooth headset 200, if the mobile phone 101 subsequently detects that the Bluetooth connection with the Bluetooth headset 200 is disconnected, the mobile phone 101 can send a message 2 in the first local area network in the form of a broadcast, and the message 2 is used to indicate that the Bluetooth connection between the mobile phone 101 and the Bluetooth headset 200 is disconnected. In this way, the devices in the Wi-Fi network can promptly learn the connection status between the Bluetooth headset 200 and other devices in the current Wi-Fi network.
[0133] Similarly, if the Bluetooth connection between the mobile phone 101 and the Bluetooth headset 200 is disconnected, and the Bluetooth headset 200 is connected to other Bluetooth devices (for example, a tablet computer) in the Wi-Fi network, the tablet computer can serve as the latest audio output device of the Bluetooth headset 200 and broadcast a message in the first local area network that the tablet computer and the Bluetooth headset 200 have established a Bluetooth connection, so that the devices in the first local area network know that the current audio output device of the Bluetooth headset 200 is the tablet computer.
[0134] S504 . When the IOT device generates a first event, the IOT device sends a first message corresponding to the first event to the mobile phone 101 .
[0135] For example, for different IOT devices, specific events that need to be reported to the user can be pre-set. For example, the power on / off event and heating end event can be set as the events that need to be reported to the user for the microwave oven; the light on / off event can be set as the smart light bulb power on / off event; the alarm clock event and schedule reminder event can be set as the events that need to be reported to the user for the speaker, etc.
[0136] Alternatively, the IOT device may also automatically determine whether it is necessary to report corresponding events to the user when performing different work tasks. For example, when a tablet computer is running as an IOT device, if it receives a video call request from a contact, the tablet computer may determine that it is necessary to report the incoming call event corresponding to this video call request to the user. If the tablet computer receives an advertisement push from an application, the tablet computer may determine that it is not necessary to report the push event corresponding to this advertisement push to the user. Different IOT devices may have different strategies for determining whether corresponding events need to be reported to users, and technicians in this field may set this according to actual needs or actual application scenarios.
[0137] In step S504, any IOT device in the first local area network can determine the specific event that needs to be reported to the user in real time according to the above method during operation. When it is necessary to report the first event to the user, if the IOT device has learned that the current Bluetooth headset is connected to the mobile phone 101 in the first local area network, the IOT device can first obtain the communication address of the mobile phone 101, and then send the first message corresponding to the first event to the mobile phone 101 according to the communication address of the mobile phone 101.
[0138] For example, the first local area network is still taken as the Wi-Fi network in the user's home. Figure 8 As shown, after the mobile phone 101 broadcasts the message that the mobile phone 101 and the Bluetooth headset 200 have established a Bluetooth connection to the IOT devices in the Wi-Fi network, if the smart door lock 801 in the Wi-Fi network receives a ringing event, it means that a guest is visiting. At this time, the smart door lock 801 can determine that it needs to report this ringing event to the user. Furthermore, the smart door lock 801 can obtain the communication address such as the IP address of the mobile phone 101 according to the device identification of the mobile phone 101.
[0139] For example, the router 802 providing the above-mentioned Wi-Fi network generally maintains the correspondence between the device identification of each device in the Wi-Fi network and the IP address of each device in real time. Figure 8 As shown, after receiving the ringing event, the smart door lock 801 may send a query request to the router 802, and the query request may carry the device identification of the mobile phone 101, such as the MAC address of the mobile phone 101. Then, the router 802 may respond to the query request and query the IP address currently corresponding to the MAC address of the mobile phone 101, that is, the IP address of the mobile phone 101. In addition, the router 802 may carry the IP address of the mobile phone 101 in the response message and send it to the smart door lock 801, so that the smart door lock 801 obtains the IP address (i.e., the communication address) of the mobile phone 101.
[0140] In addition to the IP address, the communication address of the mobile phone 101 can also be the Bluetooth MAC address of the mobile phone 101, etc., and the present application embodiment does not impose any restrictions on this. For example, if the smart door lock 801 and the mobile phone 101 are networked via a Bluetooth connection, after the smart door lock 801 receives the above ringing event, it can use the Bluetooth MAC address of the mobile phone 101 as the communication address to communicate with the mobile phone 101.
[0141] Alternatively, the smart door lock 801 can also interact with the mobile phone 101 directly according to the device identification of the mobile phone 101. For example, the smart door lock 801 can send information that needs to be sent to the mobile phone 101 and the device identification of the mobile phone 101 to the router 802. In this way, the router 802 can send the information that the smart door lock 801 needs to send to the mobile phone 101 to the mobile phone 101 according to the device identification of the mobile phone 101. At this time, the smart door lock 801 can communicate with the mobile phone 101 without obtaining the communication address such as the IP address of the mobile phone 101.
[0142] Still taking the first LAN as the Wi-Fi network in the user's home as an example, Fig. 9 As shown, after the smart door lock 801 obtains the IP address of the mobile phone 101, the message 1 corresponding to the current ringing event can be encapsulated into a network message 1. For example, the smart door lock 801 can encapsulate the message 1 into the network message 1 according to protocols such as TCP or UDP. Furthermore, the smart door lock 801 can send the network message 1 to the mobile phone 101 according to the IP address of the mobile phone 101 in the network, so that the mobile phone 101 obtains the message 1 corresponding to the current ringing event.
[0143] Among them, message 1 corresponding to this ringing event is used to notify the user of this ringing event. Message 1 may specifically include audio information, and may also include text information and other content. For example, message 1 may include the reminder tone set by the smart door lock 801 for the ringing event. For another example, message 1 may include the voice content of "Master, there are guests visiting." For another example, message 1 may include the text content of "Master, there are guests visiting." Alternatively, message 1 may also be an identifier corresponding to this ringing event, such as 001. Subsequently, the mobile phone 101 may learn that the smart door lock 801 has received the ringing event based on the received message 1.
[0144] In addition, the message 1 corresponding to the ringing event may also include relevant information such as the time of the ringing event, the number of rings, etc. When the smart door lock 801 captures an image of a visitor, the message 1 may also include the image of the visitor or characteristic information such as the age and gender of the visitor, which is not limited in any way in the embodiments of the present application.
[0145] S505 . After receiving the first message, the mobile phone 101 sends the first audio corresponding to the first message to the Bluetooth headset 200 .
[0146] Exemplarily, after receiving the network message 1 sent by the smart door lock 801 in the network, the mobile phone 101 can parse the message 1 corresponding to the ringing event in the network message 1 according to the corresponding TCP or UDP protocol, thereby knowing that the smart door lock 801 has received the ringing event. At this time, on the one hand, the mobile phone 101 can determine the specific audio content (i.e., the first audio) sent to the Bluetooth headset 200 according to the message 1, and on the other hand, the mobile phone 101 can determine the playback strategy for playing the first audio according to the audio playback service currently executed by the Bluetooth headset 200. Furthermore, the mobile phone 101 can send the first audio to the Bluetooth headset 200 according to the determined playback strategy, thereby transmitting the ringing event indicated by the first audio to the Bluetooth headset 200.
[0147] For example, if the message 1 carries audio information (such as the voice content of "Master, a guest is visiting"), the mobile phone 101 may determine the audio information carried in the message 1 as the corresponding first audio. For another example, the mobile phone 101 may convert the text content carried in the message 1 (such as the text content of "Master, a guest is visiting") into audio information in an audio format, and determine the audio information as the corresponding first audio.
[0148] For another example, the mobile phone 101 may also store the correspondence between events of different IOT devices and corresponding audios. For example, the ringing event of a smart door lock corresponds to audio A, the heating end event of a microwave oven corresponds to audio B, the power-on event of an air conditioner corresponds to audio C, etc. Then, when the mobile phone 101 obtains the identifier of the ringing event from the above message 1, the audio A corresponding to the ringing event may be determined as the corresponding first audio.
[0149] For another example, the message 1 received by the mobile phone 101 from the smart door lock 801 may include the voice content of "Master, a guest is visiting", and may also include the time of the ringing event and the visitor's age, gender and other content. At this time, the mobile phone 101 may also use a neural network algorithm or other methods to extract important information from the message 1 and generate a corresponding first audio. For example, the first audio may be "A male visitor is visiting at 15:07", etc., and the embodiments of the present application do not impose any restrictions on this.
[0150] In addition to determining the first audio to be sent to the Bluetooth headset 200 , the mobile phone 101 may also determine how to play the first audio, ie, the play strategy of the first audio, according to the audio play service currently executed by the Bluetooth headset 200 .
[0151] Exemplarily, the mobile phone 101 may query whether an audio playback service is currently being executed on the Bluetooth headset 200. For example, the mobile phone 101 may query whether audio data is being transmitted on the Bluetooth connection between the mobile phone 101 and the Bluetooth headset 200. If audio data is being transmitted, the mobile phone 101 is currently executing an audio playback service on the Bluetooth headset 200. Otherwise, the mobile phone 101 is not currently executing an audio playback service on the Bluetooth headset 200.
[0152] If the mobile phone 101 does not perform the audio playback service on the Bluetooth headset 200, it means that the audio channel on the Bluetooth headset 200 is idle at this time, and the mobile phone 101 can determine that the playback strategy of the first audio is to directly play the first audio. Fig. 9 As shown, the mobile phone 101 can encapsulate the first audio into a Bluetooth data packet according to the Bluetooth protocol, and send the Bluetooth data packet to the Bluetooth headset 200 through the Bluetooth connection.
[0153] If the mobile phone 101 is executing an audio playback service on the Bluetooth headset 200, it means that the audio channel on the Bluetooth headset 200 is occupied by the audio playback service. At this time, the mobile phone 101 can further obtain the type of the audio playback service executed on the Bluetooth headset 200. For example, the service identifier of the call service is MODE_IN_CALL, the service identifier of the incoming call service is MODE_IN_RING, and the service identifier of the media service is MODE_IN_MUSIC.
[0154] For example, when the mobile phone 101 obtains the service identifier of the current audio playback service as MODE_IN_CALL, it means that the audio playback service executed on the Bluetooth headset 200 is the telephone call service. Since the call service has a higher priority, the mobile phone 101 can determine the playback strategy of the first audio as the first audio mixed with the call voice. At this time, the mobile phone 101 can mix the current call voice with the first audio in real time, and then send the mixed second audio (the second audio includes the first audio) to the Bluetooth headset 200 in real time via the Bluetooth connection.
[0155] For another example, when the mobile phone 101 obtains the service identifier of the current audio playback service as MODE_IN_RING, it means that the audio playback service executed on the Bluetooth headset 200 is the phone ringing service. Similarly, the priority of the phone ringing service is also relatively high. Therefore, the mobile phone 101 can determine the playback strategy of the first audio as a mixed playback of the first audio and the ringing ringtone. At this time, the mobile phone 101 can mix the current ringtone with the first audio in real time, and then send the mixed third audio (the third audio includes the first audio) to the Bluetooth headset 200 in real time via the Bluetooth connection.
[0156] Of course, since the phone's ringing service and call service have higher priority, the mobile phone 101 can also be set to play the first audio after the ringing service or call service ends when the Bluetooth headset 200 performs the ringing service or call service.
[0157] For another example, when the mobile phone 101 obtains the service identifier of the current audio playback service as MODE_IN_MUSIC, it indicates that the audio playback service executed on the Bluetooth headset 200 is a multimedia service. The priority of multimedia services is generally low, so the mobile phone 101 can determine the playback strategy of the first audio as: suspend the current audio playback service and play the first audio. At this time, the mobile phone 101 can stop sending the multimedia data stream of the current audio playback service to the Bluetooth headset 200, but send the first audio to the Bluetooth headset 200 in real time via the Bluetooth connection. After the first audio is sent to the Bluetooth headset 200, the mobile phone 101 can continue to send the multimedia data stream in the above audio playback service to the Bluetooth headset 200.
[0158] Of course, the types of the above-mentioned audio playback services may also include navigation, notification and other types. Technical personnel in this field can set the playback strategy of the first audio when the Bluetooth headset 200 performs different types of audio playback services according to actual application scenarios and actual needs. The embodiment of the present application does not impose any restrictions on this.
[0159] S506: After receiving the first audio, the Bluetooth headset 200 plays the first audio.
[0160] For example, Fig. 9 As shown, the Bluetooth headset 200 can receive the first audio sent by the mobile phone 101 in the form of a Bluetooth data packet. In addition, the Bluetooth headset 200 can parse the received Bluetooth data packet in real time and play the audio data in the Bluetooth data packet through the speaker in the Bluetooth headset 200, so that after the smart door lock 801 receives the ringing event, the first audio associated with the ringing event of the smart door lock 801 is played through the Bluetooth headset 200.
[0161] In this way, when the user uses the Bluetooth headset 200 connected to the mobile phone 101, he can timely perceive the events reported by other devices (such as smart door lock 801) in the network that are not connected to the Bluetooth headset 200 through the audio played by the Bluetooth headset 200, avoiding missing relevant messages reported to the user by various electronic devices in the network. In addition, this method does not require the smart door lock 801 and other devices that are not connected to the Bluetooth headset 200 to have Bluetooth function, so that non-Bluetooth devices without Bluetooth function can also indirectly realize the communication function with the Bluetooth headset 200.
[0162] In the above embodiment, the example of the smart door lock 801 in the Wi-Fi network (i.e., the first local area network) notifying the Bluetooth headset 200 worn by the user of the ringing event is used. It is understandable that when the smart door lock 801 needs to report other events to the user, the corresponding audio can also be sent to the Bluetooth headset 200 for playback according to the above method. Of course, when there is no other device (such as a microwave oven, etc.) connected to the Bluetooth headset 200 in the Wi-Fi network that needs to report an event to the user, the corresponding audio can also be sent to the Bluetooth headset 200 for playback according to the above method.
[0163] In addition, if the audio output device of the Bluetooth headset 200 is switched from the mobile phone 101 to another Bluetooth device in the Wi-Fi network, that is, the device connected to the Bluetooth headset 200 is switched from the mobile phone 101 to other Bluetooth devices in the Wi-Fi network, then the IOT devices in the Wi-Fi network that are not connected to the Bluetooth headset 200 can still use the above method to send the audio corresponding to the event that needs to be reported to the user to the Bluetooth headset 200 for playback through the latest audio output device. The embodiments of the present application do not impose any restrictions on this.
[0164] In other embodiments, still taking the mobile phone 101 as an example of the audio output device of the Bluetooth headset 200, when the user hopes that the Bluetooth headset 200 can not only play the audio of the mobile phone 101, but also play the audio of one or more other mobile terminals in the Wi-Fi network (i.e., the first local area network), the above method can also be used to send the audio generated by one or more mobile terminals to the Bluetooth headset 200 for playback, thereby enabling the Bluetooth headset 200 to realize the function of a multi-mode Bluetooth headset.
[0165] The following will be described in detail in conjunction with the following steps S507-S509. It can be understood that steps S507-S509 can be executed after steps S501-S503.
[0166] S507 . When the mobile terminal generates a second event, the mobile terminal sends a second message corresponding to the second event to the mobile phone 101 .
[0167] Take the mobile terminal as the tablet computer 1001 in the above Wi-Fi network as an example. Fig.10As shown, by executing steps S501-S503, the mobile phone 101 and the tablet computer 1001 access the same Wi-Fi network (i.e., the first local area network), and the mobile phone 101 has established a Bluetooth connection with the Bluetooth headset 200. Of course, IOT devices such as smart door locks 801 and microwave ovens can also access the above-mentioned Wi-Fi network as members of the Wi-Fi network. In this scenario, if the user not only wants the Bluetooth headset 200 to play the audio in the mobile phone 101, but also wants the Bluetooth headset 200 to play the audio in the tablet computer 1001, the user can input a preset operation to the tablet computer 1001. At this time, the tablet computer 1001 can respond to the preset operation input by the user and generate a corresponding second event. At this time, the second event is used to indicate that the tablet computer 1001 needs to occupy the functional resources of the Bluetooth headset 200.
[0168] For example, the functional resources of the Bluetooth headset 200 may include audio playback functional resources and / or call functional resources. The call functional resources are used to complete the call function of a terminal (such as telephone or video call functions), and the audio playback functional resources are used to implement the function of playing audio for a terminal (such as playing music functions).
[0169] For example, in step S503, after the mobile phone 101 establishes a Bluetooth connection with the Bluetooth headset 200, the mobile phone 101 can notify the devices in the current Wi-Fi network that the mobile phone 101 has been connected to the Bluetooth headset 200 by broadcasting. Fig.11 As shown in (a) of FIG. 1 , after the tablet computer 1001 learns that the mobile phone 101 is connected to the Bluetooth headset 200, a prompt message 1102 (also referred to as a preset control) may be displayed in the current display interface 1101. The prompt message 1102 may be used to prompt the user to use the functional resources of the Bluetooth headset 200 to play the audio of the tablet computer 1001. Fig.11 As shown in (a) in FIG. 1 , a connection button 1103 may be set in the prompt information 1102. If it is detected that the user selects the connection button 1103, indicating that the user inputs a preset operation, the tablet computer 1001 generates a second event for occupying the functional resources of the Bluetooth headset 200.
[0170] Fig.11 In (a), the prompt information 1102 is displayed in the form of a dialog box. It is understandable that the tablet computer 1001 can also display the prompt information 1102 in the form of a floating window or a floating button. Fig.11As shown in (b), after the tablet computer 1001 learns that the mobile phone 101 is connected to the Bluetooth headset 200, a floating button 1104 may be displayed in the current display interface 1101. The floating button 1104 is used to prompt the user to use the functional resources of the Bluetooth headset 200 to play the audio of the tablet computer 1001. If it is detected that the user clicks the above-mentioned floating button 1104, it means that the user inputs the preset operation, and the tablet computer 1001 generates a second event for occupying the functional resources of the Bluetooth headset 200.
[0171] Alternatively, after the tablet computer 1001 learns that the mobile phone 101 is connected to the Bluetooth headset 200, when the tablet computer 1001 detects that the user inputs an audio playback operation, the tablet computer 1001 can prompt the user to use the tablet computer 1001 to occupy the functional resources of the Bluetooth headset 200 by displaying the above-mentioned preset controls, thereby using the Bluetooth headset 200 to play the audio on the tablet computer 1001.
[0172] For example, Fig.12 As shown in (a) of FIG. 1 , after the user opens the music APP in the tablet computer 1001, the tablet computer 1001 may display the display interface 1201 of the music APP. When it is detected that the user inputs an operation of playing a certain audio (such as song A) in the display interface 1201, the display interface 1201 may display the above prompt information 1102 in the form of a dialog box or a floating window. For another example, Fig.12 As shown in (b), after the tablet computer 1001 learns that the mobile phone 101 is connected to the Bluetooth headset 200, a control 1202 can be added to the display interface 1201 when the display interface 1201 of the music APP is displayed, and the user is prompted to connect the tablet computer 1001 to the Bluetooth headset 200 through the control 1202. If it is detected that the user clicks the control 1202, it means that the user inputs the preset operation, and the tablet computer 1001 generates a second event for occupying the functional resources of the Bluetooth headset 200.
[0173] Alternatively, after the tablet computer 1001 learns that the mobile phone 101 is connected to the Bluetooth headset 200, if the user turns on the Bluetooth function in the tablet computer 1001, Fig.13 As shown, the tablet computer 1001 can display the name of the Bluetooth headset 200 and other identifiers 1301 in the optional device list 1302, that is, the tablet computer 1001 can use the Bluetooth headset 200 as a searched Bluetooth device. Subsequently, if it is detected that the user clicks the identifier 1301, indicating that the user inputs a preset operation, the tablet computer 1001 generates a second event for occupying the functional resources of the Bluetooth headset 200.
[0174] When the tablet computer 1001 generates the second event, similar to step S504, the tablet computer 1001 may send a second message corresponding to the second event to the audio output device (i.e., the mobile phone 101) currently connected to the Bluetooth headset 200. For example, the tablet computer 1001 may first obtain the communication address of the mobile phone 101, and then interact with the mobile phone 101 according to the communication address of the mobile phone 101.
[0175] Still taking the tablet computer 1001 as an example of a mobile terminal in the Wi-Fi network, after the tablet computer 1001 obtains the communication address (e.g., IP address) of the mobile phone 101 in response to the second event, it can send a second message to the mobile phone 101 according to the IP address of the mobile phone 101. The second message corresponds to the second event and is used to instruct the tablet computer 1001 to wait for the functional resources of the Bluetooth headset 200.
[0176] S508 . After receiving the second message, the mobile phone 101 sends the second audio subsequently sent by the mobile terminal to the Bluetooth headset 200 .
[0177] Exemplarily, after the mobile phone 101 receives the second message sent by the tablet computer 1001 , it can be learned by parsing the second message that the tablet computer 1001 needs to occupy the functional resources of the Bluetooth headset 200 (ie, the second event).
[0178] At this time, different from step S505, the mobile phone 101 can determine that the specific audio content (i.e., the second audio) sent to the Bluetooth headset 200 is: the audio data subsequently sent by the tablet computer 1001. Optionally, the mobile phone 101 can also send a connection success message to the tablet computer 1001. In this way, for the tablet computer 1001, after receiving the connection success message sent by the mobile phone 101, the tablet computer 1001 can be considered to have successfully occupied the functional resources of the Bluetooth headset 200. At this time, if Fig.14 As shown, the tablet computer 1001 may display a prompt message 1401 to prompt the user that the audio in the tablet computer 1001 will be played through the Bluetooth headset 200 later.
[0179] Furthermore, the mobile phone 101 can set a play strategy for the second audio. Since the Bluetooth headset 200 can play both the audio data from the mobile phone 101 and the audio data from the tablet computer 1001, the play strategy for the second audio can be set to: give priority to playing the audio data from the mobile phone 101. Alternatively, the play strategy for the second audio can be: give priority to playing the audio data from the tablet computer 1001. Alternatively, the play strategy for the second audio can be: play the audio data from the mobile phone 101 and the tablet computer 1001 at the same time.
[0180] For example, if the play policy of the second audio is: give priority to playing the audio data from the tablet computer 1001, after the mobile phone 101 receives the audio data sent by the tablet computer 1001, if the Bluetooth headset 200 is executing the audio play service 1 of the mobile phone 101, the mobile phone 101 can stop sending the audio data of the audio play service 1 to the Bluetooth headset 200, and instead send the audio data from the tablet computer 1001 to the Bluetooth headset 200, so that the Bluetooth headset 200 executes the audio play service 2 of the tablet computer 1001. When the audio play service 2 ends, the mobile phone 101 can continue to send the audio data from the mobile phone 101 to the Bluetooth headset 200, so that the Bluetooth headset 200 continues to execute the audio play service 1.
[0181] For another example, if the playback strategy of the second audio is to give priority to playing audio data from the mobile phone 101, then after the mobile phone 101 receives the audio data sent by the tablet computer 1001, if the Bluetooth headset 200 is executing the audio playback service 1 of the mobile phone 101, the mobile phone 101 may temporarily not send the audio data from the tablet computer 1001 to the Bluetooth headset 200, but after the audio playback service 1 is completed, send the audio data from the tablet computer 1001 to the Bluetooth headset 200, so that the Bluetooth headset 200 executes the audio playback service 2 of the tablet computer 1001 after executing the audio playback service 1 of the mobile phone 101.
[0182] For another example, if the playback strategy of the second audio is: play the audio data from the mobile phone 101 and the tablet computer 1001 at the same time, then after the mobile phone 101 receives the audio data sent by the tablet computer 1001, if the Bluetooth headset 200 is executing the audio playback service 1 of the mobile phone 101, the mobile phone 101 can first mix the audio data from the tablet computer 1001 and the audio data of the mobile phone 101, and then send the mixed audio data to the Bluetooth headset 200, so that the Bluetooth headset 200 can simultaneously execute the audio playback service 1 of the mobile phone 101 and the audio playback service 2 of the tablet computer 1001.
[0183] Of course, if the Bluetooth headset 200 is in an idle state (i.e., no audio playback task is performed on the Bluetooth headset 200) when the mobile phone 101 receives audio data sent by the tablet computer 1001, the mobile phone 101 can directly send the audio data from the tablet computer 1001 to the Bluetooth headset 200, and the embodiment of the present application does not impose any restrictions on this.
[0184] When the mobile phone 101 determines that the audio data (i.e., the second audio) sent by the tablet computer 1001 needs to be sent to the Bluetooth headset 200, and determines the playback strategy of the second audio, when the mobile phone 101 subsequently receives the audio data sent by the tablet computer 1001, the mobile phone 101 can send the audio data sent by the tablet computer 1001 to the Bluetooth headset 200 via the Bluetooth connection according to the above playback strategy.
[0185] S509: After receiving the second audio, the Bluetooth headset 200 plays the second audio.
[0186] Similar to the above step S506 , after the Bluetooth headset 200 receives the audio data (ie, the second audio) sent by the tablet computer 1001 through the mobile phone 101 , the received audio data can be played through the speaker in the Bluetooth headset 200 .
[0187] In this way, although the Bluetooth headset 200 only establishes a Bluetooth connection with the mobile phone 101 in the Wi-Fi network, according to the above method, the Bluetooth headset 200 can be used as an audio output device of the mobile phone 101 to perform the audio playback task of the mobile phone 101, and can also be used as an audio output device of the tablet computer 1001 to perform the audio playback task of the tablet computer 1001, thereby realizing the function of a multi-mode Bluetooth headset and improving the user experience.
[0188] Of course, in addition to the tablet computer 1001, other mobile terminals in the above-mentioned Wi-Fi network (i.e., the first local area network) that are not connected to the Bluetooth headset 200 can also communicate with the Bluetooth headset 200 according to the above-mentioned method, thereby simulating the use effect of multiple devices connected to the Bluetooth headset 200 and realizing the function of a multi-mode Bluetooth headset. The embodiment of the present application does not impose any restrictions on this.
[0189] In the above embodiment, the mobile phone 101 is used as an example of an audio output device connected to the Bluetooth headset 200 in the Wi-Fi network (i.e., the first local area network). It can be understood that the audio output device connected to the Bluetooth headset 200 can also be other audio output devices with Bluetooth function in the first local area network (such as Bluetooth speakers, Bluetooth TVs, etc.), and the embodiments of the present application do not impose any restrictions on this.
[0190] In some other embodiments, still taking the above-mentioned Wi-Fi network as the first local area network as an example, there may be multiple devices connected to different Bluetooth headsets in the Wi-Fi network. Fig.15 As shown, mobile phone 1, mobile phone 2, tablet computer, microwave oven 1501 and other devices can be connected to the Wi-Fi network, wherein mobile phone 1 can establish a Bluetooth connection with Bluetooth headset A of user 1, and mobile phone 2 can establish a Bluetooth connection with Bluetooth headset B of user 2.
[0191] In this scenario, the IOT device or mobile terminal that is not connected to the Bluetooth headset in the Wi-Fi network can still communicate with the Bluetooth headset according to the above method, so that the IOT device or mobile terminal that is not connected to the Bluetooth headset can realize the Bluetooth function. For example, when mobile phone 1 establishes a Bluetooth connection with Bluetooth headset A, mobile phone 1 can broadcast the message that mobile phone 1 establishes a Bluetooth connection with Bluetooth headset A in the Wi-Fi network. And, when mobile phone 2 establishes a Bluetooth connection with Bluetooth headset B, mobile phone 2 can also broadcast the message that mobile phone 2 establishes a Bluetooth connection with Bluetooth headset B in the Wi-Fi network.
[0192] The difference is that when a device in the Wi-Fi network that is not connected to a Bluetooth headset needs to report an event, for example, when the microwave oven 1501 generates a heating end event, it still Fig.15 As shown, if mobile phone 1 and mobile phone 2 are both connected to Bluetooth headsets, microwave oven 1501 can send message A corresponding to the heating end event to mobile phone 1 and mobile phone 2 respectively according to the method of the above embodiment. In this way, multiple devices connected to Bluetooth headsets in the Wi-Fi network can sense the above heating end event.
[0193] Furthermore, after receiving message A, mobile phone 1 can send the audio corresponding to message A to Bluetooth headset A for playback according to the method of the above embodiment. Similarly, after receiving message A, mobile phone 2 can also send the audio corresponding to message A to Bluetooth headset B for playback according to the method of the above embodiment. In this way, no matter which Bluetooth headset the user uses, he can perceive the events reported by the device that is not connected to the Bluetooth headset in the Wi-Fi network, avoiding the user from missing messages reported by other devices in the network when using the Bluetooth headset.
[0194] Alternatively, the microwave oven 1501 sends the message A corresponding to the heating end event to the mobile phone 1 and the mobile phone 2 respectively according to the method of the above embodiment. Fig.16 As shown, mobile phone 1 and mobile phone 2 can determine which Bluetooth headset will report the heating end event to the user through negotiation. Exemplarily, mobile phone 1 and mobile phone 2 can respectively determine the audio playback services being executed on their corresponding Bluetooth headsets. Furthermore, after negotiation, mobile phone 1 and mobile phone 2 can determine the Bluetooth headset that is relatively idle or has a lower priority for audio playback services as the target Bluetooth headset, and the target Bluetooth headset will notify the user of the heating end event. In this way, when the target Bluetooth headset notifies the user of the heating end event, it will not interfere with the audio playback services being executed by other Bluetooth headsets.
[0195] For example, if Bluetooth headset A connected to mobile phone 1 is in idle state, and Bluetooth headset B connected to mobile phone 2 is performing audio playback service, mobile phone 1 can send the audio corresponding to the heating end event to Bluetooth headset A for playback, that is, Bluetooth headset A prompts the user of the heating end event of the microwave oven. At this time, mobile phone 2 does not need to send the audio corresponding to the heating end event to Bluetooth headset B, and mobile phone 2 can continue to perform its audio playback service.
[0196] For another example, if Bluetooth headset A connected to mobile phone 1 is performing a call service, and Bluetooth headset B connected to mobile phone 2 is performing a multimedia playback service, if the priority of the multimedia playback service is lower than the priority of the call service, mobile phone 2 can suspend the multimedia playback service and send the audio corresponding to the current heating end event to Bluetooth headset A for playback. At this time, mobile phone 1 does not need to send the audio corresponding to the current heating end event to Bluetooth headset A, and mobile phone 1 can continue to perform its call service.
[0197] In other embodiments, Fig.17 As shown, the central node 1701 of the Wi-Fi network can also be pre-set in the Wi-Fi network. For example, the central node 1701 can be a router or any device in the Wi-Fi network. At this time, the microwave oven 150 can send a message A corresponding to the heating end event to the central node 1701, and the central node 1701 decides to notify the user of the target Bluetooth headset of this heating end event. Furthermore, the central node 1701 can send message A to the device connected to the target Bluetooth headset. For example, the central node 1701 can also determine the target Bluetooth headset by comparing whether Bluetooth headset A and Bluetooth headset B perform audio playback services and the priority of the audio playback services performed. Furthermore, the central node 1701 can send message A to the device connected to the target Bluetooth headset (such as mobile phone 1), and mobile phone 1 responds to the message A, and sends the audio corresponding to this heating end event to Bluetooth headset A for playback, so as to avoid interfering with the audio playback services being performed by other Bluetooth headsets.
[0198] It should be noted that whether the target Bluetooth headset for reporting relevant events to the user is decided by the central node 1701, or the target Bluetooth headset for reporting relevant events to the user is decided by mobile phone 1 and mobile phone 2 through negotiation, those skilled in the art can set the specific strategy for the above decision-making according to actual needs and actual application scenarios, and the embodiments of the present application do not impose any restrictions on this. Exemplarily, the priority order of each device in the Wi-Fi network can be pre-set. In this way, when making a decision, the central node 1701 can select the Bluetooth headset connected to the device with the highest priority as the target Bluetooth headset among multiple devices connected to the Bluetooth headset. For example, if the priority of the father's mobile phone 1 is greater than the priority of the child's mobile phone 2, the central node 1701 can determine the Bluetooth headset A connected to the mobile phone 1 as the target Bluetooth headset.
[0199] like Fig.18 As shown, the embodiment of the present application discloses a terminal, which can be a device (such as a mobile phone 101) connected to a Bluetooth headset in the above-mentioned audio system 100. The terminal may specifically include: a touch screen 1801, wherein the touch screen 1801 includes a touch sensor 1806 and a display screen 1807; one or more processors 1802; a memory 1803; a communication module 1808; one or more applications (not shown); and one or more computer programs 1804, and the above-mentioned components may be connected via one or more communication buses 1805. Among them, the above-mentioned one or more computer programs 1804 are stored in the above-mentioned memory 1803 and are configured to be executed by the one or more processors 1802, and the one or more computer programs 1804 include instructions, which can be used to execute the relevant steps executed by the mobile phone 101 in the above-mentioned embodiment.
[0200] like Fig.19 As shown, an embodiment of the present application discloses a terminal, which can be an IOT device or mobile terminal in the above-mentioned audio system 100 that is not connected to a Bluetooth headset. The terminal may specifically include: a communication module 1901; one or more processors 1902; a memory 1903; one or more applications (not shown); and one or more computer programs 1904, and the above-mentioned devices may be connected via one or more communication buses 1905. Of course, the terminal may also include modules such as a touch screen, and similarly, the touch screen may include a touch sensor and a display screen. Among them, the above-mentioned one or more computer programs 1904 are stored in the above-mentioned memory 1903 and are configured to be executed by the one or more processors 1902, and the one or more computer programs 1904 include instructions, which can be used to execute the relevant steps performed by the IOT device or mobile terminal in the above-mentioned embodiment.
[0201] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0202] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.
[0203] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.
[0204] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.
Claims
1. An audio system, characterized in that: The system includes a first terminal, a second terminal and an audio output device, the first terminal and the audio output device have a Bluetooth connection, the second terminal and the audio output device have no Bluetooth connection, and a wireless communication connection is established between the first terminal and the second terminal; wherein, The second terminal is used to: when a first event occurs, send a first message corresponding to the first event to the first terminal using the wireless communication connection; when the second terminal is a smart home device, the first event is an event corresponding to the operation of the smart home device; The first terminal is used to: receive the first message sent by the second terminal; and send the first audio corresponding to the first message to the audio output device using the Bluetooth connection; The audio output device is used to: receive the first audio sent by the first terminal; and play the first audio.
2. The system according to claim 1, characterized in that When the first event is any event generated when the smart home device is working, the first message includes: audio information and / or text information corresponding to the first event.
3. The system according to claim 2, characterized in that When the first message includes audio information, the first audio includes the audio information; and / or, When the first message includes text information, the first terminal is further configured to convert the text information into the first audio.
4. The system according to any one of claims 1 to 3, characterized in that: Before sending the first audio corresponding to the first message to the audio output device, the first terminal is further used for: If the audio output device does not perform an audio playback service, sending the first audio to the audio output device; If the audio output device is executing an audio playback service, the first audio is sent to the audio output device according to the type of the audio playback service.
5. The system according to claim 4, characterized in that The method of sending the first audio to the audio output device according to the type of the audio playback service includes: When the type of the audio playback service is a call service or a ringing service, mixing the first audio with the audio of the audio playback service and sending the mixed audio to the audio output device; When the type of the audio play service is a multimedia service, the sending of the audio of the audio play service to the audio output device is suspended, and the first audio is sent to the audio output device.
6. The system according to claim 1, characterized in that When the first event is an event in which the mobile terminal occupies the functional resources of the audio output device, the functional resources include audio playback functional resources and / or call function resources, the call function resources are used to complete the call function of a certain terminal, and the audio playback functional resources are used to implement the function of playing audio for a certain terminal.
7. The system according to claim 6, characterized in that Before the second terminal generates the first event, the second terminal is further used for: Displaying a preset control, where the control is used to prompt the user to use the second terminal to occupy functional resources of the audio output device; The second terminal generates a first event, including: In response to a preset operation input by a user to the control, the second terminal generates the first event.
8. The system according to claim 7, characterized in that The second terminal displays a preset control, including: When the second terminal obtains the audio playing operation input by the user, the second terminal displays the control; or, When the second terminal obtains the message that the audio output device is connected to the first terminal through Bluetooth, the second terminal displays the control.
9. The system according to any one of claims 6 to 8, characterized in that: After receiving the first message sent by the second terminal, the first terminal is further configured to: Receive audio data sent by the second terminal, where the audio data is the first audio.
10. The system according to any one of claims 1-3, 6-8, characterized in that: After the first terminal establishes a Bluetooth connection with the audio output device, the first terminal is further used to: A broadcast message is sent in the audio system, where the broadcast message is used to instruct the first terminal to establish a Bluetooth connection with the audio output device.
11. An audio playing method, characterized in that: include: The first terminal establishes a wireless communication connection with the second terminal; After the first terminal establishes a Bluetooth connection with the audio output device, the first terminal receives a first message sent by the second terminal through the wireless communication connection, wherein the first message is used to indicate that the second terminal generates a first event, and the second terminal does not establish a Bluetooth connection with the audio output device; wherein, when the second terminal is a smart home device, the first event is any event generated when the smart home device is working, and when the second terminal is a mobile terminal, the first event is an event that the mobile terminal occupies functional resources of the audio output device; The first terminal determines a first audio corresponding to the first message; The first terminal sends the first audio to the audio output device through the Bluetooth connection, so that the audio output device plays the first audio.
12. The method according to claim 11, characterized in that The first message includes the first audio; or the first message includes text information corresponding to the first audio.
13. The method according to claim 12, characterized in that The first terminal sends the first audio to the audio output device, including: If the audio output device does not perform an audio playback service, the first terminal sends the first audio to the audio output device; If the audio output device is executing an audio playback service, the first terminal sends the first audio to the audio output device according to the type of the audio playback service.
14. The method according to claim 13, characterized in that The first terminal sends the first audio to the audio output device according to the type of the audio playback service, including: When the type of the audio playback service is a call service or a ringing service, mixing the first audio with the audio of the audio playback service and sending the mixed audio to the audio output device; When the type of the audio play service is a multimedia service, the sending of the audio of the audio play service to the audio output device is suspended, and the first audio is sent to the audio output device.
15. The method according to claim 11, characterized in that The functional resources include audio playback functional resources and / or call functional resources, wherein the call functional resources are used to complete the call function of a certain terminal, and the audio playback functional resources are used to implement the function of playing audio for a certain terminal; The first audio is audio data sent by the second terminal.
16. The method according to claim 15, characterized in that After the first terminal receives the first message sent by the second terminal, the method further includes: The first terminal sends a connection success message to the second terminal, so that the second terminal sends audio data to the first terminal in response to the connection success message.
17. The method according to any one of claims 11 to 16, characterized in that Before the first terminal receives the first message sent by the second terminal, the method further includes: The first terminal accesses the local area network where the second terminal is located; After the first terminal establishes a Bluetooth connection with the audio output device, the first terminal sends a broadcast message in the local area network, where the broadcast message is used to instruct the first terminal to establish a Bluetooth connection with the audio output device.
18. A terminal, characterized in that: include: one or more processors; Communication module; Memory; Wherein, one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the terminal, the terminal executes an audio playback method as described in any one of claims 11-17.
19. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, characterized in that: When the instruction is executed on the terminal, the terminal executes an audio playing method as described in any one of claims 11-17.
20. A computer program product, characterized in that When the computer program product is run on a terminal, the terminal executes an audio playing method as described in any one of claims 11-17.