Audio output method and terminal equipment
By automatically switching audio signals between multiple terminal devices, the problem of users who may miss calls when receiving incoming calls from their mobile phones is solved, simplifying the headphone connection switching process and improving the user experience.
Patent Information
- Application Number
- CN202411629526.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2020-01-22
- Filing Date
- 2020-10-22
- Publication Date
- 2025-02-14
AI Technical Summary
In the prior art, when a user uses headphones to connect to a laptop in an office or public environment, if the phone calls, it may miss the call because he does not hear the incoming call ringtone, and switching the headphones is cumbersome, which affects the user experience.
An audio output method is provided, allowing multiple terminal devices of the same user to access the network through the same system authentication account to realize automatic switching of audio signals. The specific steps include: the first terminal device receives an audio output request from the second terminal device, and then sends an audio output request response to the second terminal device, triggers the second terminal device to acquire audio data, and outputs it through the connected audio output device. Audio signal.
It reduces the complexity of user operations, improves the intelligence of terminal devices, improves the user experience, and enables users to switch to output audio signals from different devices without manually operating the headset.
Smart Images

Figure CN119440458A_ABST
Abstract
Description
[0001] This application is a divisional application with application number 202080094237.4, application date October 22, 2020, and invention name “An audio output method and terminal device”.
[0002] This application claims priority to a Chinese patent application filed with the Chinese Patent Office on January 22, 2020, with application number 202010075562.8 and application name “An Audio Output Method and Terminal Device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of terminal technology, and in particular to an audio output method and a terminal device. Background Art
[0004] With the development of smart terminals, it is becoming more and more common for a user to own multiple terminal devices. For example, a user can own a smart phone, a tablet computer, and a laptop computer. Currently, in addition to the built-in earpiece, the terminal device can also be connected to other audio output devices, such as wired headphones, Bluetooth headphones, external speakers, etc.
[0005] Currently, in public environments such as offices, when users use headphones to connect to a laptop computer to listen to music, if the user's mobile phone calls, the user may miss the call because he or she does not hear the ringtone. Even if the user hears the ringtone, if the user wants to answer the call with the headphones, if the user is using a wired headset, the user needs to unplug the wired headset from the laptop computer and plug it into the headphone jack of the mobile phone before answering the mobile phone call through the wired headset; if the user is using a Bluetooth headset, the user needs to disconnect the laptop computer and the Bluetooth headset and connect the mobile phone to the Bluetooth headset before answering the mobile phone call through the Bluetooth headset. It can be seen that this process is relatively cumbersome and affects the user experience. Summary of the invention
[0006] The present application provides an audio output method and a terminal device, which help to reduce the user's operation complexity, improve the intelligence of the terminal device, and ultimately enhance the user experience.
[0007] In a first aspect, an embodiment of the present application provides an audio output method, which can be applied to at least two terminal devices of the same user, wherein the at least two terminal devices of the user use the same system authentication account to access the network, and specifically, the method includes: a first terminal device receives an audio output request from a second terminal device, and in response to the audio output request, the user issues an operation instruction, the first terminal device receives the user's operation, and then in response to the operation, sends an audio output request response to the second terminal device, the audio output request response is used to trigger the second terminal device to obtain audio data corresponding to the audio output request, for example, triggering the second terminal device to connect an incoming call and obtain call data. The first terminal device receives the audio data from the second terminal device, and then outputs the audio data to the audio output device, so that the audio output device outputs a first audio signal corresponding to the audio data, wherein the audio output device can be a wired audio output device, and the wired audio output device is in a state of being connected to the first terminal device.
[0008] It can be seen that in the above embodiment, although the second terminal device is not connected to the audio output device, it can output the audio signal through the audio output device connected to the first terminal device. The user does not need to pick up the second terminal device or unplug the wired audio output device to switch the output of audio signals from different devices on the wired audio output device. For example, it is possible to switch the output of call data on the wired audio output device, which provides a better user experience.
[0009] In a possible implementation, after the first terminal device receives the audio output request from the second terminal device, it can first convert the audio output request into a second audio signal, the second audio signal is used to voice prompt the user that there is an audio output request from the second terminal device, and then control the audio output device to output the second audio signal while outputting the third audio signal of the first terminal device. In this implementation, if the user cannot respond to the first terminal device by operating the first terminal device, such as a smart TV, the method can be executed so that the user can respond to the audio output request by operating the audio output device.
[0010] In another possible implementation, after the first terminal device receives an audio output request from the second terminal device, a prompt message may be displayed on the first terminal device, where the prompt message is used to prompt the user that there is an audio output request from the second terminal device. For example, in this case, if the first terminal device is a tablet computer, a laptop computer, etc., the user can answer or hang up the call by operating the first terminal device.
[0011] In a possible implementation, before executing the above method embodiment, the first terminal device and the second terminal device can access the access point device to establish an internal local area network connection, that is, the first terminal device and the second terminal device are located in the same local area network, or the first terminal device, the second terminal device and the third terminal device can access the same access point to establish an internal local area network connection. Exemplarily, the first terminal device and the second terminal device are both connected to the same WiFi hotspot. Since the terminal devices are connected through the local area network, call data can be transmitted across devices without consuming cellular network traffic.
[0012] In a possible implementation, before the first terminal device establishes a network connection with the second terminal device, the first terminal device sends a broadcast message, which includes a ciphertext, which is obtained by the first terminal device using the public key corresponding to the system authentication account of the first terminal device to encrypt the system authentication of the first terminal device. After receiving the broadcast message, the second terminal device decrypts the ciphertext with the private key corresponding to the system authentication account of the second terminal device, and then sends a feedback message to the first terminal device to indicate whether the decryption is successful. When the first terminal device receives the feedback message indicating that the ciphertext is successfully decrypted, it can be determined that the system authentication account of the second terminal device is the same as the system authentication account of the first terminal device. When the first terminal device receives the feedback message indicating that the decryption of the ciphertext fails, it can be determined that the system authentication account of the second terminal device is different from the system authentication account of the first terminal device. The reason for doing this is to ensure the security of data access between devices and prevent data in the device from being illegally accessed. Exemplarily, the system authentication account can be a user's Huawei account, or an Apple account, etc.
[0013] In a second aspect, an embodiment of the present application provides an audio output method, which can be applied to at least two terminal devices of the same user, wherein the at least two terminal devices of the user use the same system authentication account to access the network, and specifically, the method includes: a first terminal device receives an audio output request from a second terminal device, and in response to the audio output request, the user issues an operation instruction, and then in response to the operation, the first terminal device sends an audio output request response to the second terminal device, and the audio output request response is used to trigger the second terminal device to obtain audio data corresponding to the audio output request. After the first terminal device sends the audio output request response or at the same time as the first terminal device sends the audio output request response, the first terminal device disconnects from the audio output device, and the audio output device establishes a connection with the second terminal device, and then the second terminal device outputs the audio data to the audio output device, so that the audio output device outputs the first audio signal corresponding to the audio data, wherein the audio output device can be a wireless audio output device.
[0014] In the embodiment of the present application, the user does not need to operate the second terminal device, nor does he need to manually disconnect and reconnect the wireless audio output device, and can switch the output of audio signals from different devices on the wireless audio output device. For example, when the mobile phone is not with the user, the above method can be used to switch the output of call data on the wireless audio output device, which is less likely to miss calls and provides a better user experience.
[0015] In a possible implementation, after the first terminal device receives the audio output request from the second terminal device, it can first convert the audio output request into a second audio signal, the second audio signal is used to voice prompt the user that there is an audio output request from the second terminal device, and then control the audio output device to output the second audio signal while outputting the third audio signal of the first terminal device. In this implementation, if the user cannot respond to the first terminal device by operating the first terminal device, such as a smart TV, the method can be executed so that the user can respond to the audio output request by operating the audio output device.
[0016] In another possible implementation, after the first terminal device receives an audio output request from the second terminal device, a prompt message may be displayed on the first terminal device, where the prompt message is used to prompt the user that there is an audio output request from the second terminal device. For example, in this case, if the first terminal device is a tablet computer, a laptop computer, etc., the user can answer or hang up the call by operating the first terminal device.
[0017] In a possible implementation, before executing the above method embodiment, the first terminal device and the second terminal device can access the same access point device to establish an internal local area network connection, that is, the first terminal device and the second terminal device are located in the same local area network, or the first terminal device, the second terminal device and the third terminal device can access the same access point to establish an internal local area network connection. Exemplarily, the first terminal device and the second terminal device are both connected to the same WiFi hotspot. Since the terminal devices are connected through the local area network, call data can be transmitted across devices without consuming cellular network traffic.
[0018] In a possible implementation, before the first terminal device establishes a network connection with the second terminal device, the first terminal device sends a broadcast message, which includes a ciphertext, which is obtained by the first terminal device using the public key corresponding to the system authentication account of the first terminal device to encrypt the system authentication of the first terminal device. After receiving the broadcast message, the second terminal device decrypts the ciphertext with the private key corresponding to the system authentication account of the second terminal device, and then sends a feedback message to the first terminal device to indicate whether the decryption is successful. When the first terminal device receives the feedback message indicating that the ciphertext is successfully decrypted, it can be determined that the system authentication account of the second terminal device is the same as the system authentication account of the first terminal device. When the first terminal device receives the feedback message indicating that the decryption of the ciphertext fails, it can be determined that the system authentication account of the second terminal device is different from the system authentication account of the first terminal device. The reason for doing this is to ensure the security of data access between devices and prevent data in the device from being illegally accessed. Exemplarily, the system authentication account can be a user's Huawei account, or an Apple account, etc.
[0019] In a third aspect, an embodiment of the present application provides an audio output method, which can be applied to at least two terminal devices of the same user, wherein the at least two terminal devices of the user use the same system authentication account to access the network, and specifically, the method includes: a second terminal device receives an audio output request, and in response to the audio output request, the second terminal device sends the audio output request to the first terminal device, and then the second terminal device receives an audio output request response from the first terminal device, and the audio output request response is used to trigger the second terminal device to obtain audio data corresponding to the audio output request. When the second terminal device receives the audio output request response, the audio output device establishes a connection with the second terminal device, and then the second terminal device outputs a first audio signal corresponding to the audio data through the audio output device, wherein the audio output device can be a wireless audio output device.
[0020] In the embodiment of the present application, the user does not need to operate the second terminal device, nor does he need to manually disconnect and reconnect the wireless audio output device, and can switch the output of audio signals from different devices on the wireless audio output device. For example, when the mobile phone is not with the user, the above method can be used to switch the output of call data on the wireless audio output device, which is less likely to miss calls and provides a better user experience.
[0021] In a possible implementation, before executing the above method embodiment, the first terminal device and the second terminal device can access the same access point device to establish an internal local area network connection, that is, the first terminal device and the second terminal device are located in the same local area network, or the first terminal device, the second terminal device and the third terminal device can access the same access point to establish an internal local area network connection. Exemplarily, the first terminal device and the second terminal device are both connected to the same WiFi hotspot. Since the terminal devices are connected through the local area network, call data can be transmitted across devices without consuming cellular network traffic.
[0022] In a possible implementation, before the first terminal device establishes a network connection with the second terminal device, the first terminal device sends a broadcast message, which includes a ciphertext, which is obtained by the first terminal device using the public key corresponding to the system authentication account of the first terminal device to encrypt the system authentication of the first terminal device. After receiving the broadcast message, the second terminal device decrypts the ciphertext with the private key corresponding to the system authentication account of the second terminal device, and then sends a feedback message to the first terminal device to indicate whether the decryption is successful. When the first terminal device receives the feedback message indicating that the ciphertext is successfully decrypted, it can be determined that the system authentication account of the second terminal device is the same as the system authentication account of the first terminal device. When the first terminal device receives the feedback message indicating that the decryption of the ciphertext fails, it can be determined that the system authentication account of the second terminal device is different from the system authentication account of the first terminal device. The reason for doing this is to ensure the security of data access between devices and prevent data in the device from being illegally accessed. Exemplarily, the system authentication account can be a user's Huawei account, or an Apple account, etc.
[0023] In a fourth aspect, an embodiment of the present application provides an audio output method, the method comprising: a second terminal device receives an audio output request, and then the second terminal device sends an audio output request to a first terminal device, wherein the second terminal device and the first terminal device use the same system authentication account to access the network, and the first terminal device is currently connected to an audio output device.
[0024] The first terminal device receives the audio output request, and in response to the audio output request, receives an operation of a user.
[0025] In response to the operation, the first terminal device sends an audio output request response to the second terminal device. In response to the audio output request response, the second terminal device obtains audio data corresponding to the audio output request; the second terminal device sends the audio data to the first terminal device; and finally the first terminal device outputs a first audio signal corresponding to the audio data through the audio output device.
[0026] The beneficial effects of the present application can refer to the beneficial effects of the first aspect mentioned above, which will not be repeated here.
[0027] In a fifth aspect, an embodiment of the present application provides an audio output method, the method comprising: a second terminal device receives an audio output request, the second terminal device sends an audio output request to a first terminal device, wherein the second terminal device and the first terminal device use the same system authentication account to access the network, the first terminal device is currently connected to an audio output device, the first terminal device receives the audio output request, and in response to the audio output request, the first terminal device receives an operation of the user. In response to the operation, the first terminal device sends an audio output request response to the second terminal device, and disconnects the first communication link with the audio output device. In response to the audio output request response, the second terminal device obtains audio data corresponding to the audio output request. The second terminal device establishes a second communication link with the audio output device, and outputs a first audio signal corresponding to the audio data through the audio output device.
[0028] The beneficial effects of the present application can be found in the beneficial effects of the second aspect mentioned above, which will not be repeated here.
[0029] In a sixth aspect, an embodiment of the present application provides a first terminal device, comprising a sensor, a touch screen, a processor and a memory, wherein the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are executed by the processor, the terminal device can implement any possible design method of the first aspect, or any possible design method of the second aspect, or any possible design method of the fourth aspect, or any possible design method of the fifth aspect.
[0030] In the seventh aspect, an embodiment of the present application provides a second terminal device, including a sensor, a touch screen, a processor and a memory, wherein the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are executed by the processor, the terminal device can implement any possible design method of the third aspect, or any possible design method of the fourth aspect, or any possible design method of the fifth aspect.
[0031] In an eighth aspect, an embodiment of the present application provides an audio output system, which may include the above-mentioned first terminal device and second terminal device, and is used to execute any possible design method of the fourth aspect, or any possible design method of the fifth aspect.
[0032] In a ninth aspect, an embodiment of the present application further provides a device, which includes a module / unit for executing any possible design method of any of the above aspects. These modules / units can be implemented by hardware, or by executing corresponding software implementations by hardware.
[0033] In the tenth aspect, a computer-readable storage medium is also provided in an embodiment of the present application, and the computer-readable storage medium includes a computer program. When the computer program runs on a terminal device, the terminal device executes any possible design method of any of the above aspects.
[0034] In the eleventh aspect, an embodiment of the present application also provides a method comprising a computer program product, which, when running on a terminal, enables the terminal device to execute any possible design of any of the above aspects.
[0035] In the twelfth aspect, an embodiment of the present application also provides a chip, which is coupled to a memory and is used to execute a computer program stored in the memory to execute any possible design method of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the present application;
[0037] Figure 2 A schematic diagram of the structure of a mobile phone provided in an embodiment of the present application;
[0038] Figure 3 A schematic diagram of the structure of an Android operating system provided in an embodiment of the present application;
[0039] Figure 4 A schematic diagram of an application scenario provided for an embodiment of the present application;
[0040] Figure 5 A schematic diagram of a device account verification method provided in an embodiment of the present application;
[0041] Figure 6 A schematic diagram of a group of interfaces provided in an embodiment of the present application;
[0042] Fig. 7A An interactive schematic diagram of an audio output method corresponding to a wired audio output device provided in an embodiment of the present application;
[0043] Figure 7B A schematic diagram of an application scenario provided for an embodiment of the present application;
[0044] Figure 8 A schematic diagram of another audio output interaction process provided in an embodiment of the present application;
[0045] Fig. 9 A schematic diagram of another audio output interaction process provided in an embodiment of the present application;
[0046] Fig.10 A schematic diagram of another audio output interaction process provided in an embodiment of the present application;
[0047] Fig.11 Another audio output interaction flow diagram provided in an embodiment of the present application. DETAILED DESCRIPTION
[0048] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0049] Below, some terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.
[0050] 1) The APP involved in the embodiments of the present application, referred to as application, is a software program that can realize one or more specific functions. Usually, multiple applications can be installed in a terminal device. For example, a camera application, a mailbox application, a smart home control application, etc. The application mentioned below can be a system application installed when the terminal device leaves the factory, or it can be a third-party application downloaded from the Internet or obtained from other terminal devices by the user during the use of the terminal device.
[0051] 2) Audio output devices can be divided into wireless audio devices and wired audio devices. Wireless audio devices include Bluetooth headsets, and wired audio devices include wired headsets. The audio output device connects to the terminal device through a wired connection or a wireless network connection to convert the audio data of the terminal device into voice content and output the voice content. For example, the voice data can be a voice call or a voice call or video call established using an application (such as WeChat, Facebook), the voice data of a music player playing a music service, the voice data of a video player playing a video service, and so on.
[0052] In the prior art, the user can only switch the audio signal output by the audio output device by manually switching the terminal device to which the audio output device is connected. Figure 1As shown, the tablet computer 101 is currently playing a video, and the tablet computer 101 plays the audio content of the video through the earphone 100. At this time, if the user's mobile phone 102 calls, if the user wants to answer the call through the Bluetooth earphone, the connection between the earphone 100 and the tablet computer 101 has to be interrupted. If the earphone 100 is a Bluetooth earphone, the user needs to establish a Bluetooth connection between the Bluetooth earphone 100 and the mobile phone 102 to successfully answer the call. If the earphone 100 is a wired earphone, the user needs to manually unplug the earphone 100 from the tablet computer 101 and then plug it into the earphone jack of the mobile phone 102. It can be seen that the above operation process is relatively cumbersome and affects the user experience.
[0053] To this end, an embodiment of the present application provides an audio output method. The method can realize automatic switching of the audio signal output by the audio output device, so that when the terminal device uses the audio output device to output the first audio signal, the audio output device can be automatically switched to answer the call from the second terminal device. This reduces the user's operation complexity, improves the intelligence of the terminal device, and ultimately improves the user experience.
[0054] The various embodiments disclosed in the embodiments of the present application can be applied to terminal devices. In some embodiments, the terminal device can be a portable terminal including functions such as a personal digital assistant and / or a music player, such as a mobile phone, a tablet computer, a wearable device with wireless communication functions (such as a smart watch), a vehicle-mounted device, etc. Exemplary embodiments of portable terminals include but are not limited to a portable device equipped with a Or a portable terminal with other operating systems. The portable terminal may also be a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments, the terminal may also be a desktop computer with a touch-sensitive surface (e.g., a touch panel).
[0055] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.
[0056] The following uses a mobile phone as an example. Figure 2 A schematic structural diagram of a mobile phone 200 is shown.
[0057] The mobile phone 200 may include a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 251, a wireless communication module 252, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc. The sensor module 280 may include a gyroscope sensor 280A, an acceleration sensor 280B, a proximity light sensor 280G, a fingerprint sensor 280H, and a touch sensor 280K (of course, the mobile phone 200 may also include other sensors, such as a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, etc., which are not shown in the figure).
[0058] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the mobile phone 200. In other embodiments of the present application, the mobile phone 200 may include more or fewer components than those shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0059] The processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (Neural-network Processing Unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the mobile phone 200. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.
[0060] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0061] The processor 210 can run the audio output method provided in the embodiment of the present application to reduce the user's operation complexity, improve the intelligence of the terminal device, and enhance the user experience. The processor 210 can include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU can cooperate to execute the audio output method provided in the embodiment of the present application. For example, part of the algorithm in the audio output method is executed by the CPU, and another part of the algorithm is executed by the GPU to obtain faster processing efficiency.
[0062] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. The display screen 294 may be used to display information input by a user or information provided to a user, as well as various graphical user interfaces (GUIs). For example, the display screen 294 may display photos, videos, web pages, or files, etc. For another example, the display screen 294 may display the following: Figure 1 The graphical user interface shown in Figure 1. Figure 1The graphical user interface shown includes a status bar, a hidden navigation bar, time and weather widgets, and application icons, such as a browser icon. The status bar includes the operator name (such as China Mobile), mobile network (such as 4G), time, and remaining battery. The navigation bar includes a back key icon, a home key icon, and a forward key icon. In addition, it is understood that in some embodiments, the status bar may also include a Bluetooth icon, a Wi-Fi icon, an external device icon, etc. It is also understood that in other embodiments, Figure 1 The graphical user interface shown may also include a Dock bar, which may include commonly used application icons, etc. When the processor 210 detects a touch event of a user's finger (or a stylus, etc.) on an application icon, in response to the touch event, the user interface of the application corresponding to the application icon is opened and displayed on the display screen 294.
[0063] In the embodiment of the present application, the display screen 294 can be an integrated flexible display screen, or a spliced display screen consisting of two rigid screens and a flexible screen located between the two rigid screens. After the processor 210 runs the audio output method provided in the embodiment of the present application, the processor 210 can control the external audio output device to switch the output audio signal.
[0064] The camera 293 (a front camera or a rear camera, or one camera can be used as both a front camera and a rear camera) is used to capture still images or videos. Generally, the camera 293 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal.
[0065] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the mobile phone 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store codes of operating systems, applications (such as camera applications, WeChat applications, etc.), etc. The data storage area may store data created during the use of the mobile phone 200 (such as images, videos, etc. collected by the camera application), etc.
[0066] The internal memory 221 may also store one or more computer programs 1310 corresponding to the audio output algorithm provided in the embodiment of the present application. The one or more computer programs 1304 are stored in the above-mentioned memory 221 and are configured to be executed by the one or more processors 210. The one or more computer programs 1310 include instructions, and the above-mentioned instructions can be used to execute such as Fig. 7A , Figures 8 to 11 In the various steps of the corresponding embodiments, the computer program 1310 may include an account verification module 2211 and a priority comparison module 2212. The account verification module 2211 is used to authenticate the system authentication account of other terminal devices in the local area network; the priority comparison module 2212 can be used to compare the priority of the audio output request service and the priority of the current output service of the audio output device. The state synchronization module 2213 can be used to synchronize the device state of the audio output device currently connected to the terminal device to other terminal devices, or synchronize the device state of the audio output device currently connected to other devices to the local. When the code of the audio output algorithm stored in the internal memory 221 is run by the processor 210, the processor 210 can control the audio output device to switch the output audio signal.
[0067] In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0068] Of course, the code of the audio output algorithm provided in the embodiment of the present application can also be stored in an external memory. In this case, the processor 210 can run the code of the audio output algorithm stored in the external memory through the external memory interface 220, and the processor 210 can control the audio output device to switch the output audio signal.
[0069] The functions of the sensor module 280 are described below.
[0070] The gyroscope sensor 280A can be used to determine the motion posture of the mobile phone 200. In some embodiments, the angular velocity of the mobile phone 200 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 280A. That is, the gyroscope sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or stillness.
[0071] When the display screen in the embodiment of the present application is a foldable screen, the gyroscope sensor 280A can be used to detect the folding or unfolding operation acting on the display screen 294. The gyroscope sensor 280A can report the detected folding operation or unfolding operation as an event to the processor 210 to determine the folded state or unfolded state of the display screen 294.
[0072] The acceleration sensor 280B can detect the magnitude of the acceleration of the mobile phone 200 in all directions (generally three axes). That is, the gyroscope sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or stillness. When the display screen in the embodiment of the present application is a foldable screen, the acceleration sensor 280B can be used to detect the folding or unfolding operation acting on the display screen 294. The acceleration sensor 280B can report the detected folding operation or unfolding operation as an event to the processor 210 to determine the folding state or unfolding state of the display screen 294.
[0073] The proximity light sensor 280G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The mobile phone emits infrared light outward through the light emitting diode. The mobile phone uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone. When insufficient reflected light is detected, the mobile phone can determine that there is no object near the mobile phone. When the display screen in the embodiment of the present application is a foldable screen, the proximity light sensor 280G can be set on the first screen of the foldable display screen 294, and the proximity light sensor 280G can detect the size of the folding angle or unfolding angle between the first screen and the second screen based on the optical path difference of the infrared signal.
[0074] The gyroscope sensor 280A (or the acceleration sensor 280B) can send the detected motion state information (such as angular velocity) to the processor 210. The processor 210 determines whether the current state is handheld or tripod based on the motion state information (for example, when the angular velocity is not 0, it means that the mobile phone 200 is in the handheld state).
[0075] The fingerprint sensor 280H is used to collect fingerprints. The mobile phone 200 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0076] The touch sensor 280K is also called a "touch panel". The touch sensor 280K can be set on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, also called a "touch screen". The touch sensor 280K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 294. In other embodiments, the touch sensor 280K can also be set on the surface of the mobile phone 200, which is different from the position of the display screen 294.
[0077] Exemplarily, the display screen 294 of the mobile phone 200 displays a main interface, which includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor 280K, triggering the processor 210 to start the camera application and turn on the camera 293. The display screen 294 displays the interface of the camera application, such as a viewfinder interface.
[0078] The wireless communication function of the mobile phone 200 can be realized through the antenna 1, the antenna 2, the mobile communication module 251, the wireless communication module 252, the modem processor and the baseband processor.
[0079] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0080] The mobile communication module 251 can provide a solution for wireless communication including 2G / 3G / 4G / 5G applied to the mobile phone 200. The mobile communication module 251 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 251 can receive electromagnetic waves from the antenna 1, filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 251 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 251 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 251 can be set in the same device as at least some of the modules of the processor 210. In an embodiment of the present application, the mobile communication module 251 can also be used to interact with other terminal devices, that is, to send an audio output request to other terminal devices, or the mobile communication module 251 can be used to receive an audio output request and encapsulate the received audio output request into a message of a specified format.
[0081] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 270A, a receiver 270B, etc.), or displays an image or video through a display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 251 or other functional modules.
[0082] The wireless communication module 252 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 200. The wireless communication module 252 can be one or more devices integrating at least one communication processing module. The wireless communication module 252 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 210. The wireless communication module 252 can also receive the signal to be sent from the processor 210, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. In the embodiment of the present application, the wireless communication module 252 is used to establish a connection with the audio output device and output the voice signal through the audio output device. Or the wireless communication module 252 can be used to access the access point device, send a message corresponding to the audio output request to other terminal devices, or receive a message corresponding to the audio output request sent from other terminal devices. Optionally, the wireless communication module 252 can also be used to receive voice data from other terminal devices.
[0083] In addition, the mobile phone 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D, and the application processor. For example, music playback, recording, etc. The mobile phone 200 can receive the key 290 input and generate key signal input related to the user settings and function control of the mobile phone 200. The mobile phone 200 can use the motor 291 to generate a vibration prompt (such as an incoming call vibration prompt). The indicator 292 in the mobile phone 200 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 in the mobile phone 200 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 295, or pulled out from the SIM card interface 295, to achieve contact and separation with the mobile phone 200.
[0084] It should be understood that in actual applications, the mobile phone 200 may include Figure 2 The embodiments of the present application are not limited to the more or fewer components shown. The illustrated mobile phone 200 is only an example, and the mobile phone 200 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.
[0085] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to exemplify the software structure of the terminal device. Figure 3 It is a software structure block diagram of the terminal device according to an embodiment of the present invention.
[0086] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0087] The application layer can include a series of application packages.
[0088] like Figure 3 As shown, the application package may include applications such as phone, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
[0089] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0090] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0091] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0092] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0093] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0094] The phone manager is used to provide communication functions for terminal devices, such as the management of call status (including answering, hanging up, etc.).
[0095] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0096] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.
[0097] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0098] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0099] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0100] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0101] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0102] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0103] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0104] A 2D graphics engine is a drawing engine for 2D drawings.
[0105] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0106] Figure 4 A schematic diagram of an application scenario to which the embodiments of the present application are applicable is shown exemplarily.
[0107] like Figure 4 As shown, the application scenario includes: a server 400 , a terminal device 401 , a terminal device 402 , and a terminal device 403 .
[0108] Among them, the server 400 can exchange information with the terminal device 401, the terminal device 402 and the terminal device 403. For example, the terminal device 401, the terminal device 402 and the terminal device 403 obtain the system authentication account information from the server 400, so as to verify whether the devices log in to the same system authentication account between the terminal device 401, the terminal device 402 and the terminal device 403. In some scenarios, the server 400 can be connected to the terminal device 201, the terminal device 402 and the terminal device 403 through the network. The server 400 can also be a cloud server or a server cluster located on the network side.
[0109] Figure 4In the figure, terminal device 401, terminal device 402 and terminal device 403 can be various types of terminal devices, such as: mobile phones, laptop computers, tablet computers, smart TVs, smart watches, etc.
[0110] Figure 4 In the embodiment, a connection is established between terminal device 401, terminal device 402 and terminal device 403 by wired and / or wireless means, and a connection is established between terminal device 401, terminal device 402 and terminal device 403 and server 400 by wired and / or wireless means. For example, a connection can be established between terminal device 401 and terminal device 402 via a data line. For another example, terminal device 401 and terminal device 402 can be interconnected via a wireless communication network. The wireless communication network can be a local area network or a wide area network transferred by a relay device. When the communication network is a local area network, illustratively, the communication network can be a short-range communication network such as a wifi hotspot network, a wifi P2P network, a Bluetooth network, a zigbee network or a near field communication (NFC) network. When the communication network is a wide area network, illustratively, the communication network may be a third-generation wireless telephone technology (3G) network, a fourth-generation mobile communication technology (4G) network, a fifth-generation mobile communication technology (5G) network, a future-evolved public land mobile network (PLMN) or the Internet, etc. Figure 4 In the scenario shown, different terminal devices can send data through a communication network, such as sending pictures, texts, videos, or search results of terminal devices for objects such as pictures, texts, or videos.
[0111] It should be noted that the above system may include more terminal devices, or the above system may include less than three terminal devices, and the embodiments of the present application do not limit this.
[0112] In the embodiment of the present application, Figure 4 After the terminal device in the same access point device is connected, it is also necessary to authenticate the system authentication account of other terminal devices in advance. In this way, after the authentication is passed, the terminal device can receive messages sent by other terminal devices. Figure 4For example, the terminal device 401 (also called the first terminal device), the terminal device 402 (also called the second terminal device), and the terminal device 403 (also called the third terminal device) in the example are described as follows for the convenience of unified description. The first terminal device, the second terminal device, and the third terminal device can all be connected to the same access point (AP). For example, the first terminal device, the second terminal device, and the third terminal device are all connected to the same router, or the first terminal device, the second terminal device, and the third terminal device are all connected to the same WiFi hotspot. If in the method, the device accessing the access point also includes a fourth terminal device, the first terminal device, the second terminal device, the third terminal device, and the fourth terminal device can complete the networking, that is, they are in the same network.
[0113] After the network connection is established between the terminal devices, the first terminal device can first authenticate other devices connected to the same access point, that is, confirm whether the system authentication account of the other devices is the same as that of the first terminal device. The first terminal device determines the target device set with the same system authentication account, and then the first terminal device completes the authentication with the terminal devices in the target device set. Specifically, Figure 5 As shown, the authentication method includes the following steps.
[0114] Step 501: The first terminal device sends a broadcast message through the wireless communication module 252. The broadcast message includes a ciphertext, which is obtained by the first terminal device encrypting the system authentication account of the first terminal device using the public key corresponding to the system authentication account of the first terminal device.
[0115] The first terminal device may obtain the public key corresponding to the system authentication account of the first terminal device from the server in advance. For example, the account of the first terminal device may be a Huawei account, and the first terminal device may first obtain the public key corresponding to the Huawei account from the Huawei cloud server, and then use the public key to encrypt the Huawei account, and then generate a broadcast message.
[0116] Step 502, after the second terminal device, the third terminal device and the fourth terminal device receive the broadcast message through the wireless communication module 252, the processor 210 of the second terminal device, the third terminal device and the fourth terminal device reads the private key corresponding to the system authentication account of its own device from the trusted storage area of the memory 221, and then the processor 210 in the second terminal device, the third terminal device and the fourth terminal device uses the private key to decrypt the broadcast message.
[0117] Among them, the second terminal device, the third terminal device, and the fourth terminal device can obtain the private key corresponding to the system authentication account of their own terminal device from the server in advance. Exemplarily, if the accounts of the second terminal device, the third terminal device, and the fourth terminal device are all Huawei accounts, the second terminal device, the third terminal device, and the fourth terminal device can obtain the private key corresponding to the Huawei account of their own device from the Huawei cloud server in advance, and store the private key in the trusted storage area.
[0118] Step 503: If the second terminal device decrypts successfully, the second terminal device sends an affirmative feedback message to the first terminal device through the wireless communication module 252, and the affirmative feedback message indicates that the second terminal device decrypts the ciphertext successfully.
[0119] Step 504: If the third terminal device decrypts successfully, the third terminal device sends an affirmative feedback message to the first terminal device through the wireless communication module 252, and the affirmative feedback message indicates that the third terminal device decrypts the ciphertext successfully.
[0120] Step 505: If the fourth terminal device fails to decrypt, the fourth terminal device sends a negative feedback message to the first terminal device through the wireless communication module 252, and the negative feedback message indicates that the fourth terminal device fails to decrypt the ciphertext.
[0121] In step 506, the processor 210 of the first terminal device can execute the method defined by the account verification module 2211. The processor 210 determines that the system authentication account of the second terminal device and the third terminal device is consistent with itself based on the affirmative feedback messages from the second terminal device and the third terminal device. Therefore, a network connection is established among the first terminal device, the second terminal device and the third terminal device to complete the networking.
[0122] In a possible embodiment, when the first terminal device sends a broadcast message, it can start a timer. When the timer expires, the first terminal device determines the positive feedback message received within the time period (for example, 3 seconds). Assuming that the first terminal device receives positive feedback messages from the second terminal device and the third terminal device within the time period, the first terminal device, the second terminal device and the third terminal device complete the networking.
[0123] It can be seen that other terminal devices use the private key corresponding to their own accounts to decrypt the broadcast messages. If the decryption is successful, it means that the device itself and the terminal device that sends the broadcast message are logged in to the same system authentication account. This method can ensure the security of data access between devices and prevent data from being illegally accessed.
[0124] In a possible embodiment of the present application, after the first terminal device completes the authentication of the second terminal device and the third terminal device, the first terminal device connected to the audio output device can select all or part of the terminal devices from the second terminal device and the third terminal device for device status synchronization. For example, the first terminal device synchronizes the device status to the second terminal device and the third terminal device. Figure 5 The method shown may also include the following steps.
[0125] Step 507, the processor 210 of the first terminal device can execute the method defined by the device synchronization module 2213, the processor 210 detects that an audio output device is connected, the first terminal device determines the type of the audio output device, and the application type corresponding to the voice service being output by the audio output device, and generates a device status related to the audio output device, which may include that an audio output device is connected to the first terminal device, the type of the audio output device (wired or wireless), and the application type corresponding to the voice service currently output by the audio output device.
[0126] For example, assuming that the first terminal device is a tablet device, a Bluetooth headset is currently connected to the tablet device, and the tablet device currently outputs an audio signal of a video service from a video type application through the Bluetooth headset. Then the device status related to the Bluetooth headset includes: the tablet device has a headset connected, and the headset is a wireless headset, and the application type corresponding to the voice service currently output by the wireless headset is a video type application.
[0127] Step 508 : The first terminal device sends the device status to the second terminal device and the third terminal device via the wireless communication module 252 .
[0128] Continuing with the above example, assuming that the second terminal device is a laptop computer and the third terminal device is a mobile phone, the tablet device can encapsulate the device status into signaling, and then send a multicast message including the signaling to the laptop computer and the mobile phone via WiFi. After receiving the multicast message, the laptop computer and the mobile phone can parse the multicast message to obtain the device status.
[0129] Step 509 : After receiving the device status via the wireless communication module 252 , the second terminal device and the third terminal device save the device status.
[0130] For example, it is assumed that the tablet device 101 is currently connected to a Bluetooth headset, and the tablet device 101 plays the voice content in the video application through the Bluetooth headset, such as Figure 1 After the tablet device 101 authenticates the devices in the local area network according to the above method, it is determined that the terminal devices with the same system authentication account also include the mobile phone 102, the PC (laptop) and the smart TV. The tablet device 101 can display a pop-up box 610, such as Figure 6 As shown in (a) of FIG. 6 , the pop-up box 610 displays prompt information, which is used to prompt the user to select a device that needs to be synchronized. Figure 6 As shown in (b), the tablet device 101 receives the selection operation 621 of the user on the icon of the mobile phone 102, and receives the operation of the user on the confirmation control 622, then the tablet device 101 selects to send the device status to the mobile phone 102. Therefore, the mobile phone 102 can obtain the status of the current audio output device from the tablet device 101: the audio output device is connected to the tablet device 101, the audio output device is a Bluetooth headset, and the audio output device is currently outputting the voice content part of the video service of the video application.
[0131] Considering that audio output devices are divided into wired audio output devices and wireless audio output devices, the audio output method provided in the embodiment of the present application is illustrated in two scenarios below.
[0132] Scenario 1: The audio output device is a wired audio output device
[0133] like Fig. 7A As shown, an embodiment of the present application provides an audio output method, which can be implemented in at least two terminal devices of a user, and the at least two terminal devices of the user use the same system authentication account to access the network. Exemplarily, a first terminal device and a second terminal device of the user are taken as an example, wherein the first terminal device is currently connected to the wired audio output device. Specifically, the method includes the following steps.
[0134] Step 701: The mobile communication module 251 of the second terminal device receives an audio output request.
[0135] In a possible implementation, the second terminal device encapsulates the audio output request into a signaling in a set format.
[0136] The audio output request may be a video service play request of a video type application, a music play request of a music type application, a radio play request of a radio type application, or a call request. The call request may be a voice call request received by the second terminal device, or a voice call request or video call request received by the second terminal device through a third-party application (such as WeChat, Facebook).
[0137] For example, Figure 7B As shown, assuming that the second terminal device is a mobile phone 102, the audio output request may be a call request received by the mobile phone 102, for example, Figure 7B The mobile phone 102 in the middle shows an incoming call request from George.
[0138] Step 702 , the mobile communication module 251 of the second terminal device sends the encapsulated signaling to the wireless communication module 252 .
[0139] Optionally, after the above step 702, or while executing the above step 702, step 703 may also be executed: the mobile communication module 251 of the second terminal device sends the encapsulated signaling to the priority comparison module 2212, and the priority comparison module 2212 of the second terminal device obtains the device state of the wireless audio output device of the first terminal device from the state synchronization module 2213, and determines that the priority of the voice service corresponding to the message is higher than the priority of the voice service in the stored device state. For example, Figure 7B As shown, assuming that the second terminal device is the tablet device 101, the device status stored in the status synchronization module 2213 is: the audio output device is a wired headset, and the tablet device 101 is currently outputting the audio signal of the video service through the wired headset. Therefore, the priority comparison module 2212 determines that the voice service corresponding to the call request has a higher priority than the video service.
[0140] It should be noted that in step 703, the device status stored in the status synchronization module 2213 may not include voice services, which may also mean that the wired audio output device is connected to the first terminal device, but the wired audio output device does not output an audio signal. Figure 7B In the example, a wired headset is plugged into the tablet device 101, but when the tablet device 101 pauses playing the video, the device state does not include the voice service. At this time, the priority comparison module 2212 of the second terminal device can still determine the priority of the voice service corresponding to the message.
[0141] Step 704: The wireless communication module 252 of the second terminal device sends a signal corresponding to the audio output request to the first terminal device.
[0142] For example, assuming Figure 7B In the example, the tablet device 101 and the mobile phone 102 are connected to the same wifi hotspot, and the mobile phone 102 can send a signal corresponding to the call request to the tablet device through the WLAN network.
[0143] Step 705: The processor 210 of the first terminal device converts the signaling into a second audio signal.
[0144] For example, in combination Figure 7B For example, the tablet device 101 may convert the signaling into voice content similar to "George is calling, do you want to answer it?"
[0145] In a possible implementation, the above step 705 may also be that the processor 210 of the first terminal device converts the message into a second audio signal, mixes the second audio signal into a third audio signal currently being output, and the third audio signal is an audio signal from the first terminal device, combined with Figure 7B For example, the third audio signal may be the voice content of the video service of the video type application currently being output by the tablet device 101. The tablet device 101 mixes the voice content with the second audio signal. For example, the tablet device 101 converts the message into a second audio signal, such as "George is calling, do you want to answer the call?", and then mixes the second audio signal into the audio signal of the video service currently being output.
[0146] Step 706: The first terminal device outputs the second audio signal through a wired audio device.
[0147] For example, combined with Figure 7B For example, the tablet device 101 pauses playing the voice content of the video type application and plays the second audio signal, such as "George is calling, do you want to answer it?"
[0148] In a possible implementation, the above step 705 may also be that the first terminal device outputs a mixed signal including the second audio signal and the third audio signal through a wired audio device. Figure 7B For example, the tablet device 101 controls the left channel of the wired headset to play the voice content of "George is calling, do you want to answer it" at a high volume, and the right channel plays the audio signal of the video service at a low volume at the same time.
[0149] It should be noted that the above steps 705 and 706 may be optional steps. In one possible case, if the first terminal device is a device such as a smart TV, and the user cannot respond to the audio output request (for example, answering a call or hanging up a call) by performing a touch operation on the first terminal device, the first terminal device may perform the above steps 705 and 706 so that the user can confirm answering a call or hanging up a call by operating the audio output device, for example, the user can answer a call or hang up a call by operating a button on a headset, or the user can answer a call or hang up a call by issuing a voice command to the headset.
[0150] In another possible case, if the first terminal device is a tablet computer, a laptop computer, etc., the user can answer or hang up the call by operating the first terminal device, and then steps 705 and 706 may not be performed. The above steps 705 and 706 can be replaced by the first terminal device displaying a prompt message, which is used to prompt the user that there is an audio output request from the second terminal device. For example, when the audio output request is a call request from the mobile phone 102, the tablet device 101 can display an interface, which includes a prompt message, prompting the user's mobile phone to have an incoming call and whether to answer it.
[0151] Step 707: The user issues an operation instruction to trigger the first terminal device to generate an audio output request response.
[0152] In a possible example, a user may trigger a first terminal device to which the wired audio output device is connected to generate an audio output request response (eg, answering a call or hanging up a call) by operating a physical button on a wired audio device (eg, a wired headset).
[0153] Another possible example is that the user can generate an audio output request response by operating the first terminal device. For example, the tablet device can display a prompt box, which prompts the user that the mobile phone 102 has an incoming call, and the tablet device 101 can receive the user's touch operation on the tablet device 101, thereby generating an audio output request response (such as answering a call or hanging up a call).
[0154] Another possible example is that the user can send a voice command to the first terminal device through a wired audio device to trigger the first terminal device to generate an audio output request response. For example, the user can send a voice command such as "answer the call" to trigger the tablet device 101 to generate an audio output request response for answering the call; or the user can send a voice command such as "hang up" to trigger the tablet device 101 to generate an audio output request response for hanging up the call.
[0155] Step 708: The first terminal device sends an audio output request response to the second terminal device.
[0156] Combination Figure 7B For example, the tablet device 101 sends a call request response to the mobile phone 102. The call request response can be an affirmative response, such as answering the incoming call, or a negative response, such as rejecting the incoming call.
[0157] Step 709: When the audio output request response is a positive response, the second terminal device obtains audio data corresponding to the audio output request.
[0158] For example, when the positive response is confirmation of connecting the incoming call, the second terminal device connects the call, and the mobile communication module 251 of the second terminal device receives the call data from the network device, thereby acquiring the call data. Figure 7B The mobile phone 102 in the embodiment answers the call and receives the call data from the network device.
[0159] Step 710 : The second terminal device sends audio data to the first terminal device via the wireless communication module 252 .
[0160] For example, Figure 7B The mobile phone 102 sends call data to the tablet device 101.
[0161] Step 711: The first terminal device outputs audio data to a wired audio output device.
[0162] Step 712: The wired audio output device outputs a first audio signal corresponding to the audio data.
[0163] In a possible implementation, if the first terminal device does not currently output an audio signal through an audio output device, the first audio signal corresponding to the audio data may be directly output through a wired audio device.
[0164] In a possible implementation, if the first terminal device controls the audio output device to output the third audio signal before receiving the audio data, the wired audio device is controlled to stop outputting the third audio signal, and then the first audio signal corresponding to the audio data is output through the wired audio device. Figure 7B In the embodiment, before receiving the call data from the mobile phone 102, the tablet device 101 outputs the voice content of the video service through the wired headset. After receiving the call data, the tablet device 101 controls the wired headset to stop outputting the voice content of the video service, and controls the wired headset to start outputting the voice content corresponding to the call data.
[0165] It should be noted that in the above method, in a possible implementation, after the second terminal device receives the audio output request, the mobile communication module 251 of the second terminal device sends the encapsulated signaling to the wireless communication module 252, and the second terminal device can directly send the encapsulated signaling corresponding to the call request to the first terminal device through the wireless communication module 252. The first terminal device can determine that the priority of the voice service corresponding to the audio output request is higher than the priority of the voice service in the device state through the priority comparison module 2212 in the first terminal device, and then the first terminal device continues to execute subsequent steps 705 to 711.
[0166] In addition, it should be noted that in the embodiments of the present application, the system can pre-define the order of priority of various types of voice services from high to low, or the user can customize the order of priority of various types of voice services from high to low (for example, the order is: voice calls initiated by telephone applications (system applications), voice calls or video calls initiated by third-party applications, audio signals output by video applications, and audio signals output by music applications). Based on this priority order, the priority module in the first terminal device or the second terminal device can compare the priorities of voice services corresponding to different devices according to the priority order. If it is determined that the priority of the voice service of the second terminal device is higher than the priority of the voice service stored in the status synchronization module 2213, the above-mentioned audio signal switching process is executed; otherwise, the voice signal output by the audio output device is not switched. For example, the tablet device 101 can output the voice service of the video call of the WeChat application through the wired headset. At this time, if the phone application of the mobile phone 102 shows that there is an incoming call, because the mobile phone 102 determines that the priority of the voice service of the mobile phone 102 is higher than the priority of the voice service of the video call stored in the status synchronization module 2213, the tablet device 101 controls the wired headset to output the call data from the mobile phone 102. In the embodiment of the present application, the type of the audio signal output by the audio output device before and after the switching in the audio output method is not limited. The specific type of the audio signal can be based on the specific application scenario, which will not be repeated here.
[0167] It can be seen that in the embodiment of the present application, the user does not need to pick up the second terminal device, nor does he need to unplug the wired audio output device to switch the output of audio signals from different devices on the wired audio output device. For example, when the mobile phone is not with the user, according to the above method, the user can still switch the output of call data on the wired audio output device, which is less likely to miss a call and provide a better user experience.
[0168] Scenario 2: The audio output device is a wireless audio output device
[0169] like Figure 8 As shown, an embodiment of the present application provides an audio output method, which can be implemented in at least two terminal devices of a user, and the at least two terminal devices of the user use the same system authentication account to access the network. For example, take the first terminal device and the second terminal device of the user as an example, where the first terminal device is currently connected to the wireless audio output device. Specifically, the method includes the following steps.
[0170] Figure 8 Steps 801 to 809 are the same as steps 701 to 709 described above and will not be repeated here.
[0171] Step 810: When the audio output request response is a positive response, the first terminal device disconnects the first communication link between the wireless audio output device and the first terminal device.
[0172] For example, Figure 1 In the embodiment, after receiving the operation instruction from the user, when the tablet device 101 determines that the audio output request response is to connect the incoming call, the tablet device 101 disconnects the Bluetooth communication link between the tablet device 101 and the Bluetooth headset.
[0173] Step 811: When the audio output request response is a positive response, a second communication link is established between the second terminal device and the audio output device, and the second terminal device outputs the audio data to the audio output device.
[0174] For example, Figure 1 In the embodiment, after receiving the user's operation instruction, the mobile phone 102 determines that the audio output request response is to connect the incoming call, and then establishes a Bluetooth communication link with the Bluetooth headset. For example, the mobile phone 102 quickly establishes a Bluetooth communication link with the Bluetooth headset through the Google Fast Pair Service (GFPS).
[0175] Step 812: The wireless audio output device outputs a first audio signal corresponding to the audio data.
[0176] For example, Figure 1 After receiving the call data, the mobile phone 102 controls the Bluetooth headset to start outputting the voice content corresponding to the call data.
[0177] It should be noted that in this scenario 2, in one possible implementation, after the second terminal device receives the audio output request, the mobile communication module 251 of the second terminal device sends the encapsulated signaling to the wireless communication module 252, and the second terminal device can directly send the encapsulated message corresponding to the audio output request to the first terminal device through the wireless communication module 252. The first terminal device can determine that the priority of the voice service corresponding to the call request is higher than the priority of the voice service in the device status through the priority comparison module 2212 in the first terminal device, and then the first terminal device continues to execute subsequent steps 805 to 813.
[0178] In addition, it should be noted that in the embodiments of the present application, the system can pre-define the order of priority of various types of voice services from high to low, or the user can customize the order of priority of various types of voice services from high to low (for example, the order is: voice calls initiated by telephone applications (system applications), voice calls or video calls initiated by third-party applications, audio signals output by video applications, and audio signals output by music applications). Based on this priority order, the priority module in the first terminal device or the second terminal device can compare the priorities of voice services corresponding to different devices according to the priority order. If it is determined that the priority of the voice service of the second terminal device is higher than the priority of the voice service stored in the status synchronization module 2213, the above-mentioned audio signal switching process is executed; otherwise, the voice signal output by the audio output device is not switched. For example, the tablet device 101 can output the voice service of the video call of the WeChat application through the Bluetooth headset. At this time, if the phone application of the mobile phone 102 shows that there is an incoming call, because the mobile phone 102 determines that the priority of the voice service of the mobile phone 102 is higher than the priority of the voice service of the video call stored in the status synchronization module 2213, the tablet device 101 is disconnected from the Bluetooth headset, and the Bluetooth headset is connected to the mobile phone 102 and outputs the call data from the mobile phone 102. In the embodiment of the present application, the type of audio signal output by the audio output device before and after the switching in the audio output method is not limited. The specific type of the audio signal can be based on the specific application scenario, which will not be repeated here.
[0179] It can be seen that in the embodiment of the present application, the user does not need to operate the second terminal device, nor does he need to manually disconnect and reconnect the wireless audio output device, and can switch the output of audio signals from different devices on the wireless audio output device. For example, when the mobile phone is not with the user, the above method can be used to switch the output of call data on the wireless audio output device, which is less likely to miss calls and provides a better user experience.
[0180] Based on the above scenario 1, the embodiment of the present application further provides an audio output method, which can be executed by the first terminal device. Fig. 9 The method specifically comprises the following steps.
[0181] Step 901: A first terminal device receives an audio output request from a second terminal device.
[0182] The second terminal device and the first terminal device use the same system authentication account to access the network, and the first terminal device is currently connected to a wired audio output device. The possible contents of the audio output request can be found in step 701, which will not be repeated here.
[0183] Step 902: The first terminal device receives a user operation.
[0184] It should be noted that, optionally, in one possible implementation, before the first terminal device receives the user's operation, the first terminal device may display a prompt message, which is used to prompt the user that there is an audio output request from the second terminal device. For a specific example, see step 706. For another possible implementation, before the first terminal device receives the user's operation, the first terminal device may convert the audio output request into a second audio signal, and output the second audio signal through the wired audio output device while the wired audio output device outputs the third audio signal of the first terminal device. For a specific example, see step 705, which will not be repeated here.
[0185] Step 903: In response to the operation, the first terminal device sends an audio output request response to the second terminal device.
[0186] The audio output request response is used to trigger the second terminal device to obtain the audio data corresponding to the audio output request. For details, please refer to the above steps 707 and 708, which will not be repeated here.
[0187] Step 904: The first terminal device receives audio data from the second terminal device.
[0188] That is, when the audio output request response is a positive response, the second terminal device obtains the audio data corresponding to the audio output request, and then sends the audio data to the first terminal device. For example, when the positive response is confirmation of connecting the incoming call, the second terminal device connects the call, and the mobile communication module 251 of the second terminal device receives the call data from the network device, thereby obtaining the call data. For another example, when the positive response is confirmation of playing music, the second terminal device obtains the audio data corresponding to the music file.
[0189] Step 905: The first terminal device outputs the audio data to the wired audio output device, so that the wired audio output device outputs a first audio signal corresponding to the audio data.
[0190] That is to say, the first terminal device outputs the audio signal from other terminal devices through the wired audio output device. In the process of switching the audio signal on the wired audio output device, the user does not need to pick up the second terminal device or unplug the wired audio output device, and can switch the output of audio signals from different devices on the wired audio output device. For example, when the mobile phone is not with the user, according to the above method, the user can still switch the output of call data on the wired audio output device, which is less likely to miss a call and provides a better user experience.
[0191] Based on the above scenario 2, the embodiment of the present application further provides an audio output method, which can be executed by the first terminal device, see Fig.10 The method specifically comprises the following steps.
[0192] Step 1001: A first terminal device receives an audio output request from a second terminal device.
[0193] The second terminal device and the first terminal device use the same system authentication account to access the network, and the first terminal device is currently connected to a wireless audio output device. The possible contents of the audio output request can be found in step 701, which will not be repeated here.
[0194] Step 1002: The first terminal device receives an operation from a user.
[0195] It should be noted that, optionally, in one possible implementation, before the first terminal device receives the user's operation, the first terminal device may display a prompt message, which is used to prompt the user that there is an audio output request from the second terminal device. For a specific example, see step 706. For another possible implementation, before the first terminal device receives the user's operation, the first terminal device may convert the audio output request into a second audio signal, and output the second audio signal through the wireless audio output device while the wireless audio output device outputs the third audio signal of the first terminal device. For a specific example, see step 705, which will not be repeated here.
[0196] Step 1003: In response to the operation, the first terminal device sends an audio output request response to the second terminal device.
[0197] The audio output request response is used to trigger the second terminal device to obtain the audio data corresponding to the audio output request. For details, please refer to the above steps 707 and 708, which will not be repeated here.
[0198] Step 1004: The first terminal device disconnects the first communication link with the wireless audio output device, so that the wireless audio output device establishes a second communication link with the second terminal device, where the second communication link is used to transmit a first audio signal corresponding to the audio data.
[0199] That is, when the audio output request response is a positive response, the first terminal device disconnects the first communication link between the wireless audio output device and the first terminal device. In this way, the second terminal device can establish a second communication link with the wireless audio output device, so that the second terminal device outputs an audio signal corresponding to the audio data through the wireless audio device. For specific examples, see step 811 and step 812, which will not be repeated here.
[0200] It can be seen that in the embodiment of the present application, the user does not need to operate the second terminal device, nor does he need to manually disconnect and reconnect the wireless audio output device, and can switch the output of audio signals from different devices on the wireless audio output device. For example, when the mobile phone is not with the user, the above method can be used to switch the output of call data on the wireless audio output device, which is less likely to miss calls and provides a better user experience.
[0201] Based on the above scenario 2, the embodiment of the present application further provides an audio output method, which can be executed by the second terminal device. Fig.11 The method specifically comprises the following steps.
[0202] Step 1101: The second terminal device receives an audio output request.
[0203] Among them, the possible content of the audio output request can be found in step 701, which will not be repeated here.
[0204] Step 1102: The second terminal device sends an audio output request to the first terminal device.
[0205] The second terminal device and the first terminal device use the same system authentication account to access the network, and the first terminal device is currently connected to a wireless audio output device.
[0206] Step 1103: The second terminal device receives an audio output request response from the first terminal device.
[0207] The audio output request response is used to trigger the second terminal device to obtain the audio data corresponding to the audio output request. For details, please refer to the above steps 707 and 708, which will not be repeated here.
[0208] Step 1104: The second terminal device obtains audio data.
[0209] For example, when the positive response is confirmation of connecting the incoming call, the second terminal device connects the call, and the mobile communication module 251 of the second terminal device receives the call data from the network device, thereby acquiring the call data. Figure 7B The mobile phone 102 in the embodiment connects the call, and the mobile phone 102 receives the call data from the network device. For another example, when the affirmative response is to confirm to play the music, the second terminal device obtains the audio data corresponding to the music file.
[0210] Step 1105: The second terminal device establishes a first communication link with the audio output device.
[0211] For details, please refer to step 811, which will not be repeated here.
[0212] Step 1106: The second terminal device outputs the audio data to the wired audio output device, so that the wired audio output device outputs a first audio signal corresponding to the audio data.
[0213] For example, Figure 1 After the mobile phone 102 receives the call data, the mobile phone 102 starts to output the voice content corresponding to the call data through the Bluetooth headset.
[0214] It can be seen that in the embodiment of the present application, the user does not need to operate the second terminal device, nor does he need to manually disconnect and reconnect the wireless audio output device, and can switch the output of audio signals from different devices on the wireless audio output device. For example, when the mobile phone is not with the user, the above method can be used to switch the output of call data on the wireless audio output device, which is less likely to miss calls and provides a better user experience.
[0215] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a terminal device, the terminal device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.
[0216] The embodiments of the present application also provide a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the method in the above-mentioned embodiments.
[0217] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory so that the chip executes the methods in the above-mentioned method embodiments.
[0218] Among them, the terminal device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0219] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0220] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be discarded or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0221] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0222] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0223] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0224] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An audio output system, comprising a first terminal device, a second terminal device and an audio output device, wherein: The second terminal device and the first terminal device use the same system authentication account to access the network, a first music application and a first video call application are installed on the first terminal device, and a second music application, a second video call application and a telephone application are installed on the second terminal device, characterized in that: When the first terminal device is connected to the audio output device and the audio output device does not output an audio signal corresponding to the audio data from the first terminal device, in response to a music playback request of the second music application, the second terminal device is configured to interact with the first terminal device so that the audio output device outputs an audio signal corresponding to the audio data of the second music application; When the audio output device outputs an audio signal corresponding to the audio data of the first music application, the second terminal device receives the first video call from the second video call application, In response to the second user operation, the second terminal device is configured to connect the first video call through the second video call application, and interact with the first terminal device, so that the audio output device outputs an audio signal corresponding to the audio data of the first video call; When the first terminal device makes a video call through the first video call application and the audio output device outputs an audio signal corresponding to the audio data of the first video call application, the second terminal device receives a first incoming call from the phone application, In response to a third user operation, the second terminal device is configured to answer the first incoming call through the phone application, and interact with the first terminal device to enable the audio output device to output an audio signal corresponding to the audio data of the first incoming call; When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving a second incoming call of the phone application, the first terminal device is configured to display a first prompt, the first prompt being associated with the second incoming call; In response to a first touch operation received by the first terminal device, the first terminal device is configured to send an instruction to answer the second incoming call to the second terminal device; In response to receiving an instruction to answer the second incoming call, the second terminal device is configured to answer the second incoming call through the phone application and send audio data of the second incoming call to the first terminal device; The first terminal device is configured to enable the audio output device to output an audio signal corresponding to the audio data of the second incoming call.
2. The system according to claim 1, characterized in that When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving the second incoming call of the phone application, the second terminal device is configured to display a second prompt associated with the second incoming call; In response to a fifth user operation received by the second terminal device, the second terminal device is configured to: answering the second incoming call through the phone application; establishing a communication link with the audio output device; An audio signal corresponding to the audio data of the second incoming call is output to the audio output device through the communication link.
3. The system according to claim 1 or 2, characterized in that: When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving the second incoming call of the telephone application, the audio output device is configured to output a first voice prompt, and the first voice prompt is associated with the second incoming call.
4. The system according to claim 3, characterized in that In response to a first voice command from a user or a user operation on the audio output device, the second terminal device is configured to answer the second incoming call through the phone application and send audio data of the second incoming call to the first terminal device.
5. The system according to claim 3, characterized in that The first terminal device is configured to cause the audio output device to output the first voice prompt.
6. The system according to claim 5, characterized in that In response to receiving the second incoming call, the second terminal device is configured to send signaling corresponding to the second incoming call to the first terminal device; The first terminal device is configured to convert the signaling into the first voice prompt.
7. The system according to claim 3, characterized in that The content of the first voice prompt includes: the user identification of the second incoming call.
8. The system according to claim 3, characterized in that The user operation on the audio output device includes: physical contact between the user and the audio output device.
9. The system according to claim 3, characterized in that When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving an incoming call from the phone application, the first terminal device is configured to pause playing the audio data of the first music application.
10. The system according to claim 3, characterized in that When the audio output device outputs an audio signal corresponding to the audio data of the first music application, after the second terminal device receives the second incoming call from the telephone application, the first terminal device is configured to continue playing the audio data of the first music application, and the audio output device is configured to simultaneously output an audio signal corresponding to the audio data of the first music application and the first voice prompt.
11. The system according to any one of claims 4 to 10, characterized in that: The first voice command includes: "Answer".
12. The system according to claim 3, characterized in that In response to a second voice command from the user, the second terminal device is configured to hang up the second incoming call.
13. The system according to claim 12, characterized in that The second voice command includes: "hang up".
14. The system according to claim 1, characterized in that When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving the second incoming call from the phone application, the first terminal device is configured to display the first prompt corresponding to the second incoming call, and, in response to the second touch operation received by the first terminal device, the first terminal device is configured to send an indication to reject the second incoming call to the second terminal device, and in response to receiving the indication to reject the second incoming call, the second terminal device is configured to reject the second incoming call.
15. The system according to claim 2, characterized in that In response to a ninth user operation received by the second terminal device, the second terminal device is configured to hang up the second incoming call.
16. The system according to claim 1, characterized in that When the first terminal device makes a video call through the first video call application, and the audio output device outputs an audio signal corresponding to the audio data of the first video call application, the second terminal device receives a tenth user operation that triggers the second terminal device to play the audio data of the second music application; After the second terminal device receives the tenth user operation, the audio output device is configured to continue to output the audio signal corresponding to the audio data of the first video call application.
17. The system according to claim 1, characterized in that When the second terminal device makes a call through the telephone application and the audio output device outputs an audio signal corresponding to the audio data of the telephone application, the first terminal device receives a second video call of the first video call application; When the first terminal receives an eleventh user operation for the second video call, the first terminal device is configured to connect the second video call through the first video call application, and the audio output device is configured to continue to output the audio signal corresponding to the audio data of the telephone application.
18. The system according to claim 1, characterized in that When the audio output device outputs an audio signal corresponding to the audio data of the first music application, in response to the second terminal device receiving a third video call of the second video call application, the second terminal device is configured to display a third prompt, the third prompt being associated with the third video call; In response to the twelfth user operation received by the second terminal device, the second terminal device is configured to connect the third video call through the second video call application, and interact with the first terminal device to enable the audio output device to output an audio signal corresponding to the audio data of the third video call; The audio output device is configured to output audio data of the third video call.
19. The system according to any one of claims 12 to 18, characterized in that: The first terminal device is a tablet computer, the second terminal device is a mobile phone, and the audio output device is a wireless headset or a wired headset.
20. The system according to claim 19, characterized in that in, The priority of the telephone application is higher than that of the first video call application, the priority of the first video call application is higher than that of the second music application, and the priority of the second video call application is higher than that of the first music application.
21. An electronic device, characterized in that: include: A touch screen, wherein the touch screen comprises a touch panel and a display screen; one or more processors; Memory; Multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to perform the steps performed by the first terminal device in the system as described in any one of claims 1-20.
22. An electronic device, characterized in that: include: A touch screen, wherein the touch screen comprises a touch panel and a display screen; one or more processors; Memory; Multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to perform the steps performed by the second terminal device in the system as described in any one of claims 1-20.
23. An audio output device, characterized in that: The audio output device comprises: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, The one or more computer programs include instructions, which, when executed by the audio output device, cause the audio output device to perform the steps performed by the audio output device in the system according to any one of claims 1 to 20.